00000100:00100000:0.0:1651529338.662927:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151311 00010000:00010000:0.0:1651529338.662934:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc5ae lrc: 2/0,0 mode: PW/PW res: [0x2b01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662937:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944b24dc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.662939:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc5ae lrc: 2/0,0 mode: PW/PW res: [0x2b01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662941:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc5ae lrc: 3/0,0 mode: PW/PW res: [0x2b01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662946:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc5ae lrc: 1/0,0 mode: --/PW res: [0x2b01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662949:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc5ae lrc: 0/0,0 mode: --/PW res: [0x2b01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662954:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc5a7 lrc: 2/0,0 mode: PW/PW res: [0x2b01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662957:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c6323f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.662957:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc5a7 lrc: 2/0,0 mode: PW/PW res: [0x2b01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662960:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc5a7 lrc: 3/0,0 mode: PW/PW res: [0x2b01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662964:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc5a7 lrc: 1/0,0 mode: --/PW res: [0x2b01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662969:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc5a7 lrc: 0/0,0 mode: --/PW res: [0x2b01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662975:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 3/0,1 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662978:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 3/0,1 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662981:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 3/0,1 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.662984:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 2/0,0 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663021:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+863:39029:x1731745946302208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1467us (1600us total) trans 30064892227 rc 0/0 00000100:00100000:0.0:1651529338.663024:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151313 00010000:00010000:0.0:1651529338.663031:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 2/0,0 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663034:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039c01342 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.663035:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 2/0,0 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663038:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 3/0,0 mode: PW/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663043:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 1/0,0 mode: --/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663046:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bc5bc lrc: 0/0,0 mode: --/PW res: [0x2b01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663052:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 3/0,1 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663055:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 3/0,1 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663058:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 3/0,1 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663061:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 2/0,0 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663115:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946302016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1689us (1737us total) trans 30064892228 rc 0/0 00000100:00100000:0.0:1651529338.663118:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151309 00010000:00010000:0.0:1651529338.663138:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 2/0,0 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663141:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001988a229 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.663142:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 2/0,0 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663145:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 3/0,0 mode: PW/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663150:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 1/0,0 mode: --/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663153:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc5a0 lrc: 0/0,0 mode: --/PW res: [0x2b019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663163:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966561664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.663166:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bc5ca lrc: 3/0,1 mode: --/PW res: [0x2b01f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663173:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626176 00010000:00010000:0.0:1651529338.663178:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3b5801 lrc: 4/0,0 mode: PR/PR res: [0x2b01f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad7a9 expref: 2356 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663183:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626112 00010000:00010000:0.0:1651529338.663185:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3b5243 lrc: 4/0,0 mode: PR/PR res: [0x2b01e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0b1 expref: 2357 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663190:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626240 00010000:00010000:0.0:1651529338.663210:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3b4ab0 lrc: 4/0,0 mode: PR/PR res: [0x2b020:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa322 expref: 2358 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663216:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10328 00000100:00100000:0.0:1651529338.663218:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2358:41279:x1731746395626112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.663221:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.663223:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3b5243 lrc: 4/0,0 mode: PR/PR res: [0x2b01e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0b1 expref: 2357 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.663226:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3b5243 lrc: 3/0,0 mode: PR/PR res: [0x2b01e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0b1 expref: 2357 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.663238:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3b5243 lrc: 0/0,0 mode: --/PR res: [0x2b01e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0b1 expref: 2357 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.663242:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663242:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663243:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 3/0,1 mode: PW/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663246:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 4/0,1 mode: PW/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663256:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.663264:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2355:41279:x1731746395626112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.663266:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10328 00010000:00010000:0.0:1651529338.663273:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bc5ca lrc: 3/0,1 mode: PW/PW res: [0x2b01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663277:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bc5ca lrc: 3/0,1 mode: PW/PW res: [0x2b01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663283:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bc5ca lrc: 3/0,1 mode: PW/PW res: [0x2b01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663285:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bc5ca lrc: 2/0,0 mode: PW/PW res: [0x2b01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663348:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946302400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1747us (1909us total) trans 30064892229 rc 0/0 00000100:00100000:0.0:1651529338.663351:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151315 00010000:00010000:0.0:1651529338.663365:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 2/0,0 mode: PW/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663368:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e2fdca5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.663369:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 2/0,0 mode: PW/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663372:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 3/0,0 mode: PW/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663377:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 1/0,0 mode: --/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663380:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc5c3 lrc: 0/0,0 mode: --/PW res: [0x2b01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.663509:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc5d1 lrc: 2/0,0 mode: PW/PW res: [0x2b020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663514:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086c708e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.663515:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc5d1 lrc: 2/0,0 mode: PW/PW res: [0x2b020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663518:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc5d1 lrc: 3/0,0 mode: PW/PW res: [0x2b020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663527:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc5d1 lrc: 1/0,0 mode: --/PW res: [0x2b020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663530:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc5d1 lrc: 0/0,0 mode: --/PW res: [0x2b020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.663538:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151318 00000100:00100000:0.0:1651529338.663540:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+867:39030:x1731745946302528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.663559:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176161 count 1 00010000:00010000:0.0:1651529338.663564:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: --/PW res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663568:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 2/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2352 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663574:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663574:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663575:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 4/0,1 mode: --/PW res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663582:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 3/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2352 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663593:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 4/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2352 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663598:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966561856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.663607:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.663614:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151320 00000100:00100000:0.0:1651529338.663615:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+867:39030:x1731745946302656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.663620:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176163 count 1 00010000:00010000:0.0:1651529338.663624:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,1 mode: --/PW res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663628:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3b2bd8 lrc: 2/0,0 mode: PR/PR res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a27b4 expref: 2352 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663631:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663632:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663633:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 4/0,1 mode: --/PW res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663641:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3b2bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a27b4 expref: 2352 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663645:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3b2bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a27b4 expref: 2352 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663664:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966561984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.663672:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.663698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.663724:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946302848 00000100:00100000:0.0:1651529338.663740:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946302976 00000100:00100000:0.0:1651529338.663743:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946302912 00000100:00100000:0.0:1651529338.663746:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151322 00000100:00100000:0.0:1651529338.663748:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+870:39029:x1731745946302848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.663753:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176166 count 1 00010000:00010000:0.0:1651529338.663757:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,1 mode: --/PW res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663762:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3b5e67 lrc: 2/0,0 mode: PR/PR res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af2d0 expref: 2352 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663765:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663765:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663766:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 4/0,1 mode: --/PW res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663782:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3b5e67 lrc: 3/0,0 mode: PR/PR res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af2d0 expref: 2352 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663786:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3b5e67 lrc: 4/0,0 mode: PR/PR res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af2d0 expref: 2352 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663790:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966562112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.663835:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.663841:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151324 00000100:00100000:0.0:1651529338.663843:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946302912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.663848:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176167 count 1 00010000:00010000:0.0:1651529338.663852:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: --/PW res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663857:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 2/0,0 mode: PR/PR res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2352 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663860:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663860:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.663861:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 4/0,1 mode: --/PW res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.663867:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 3/0,0 mode: PR/PR res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2352 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.663871:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 4/0,0 mode: PR/PR res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2352 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.663883:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966562240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.663892:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.664932:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966561856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.664951:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: --/PW res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.664966:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966561984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.664973:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,1 mode: --/PW res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.664980:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626368 00010000:00010000:0.0:1651529338.664985:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 4/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2353 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.664991:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626496 00010000:00010000:0.0:1651529338.664993:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3b2bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b023:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a27b4 expref: 2354 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.664997:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626304 00010000:00010000:0.0:1651529338.664999:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3b4585 lrc: 4/0,0 mode: PR/PR res: [0x2b022:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8edf expref: 2355 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.665004:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10330 00000100:00100000:0.0:1651529338.665006:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2356:41278:x1731746395626368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.665018:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.665020:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 4/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2356 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665023:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 3/0,0 mode: PR/PR res: [0x2b021:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2356 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665029:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3b3031 lrc: 0/0,0 mode: --/PR res: [0x2b021:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3934 expref: 2355 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665033:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665034:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665035:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665063:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 4/0,1 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665070:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.665079:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2353:41278:x1731746395626368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 72us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.665083:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10330 00000100:00100000:0.0:1651529338.665093:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10333 00000100:00100000:0.0:1651529338.665095:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2352:41278:x1731746395626432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.665098:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.665099:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3b3062 lrc: 4/0,0 mode: PR/PR res: [0x2b024:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39d5 expref: 2352 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665115:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3b3062 lrc: 3/0,0 mode: PR/PR res: [0x2b024:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39d5 expref: 2351 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665120:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3b3062 lrc: 0/0,0 mode: --/PR res: [0x2b024:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39d5 expref: 2351 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665124:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665124:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665125:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 3/0,1 mode: PW/PW res: [0x2b024:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665128:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 4/0,1 mode: PW/PW res: [0x2b024:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665137:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.665144:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2349:41278:x1731746395626432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.665147:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10333 00010000:00010000:0.0:1651529338.665157:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,1 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665160:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,1 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665163:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,1 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665182:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 2/0,0 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665225:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+871:39030:x1731745946302656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1609us (1772us total) trans 30064892233 rc 0/0 00000100:00100000:0.0:1651529338.665228:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151320 00010000:00010000:0.0:1651529338.665236:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 2/0,0 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edf74e92 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.665240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 2/0,0 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 3/0,0 mode: PW/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665248:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 1/0,0 mode: --/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665251:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc5ed lrc: 0/0,0 mode: --/PW res: [0x2b023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665263:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 2/0,0 mode: PW/PW res: [0x2b024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665266:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000373fc508 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.665267:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 2/0,0 mode: PW/PW res: [0x2b024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665270:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 3/0,0 mode: PW/PW res: [0x2b024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665274:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 1/0,0 mode: --/PW res: [0x2b024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665276:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc5e6 lrc: 0/0,0 mode: --/PW res: [0x2b024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665283:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665285:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665288:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 3/0,1 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665291:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bc5df lrc: 2/0,0 mode: PW/PW res: [0x2b021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665331:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+871:39030:x1731745946302528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1790us (1905us total) trans 30064892235 rc 0/0 00000100:00100000:0.0:1651529338.665334:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151318 00000100:00100000:0.0:1651529338.665367:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966562112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.665371:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,1 mode: --/PW res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.665413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.665419:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.665425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.665435:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966562240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.665439:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: --/PW res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665445:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626560 00010000:00010000:0.0:1651529338.665450:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3b5ca0 lrc: 4/0,0 mode: PR/PR res: [0x2b025:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae9a0 expref: 2349 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.665472:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626624 00010000:00010000:0.0:1651529338.665476:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3b5e67 lrc: 4/0,0 mode: PR/PR res: [0x2b026:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af2d0 expref: 2351 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.665480:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626688 00010000:00010000:0.0:1651529338.665482:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047d05054/0xa29a79078f3b5f0f lrc: 4/0,0 mode: PR/PR res: [0x2b028:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af650 expref: 2352 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.665487:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10334 00000100:00100000:0.0:1651529338.665489:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2352:41279:x1731746395626560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.665491:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.665493:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3b5ca0 lrc: 4/0,0 mode: PR/PR res: [0x2b025:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae9a0 expref: 2352 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665497:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3b5ca0 lrc: 3/0,0 mode: PR/PR res: [0x2b025:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae9a0 expref: 2352 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665502:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3b5ca0 lrc: 0/0,0 mode: --/PR res: [0x2b025:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae9a0 expref: 2352 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665506:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665506:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665507:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 3/0,1 mode: PW/PW res: [0x2b025:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665510:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 4/0,1 mode: PW/PW res: [0x2b025:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665521:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.665528:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2350:41279:x1731746395626560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.665537:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10334 00000100:00100000:0.0:1651529338.665556:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10337 00000100:00100000:0.0:1651529338.665567:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2348:41279:x1731746395626752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.665570:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.665572:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 4/0,0 mode: PR/PR res: [0x2b027:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2348 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665587:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 3/0,0 mode: PR/PR res: [0x2b027:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2347 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665593:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3b453f lrc: 0/0,0 mode: --/PR res: [0x2b027:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8de3 expref: 2347 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.665596:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665597:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665598:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665601:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 4/0,1 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665607:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.665614:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2345:41279:x1731746395626752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.665617:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10337 00010000:00010000:0.0:1651529338.665633:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 2/0,0 mode: PW/PW res: [0x2b025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665636:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042e455a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.665637:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 2/0,0 mode: PW/PW res: [0x2b025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665640:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 3/0,0 mode: PW/PW res: [0x2b025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665652:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 1/0,0 mode: --/PW res: [0x2b025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665654:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc5f4 lrc: 0/0,0 mode: --/PW res: [0x2b025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665661:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665664:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665667:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,1 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665670:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 2/0,0 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665709:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946302912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1866us (1991us total) trans 30064892237 rc 0/0 00000100:00100000:0.0:1651529338.665712:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151324 00010000:00010000:0.0:1651529338.665719:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 2/0,0 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665722:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb7fe31f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.665723:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 2/0,0 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665741:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 3/0,0 mode: PW/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665746:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 1/0,0 mode: --/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665749:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc609 lrc: 0/0,0 mode: --/PW res: [0x2b027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665756:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,1 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665758:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,1 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665762:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,1 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665764:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 2/0,0 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.665821:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+871:39029:x1731745946302848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2054us (2105us total) trans 30064892239 rc 0/0 00000100:00100000:0.0:1651529338.665824:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151322 00000100:00100000:0.0:1651529338.665856:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303040 00000100:00100000:0.0:1651529338.665874:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303168 00000100:00100000:0.0:1651529338.665895:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303104 00000100:00100000:0.0:1651529338.665902:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303232 00000100:00100000:0.0:1651529338.665907:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151325 00000100:00100000:0.0:1651529338.665909:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+874:39030:x1731745946303040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.665914:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176169 count 1 00010000:00010000:0.0:1651529338.665919:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bc610 lrc: 3/0,1 mode: --/PW res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665924:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 2/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2344 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.665927:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665927:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665928:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bc610 lrc: 4/0,1 mode: --/PW res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665935:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 3/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2344 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.665939:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 4/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2344 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.665943:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966562304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.665958:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.665964:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151326 00000100:00100000:0.0:1651529338.665966:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+874:39030:x1731745946303168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.665971:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176171 count 1 00010000:00010000:0.0:1651529338.665974:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 3/0,1 mode: --/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.665995:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3b412c lrc: 2/0,0 mode: PR/PR res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7c78 expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.665998:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.665999:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.666000:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 4/0,1 mode: --/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666007:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3b412c lrc: 3/0,0 mode: PR/PR res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7c78 expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.666010:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3b412c lrc: 4/0,0 mode: PR/PR res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7c78 expref: 2344 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.666014:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966562432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.666023:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.666029:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 2/0,0 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666032:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.666033:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 2/0,0 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666036:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 3/0,0 mode: PW/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666043:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 1/0,0 mode: --/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666046:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc5fb lrc: 0/0,0 mode: --/PW res: [0x2b026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.666176:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303296 00000100:00100000:0.0:1651529338.666192:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303424 00000100:00100000:0.0:1651529338.666196:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151329 00000100:00100000:0.0:1651529338.666198:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+878:39029:x1731745946303360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.666203:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176174 count 1 00010000:00010000:0.0:1651529338.666207:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: --/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666212:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 2/0,0 mode: PR/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.666215:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.666216:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.666216:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 4/0,1 mode: --/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666223:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 3/0,0 mode: PR/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.666227:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 4/0,0 mode: PR/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2344 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.666234:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966562560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.666254:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.666260:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151332 00000100:00100000:0.0:1651529338.666262:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+878:39030:x1731745946303424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.666266:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176175 count 1 00010000:00010000:0.0:1651529338.666271:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 3/0,1 mode: --/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666275:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3b460a lrc: 2/0,0 mode: PR/PR res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a912b expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.666278:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.666279:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.666279:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 4/0,1 mode: --/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.666286:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3b460a lrc: 3/0,0 mode: PR/PR res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a912b expref: 2344 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.666289:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3b460a lrc: 4/0,0 mode: PR/PR res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a912b expref: 2344 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.666293:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966562752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.666301:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.667903:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966562432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.667926:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 3/0,1 mode: --/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.667940:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626816 00010000:00010000:0.0:1651529338.667946:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 5/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2345 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.667957:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626944 00010000:00010000:0.0:1651529338.667960:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3b412c lrc: 4/0,0 mode: PR/PR res: [0x2b02b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7c78 expref: 2346 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.667964:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395626880 00010000:00010000:0.0:1651529338.667966:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3b56e2 lrc: 4/0,0 mode: PR/PR res: [0x2b02a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad31f expref: 2347 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.667971:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10338 00000100:00100000:0.0:1651529338.667972:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2347:41279:x1731746395626816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.667975:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.667977:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 5/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2347 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.667980:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3b52cf lrc: 4/0,0 mode: PR/PR res: [0x2b029:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac35f expref: 2347 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.667987:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.667987:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.667988:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bc610 lrc: 3/0,1 mode: PW/PW res: [0x2b029:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.667999:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bc610 lrc: 4/0,1 mode: PW/PW res: [0x2b029:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668004:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.668015:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2347:41279:x1731746395626816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.668018:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10338 00000100:00100000:0.0:1651529338.668028:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10340 00000100:00100000:0.0:1651529338.668029:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2345:41279:x1731746395626880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.668032:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.668034:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3b56e2 lrc: 4/0,0 mode: PR/PR res: [0x2b02a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad31f expref: 2345 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668062:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3b56e2 lrc: 3/0,0 mode: PR/PR res: [0x2b02a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad31f expref: 2344 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668068:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3b56e2 lrc: 0/0,0 mode: --/PR res: [0x2b02a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad31f expref: 2344 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668072:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668072:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668073:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 3/0,1 mode: PW/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668076:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 4/0,1 mode: PW/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668091:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.668098:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2342:41279:x1731746395626880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.668101:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10340 00010000:00010000:0.0:1651529338.668109:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 3/0,1 mode: PW/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668112:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 3/0,1 mode: PW/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668122:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 3/0,1 mode: PW/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668125:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c93a5f56/0xa29a79078f3bc617 lrc: 2/0,0 mode: PW/PW res: [0x2b02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.668202:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946303168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2234us (2374us total) trans 30064892241 rc 0/0 00000100:00100000:0.0:1651529338.668205:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151326 00000100:00100000:0.0:1651529338.668218:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966562560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.668222:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: --/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.668257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.668268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.668290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.668302:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.668327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.668345:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 2/0,0 mode: PW/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668349:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076f6605b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.668350:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 2/0,0 mode: PW/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668353:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 3/0,0 mode: PW/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668358:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 1/0,0 mode: --/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668361:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc61e lrc: 0/0,0 mode: --/PW res: [0x2b02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.668371:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966562752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.668374:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 3/0,1 mode: --/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.668382:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10342 00000100:00100000:0.0:1651529338.668384:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2346:41278:x1731746395627136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.668387:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.668389:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 4/0,0 mode: PR/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2345 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668400:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 3/0,0 mode: PR/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2345 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668427:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3b41aa lrc: 0/0,0 mode: --/PR res: [0x2b02e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f3b expref: 2344 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668431:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668432:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668433:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668436:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 4/0,1 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668442:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.668450:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2342:41278:x1731746395627136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.668458:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10342 00000100:00100000:0.0:1651529338.668465:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10344 00000100:00100000:0.0:1651529338.668467:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2340:41278:x1731746395627008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.668470:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.668471:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3b3395 lrc: 4/0,0 mode: PR/PR res: [0x2b02d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46e0 expref: 2340 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668475:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3b3395 lrc: 3/0,0 mode: PR/PR res: [0x2b02d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46e0 expref: 2340 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668488:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3b3395 lrc: 0/0,0 mode: --/PR res: [0x2b02d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46e0 expref: 2339 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.668503:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668504:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.668505:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc633 lrc: 3/0,1 mode: PW/PW res: [0x2b02d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668518:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc633 lrc: 4/0,1 mode: PW/PW res: [0x2b02d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668532:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.668539:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2337:41278:x1731746395627008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.668541:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10344 00010000:00010000:0.0:1651529338.668553:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc625 lrc: 2/0,0 mode: PW/PW res: [0x2b02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668556:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063c1deaa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.668557:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc625 lrc: 2/0,0 mode: PW/PW res: [0x2b02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668560:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc625 lrc: 3/0,0 mode: PW/PW res: [0x2b02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668564:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc625 lrc: 1/0,0 mode: --/PW res: [0x2b02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668577:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc625 lrc: 0/0,0 mode: --/PW res: [0x2b02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668584:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 3/0,1 mode: PW/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668587:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 3/0,1 mode: PW/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668590:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 3/0,1 mode: PW/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668593:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bc641 lrc: 2/0,0 mode: PW/PW res: [0x2b02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.668670:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946303424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2406us (2504us total) trans 30064892245 rc 0/0 00000100:00100000:0.0:1651529338.668673:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151332 00010000:00010000:0.0:1651529338.668898:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc63a lrc: 2/0,0 mode: PW/PW res: [0x2b030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668902:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ff0eeeb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.668903:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc63a lrc: 2/0,0 mode: PW/PW res: [0x2b030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668907:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc63a lrc: 3/0,0 mode: PW/PW res: [0x2b030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668935:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc63a lrc: 1/0,0 mode: --/PW res: [0x2b030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668938:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc63a lrc: 0/0,0 mode: --/PW res: [0x2b030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668946:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668949:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668952:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 3/0,1 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.668955:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bc62c lrc: 2/0,0 mode: PW/PW res: [0x2b02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.669001:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+882:39029:x1731745946303360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2802us (2864us total) trans 30064892247 rc 0/0 00000100:00100000:0.0:1651529338.669004:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151329 00000100:00100000:0.0:1651529338.669010:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151335 00000100:00100000:0.0:1651529338.669011:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+881:39029:x1731745946303680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.669016:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176179 count 1 00010000:00010000:0.0:1651529338.669021:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: --/PW res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669034:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 2/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2336 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669037:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669038:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669054:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 4/0,1 mode: --/PW res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669071:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 3/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2336 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669075:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 4/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2336 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.669080:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966562944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.669089:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.669096:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303744 00000100:00100000:0.0:1651529338.669107:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946303808 00000100:00100000:0.0:1651529338.669113:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151336 00000100:00100000:0.0:1651529338.669115:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+883:39029:x1731745946303744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.669119:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176180 count 1 00010000:00010000:0.0:1651529338.669123:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 3/0,1 mode: --/PW res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669128:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3b5daa lrc: 2/0,0 mode: PR/PR res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee46 expref: 2336 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669134:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669134:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669135:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 4/0,1 mode: --/PW res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669141:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3b5daa lrc: 3/0,0 mode: PR/PR res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee46 expref: 2336 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669144:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3b5daa lrc: 4/0,0 mode: PR/PR res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee46 expref: 2336 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.669148:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966563008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.669161:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.669168:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151338 00000100:00100000:0.0:1651529338.669169:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+885:39029:x1731745946303872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.669175:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176182 count 1 00010000:00010000:0.0:1651529338.669193:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: --/PW res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669198:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 2/0,0 mode: PR/PR res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2336 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.669202:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 4/0,1 mode: --/PW res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.669211:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 3/0,0 mode: PR/PR res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2336 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.669215:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 4/0,0 mode: PR/PR res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2336 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.669219:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966563136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.669227:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.669243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.670664:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966562944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.670677:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: --/PW res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.670693:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966563136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.670697:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: --/PW res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.670717:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966563008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.670721:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 3/0,1 mode: --/PW res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.670737:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627328 00010000:00010000:0.0:1651529338.670743:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096be54e3/0xa29a79078f3b34ad lrc: 4/0,0 mode: PR/PR res: [0x2b032:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4a0c expref: 2337 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.670756:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627456 00010000:00010000:0.0:1651529338.670759:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 4/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2338 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.670780:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10347 00000100:00100000:0.0:1651529338.670783:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2338:41279:x1731746395627456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.670786:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.670788:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 4/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2337 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.670792:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 3/0,0 mode: PR/PR res: [0x2b033:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2337 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.670826:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3b3b28 lrc: 0/0,0 mode: --/PR res: [0x2b033:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63c7 expref: 2337 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.670831:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.670832:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.670833:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670836:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 4/0,1 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670842:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.670857:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2335:41279:x1731746395627456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.670860:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10347 00010000:00010000:0.0:1651529338.670870:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc648 lrc: 2/0,0 mode: PW/PW res: [0x2b032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670874:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014d87497 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.670875:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc648 lrc: 2/0,0 mode: PW/PW res: [0x2b032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670878:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc648 lrc: 3/0,0 mode: PW/PW res: [0x2b032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670882:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc648 lrc: 1/0,0 mode: --/PW res: [0x2b032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670885:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc648 lrc: 0/0,0 mode: --/PW res: [0x2b032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670891:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670894:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670897:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,1 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670900:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 2/0,0 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.670950:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+887:39029:x1731745946303680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1938us (2149us total) trans 30064892249 rc 0/0 00000100:00100000:0.0:1651529338.670954:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151335 00010000:00010000:0.0:1651529338.670961:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 2/0,0 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670964:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.670965:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 2/0,0 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670968:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 3/0,0 mode: PW/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670973:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 1/0,0 mode: --/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.670975:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bc656 lrc: 0/0,0 mode: --/PW res: [0x2b033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.670983:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627584 00010000:00010000:0.0:1651529338.670987:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3b4b6d lrc: 4/0,0 mode: PR/PR res: [0x2b035:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa52f expref: 2335 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.670999:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627712 00010000:00010000:0.0:1651529338.671002:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075fd18e9/0xa29a79078f3b5672 lrc: 4/0,0 mode: PR/PR res: [0x2b037:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad17b expref: 2336 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671008:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627392 00010000:00010000:0.0:1651529338.671010:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3b4905 lrc: 4/0,0 mode: PR/PR res: [0x2b031:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d2c expref: 2337 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671014:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627520 00010000:00010000:0.0:1651529338.671016:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3b5daa lrc: 4/0,0 mode: PR/PR res: [0x2b034:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee46 expref: 2338 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671020:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10348 00000100:00100000:0.0:1651529338.671022:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2338:41279:x1731746395627584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.671025:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.671026:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3b4b6d lrc: 4/0,0 mode: PR/PR res: [0x2b035:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa52f expref: 2338 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671030:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3b4b6d lrc: 3/0,0 mode: PR/PR res: [0x2b035:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa52f expref: 2338 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671034:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3b4b6d lrc: 0/0,0 mode: --/PR res: [0x2b035:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa52f expref: 2338 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671038:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671038:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671039:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 3/0,1 mode: PW/PW res: [0x2b035:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671042:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 4/0,1 mode: PW/PW res: [0x2b035:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671051:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.671078:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2339:41279:x1731746395627584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.671081:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10348 00000100:00100000:0.0:1651529338.671086:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10350 00000100:00100000:0.0:1651529338.671088:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2338:41279:x1731746395627392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.671091:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.671093:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3b4905 lrc: 4/0,0 mode: PR/PR res: [0x2b031:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d2c expref: 2338 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671107:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3b4905 lrc: 3/0,0 mode: PR/PR res: [0x2b031:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d2c expref: 2337 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671113:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3b4905 lrc: 0/0,0 mode: --/PR res: [0x2b031:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d2c expref: 2337 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671116:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671117:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671118:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 3/0,1 mode: PW/PW res: [0x2b031:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671121:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 4/0,1 mode: PW/PW res: [0x2b031:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671130:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.671137:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2336:41279:x1731746395627392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.671140:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10350 00000100:00100000:0.0:1651529338.671145:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10352 00000100:00100000:0.0:1651529338.671147:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2334:41279:x1731746395627648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.671150:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.671151:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 4/0,0 mode: PR/PR res: [0x2b036:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2334 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671155:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 3/0,0 mode: PR/PR res: [0x2b036:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2334 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671172:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3b36cf lrc: 0/0,0 mode: --/PR res: [0x2b036:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5312 expref: 2333 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.671176:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671176:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671177:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671186:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 4/0,1 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671192:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.671199:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2331:41279:x1731746395627648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.671201:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10352 00010000:00010000:0.0:1651529338.671212:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671216:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671219:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 3/0,1 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671222:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bc66b lrc: 2/0,0 mode: PW/PW res: [0x2b036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.671266:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+887:39029:x1731745946303872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2096us (2141us total) trans 30064892250 rc 0/0 00000100:00100000:0.0:1651529338.671269:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151338 00010000:00010000:0.0:1651529338.671283:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 3/0,1 mode: PW/PW res: [0x2b034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671286:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 3/0,1 mode: PW/PW res: [0x2b034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671289:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 3/0,1 mode: PW/PW res: [0x2b034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671292:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bc65d lrc: 2/0,0 mode: PW/PW res: [0x2b034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.671328:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+887:39029:x1731745946303744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2213us (2262us total) trans 30064892252 rc 0/0 00000100:00100000:0.0:1651529338.671333:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151336 00010000:00010000:0.0:1651529338.671340:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 2/0,0 mode: PW/PW res: [0x2b035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671344:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f389188 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.671345:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 2/0,0 mode: PW/PW res: [0x2b035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671347:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 3/0,0 mode: PW/PW res: [0x2b035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671352:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 1/0,0 mode: --/PW res: [0x2b035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671355:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc664 lrc: 0/0,0 mode: --/PW res: [0x2b035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.671384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.671406:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.671463:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 2/0,0 mode: PW/PW res: [0x2b031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671467:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f55bae0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.671468:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 2/0,0 mode: PW/PW res: [0x2b031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671471:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 3/0,0 mode: PW/PW res: [0x2b031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671476:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 1/0,0 mode: --/PW res: [0x2b031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671479:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc64f lrc: 0/0,0 mode: --/PW res: [0x2b031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.671507:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151342 00000100:00100000:0.0:1651529338.671510:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+888:39029:x1731745946304128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.671525:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176186 count 1 00010000:00010000:0.0:1651529338.671530:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,1 mode: --/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671535:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ebd3a3b/0xa29a79078f3b2fdd lrc: 2/0,0 mode: PR/PR res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a379e expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671538:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671539:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671540:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 4/0,1 mode: --/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671553:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ebd3a3b/0xa29a79078f3b2fdd lrc: 3/0,0 mode: PR/PR res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a379e expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671557:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ebd3a3b/0xa29a79078f3b2fdd lrc: 4/0,0 mode: PR/PR res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a379e expref: 2328 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671564:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966563392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.671579:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.671584:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc672 lrc: 2/0,0 mode: PW/PW res: [0x2b037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671587:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086c708e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.671588:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc672 lrc: 2/0,0 mode: PW/PW res: [0x2b037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671591:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc672 lrc: 3/0,0 mode: PW/PW res: [0x2b037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671595:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc672 lrc: 1/0,0 mode: --/PW res: [0x2b037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671613:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc672 lrc: 0/0,0 mode: --/PW res: [0x2b037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.671650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.671664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.671685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.671708:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.671739:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304256 00000100:00100000:0.0:1651529338.671749:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304384 00000100:00100000:0.0:1651529338.671755:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304320 00000100:00100000:0.0:1651529338.671761:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151343 00000100:00100000:0.0:1651529338.671763:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+892:39029:x1731745946304256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.671781:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176188 count 1 00010000:00010000:0.0:1651529338.671786:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: --/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671791:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 2/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2328 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671794:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671795:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671796:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 4/0,1 mode: --/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671818:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 3/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2328 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671835:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 4/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2328 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671840:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966563520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.671849:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.671856:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151346 00000100:00100000:0.0:1651529338.671858:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+892:39030:x1731745946304320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.671862:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176189 count 1 00010000:00010000:0.0:1651529338.671866:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,1 mode: --/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671901:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3b4ce7 lrc: 2/0,0 mode: PR/PR res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaabc expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671904:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671904:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671905:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 4/0,1 mode: --/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671921:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3b4ce7 lrc: 3/0,0 mode: PR/PR res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaabc expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671925:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3b4ce7 lrc: 4/0,0 mode: PR/PR res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaabc expref: 2328 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.671929:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966563648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.671937:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.671944:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304448 00000100:00100000:0.0:1651529338.671956:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151347 00000100:00100000:0.0:1651529338.671958:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+893:39029:x1731745946304448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.671963:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176191 count 1 00010000:00010000:0.0:1651529338.671967:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,1 mode: --/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671982:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3b5067 lrc: 2/0,0 mode: PR/PR res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab964 expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671988:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671989:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.671989:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 4/0,1 mode: --/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.671996:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3b5067 lrc: 3/0,0 mode: PR/PR res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab964 expref: 2328 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.671999:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3b5067 lrc: 4/0,0 mode: PR/PR res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab964 expref: 2328 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.672003:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966563712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.672022:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.672031:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966563392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.672034:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,1 mode: --/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673144:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966563520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.673149:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: --/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673157:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966563648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.673160:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,1 mode: --/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673187:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966563712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.673202:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,1 mode: --/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673223:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627904 00010000:00010000:0.0:1651529338.673229:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ebd3a3b/0xa29a79078f3b2fdd lrc: 4/0,0 mode: PR/PR res: [0x2b03a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a379e expref: 2329 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673235:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628032 00010000:00010000:0.0:1651529338.673237:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 4/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2330 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673241:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628160 00010000:00010000:0.0:1651529338.673243:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3b4ce7 lrc: 4/0,0 mode: PR/PR res: [0x2b03d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaabc expref: 2331 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673247:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627840 00010000:00010000:0.0:1651529338.673249:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3b5760 lrc: 4/0,0 mode: PR/PR res: [0x2b039:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad4ca expref: 2333 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673253:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395627968 00010000:00010000:0.0:1651529338.673256:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3b4cb6 lrc: 4/0,0 mode: PR/PR res: [0x2b03e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa30 expref: 2334 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673260:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628224 00010000:00010000:0.0:1651529338.673262:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3b5067 lrc: 4/0,0 mode: PR/PR res: [0x2b03f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab964 expref: 2336 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.673268:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10355 00000100:00100000:0.0:1651529338.673270:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2336:41278:x1731746395628032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.673273:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.673274:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 4/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2336 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673278:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 3/0,0 mode: PR/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2336 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673284:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3b4714 lrc: 0/0,0 mode: --/PR res: [0x2b03c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9506 expref: 2336 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673288:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673288:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673289:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673292:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 4/0,1 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673305:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.673313:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2334:41278:x1731746395628032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.673316:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10355 00000100:00100000:0.0:1651529338.673321:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10357 00000100:00100000:0.0:1651529338.673323:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2332:41278:x1731746395627840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.673325:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.673327:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3b5760 lrc: 4/0,0 mode: PR/PR res: [0x2b039:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad4ca expref: 2332 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673331:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3b5760 lrc: 3/0,0 mode: PR/PR res: [0x2b039:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad4ca expref: 2332 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673336:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3b5760 lrc: 0/0,0 mode: --/PR res: [0x2b039:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad4ca expref: 2332 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673340:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673340:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673341:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc680 lrc: 3/0,1 mode: PW/PW res: [0x2b039:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673344:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc680 lrc: 4/0,1 mode: PW/PW res: [0x2b039:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673354:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.673359:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2330:41278:x1731746395627840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.673362:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10357 00000100:00100000:0.0:1651529338.673372:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10358 00000100:00100000:0.0:1651529338.673374:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2329:41278:x1731746395628288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.673377:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.673378:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3b5fe1 lrc: 5/0,0 mode: PR/PR res: [0x2b040:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afb82 expref: 2329 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673382:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3b5fe1 lrc: 4/0,0 mode: PR/PR res: [0x2b040:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afb82 expref: 2328 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673387:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673388:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673388:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6b1 lrc: 3/0,1 mode: PW/PW res: [0x2b040:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673391:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6b1 lrc: 4/0,1 mode: PW/PW res: [0x2b040:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673395:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.673401:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2327:41278:x1731746395628288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.673403:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10358 00000100:00100000:0.0:1651529338.673407:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10360 00000100:00100000:0.0:1651529338.673409:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2326:41278:x1731746395628096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.673412:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.673413:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3b4c85 lrc: 4/0,0 mode: PR/PR res: [0x2b03b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa96c expref: 2326 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673416:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3b4c85 lrc: 3/0,0 mode: PR/PR res: [0x2b03b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa96c expref: 2326 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673421:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3b4c85 lrc: 0/0,0 mode: --/PR res: [0x2b03b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa96c expref: 2326 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.673427:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673428:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.673428:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 3/0,1 mode: PW/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673431:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 4/0,1 mode: PW/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673440:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.673446:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2324:41278:x1731746395628096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.673448:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10360 00010000:00010000:0.0:1651529338.673455:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,1 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673458:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,1 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673461:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,1 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673464:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 2/0,0 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673517:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946304128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2007us (2111us total) trans 30064892256 rc 0/0 00000100:00100000:0.0:1651529338.673521:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151342 00010000:00010000:0.0:1651529338.673533:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 2/0,0 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673537:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.673538:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 2/0,0 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673541:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 3/0,0 mode: PW/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673545:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 1/0,0 mode: --/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673548:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc687 lrc: 0/0,0 mode: --/PW res: [0x2b03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673553:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 2/0,0 mode: PW/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673555:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000245df374 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.673556:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 2/0,0 mode: PW/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673559:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 3/0,0 mode: PW/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673562:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 1/0,0 mode: --/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673567:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc69c lrc: 0/0,0 mode: --/PW res: [0x2b03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673573:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673576:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673579:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 3/0,1 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673582:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3bc695 lrc: 2/0,0 mode: PW/PW res: [0x2b03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673629:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+896:39029:x1731745946304256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1865us (1979us total) trans 30064892258 rc 0/0 00000100:00100000:0.0:1651529338.673632:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151343 00010000:00010000:0.0:1651529338.673639:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,1 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673642:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,1 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673645:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,1 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673650:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 2/0,0 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673683:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946304320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1824us (1975us total) trans 30064892260 rc 0/0 00000100:00100000:0.0:1651529338.673686:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151346 00010000:00010000:0.0:1651529338.673692:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 2/0,0 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673695:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017c4c435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.673696:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 2/0,0 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673699:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 3/0,0 mode: PW/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673704:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 1/0,0 mode: --/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673706:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6a3 lrc: 0/0,0 mode: --/PW res: [0x2b03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673712:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,1 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673715:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,1 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673718:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,1 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673721:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 2/0,0 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.673775:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+896:39029:x1731745946304448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1815us (1835us total) trans 30064892261 rc 0/0 00000100:00100000:0.0:1651529338.673778:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151347 00010000:00010000:0.0:1651529338.673785:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 2/0,0 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673788:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edf74e92 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.673789:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 2/0,0 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673792:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 3/0,0 mode: PW/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673796:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 1/0,0 mode: --/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673799:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6aa lrc: 0/0,0 mode: --/PW res: [0x2b03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673860:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc68e lrc: 2/0,0 mode: PW/PW res: [0x2b03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673872:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc76f821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.673874:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc68e lrc: 2/0,0 mode: PW/PW res: [0x2b03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673877:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc68e lrc: 3/0,0 mode: PW/PW res: [0x2b03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673881:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc68e lrc: 1/0,0 mode: --/PW res: [0x2b03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.673884:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc68e lrc: 0/0,0 mode: --/PW res: [0x2b03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.674178:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151350 00000100:00100000:0.0:1651529338.674181:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+896:39030:x1731745946304640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.674187:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176194 count 1 00010000:00010000:0.0:1651529338.674192:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: --/PW res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674208:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 2/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674212:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674212:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674213:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 4/0,1 mode: --/PW res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674231:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 3/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674235:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 4/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2320 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.674240:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966563904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.674249:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.674256:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304704 00000100:00100000:0.0:1651529338.674284:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304768 00000100:00100000:0.0:1651529338.674293:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151351 00000100:00100000:0.0:1651529338.674295:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+898:39030:x1731745946304704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.674299:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176195 count 1 00010000:00010000:0.0:1651529338.674304:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: --/PW res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674308:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 2/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674311:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674312:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674313:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 4/0,1 mode: --/PW res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674319:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 3/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674336:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 4/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2320 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.674340:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966563968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.674349:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.674355:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304832 00000100:00100000:0.0:1651529338.674359:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304896 00000100:00100000:0.0:1651529338.674362:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946304960 00000100:00100000:0.0:1651529338.674364:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305024 00000100:00100000:0.0:1651529338.674367:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151352 00000100:00100000:0.0:1651529338.674369:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+902:39029:x1731745946304768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.674373:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176196 count 1 00010000:00010000:0.0:1651529338.674377:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,1 mode: --/PW res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674381:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3b4c54 lrc: 2/0,0 mode: PR/PR res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8a8 expref: 2320 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674384:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674385:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674385:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 4/0,1 mode: --/PW res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674391:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3b4c54 lrc: 3/0,0 mode: PR/PR res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8a8 expref: 2320 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674406:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3b4c54 lrc: 4/0,0 mode: PR/PR res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8a8 expref: 2320 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.674410:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966564032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.674423:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.674430:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151354 00000100:00100000:0.0:1651529338.674432:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+902:39029:x1731745946304896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.674436:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176198 count 1 00010000:00010000:0.0:1651529338.674440:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,1 mode: --/PW res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674444:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3b35ef lrc: 2/0,0 mode: PR/PR res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4f0d expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674447:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674448:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.674449:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 4/0,1 mode: --/PW res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.674455:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3b35ef lrc: 3/0,0 mode: PR/PR res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4f0d expref: 2320 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.674458:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3b35ef lrc: 4/0,0 mode: PR/PR res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4f0d expref: 2320 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.674466:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966564160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.674473:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.675315:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966563904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.675320:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: --/PW res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.675334:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966564032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.675342:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,1 mode: --/PW res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.675349:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966564160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.675352:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,1 mode: --/PW res: [0x2b046:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.675358:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966563968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.675361:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: --/PW res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.677388:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628416 00010000:00010000:0.0:1651529338.677394:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 4/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2321 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677400:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628544 00010000:00010000:0.0:1651529338.677403:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3b4c54 lrc: 4/0,0 mode: PR/PR res: [0x2b044:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8a8 expref: 2322 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677407:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628800 00010000:00010000:0.0:1651529338.677409:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3b5186 lrc: 4/0,0 mode: PR/PR res: [0x2b048:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe11 expref: 2324 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677413:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628352 00010000:00010000:0.0:1651529338.677415:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3b4d65 lrc: 4/0,0 mode: PR/PR res: [0x2b041:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aacc2 expref: 2325 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677419:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628480 00010000:00010000:0.0:1651529338.677421:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 4/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2326 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677425:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628608 00010000:00010000:0.0:1651529338.677427:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3b4ea0 lrc: 4/0,0 mode: PR/PR res: [0x2b045:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab2cd expref: 2327 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.677432:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10362 00000100:00100000:0.0:1651529338.677434:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2328:41278:x1731746395628416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.677437:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.677438:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 4/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2328 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677442:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 3/0,0 mode: PR/PR res: [0x2b042:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2328 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677450:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3b2d21 lrc: 0/0,0 mode: --/PR res: [0x2b042:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2cdf expref: 2328 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677454:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677455:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677456:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677459:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 4/0,1 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677466:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.677485:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2326:41278:x1731746395628416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.677488:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10362 00000100:00100000:0.0:1651529338.677495:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10364 00000100:00100000:0.0:1651529338.677496:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2324:41278:x1731746395628800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.677499:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.677501:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3b5186 lrc: 4/0,0 mode: PR/PR res: [0x2b048:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe11 expref: 2324 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677504:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3b5186 lrc: 3/0,0 mode: PR/PR res: [0x2b048:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe11 expref: 2324 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677510:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3b5186 lrc: 0/0,0 mode: --/PR res: [0x2b048:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe11 expref: 2324 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677516:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677516:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677517:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 3/0,1 mode: PW/PW res: [0x2b048:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677520:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 4/0,1 mode: PW/PW res: [0x2b048:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677527:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.677533:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2322:41278:x1731746395628800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.677536:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10364 00000100:00100000:0.0:1651529338.677541:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10366 00000100:00100000:0.0:1651529338.677542:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2321:41278:x1731746395628480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.677545:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.677546:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 4/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2321 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677550:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 3/0,0 mode: PR/PR res: [0x2b043:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2320 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677554:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3b3c0f lrc: 0/0,0 mode: --/PR res: [0x2b043:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6755 expref: 2320 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677558:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677559:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677559:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677562:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 4/0,1 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677568:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.677574:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2318:41278:x1731746395628480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.677576:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10366 00000100:00100000:0.0:1651529338.677586:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10368 00000100:00100000:0.0:1651529338.677588:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2317:41278:x1731746395628608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.677591:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.677592:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3b4ea0 lrc: 4/0,0 mode: PR/PR res: [0x2b045:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab2cd expref: 2316 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677596:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3b4ea0 lrc: 3/0,0 mode: PR/PR res: [0x2b045:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab2cd expref: 2316 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677601:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3b4ea0 lrc: 0/0,0 mode: --/PR res: [0x2b045:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab2cd expref: 2316 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.677604:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677605:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.677606:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc6d4 lrc: 3/0,1 mode: PW/PW res: [0x2b045:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677611:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc6d4 lrc: 4/0,1 mode: PW/PW res: [0x2b045:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677619:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.677625:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2314:41278:x1731746395628608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.677628:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10368 00010000:00010000:0.0:1651529338.677635:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,1 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677638:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,1 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677641:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,1 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677644:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 2/0,0 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.677693:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+904:39029:x1731745946304896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3260us (3359us total) trans 30064892264 rc 0/0 00000100:00100000:0.0:1651529338.677696:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151354 00010000:00010000:0.0:1651529338.677703:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 2/0,0 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677707:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007eb0121f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.677708:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 2/0,0 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677711:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 3/0,0 mode: PW/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677716:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 1/0,0 mode: --/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677718:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc6db lrc: 0/0,0 mode: --/PW res: [0x2b046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677724:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677737:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677741:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 3/0,1 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677743:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3bc6bf lrc: 2/0,0 mode: PW/PW res: [0x2b042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.677780:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+903:39030:x1731745946304640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3599us (3646us total) trans 30064892266 rc 0/0 00000100:00100000:0.0:1651529338.677783:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151350 00010000:00010000:0.0:1651529338.677797:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc6e2 lrc: 2/0,0 mode: PW/PW res: [0x2b047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677801:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076f6605b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.677802:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc6e2 lrc: 2/0,0 mode: PW/PW res: [0x2b047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677820:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc6e2 lrc: 3/0,0 mode: PW/PW res: [0x2b047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677825:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc6e2 lrc: 1/0,0 mode: --/PW res: [0x2b047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677828:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc6e2 lrc: 0/0,0 mode: --/PW res: [0x2b047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677835:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,1 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677838:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,1 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677841:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,1 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677843:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 2/0,0 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.677889:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+903:39029:x1731745946304768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3519us (3616us total) trans 30064892268 rc 0/0 00000100:00100000:0.0:1651529338.677892:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151352 00010000:00010000:0.0:1651529338.677899:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 2/0,0 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677902:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bae50051 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.677903:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 2/0,0 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677906:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 3/0,0 mode: PW/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677911:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 1/0,0 mode: --/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677913:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc6cd lrc: 0/0,0 mode: --/PW res: [0x2b044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677917:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc6b8 lrc: 2/0,0 mode: PW/PW res: [0x2b041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677920:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ff0eeeb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.677921:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc6b8 lrc: 2/0,0 mode: PW/PW res: [0x2b041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677924:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc6b8 lrc: 3/0,0 mode: PW/PW res: [0x2b041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677929:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc6b8 lrc: 1/0,0 mode: --/PW res: [0x2b041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677932:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc6b8 lrc: 0/0,0 mode: --/PW res: [0x2b041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677936:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 3/0,0 mode: PW/PW res: [0x2b048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677945:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042e455a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.677946:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 2/0,0 mode: PW/PW res: [0x2b048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677948:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 3/0,0 mode: PW/PW res: [0x2b048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677952:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 1/0,0 mode: --/PW res: [0x2b048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677955:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc6e9 lrc: 0/0,0 mode: --/PW res: [0x2b048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677961:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677964:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677967:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 3/0,1 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.677970:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bc6c6 lrc: 2/0,0 mode: PW/PW res: [0x2b043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.678010:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+903:39030:x1731745946304704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3714us (3776us total) trans 30064892271 rc 0/0 00000100:00100000:0.0:1651529338.678013:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151351 00000100:00100000:0.0:1651529338.678222:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305088 00000100:00100000:0.0:1651529338.678233:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151357 00000100:00100000:0.0:1651529338.678235:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+903:39030:x1731745946305088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.678240:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176201 count 1 00010000:00010000:0.0:1651529338.678245:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,1 mode: --/PW res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678250:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3b3c71 lrc: 2/0,0 mode: PR/PR res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6907 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678253:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678253:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678254:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 4/0,1 mode: --/PW res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678261:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3b3c71 lrc: 3/0,0 mode: PR/PR res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6907 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678268:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3b3c71 lrc: 4/0,0 mode: PR/PR res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6907 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.678272:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966564352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.678309:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.678392:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305216 00000100:00100000:0.0:1651529338.678401:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305152 00000100:00100000:0.0:1651529338.678405:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305280 00000100:00100000:0.0:1651529338.678418:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305344 00000100:00100000:0.0:1651529338.678423:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305472 00000100:00100000:0.0:1651529338.678426:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305408 00000100:00100000:0.0:1651529338.678429:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151358 00000100:00100000:0.0:1651529338.678431:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+909:39030:x1731745946305216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.678436:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176203 count 1 00010000:00010000:0.0:1651529338.678440:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,1 mode: --/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678444:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3b3a8e lrc: 2/0,0 mode: PR/PR res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6135 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678447:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678448:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678449:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 4/0,1 mode: --/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678455:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3b3a8e lrc: 3/0,0 mode: PR/PR res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6135 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678461:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3b3a8e lrc: 4/0,0 mode: PR/PR res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6135 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.678465:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966564416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.678478:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.678485:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151360 00000100:00100000:0.0:1651529338.678487:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946305280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.678491:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176204 count 1 00010000:00010000:0.0:1651529338.678502:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: --/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678507:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 2/0,0 mode: PR/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678510:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678511:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678511:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 4/0,1 mode: --/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678518:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 3/0,0 mode: PR/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678522:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 4/0,0 mode: PR/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.678529:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966564544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.678537:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.678543:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151362 00000100:00100000:0.0:1651529338.678545:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946305472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.678549:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176207 count 1 00010000:00010000:0.0:1651529338.678553:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,1 mode: --/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678557:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3b53a1 lrc: 2/0,0 mode: PR/PR res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ca expref: 2312 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678560:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678560:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.678561:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 4/0,1 mode: --/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.678567:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3b53a1 lrc: 3/0,0 mode: PR/PR res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ca expref: 2312 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.678570:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3b53a1 lrc: 4/0,0 mode: PR/PR res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ca expref: 2312 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.678574:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966564672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.678580:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.679954:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966564352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.679964:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,1 mode: --/PW res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.679973:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966564544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.679980:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: --/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.679988:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966564672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.679990:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,1 mode: --/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.679997:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966564416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.679999:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,1 mode: --/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680012:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628864 00010000:00010000:0.0:1651529338.680018:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3b3c71 lrc: 4/0,0 mode: PR/PR res: [0x2b049:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6907 expref: 2313 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.680024:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395629120 00010000:00010000:0.0:1651529338.680026:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f0f16f0/0xa29a79078f3b300e lrc: 5/0,0 mode: PR/PR res: [0x2b04d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38bd expref: 2315 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.680030:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395628928 00010000:00010000:0.0:1651529338.680032:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3b3a8e lrc: 4/0,0 mode: PR/PR res: [0x2b04b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6135 expref: 2316 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.680039:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395629184 00010000:00010000:0.0:1651529338.680041:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3b53a1 lrc: 4/0,0 mode: PR/PR res: [0x2b04f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ca expref: 2318 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.680046:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10371 00000100:00100000:0.0:1651529338.680048:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2318:41279:x1731746395629120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.680051:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.680052:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f0f16f0/0xa29a79078f3b300e lrc: 5/0,0 mode: PR/PR res: [0x2b04d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38bd expref: 2318 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680056:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f0f16f0/0xa29a79078f3b300e lrc: 4/0,0 mode: PR/PR res: [0x2b04d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38bd expref: 2318 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680062:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680063:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680063:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc70c lrc: 3/0,1 mode: PW/PW res: [0x2b04d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680066:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc70c lrc: 4/0,1 mode: PW/PW res: [0x2b04d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680071:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.680085:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2317:41279:x1731746395629120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.680088:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10371 00000100:00100000:0.0:1651529338.680099:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10372 00000100:00100000:0.0:1651529338.680101:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2316:41279:x1731746395628992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.680129:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.680131:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3b4cd2 lrc: 5/0,0 mode: PR/PR res: [0x2b04a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa84 expref: 2315 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680135:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3b4cd2 lrc: 4/0,0 mode: PR/PR res: [0x2b04a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa84 expref: 2315 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680141:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680143:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 3/0,1 mode: PW/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680146:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 4/0,1 mode: PW/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680150:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.680157:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2314:41279:x1731746395628992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.680165:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10372 00000100:00100000:0.0:1651529338.680173:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10374 00000100:00100000:0.0:1651529338.680175:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2312:41279:x1731746395629056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.680177:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.680179:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 4/0,0 mode: PR/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680183:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 3/0,0 mode: PR/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680188:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3b4006 lrc: 0/0,0 mode: --/PR res: [0x2b04c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77e0 expref: 2312 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680192:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680192:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680193:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680196:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 4/0,1 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680202:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.680208:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2311:41279:x1731746395629056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.680210:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10374 00010000:00010000:0.0:1651529338.680217:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680220:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680229:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,1 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680232:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 2/0,0 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680284:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946305280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1796us (1912us total) trans 30064892272 rc 0/0 00000100:00100000:0.0:1651529338.680287:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151360 00010000:00010000:0.0:1651529338.680294:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 2/0,0 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680298:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680299:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 2/0,0 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680302:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 3/0,0 mode: PW/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680306:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 1/0,0 mode: --/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680309:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc705 lrc: 0/0,0 mode: --/PW res: [0x2b04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680314:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 2/0,0 mode: PW/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680316:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c6323f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680317:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 2/0,0 mode: PW/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680323:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 3/0,0 mode: PW/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680326:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 1/0,0 mode: --/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680329:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc6fe lrc: 0/0,0 mode: --/PW res: [0x2b04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680334:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,1 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680337:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,1 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680340:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,1 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680343:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 2/0,0 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680390:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+912:39030:x1731745946305472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1844us (1988us total) trans 30064892274 rc 0/0 00000100:00100000:0.0:1651529338.680393:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151362 00010000:00010000:0.0:1651529338.680400:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 2/0,0 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680405:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680406:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 2/0,0 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680409:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 3/0,0 mode: PW/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680413:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 1/0,0 mode: --/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680416:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bc713 lrc: 0/0,0 mode: --/PW res: [0x2b04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680422:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680425:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680428:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680431:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680465:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946305216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2033us (2125us total) trans 30064892276 rc 0/0 00000100:00100000:0.0:1651529338.680468:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151358 00010000:00010000:0.0:1651529338.680475:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680478:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017c4c435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680479:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680482:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 3/0,0 mode: PW/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680486:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 1/0,0 mode: --/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680489:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc6f7 lrc: 0/0,0 mode: --/PW res: [0x2b04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680494:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,1 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680497:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,1 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680500:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,1 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680502:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 2/0,0 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680535:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946305088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2299us (2324us total) trans 30064892277 rc 0/0 00000100:00100000:0.0:1651529338.680538:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151357 00010000:00010000:0.0:1651529338.680544:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 2/0,0 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680547:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edf74e92 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680548:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 2/0,0 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680551:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 3/0,0 mode: PW/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680555:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 1/0,0 mode: --/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680557:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc6f0 lrc: 0/0,0 mode: --/PW res: [0x2b049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680603:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10377 00000100:00100000:0.0:1651529338.680605:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2308:41278:x1731746395629248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.680608:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.680610:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3b42fa lrc: 5/0,0 mode: PR/PR res: [0x2b04e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84d6 expref: 2308 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680641:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3b42fa lrc: 4/0,0 mode: PR/PR res: [0x2b04e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84d6 expref: 2308 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.680647:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680647:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680648:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc71a lrc: 3/0,1 mode: PW/PW res: [0x2b04e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680651:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc71a lrc: 4/0,1 mode: PW/PW res: [0x2b04e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680656:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.680664:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2306:41278:x1731746395629248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.680666:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10377 00010000:00010000:0.0:1651529338.680826:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc721 lrc: 2/0,0 mode: PW/PW res: [0x2b050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680830:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000373fc508 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.680831:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc721 lrc: 2/0,0 mode: PW/PW res: [0x2b050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680834:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc721 lrc: 3/0,0 mode: PW/PW res: [0x2b050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680839:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc721 lrc: 1/0,0 mode: --/PW res: [0x2b050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680852:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc721 lrc: 0/0,0 mode: --/PW res: [0x2b050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.680937:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305600 00000100:00100000:0.0:1651529338.680944:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305664 00000100:00100000:0.0:1651529338.680951:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946305728 00000100:00100000:0.0:1651529338.680956:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151365 00000100:00100000:0.0:1651529338.680958:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+913:39030:x1731745946305600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.680963:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176209 count 1 00010000:00010000:0.0:1651529338.680968:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: --/PW res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680972:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 2/0,0 mode: PR/PR res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2304 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.680975:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680976:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.680977:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 4/0,1 mode: --/PW res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.680984:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 3/0,0 mode: PR/PR res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2304 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.680994:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 4/0,0 mode: PR/PR res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2304 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.680998:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966564864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.681020:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.681027:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151367 00000100:00100000:0.0:1651529338.681029:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946305728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.681033:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176211 count 1 00010000:00010000:0.0:1651529338.681037:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: --/PW res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681042:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 2/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2304 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681045:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681045:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681046:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 4/0,1 mode: --/PW res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681052:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 3/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2304 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681056:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 4/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2304 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.681060:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966564992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.681068:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.681079:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151369 00000100:00100000:0.0:1651529338.681080:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+916:39030:x1731745946305856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.681084:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176213 count 1 00010000:00010000:0.0:1651529338.681095:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,1 mode: --/PW res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681099:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3b38ea lrc: 2/0,0 mode: PR/PR res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b00 expref: 2304 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681118:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681119:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681120:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 4/0,1 mode: --/PW res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681127:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3b38ea lrc: 3/0,0 mode: PR/PR res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b00 expref: 2304 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681131:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3b38ea lrc: 4/0,0 mode: PR/PR res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b00 expref: 2304 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.681135:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966565120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.681143:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.681270:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151372 00000100:00100000:0.0:1651529338.681273:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+918:39029:x1731745946306048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.681278:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176216 count 1 00010000:00010000:0.0:1651529338.681283:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 3/0,1 mode: --/PW res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681287:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3b5522 lrc: 2/0,0 mode: PR/PR res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accab expref: 2304 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681301:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681302:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.681302:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 4/0,1 mode: --/PW res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.681310:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3b5522 lrc: 3/0,0 mode: PR/PR res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accab expref: 2304 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.681314:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3b5522 lrc: 4/0,0 mode: PR/PR res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accab expref: 2304 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.681318:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966565312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.681326:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.682156:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966564992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.682171:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: --/PW res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682199:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966565120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.682202:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,1 mode: --/PW res: [0x2b055:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682221:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966564864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.682224:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: --/PW res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682242:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395629504 00010000:00010000:0.0:1651529338.682262:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 4/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2307 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.682278:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10378 00000100:00100000:0.0:1651529338.682280:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2309:41279:x1731746395629376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.682283:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.682285:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 4/0,0 mode: PR/PR res: [0x2b051:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2309 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682289:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 3/0,0 mode: PR/PR res: [0x2b051:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2309 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682295:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3b5576 lrc: 0/0,0 mode: --/PR res: [0x2b051:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdae expref: 2309 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682299:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682299:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682300:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682303:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 4/0,1 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682310:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.682323:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2307:41279:x1731746395629376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.682336:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10378 00000100:00100000:0.0:1651529338.682342:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10380 00000100:00100000:0.0:1651529338.682344:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2305:41279:x1731746395629504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.682347:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.682349:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 4/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2305 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682353:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 3/0,0 mode: PR/PR res: [0x2b053:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2305 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682358:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3b5912 lrc: 0/0,0 mode: --/PR res: [0x2b053:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb7d expref: 2305 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682361:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682362:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682363:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682366:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 4/0,1 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682372:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.682378:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2303:41279:x1731746395629504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.682381:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10380 00000100:00100000:0.0:1651529338.682390:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10382 00000100:00100000:0.0:1651529338.682400:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2302:41279:x1731746395629568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.682402:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.682404:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3b4ca1 lrc: 4/0,0 mode: PR/PR res: [0x2b054:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa06 expref: 2301 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682408:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3b4ca1 lrc: 3/0,0 mode: PR/PR res: [0x2b054:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa06 expref: 2301 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682426:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3b4ca1 lrc: 0/0,0 mode: --/PR res: [0x2b054:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaa06 expref: 2301 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682430:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682430:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682431:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc73d lrc: 3/0,1 mode: PW/PW res: [0x2b054:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682440:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc73d lrc: 4/0,1 mode: PW/PW res: [0x2b054:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682450:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.682456:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2300:41279:x1731746395629568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.682459:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10382 00010000:00010000:0.0:1651529338.682467:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc72f lrc: 2/0,0 mode: PW/PW res: [0x2b052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682470:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc76f821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.682478:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc72f lrc: 2/0,0 mode: PW/PW res: [0x2b052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682482:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc72f lrc: 3/0,0 mode: PW/PW res: [0x2b052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682486:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc72f lrc: 1/0,0 mode: --/PW res: [0x2b052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682489:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc72f lrc: 0/0,0 mode: --/PW res: [0x2b052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682495:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682498:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682501:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,1 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682504:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 2/0,0 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682547:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946305728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1517us (1628us total) trans 30064892282 rc 0/0 00000100:00100000:0.0:1651529338.682550:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151367 00010000:00010000:0.0:1651529338.682557:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 2/0,0 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682568:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6741c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.682569:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 2/0,0 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682572:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 3/0,0 mode: PW/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682577:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 1/0,0 mode: --/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682580:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc736 lrc: 0/0,0 mode: --/PW res: [0x2b053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682588:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,1 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682591:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,1 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682594:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,1 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682596:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 2/0,0 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682640:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+919:39030:x1731745946305856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1559us (1656us total) trans 30064892283 rc 0/0 00000100:00100000:0.0:1651529338.682650:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151369 00010000:00010000:0.0:1651529338.682658:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 2/0,0 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682665:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7509585 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.682667:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 2/0,0 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682670:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 3/0,0 mode: PW/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682674:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 1/0,0 mode: --/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682677:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc744 lrc: 0/0,0 mode: --/PW res: [0x2b055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682687:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966565312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.682691:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 3/0,1 mode: --/PW res: [0x2b058:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682696:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682699:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682711:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 3/0,1 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682714:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bc728 lrc: 2/0,0 mode: PW/PW res: [0x2b051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682783:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+919:39030:x1731745946305600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1810us (1875us total) trans 30064892284 rc 0/0 00000100:00100000:0.0:1651529338.682786:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151365 00000100:00100000:0.0:1651529338.682823:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10384 00000100:00100000:0.0:1651529338.682826:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2302:41279:x1731746395629696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.682829:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.682831:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3b5fc5 lrc: 4/0,0 mode: PR/PR res: [0x2b056:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afab0 expref: 2302 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682835:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3b5fc5 lrc: 3/0,0 mode: PR/PR res: [0x2b056:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afab0 expref: 2302 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682841:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3b5fc5 lrc: 0/0,0 mode: --/PR res: [0x2b056:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afab0 expref: 2301 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.682845:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682845:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.682846:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 3/0,1 mode: PW/PW res: [0x2b056:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682859:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 4/0,1 mode: PW/PW res: [0x2b056:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682881:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.682904:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2298:41279:x1731746395629696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.682907:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10384 00010000:00010000:0.0:1651529338.682918:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 3/0,1 mode: PW/PW res: [0x2b058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682921:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 3/0,1 mode: PW/PW res: [0x2b058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682925:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 3/0,1 mode: PW/PW res: [0x2b058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682927:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc752 lrc: 2/0,0 mode: PW/PW res: [0x2b058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.682965:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946306048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1692us (1784us total) trans 30064892285 rc 0/0 00000100:00100000:0.0:1651529338.682968:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151372 00010000:00010000:0.0:1651529338.682984:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 2/0,0 mode: PW/PW res: [0x2b056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682988:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086c708e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.682996:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 2/0,0 mode: PW/PW res: [0x2b056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.682999:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 3/0,0 mode: PW/PW res: [0x2b056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683004:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 1/0,0 mode: --/PW res: [0x2b056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683006:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc74b lrc: 0/0,0 mode: --/PW res: [0x2b056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.683191:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306176 00000100:00100000:0.0:1651529338.683199:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306240 00000100:00100000:0.0:1651529338.683202:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151373 00000100:00100000:0.0:1651529338.683204:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+920:39029:x1731745946306176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.683209:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176218 count 1 00010000:00010000:0.0:1651529338.683229:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,1 mode: --/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683234:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3b60a5 lrc: 2/0,0 mode: PR/PR res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afef4 expref: 2296 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683237:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683238:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683239:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 4/0,1 mode: --/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683246:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3b60a5 lrc: 3/0,0 mode: PR/PR res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afef4 expref: 2296 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683258:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3b60a5 lrc: 4/0,0 mode: PR/PR res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afef4 expref: 2296 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.683263:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966565376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.683291:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.683299:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151375 00000100:00100000:0.0:1651529338.683301:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+922:39029:x1731745946306112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.683306:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176217 count 1 00010000:00010000:0.0:1651529338.683310:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: --/PW res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683314:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 2/0,0 mode: PR/PR res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2296 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683317:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683318:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683318:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 4/0,1 mode: --/PW res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683325:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 3/0,0 mode: PR/PR res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2296 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683342:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 4/0,0 mode: PR/PR res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2296 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.683357:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966565504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.683366:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.683395:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306368 00000100:00100000:0.0:1651529338.683404:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151377 00000100:00100000:0.0:1651529338.683405:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+923:39030:x1731745946306368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.683410:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176221 count 1 00010000:00010000:0.0:1651529338.683414:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 3/0,1 mode: --/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683419:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3b43b7 lrc: 2/0,0 mode: PR/PR res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a87f4 expref: 2296 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683422:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683423:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683423:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 4/0,1 mode: --/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683430:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3b43b7 lrc: 3/0,0 mode: PR/PR res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a87f4 expref: 2296 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683433:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3b43b7 lrc: 4/0,0 mode: PR/PR res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a87f4 expref: 2296 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.683437:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966565632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.683459:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.683466:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306432 00000100:00100000:0.0:1651529338.683476:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306496 00000100:00100000:0.0:1651529338.683479:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306560 00000100:00100000:0.0:1651529338.683483:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151378 00000100:00100000:0.0:1651529338.683484:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+926:39029:x1731745946306432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.683489:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176222 count 1 00010000:00010000:0.0:1651529338.683493:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: --/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683497:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 2/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683500:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683501:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.683502:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 4/0,1 mode: --/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.683508:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 3/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.683511:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 4/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.683515:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966565696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.683528:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.684056:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966565376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.684077:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,1 mode: --/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684094:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966565504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.684097:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: --/PW res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684114:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966565696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.684117:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: --/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684123:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966565632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.684126:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 3/0,1 mode: --/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684132:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395629888 00010000:00010000:0.0:1651529338.684137:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3b38f8 lrc: 5/0,0 mode: PR/PR res: [0x2b05b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b46 expref: 2300 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.684145:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10387 00000100:00100000:0.0:1651529338.684146:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2300:41278:x1731746395630080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.684150:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.684151:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 4/0,0 mode: PR/PR res: [0x2b059:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2300 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684155:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 3/0,0 mode: PR/PR res: [0x2b059:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2300 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684161:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3b5282 lrc: 0/0,0 mode: --/PR res: [0x2b059:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac247 expref: 2300 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684165:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684165:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684166:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684169:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 4/0,1 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684183:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.684191:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2298:41278:x1731746395630080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.684194:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10387 00000100:00100000:0.0:1651529338.684242:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10389 00000100:00100000:0.0:1651529338.684244:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2295:41279:x1731746395629888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.684247:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.684249:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3b38f8 lrc: 5/0,0 mode: PR/PR res: [0x2b05b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b46 expref: 2295 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684253:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3b38f8 lrc: 4/0,0 mode: PR/PR res: [0x2b05b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5b46 expref: 2295 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684258:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684259:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684260:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 3/0,1 mode: PW/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684263:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 4/0,1 mode: PW/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684267:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.684273:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2294:41279:x1731746395629888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.684276:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10389 00010000:00010000:0.0:1651529338.684290:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc775 lrc: 2/0,0 mode: PW/PW res: [0x2b05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684294:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f389188 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684295:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc775 lrc: 2/0,0 mode: PW/PW res: [0x2b05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684298:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc775 lrc: 3/0,0 mode: PW/PW res: [0x2b05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684302:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc775 lrc: 1/0,0 mode: --/PW res: [0x2b05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684305:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc775 lrc: 0/0,0 mode: --/PW res: [0x2b05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684311:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684324:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684327:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,1 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684330:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 2/0,0 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684371:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+927:39029:x1731745946306112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1205us total) trans 30064892289 rc 0/0 00000100:00100000:0.0:1651529338.684375:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151375 00010000:00010000:0.0:1651529338.684382:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 2/0,0 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684385:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007eb0121f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684386:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 2/0,0 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684389:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 3/0,0 mode: PW/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684393:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 1/0,0 mode: --/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684396:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc76e lrc: 0/0,0 mode: --/PW res: [0x2b059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684408:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 2/0,0 mode: PW/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684411:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063c1deaa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684412:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 2/0,0 mode: PW/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684415:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 3/0,0 mode: PW/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684418:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 1/0,0 mode: --/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684420:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc767 lrc: 0/0,0 mode: --/PW res: [0x2b05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684426:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,1 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684429:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,1 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684432:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,1 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684434:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 2/0,0 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684483:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+927:39029:x1731745946306176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1278us (1343us total) trans 30064892291 rc 0/0 00000100:00100000:0.0:1651529338.684487:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151373 00010000:00010000:0.0:1651529338.684494:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 2/0,0 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684497:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bae50051 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684498:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 2/0,0 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684501:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 3/0,0 mode: PW/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684505:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 1/0,0 mode: --/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684508:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc760 lrc: 0/0,0 mode: --/PW res: [0x2b05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684515:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630208 00010000:00010000:0.0:1651529338.684519:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 4/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2293 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.684524:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630336 00010000:00010000:0.0:1651529338.684526:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3b3700 lrc: 5/0,0 mode: PR/PR res: [0x2b060:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a53f2 expref: 2294 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.684542:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630272 00010000:00010000:0.0:1651529338.684546:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3b4802 lrc: 4/0,0 mode: PR/PR res: [0x2b05f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98fd expref: 2296 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.684551:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10390 00000100:00100000:0.0:1651529338.684553:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2296:41278:x1731746395630208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.684555:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.684557:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 4/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684560:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 3/0,0 mode: PR/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684565:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3b57ec lrc: 0/0,0 mode: --/PR res: [0x2b05e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad763 expref: 2296 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684568:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684570:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684588:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 4/0,1 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684596:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.684604:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2295:41278:x1731746395630208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.684607:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10390 00000100:00100000:0.0:1651529338.684612:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10393 00000100:00100000:0.0:1651529338.684614:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2293:41279:x1731746395630272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.684617:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.684618:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3b4802 lrc: 4/0,0 mode: PR/PR res: [0x2b05f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98fd expref: 2293 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684622:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3b4802 lrc: 3/0,0 mode: PR/PR res: [0x2b05f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98fd expref: 2293 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684627:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3b4802 lrc: 0/0,0 mode: --/PR res: [0x2b05f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98fd expref: 2292 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.684631:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684631:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684632:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc78a lrc: 3/0,1 mode: PW/PW res: [0x2b05f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684635:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc78a lrc: 4/0,1 mode: PW/PW res: [0x2b05f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684662:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.684669:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2290:41279:x1731746395630272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.684672:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10393 00010000:00010000:0.0:1651529338.684679:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684683:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684686:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,1 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684688:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 2/0,0 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684751:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+927:39029:x1731745946306432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1266us (1322us total) trans 30064892293 rc 0/0 00000100:00100000:0.0:1651529338.684755:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151378 00010000:00010000:0.0:1651529338.684762:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 2/0,0 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684765:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d3b1de6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684766:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 2/0,0 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684769:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 3/0,0 mode: PW/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684774:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 1/0,0 mode: --/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684777:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc783 lrc: 0/0,0 mode: --/PW res: [0x2b05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684783:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 3/0,1 mode: PW/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684786:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 3/0,1 mode: PW/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684789:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 3/0,1 mode: PW/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684791:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc77c lrc: 2/0,0 mode: PW/PW res: [0x2b05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684847:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+928:39030:x1731745946306368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1440us (1474us total) trans 30064892294 rc 0/0 00000100:00100000:0.0:1651529338.684850:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151377 00010000:00010000:0.0:1651529338.684866:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc791 lrc: 2/0,0 mode: PW/PW res: [0x2b060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684869:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042e455a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.684870:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc791 lrc: 2/0,0 mode: PW/PW res: [0x2b060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684873:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc791 lrc: 3/0,0 mode: PW/PW res: [0x2b060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684878:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc791 lrc: 1/0,0 mode: --/PW res: [0x2b060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684881:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc791 lrc: 0/0,0 mode: --/PW res: [0x2b060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.684939:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306624 00000100:00100000:0.0:1651529338.684946:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306752 00000100:00100000:0.0:1651529338.684950:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306688 00000100:00100000:0.0:1651529338.684957:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151381 00000100:00100000:0.0:1651529338.684959:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946306624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.684969:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176225 count 1 00010000:00010000:0.0:1651529338.684974:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: --/PW res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684978:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 2/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2288 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.684982:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684982:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.684983:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 4/0,1 mode: --/PW res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.684989:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 3/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2288 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.684993:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 4/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2288 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.684997:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966565888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.685007:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.685013:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946306816 00000100:00100000:0.0:1651529338.685024:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151382 00000100:00100000:0.0:1651529338.685026:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+930:39030:x1731745946306752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.685031:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176227 count 1 00010000:00010000:0.0:1651529338.685035:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,1 mode: --/PW res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685039:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030fd2dc8/0xa29a79078f3b3c08 lrc: 2/0,0 mode: PR/PR res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6739 expref: 2288 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.685042:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685042:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685043:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 4/0,1 mode: --/PW res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685069:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030fd2dc8/0xa29a79078f3b3c08 lrc: 3/0,0 mode: PR/PR res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6739 expref: 2288 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.685073:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030fd2dc8/0xa29a79078f3b3c08 lrc: 4/0,0 mode: PR/PR res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6739 expref: 2288 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.685077:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966565952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.685091:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.685098:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151384 00000100:00100000:0.0:1651529338.685100:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+930:39029:x1731745946306816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.685104:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176228 count 1 00010000:00010000:0.0:1651529338.685108:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 3/0,1 mode: --/PW res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685113:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3b5028 lrc: 2/0,0 mode: PR/PR res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab876 expref: 2288 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.685116:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685117:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685117:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 4/0,1 mode: --/PW res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685123:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3b5028 lrc: 3/0,0 mode: PR/PR res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab876 expref: 2288 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.685127:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3b5028 lrc: 4/0,0 mode: PR/PR res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab876 expref: 2288 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.685130:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966566080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.685142:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.685490:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966565888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.685494:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: --/PW res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.685550:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966565952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.685554:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,1 mode: --/PW res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.685580:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630400 00010000:00010000:0.0:1651529338.685585:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 4/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2289 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.685595:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630464 00010000:00010000:0.0:1651529338.685599:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030fd2dc8/0xa29a79078f3b3c08 lrc: 4/0,0 mode: PR/PR res: [0x2b063:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6739 expref: 2291 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.685604:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10394 00000100:00100000:0.0:1651529338.685605:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2291:41279:x1731746395630400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.685608:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.685610:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 4/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2291 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.685613:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 3/0,0 mode: PR/PR res: [0x2b061:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2291 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.685619:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3b46c0 lrc: 0/0,0 mode: --/PR res: [0x2b061:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93c4 expref: 2291 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.685622:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685623:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.685624:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685627:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 4/0,1 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685634:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.685649:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2289:41279:x1731746395630400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.685665:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10394 00010000:00010000:0.0:1651529338.685678:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,1 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685681:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,1 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685684:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,1 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685687:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 2/0,0 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.685756:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+935:39030:x1731745946306752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 728us (827us total) trans 30064892296 rc 0/0 00000100:00100000:0.0:1651529338.685759:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151382 00010000:00010000:0.0:1651529338.685767:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 2/0,0 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685770:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017c4c435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.685771:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 2/0,0 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685777:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 3/0,0 mode: PW/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685781:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 1/0,0 mode: --/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685784:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc79f lrc: 0/0,0 mode: --/PW res: [0x2b063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685788:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc7a6 lrc: 2/0,0 mode: PW/PW res: [0x2b062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685791:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e2fdca5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.685792:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc7a6 lrc: 2/0,0 mode: PW/PW res: [0x2b062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685795:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc7a6 lrc: 3/0,0 mode: PW/PW res: [0x2b062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685798:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc7a6 lrc: 1/0,0 mode: --/PW res: [0x2b062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685800:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc7a6 lrc: 0/0,0 mode: --/PW res: [0x2b062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685824:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685827:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685830:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,1 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685833:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 2/0,0 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.685874:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+935:39030:x1731745946306624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 914us (961us total) trans 30064892298 rc 0/0 00000100:00100000:0.0:1651529338.685877:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151381 00010000:00010000:0.0:1651529338.685884:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 2/0,0 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685887:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edf74e92 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.685888:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 2/0,0 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685891:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 3/0,0 mode: PW/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685895:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 1/0,0 mode: --/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685898:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc798 lrc: 0/0,0 mode: --/PW res: [0x2b061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.685908:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966566080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.685912:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 3/0,1 mode: --/PW res: [0x2b064:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685968:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 3/0,1 mode: PW/PW res: [0x2b064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685972:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 3/0,1 mode: PW/PW res: [0x2b064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685975:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 3/0,1 mode: PW/PW res: [0x2b064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.685978:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc7ad lrc: 2/0,0 mode: PW/PW res: [0x2b064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.686038:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+935:39029:x1731745946306816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1083us total) trans 30064892299 rc 0/0 00000100:00100000:0.0:1651529338.686041:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151384 00000100:00100000:0.0:1651529338.686078:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307136 00000100:00100000:0.0:1651529338.686086:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151389 00000100:00100000:0.0:1651529338.686087:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+935:39030:x1731745946307136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.686113:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176233 count 1 00010000:00010000:0.0:1651529338.686117:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,1 mode: --/PW res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686133:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3b3a80 lrc: 2/0,0 mode: PR/PR res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6119 expref: 2284 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.686136:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686137:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686138:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 4/0,1 mode: --/PW res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686154:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3b3a80 lrc: 3/0,0 mode: PR/PR res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6119 expref: 2284 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.686158:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3b3a80 lrc: 4/0,0 mode: PR/PR res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6119 expref: 2284 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.686162:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966566464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.686172:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.686263:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307328 00000100:00100000:0.0:1651529338.686271:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151392 00000100:00100000:0.0:1651529338.686273:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+938:39030:x1731745946307328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.686278:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176236 count 1 00010000:00010000:0.0:1651529338.686282:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,1 mode: --/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686287:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3b517f lrc: 2/0,0 mode: PR/PR res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe03 expref: 2284 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.686301:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686302:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686303:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 4/0,1 mode: --/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686310:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3b517f lrc: 3/0,0 mode: PR/PR res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe03 expref: 2284 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.686314:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3b517f lrc: 4/0,0 mode: PR/PR res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe03 expref: 2284 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.686318:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966566592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.686337:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.686344:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630784 00010000:00010000:0.0:1651529338.686350:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b8a971/0xa29a79078f3b2dfa lrc: 5/0,0 mode: PR/PR res: [0x2b067:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3020 expref: 2286 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.686356:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395630848 00010000:00010000:0.0:1651529338.686358:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3b2e39 lrc: 5/0,0 mode: PR/PR res: [0x2b068:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3177 expref: 2288 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.686363:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10399 00000100:00100000:0.0:1651529338.686365:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2288:41279:x1731746395630784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.686367:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.686369:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8b8a971/0xa29a79078f3b2dfa lrc: 5/0,0 mode: PR/PR res: [0x2b067:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3020 expref: 2288 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.686380:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8b8a971/0xa29a79078f3b2dfa lrc: 4/0,0 mode: PR/PR res: [0x2b067:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3020 expref: 2288 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.686386:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686386:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686387:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc7c2 lrc: 3/0,1 mode: PW/PW res: [0x2b067:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686390:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc7c2 lrc: 4/0,1 mode: PW/PW res: [0x2b067:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686395:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.686402:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2287:41279:x1731746395630784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.686405:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10399 00000100:00100000:0.0:1651529338.686410:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10401 00000100:00100000:0.0:1651529338.686411:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2286:41279:x1731746395630848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.686414:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.686415:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3b2e39 lrc: 5/0,0 mode: PR/PR res: [0x2b068:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3177 expref: 2286 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.686419:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3b2e39 lrc: 4/0,0 mode: PR/PR res: [0x2b068:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3177 expref: 2286 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.686424:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686424:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.686431:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 3/0,1 mode: PW/PW res: [0x2b068:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686434:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 4/0,1 mode: PW/PW res: [0x2b068:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686439:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.686445:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2284:41279:x1731746395630848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.686447:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10401 00010000:00010000:0.0:1651529338.686463:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc7b4 lrc: 2/0,0 mode: PW/PW res: [0x2b065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686467:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d51c759 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.686468:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc7b4 lrc: 2/0,0 mode: PW/PW res: [0x2b065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686470:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc7b4 lrc: 3/0,0 mode: PW/PW res: [0x2b065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686475:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc7b4 lrc: 1/0,0 mode: --/PW res: [0x2b065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686477:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc7b4 lrc: 0/0,0 mode: --/PW res: [0x2b065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686551:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc7bb lrc: 2/0,0 mode: PW/PW res: [0x2b066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686563:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ff0eeeb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.686564:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc7bb lrc: 2/0,0 mode: PW/PW res: [0x2b066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686567:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc7bb lrc: 3/0,0 mode: PW/PW res: [0x2b066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686571:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc7bb lrc: 1/0,0 mode: --/PW res: [0x2b066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686573:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc7bb lrc: 0/0,0 mode: --/PW res: [0x2b066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686722:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 2/0,0 mode: PW/PW res: [0x2b068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686726:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c6323f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.686735:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 2/0,0 mode: PW/PW res: [0x2b068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686739:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 3/0,0 mode: PW/PW res: [0x2b068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686743:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 1/0,0 mode: --/PW res: [0x2b068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.686753:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc7c9 lrc: 0/0,0 mode: --/PW res: [0x2b068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.686980:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307392 00000100:00100000:0.0:1651529338.686991:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151393 00000100:00100000:0.0:1651529338.686993:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946307392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.686998:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176237 count 1 00010000:00010000:0.0:1651529338.687016:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: --/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687021:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 2/0,0 mode: PR/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2280 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.687024:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687024:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687025:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 4/0,1 mode: --/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687032:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 3/0,0 mode: PR/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2280 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.687036:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 4/0,0 mode: PR/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2280 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.687040:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966566656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.687057:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.687130:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151395 00000100:00100000:0.0:1651529338.687132:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+942:39029:x1731745946307456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.687138:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176238 count 1 00010000:00010000:0.0:1651529338.687142:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,1 mode: --/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687147:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3b4a2b lrc: 2/0,0 mode: PR/PR res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa17e expref: 2280 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.687150:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687150:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687151:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 4/0,1 mode: --/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687158:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3b4a2b lrc: 3/0,0 mode: PR/PR res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa17e expref: 2280 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.687161:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3b4a2b lrc: 4/0,0 mode: PR/PR res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa17e expref: 2280 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.687166:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966566784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.687183:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.687311:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966566464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.687316:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,1 mode: --/PW res: [0x2b069:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.687678:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966566592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.687689:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,1 mode: --/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.687698:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966566784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.687701:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,1 mode: --/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.687708:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966566656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.687711:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: --/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.687885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.687940:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631104 00010000:00010000:0.0:1651529338.687946:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3b517f lrc: 4/0,0 mode: PR/PR res: [0x2b06c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe03 expref: 2287 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.687953:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10402 00000100:00100000:0.0:1651529338.687955:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2288:41279:x1731746395630912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.687958:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.687967:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3b3aa3 lrc: 4/0,0 mode: PR/PR res: [0x2b06b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61a5 expref: 2288 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.687971:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3b3aa3 lrc: 3/0,0 mode: PR/PR res: [0x2b06b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61a5 expref: 2288 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.687977:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3b3aa3 lrc: 0/0,0 mode: --/PR res: [0x2b06b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61a5 expref: 2287 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.687981:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687982:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.687983:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 3/0,1 mode: PW/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687986:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 4/0,1 mode: PW/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.687995:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.688003:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2286:41279:x1731746395630912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.688006:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10402 00000100:00100000:0.0:1651529338.688011:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10404 00000100:00100000:0.0:1651529338.688013:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2284:41279:x1731746395631168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.688016:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.688017:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 4/0,0 mode: PR/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2284 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688031:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 3/0,0 mode: PR/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2284 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688036:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3b3ff1 lrc: 0/0,0 mode: --/PR res: [0x2b06d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7770 expref: 2283 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688040:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688040:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688041:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688051:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 4/0,1 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688057:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.688063:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2281:41279:x1731746395631168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.688066:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10404 00000100:00100000:0.0:1651529338.688071:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10407 00000100:00100000:0.0:1651529338.688073:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2280:41279:x1731746395631232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.688076:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.688077:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3b2fa5 lrc: 4/0,0 mode: PR/PR res: [0x2b06f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36b0 expref: 2279 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688081:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3b2fa5 lrc: 3/0,0 mode: PR/PR res: [0x2b06f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36b0 expref: 2279 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688097:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3b2fa5 lrc: 0/0,0 mode: --/PR res: [0x2b06f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36b0 expref: 2279 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688102:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 3/0,1 mode: PW/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688105:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 4/0,1 mode: PW/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688114:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.688120:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2277:41279:x1731746395631232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.688124:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10407 00000100:00100000:0.0:1651529338.688128:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10409 00000100:00100000:0.0:1651529338.688130:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2275:41279:x1731746395631360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.688133:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.688134:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3b3cda lrc: 4/0,0 mode: PR/PR res: [0x2b070:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a8f expref: 2275 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688145:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3b3cda lrc: 3/0,0 mode: PR/PR res: [0x2b070:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a8f expref: 2275 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688150:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3b3cda lrc: 0/0,0 mode: --/PR res: [0x2b070:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a8f expref: 2274 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.688163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688164:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688164:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bc801 lrc: 3/0,1 mode: PW/PW res: [0x2b070:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688167:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bc801 lrc: 4/0,1 mode: PW/PW res: [0x2b070:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688175:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.688181:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2273:41279:x1731746395631360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.688184:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10409 00010000:00010000:0.0:1651529338.688196:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 2/0,0 mode: PW/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688200:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000245df374 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688201:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 2/0,0 mode: PW/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688204:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 3/0,0 mode: PW/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688208:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 1/0,0 mode: --/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688211:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc7d7 lrc: 0/0,0 mode: --/PW res: [0x2b06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688231:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,1 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688234:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,1 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688237:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,1 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688240:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 2/0,0 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.688292:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+944:39029:x1731745946307456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1158us (1194us total) trans 30064892305 rc 0/0 00000100:00100000:0.0:1651529338.688295:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151395 00010000:00010000:0.0:1651529338.688302:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 2/0,0 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688306:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065480de5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688307:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 2/0,0 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688309:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 3/0,0 mode: PW/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688314:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 1/0,0 mode: --/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688327:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bc7fa lrc: 0/0,0 mode: --/PW res: [0x2b06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688334:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,1 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688336:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,1 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688340:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,1 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688342:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 2/0,0 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.688384:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+944:39030:x1731745946307136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2296us (2330us total) trans 30064892307 rc 0/0 00000100:00100000:0.0:1651529338.688387:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151389 00010000:00010000:0.0:1651529338.688395:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 2/0,0 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688398:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1872a21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688399:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 2/0,0 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688402:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 3/0,0 mode: PW/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688415:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 1/0,0 mode: --/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688418:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bc7d0 lrc: 0/0,0 mode: --/PW res: [0x2b069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688422:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc7de lrc: 2/0,0 mode: PW/PW res: [0x2b06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688425:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc76f821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688426:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc7de lrc: 2/0,0 mode: PW/PW res: [0x2b06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688429:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc7de lrc: 3/0,0 mode: PW/PW res: [0x2b06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688432:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc7de lrc: 1/0,0 mode: --/PW res: [0x2b06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688434:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc7de lrc: 0/0,0 mode: --/PW res: [0x2b06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688438:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 2/0,0 mode: PW/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688440:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000373fc508 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688446:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 2/0,0 mode: PW/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688449:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 3/0,0 mode: PW/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688452:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 1/0,0 mode: --/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688455:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc7f3 lrc: 0/0,0 mode: --/PW res: [0x2b06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688462:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,1 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688464:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,1 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688467:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,1 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688470:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 2/0,0 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.688508:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+943:39030:x1731745946307328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2234us (2256us total) trans 30064892310 rc 0/0 00000100:00100000:0.0:1651529338.688511:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151392 00010000:00010000:0.0:1651529338.688518:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688529:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688532:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,1 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688535:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 2/0,0 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.688570:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+943:39030:x1731745946307392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1576us (1601us total) trans 30064892311 rc 0/0 00000100:00100000:0.0:1651529338.688573:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151393 00010000:00010000:0.0:1651529338.688579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 2/0,0 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688582:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7509585 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688583:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 2/0,0 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688586:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 3/0,0 mode: PW/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688591:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 1/0,0 mode: --/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688593:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bc7e5 lrc: 0/0,0 mode: --/PW res: [0x2b06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688598:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 2/0,0 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688618:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6741c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.688619:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 2/0,0 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688622:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 3/0,0 mode: PW/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688625:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 1/0,0 mode: --/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688628:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bc7ec lrc: 0/0,0 mode: --/PW res: [0x2b06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.688665:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.688674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.688681:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307648 00000100:00100000:0.0:1651529338.688690:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307712 00000100:00100000:0.0:1651529338.688700:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151398 00000100:00100000:0.0:1651529338.688702:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+944:39030:x1731745946307712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.688707:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176242 count 1 00010000:00010000:0.0:1651529338.688712:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: --/PW res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688717:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 2/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2272 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688720:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688721:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688721:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 4/0,1 mode: --/PW res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688738:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 3/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2272 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688743:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 4/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2272 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.688747:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966566912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.688824:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.688866:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307776 00000100:00100000:0.0:1651529338.688873:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307840 00000100:00100000:0.0:1651529338.688888:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946307904 00000100:00100000:0.0:1651529338.688896:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151399 00000100:00100000:0.0:1651529338.688897:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946307776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.688903:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176243 count 1 00010000:00010000:0.0:1651529338.688907:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: --/PW res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688912:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 2/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2272 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688915:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688923:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688924:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 4/0,1 mode: --/PW res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688931:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 3/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2272 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688935:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 4/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2272 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.688939:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966567040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.688950:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.688956:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151401 00000100:00100000:0.0:1651529338.688958:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+950:39030:x1731745946307904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.688963:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176245 count 1 00010000:00010000:0.0:1651529338.688967:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 3/0,1 mode: --/PW res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688971:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3b3674 lrc: 2/0,0 mode: PR/PR res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50f7 expref: 2272 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688974:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688975:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.688975:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 4/0,1 mode: --/PW res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.688981:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3b3674 lrc: 3/0,0 mode: PR/PR res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50f7 expref: 2272 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.688995:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3b3674 lrc: 4/0,0 mode: PR/PR res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50f7 expref: 2272 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.688999:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966567168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.689007:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.689013:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151403 00000100:00100000:0.0:1651529338.689015:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+950:39030:x1731745946308032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.689019:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176247 count 1 00010000:00010000:0.0:1651529338.689023:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,1 mode: --/PW res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689027:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3b2fac lrc: 2/0,0 mode: PR/PR res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36da expref: 2272 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.689030:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.689031:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.689031:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 4/0,1 mode: --/PW res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689037:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3b2fac lrc: 3/0,0 mode: PR/PR res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36da expref: 2272 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.689041:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3b2fac lrc: 4/0,0 mode: PR/PR res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36da expref: 2272 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.689055:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966567296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.689062:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.689886:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966566912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.689891:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: --/PW res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.689899:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631424 00010000:00010000:0.0:1651529338.689904:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 4/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2273 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.689917:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10410 00000100:00100000:0.0:1651529338.689919:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2273:41278:x1731746395631424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.689923:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.689924:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 4/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2273 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.689928:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 3/0,0 mode: PR/PR res: [0x2b072:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2273 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.689933:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3b3b13 lrc: 0/0,0 mode: --/PR res: [0x2b072:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6373 expref: 2273 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.689937:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.689938:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.689946:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689949:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 4/0,1 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689957:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.689966:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2272:41278:x1731746395631424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.689969:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10410 00010000:00010000:0.0:1651529338.689975:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689979:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689982:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,1 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.689984:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 2/0,0 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690031:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946307712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1328us (1356us total) trans 30064892312 rc 0/0 00000100:00100000:0.0:1651529338.690034:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151398 00010000:00010000:0.0:1651529338.690042:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 2/0,0 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690054:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d3b1de6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.690055:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 2/0,0 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690058:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 3/0,0 mode: PW/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690063:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 1/0,0 mode: --/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690066:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bc808 lrc: 0/0,0 mode: --/PW res: [0x2b072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.690278:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308160 00000100:00100000:0.0:1651529338.690298:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151405 00000100:00100000:0.0:1651529338.690300:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946308160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.690305:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176249 count 1 00010000:00010000:0.0:1651529338.690310:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 3/0,1 mode: --/PW res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690322:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3b582b lrc: 2/0,0 mode: PR/PR res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad827 expref: 2271 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.690325:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690325:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690335:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 4/0,1 mode: --/PW res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690347:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3b582b lrc: 3/0,0 mode: PR/PR res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad827 expref: 2271 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.690351:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3b582b lrc: 4/0,0 mode: PR/PR res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad827 expref: 2271 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690356:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966567424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.690367:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.690375:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966567168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.690378:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 3/0,1 mode: --/PW res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690386:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966567296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.690388:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,1 mode: --/PW res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690395:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966567040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.690397:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: --/PW res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690478:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631488 00010000:00010000:0.0:1651529338.690484:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba40a04e/0xa29a79078f3b443c lrc: 4/0,0 mode: PR/PR res: [0x2b071:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8983 expref: 2272 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690501:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631616 00010000:00010000:0.0:1651529338.690504:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3b2cb1 lrc: 4/0,0 mode: PR/PR res: [0x2b074:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2b49 expref: 2273 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690508:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631744 00010000:00010000:0.0:1651529338.690510:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3b2c95 lrc: 4/0,0 mode: PR/PR res: [0x2b076:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2abd expref: 2274 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690514:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631552 00010000:00010000:0.0:1651529338.690516:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 4/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2276 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690520:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631680 00010000:00010000:0.0:1651529338.690522:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3b3674 lrc: 4/0,0 mode: PR/PR res: [0x2b075:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50f7 expref: 2277 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690526:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395631808 00010000:00010000:0.0:1651529338.690528:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3b2fac lrc: 4/0,0 mode: PR/PR res: [0x2b077:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36da expref: 2278 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.690532:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10412 00000100:00100000:0.0:1651529338.690534:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2278:41278:x1731746395631616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.690537:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.690538:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3b2cb1 lrc: 4/0,0 mode: PR/PR res: [0x2b074:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2b49 expref: 2278 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690544:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3b2cb1 lrc: 3/0,0 mode: PR/PR res: [0x2b074:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2b49 expref: 2278 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690551:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3b2cb1 lrc: 0/0,0 mode: --/PR res: [0x2b074:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2b49 expref: 2277 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690554:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690555:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690556:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 3/0,1 mode: PW/PW res: [0x2b074:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690559:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 4/0,1 mode: PW/PW res: [0x2b074:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690568:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.690581:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2276:41278:x1731746395631616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.690584:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10412 00000100:00100000:0.0:1651529338.690608:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10414 00000100:00100000:0.0:1651529338.690610:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2274:41278:x1731746395631552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.690613:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.690615:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 4/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2274 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690619:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 3/0,0 mode: PR/PR res: [0x2b073:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2273 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690624:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590a887c/0xa29a79078f3b5a9a lrc: 0/0,0 mode: --/PR res: [0x2b073:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae165 expref: 2273 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690627:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690628:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690629:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690632:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 4/0,1 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690638:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.690645:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2271:41278:x1731746395631552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.690648:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10414 00000100:00100000:0.0:1651529338.690652:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10416 00000100:00100000:0.0:1651529338.690654:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2270:41278:x1731746395631872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.690657:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.690658:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3b4420 lrc: 4/0,0 mode: PR/PR res: [0x2b078:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a893d expref: 2270 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690662:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3b4420 lrc: 3/0,0 mode: PR/PR res: [0x2b078:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a893d expref: 2270 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690666:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3b4420 lrc: 0/0,0 mode: --/PR res: [0x2b078:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a893d expref: 2270 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.690691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.690692:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c11d3540/0xa29a79078f3bc839 lrc: 3/0,1 mode: PW/PW res: [0x2b078:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690695:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c11d3540/0xa29a79078f3bc839 lrc: 4/0,1 mode: PW/PW res: [0x2b078:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690704:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.690711:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2267:41278:x1731746395631872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.690714:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10416 00010000:00010000:0.0:1651529338.690725:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 3/0,1 mode: PW/PW res: [0x2b075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690737:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 3/0,1 mode: PW/PW res: [0x2b075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690740:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 3/0,1 mode: PW/PW res: [0x2b075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690743:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0121f/0xa29a79078f3bc824 lrc: 2/0,0 mode: PW/PW res: [0x2b075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690793:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+952:39030:x1731745946307904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1834us (1918us total) trans 30064892313 rc 0/0 00000100:00100000:0.0:1651529338.690797:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151401 00010000:00010000:0.0:1651529338.690820:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,1 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690824:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,1 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690827:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,1 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690834:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 2/0,0 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.690871:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+953:39030:x1731745946308032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1855us (1966us total) trans 30064892315 rc 0/0 00000100:00100000:0.0:1651529338.690874:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151403 00010000:00010000:0.0:1651529338.690884:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 2/0,0 mode: PW/PW res: [0x2b074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690888:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050b6d714 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.690889:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 2/0,0 mode: PW/PW res: [0x2b074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690892:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 3/0,0 mode: PW/PW res: [0x2b074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690897:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 1/0,0 mode: --/PW res: [0x2b074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690911:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bc81d lrc: 0/0,0 mode: --/PW res: [0x2b074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690916:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 2/0,0 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690919:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065a11f8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.690920:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 2/0,0 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690923:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 3/0,0 mode: PW/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690926:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 1/0,0 mode: --/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690929:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a11f8a/0xa29a79078f3bc832 lrc: 0/0,0 mode: --/PW res: [0x2b077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690932:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3bc82b lrc: 2/0,0 mode: PW/PW res: [0x2b076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690935:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c6c667 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.690936:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3bc82b lrc: 2/0,0 mode: PW/PW res: [0x2b076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690945:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3bc82b lrc: 3/0,0 mode: PW/PW res: [0x2b076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690949:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3bc82b lrc: 1/0,0 mode: --/PW res: [0x2b076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690951:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c6c667/0xa29a79078f3bc82b lrc: 0/0,0 mode: --/PW res: [0x2b076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690958:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690961:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690964:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,1 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.690967:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 2/0,0 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.691005:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+952:39030:x1731745946307776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2107us (2154us total) trans 30064892318 rc 0/0 00000100:00100000:0.0:1651529338.691008:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151399 00010000:00010000:0.0:1651529338.691016:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 2/0,0 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691028:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bae50051 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.691030:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 2/0,0 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691033:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 3/0,0 mode: PW/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691037:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 1/0,0 mode: --/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691046:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae50051/0xa29a79078f3bc816 lrc: 0/0,0 mode: --/PW res: [0x2b073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691051:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bc80f lrc: 2/0,0 mode: PW/PW res: [0x2b071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691054:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d1f444b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.691054:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bc80f lrc: 2/0,0 mode: PW/PW res: [0x2b071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691057:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bc80f lrc: 3/0,0 mode: PW/PW res: [0x2b071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691060:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bc80f lrc: 1/0,0 mode: --/PW res: [0x2b071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691071:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bc80f lrc: 0/0,0 mode: --/PW res: [0x2b071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.691115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.691159:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966567424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.691163:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 3/0,1 mode: --/PW res: [0x2b079:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691233:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 3/0,1 mode: PW/PW res: [0x2b079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691237:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 3/0,1 mode: PW/PW res: [0x2b079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691240:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 3/0,1 mode: PW/PW res: [0x2b079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691243:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc840 lrc: 2/0,0 mode: PW/PW res: [0x2b079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.691289:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+952:39029:x1731745946308160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 989us (1040us total) trans 30064892320 rc 0/0 00000100:00100000:0.0:1651529338.691293:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151405 00000100:00100000:0.0:1651529338.691378:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308224 00000100:00100000:0.0:1651529338.691400:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308288 00000100:00100000:0.0:1651529338.691415:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308352 00000100:00100000:0.0:1651529338.691430:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308416 00000100:00100000:0.0:1651529338.691441:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308480 00000100:00100000:0.0:1651529338.691445:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308544 00000100:00100000:0.0:1651529338.691449:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151406 00000100:00100000:0.0:1651529338.691451:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+958:39029:x1731745946308224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.691456:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176250 count 1 00010000:00010000:0.0:1651529338.691461:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,1 mode: --/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691466:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3b3b60 lrc: 2/0,0 mode: PR/PR res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64a0 expref: 2263 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691469:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691470:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691471:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 4/0,1 mode: --/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691478:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3b3b60 lrc: 3/0,0 mode: PR/PR res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64a0 expref: 2263 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691507:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3b3b60 lrc: 4/0,0 mode: PR/PR res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64a0 expref: 2263 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.691512:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966567488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.691522:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.691529:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151409 00000100:00100000:0.0:1651529338.691531:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+958:39030:x1731745946308416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.691536:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176253 count 1 00010000:00010000:0.0:1651529338.691539:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,1 mode: --/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691544:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3b617e lrc: 2/0,0 mode: PR/PR res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b031c expref: 2263 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691547:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691548:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691548:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 4/0,1 mode: --/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691555:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3b617e lrc: 3/0,0 mode: PR/PR res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b031c expref: 2263 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691558:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3b617e lrc: 4/0,0 mode: PR/PR res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b031c expref: 2263 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.691562:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966567616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.691569:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.691576:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151410 00000100:00100000:0.0:1651529338.691577:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+958:39029:x1731745946308480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.691582:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176254 count 1 00010000:00010000:0.0:1651529338.691585:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: --/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691589:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 2/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691595:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691595:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691596:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 4/0,1 mode: --/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691602:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 3/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691605:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 4/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.691609:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966567744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.691615:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.691621:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151412 00000100:00100000:0.0:1651529338.691623:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+958:39029:x1731745946308608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.691627:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176256 count 1 00010000:00010000:0.0:1651529338.691630:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 3/0,1 mode: --/PW res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691634:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057c4b2f5/0xa29a79078f3b49fa lrc: 2/0,0 mode: PR/PR res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa0cf expref: 2263 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691637:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691637:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.691638:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 4/0,1 mode: --/PW res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.691646:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057c4b2f5/0xa29a79078f3b49fa lrc: 3/0,0 mode: PR/PR res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa0cf expref: 2263 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.691650:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057c4b2f5/0xa29a79078f3b49fa lrc: 4/0,0 mode: PR/PR res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa0cf expref: 2263 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.691653:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966567872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.691659:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.692289:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966567488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.692293:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,1 mode: --/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692317:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966567744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.692321:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: --/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692327:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966567616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.692340:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,1 mode: --/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692354:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632064 00010000:00010000:0.0:1651529338.692360:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3b3b60 lrc: 4/0,0 mode: PR/PR res: [0x2b07a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64a0 expref: 2264 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.692377:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632320 00010000:00010000:0.0:1651529338.692381:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3b59f2 lrc: 5/0,0 mode: PR/PR res: [0x2b07f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adef6 expref: 2267 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.692385:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632256 00010000:00010000:0.0:1651529338.692387:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 4/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2269 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.692394:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10420 00000100:00100000:0.0:1651529338.692396:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2269:41279:x1731746395632192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.692399:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.692400:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051ebf04a/0xa29a79078f3b393e lrc: 5/0,0 mode: PR/PR res: [0x2b07c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c65 expref: 2269 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692404:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051ebf04a/0xa29a79078f3b393e lrc: 4/0,0 mode: PR/PR res: [0x2b07c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c65 expref: 2269 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692410:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692411:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692412:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 3/0,1 mode: PW/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692415:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 4/0,1 mode: PW/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692420:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.692442:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2268:41279:x1731746395632192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.692447:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10420 00000100:00100000:0.0:1651529338.692453:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10422 00000100:00100000:0.0:1651529338.692454:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2266:41279:x1731746395632320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.692457:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.692459:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3b59f2 lrc: 5/0,0 mode: PR/PR res: [0x2b07f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adef6 expref: 2266 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692463:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3b59f2 lrc: 4/0,0 mode: PR/PR res: [0x2b07f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adef6 expref: 2266 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692468:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692468:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692469:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8b8a971/0xa29a79078f3bc86a lrc: 3/0,1 mode: PW/PW res: [0x2b07f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692472:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b8a971/0xa29a79078f3bc86a lrc: 4/0,1 mode: PW/PW res: [0x2b07f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692476:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.692482:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2265:41279:x1731746395632320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.692484:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10422 00000100:00100000:0.0:1651529338.692492:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10424 00000100:00100000:0.0:1651529338.692494:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2264:41279:x1731746395632256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.692497:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.692533:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 4/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692537:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 3/0,0 mode: PR/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692543:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3b371c lrc: 0/0,0 mode: --/PR res: [0x2b07e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a545b expref: 2263 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692547:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692547:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692548:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692551:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 4/0,1 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692557:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.692564:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2260:41279:x1731746395632256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.692567:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10424 00010000:00010000:0.0:1651529338.692574:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692577:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692580:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,1 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692594:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 2/0,0 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692637:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946308480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1235us total) trans 30064892322 rc 0/0 00000100:00100000:0.0:1651529338.692640:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151410 00010000:00010000:0.0:1651529338.692648:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc84e lrc: 2/0,0 mode: PW/PW res: [0x2b07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692651:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017c4c435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.692652:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc84e lrc: 2/0,0 mode: PW/PW res: [0x2b07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692655:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc84e lrc: 3/0,0 mode: PW/PW res: [0x2b07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692660:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc84e lrc: 1/0,0 mode: --/PW res: [0x2b07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692663:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c4c435/0xa29a79078f3bc84e lrc: 0/0,0 mode: --/PW res: [0x2b07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692667:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 2/0,0 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692670:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ff0eeeb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.692680:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 2/0,0 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692683:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 3/0,0 mode: PW/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692687:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 1/0,0 mode: --/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692689:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc863 lrc: 0/0,0 mode: --/PW res: [0x2b07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692693:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 2/0,0 mode: PW/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692696:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bed4ee65 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.692697:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 2/0,0 mode: PW/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692699:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 3/0,0 mode: PW/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692702:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 1/0,0 mode: --/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692705:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bed4ee65/0xa29a79078f3bc855 lrc: 0/0,0 mode: --/PW res: [0x2b07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692718:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,1 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692721:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,1 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692724:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,1 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692734:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 2/0,0 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692777:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946308416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1245us (1382us total) trans 30064892325 rc 0/0 00000100:00100000:0.0:1651529338.692780:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151409 00010000:00010000:0.0:1651529338.692788:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 2/0,0 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692791:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c6323f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.692792:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 2/0,0 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692795:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 3/0,0 mode: PW/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692799:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 1/0,0 mode: --/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692825:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc85c lrc: 0/0,0 mode: --/PW res: [0x2b07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692838:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,1 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692841:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,1 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692845:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,1 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692847:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 2/0,0 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692891:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946308224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1439us (1539us total) trans 30064892326 rc 0/0 00000100:00100000:0.0:1651529338.692894:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151406 00010000:00010000:0.0:1651529338.692900:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 2/0,0 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692904:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f6de1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.692905:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 2/0,0 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692907:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 3/0,0 mode: PW/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692920:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 1/0,0 mode: --/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692923:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f6de1/0xa29a79078f3bc847 lrc: 0/0,0 mode: --/PW res: [0x2b07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.692931:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632448 00010000:00010000:0.0:1651529338.692936:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3b5568 lrc: 5/0,0 mode: PR/PR res: [0x2b081:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd6f expref: 2258 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.692946:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632384 00010000:00010000:0.0:1651529338.692949:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057c4b2f5/0xa29a79078f3b49fa lrc: 5/0,0 mode: PR/PR res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa0cf expref: 2259 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.692956:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10425 00000100:00100000:0.0:1651529338.692958:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2259:41279:x1731746395632448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.692961:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.692962:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3b5568 lrc: 5/0,0 mode: PR/PR res: [0x2b081:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd6f expref: 2259 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692966:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3b5568 lrc: 4/0,0 mode: PR/PR res: [0x2b081:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd6f expref: 2259 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.692971:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692971:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.692972:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bc878 lrc: 3/0,1 mode: PW/PW res: [0x2b081:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.692996:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bc878 lrc: 4/0,1 mode: PW/PW res: [0x2b081:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693011:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.693027:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2257:41279:x1731746395632448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.693030:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10425 00010000:00010000:0.0:1651529338.693042:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c4b2f5/0xa29a79078f3b49fa lrc: 0/0,0 mode: --/PR res: [0x2b080:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa0cf expref: 2256 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.693046:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966567872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.693050:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 3/0,1 mode: PW/PW res: [0x2b080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693053:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 3/0,1 mode: PW/PW res: [0x2b080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693056:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 3/0,1 mode: PW/PW res: [0x2b080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693059:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 3/0,1 mode: PW/PW res: [0x2b080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693062:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc871 lrc: 2/0,0 mode: PW/PW res: [0x2b080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.693127:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946308608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1503us (1694us total) trans 30064892328 rc 0/0 00000100:00100000:0.0:1651529338.693130:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151412 00000100:00100000:0.0:1651529338.693182:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946308736 00000100:00100000:0.0:1651529338.693193:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151414 00000100:00100000:0.0:1651529338.693195:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946308736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.693200:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176258 count 1 00010000:00010000:0.0:1651529338.693222:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,1 mode: --/PW res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693228:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3b33bf lrc: 2/0,0 mode: PR/PR res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4773 expref: 2255 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693231:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693231:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693232:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 4/0,1 mode: --/PW res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693239:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3b33bf lrc: 3/0,0 mode: PR/PR res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4773 expref: 2255 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693255:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3b33bf lrc: 4/0,0 mode: PR/PR res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4773 expref: 2255 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.693260:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.693286:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.693309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693383:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693394:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.693401:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309056 00000100:00100000:0.0:1651529338.693406:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309120 00000100:00100000:0.0:1651529338.693409:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309184 00000100:00100000:0.0:1651529338.693412:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151416 00000100:00100000:0.0:1651529338.693413:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+967:39030:x1731745946308864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.693418:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176260 count 1 00010000:00010000:0.0:1651529338.693423:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,1 mode: --/PW res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693427:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3b4332 lrc: 2/0,0 mode: PR/PR res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85d9 expref: 2255 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693430:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693431:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693432:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 4/0,1 mode: --/PW res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693438:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3b4332 lrc: 3/0,0 mode: PR/PR res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85d9 expref: 2255 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693442:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3b4332 lrc: 4/0,0 mode: PR/PR res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85d9 expref: 2255 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.693455:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966568128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.693464:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.693471:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151418 00000100:00100000:0.0:1651529338.693472:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+967:39030:x1731745946308992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.693477:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176262 count 1 00010000:00010000:0.0:1651529338.693480:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,1 mode: --/PW res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693500:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c9adfc3/0xa29a79078f3b34e5 lrc: 2/0,0 mode: PR/PR res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4ae5 expref: 2255 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693504:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693505:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693505:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 4/0,1 mode: --/PW res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693513:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c9adfc3/0xa29a79078f3b34e5 lrc: 3/0,0 mode: PR/PR res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4ae5 expref: 2255 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693516:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c9adfc3/0xa29a79078f3b34e5 lrc: 4/0,0 mode: PR/PR res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4ae5 expref: 2255 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.693521:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966568320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.693528:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.693534:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151421 00000100:00100000:0.0:1651529338.693536:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+967:39030:x1731745946309184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.693541:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176265 count 1 00010000:00010000:0.0:1651529338.693544:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: --/PW res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693549:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 2/0,0 mode: PR/PR res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2255 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693552:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693552:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.693553:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 4/0,1 mode: --/PW res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693559:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 3/0,0 mode: PR/PR res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2255 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.693562:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 4/0,0 mode: PR/PR res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2255 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.693566:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966568448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.693572:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.693644:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.693648:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,1 mode: --/PW res: [0x2b082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693710:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,1 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693721:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,1 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693724:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,1 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693735:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 2/0,0 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.693788:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+968:39030:x1731745946308736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 592us (622us total) trans 30064892329 rc 0/0 00000100:00100000:0.0:1651529338.693791:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151414 00010000:00010000:0.0:1651529338.693799:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 2/0,0 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693817:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000373fc508 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.693818:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 2/0,0 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693821:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 3/0,0 mode: PW/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693826:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 1/0,0 mode: --/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.693829:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc87f lrc: 0/0,0 mode: --/PW res: [0x2b082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.694021:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309248 00000100:00100000:0.0:1651529338.694034:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151422 00000100:00100000:0.0:1651529338.694036:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+968:39030:x1731745946309248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.694041:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176266 count 1 00010000:00010000:0.0:1651529338.694046:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: --/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694050:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 2/0,0 mode: PR/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2254 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.694053:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694054:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694055:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 4/0,1 mode: --/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694062:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 3/0,0 mode: PR/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2254 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.694065:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 4/0,0 mode: PR/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2254 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.694069:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.694083:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.694200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694238:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966568128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.694242:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,1 mode: --/PW res: [0x2b084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694249:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395632576 00010000:00010000:0.0:1651529338.694254:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3b3444 lrc: 4/0,0 mode: PR/PR res: [0x2b083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4902 expref: 2258 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.694261:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10429 00000100:00100000:0.0:1651529338.694263:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2258:41278:x1731746395632768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.694266:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.694268:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3b38b2 lrc: 4/0,0 mode: PR/PR res: [0x2b087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a82 expref: 2258 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694271:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3b38b2 lrc: 3/0,0 mode: PR/PR res: [0x2b087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a82 expref: 2258 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694277:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3b38b2 lrc: 0/0,0 mode: --/PR res: [0x2b087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a82 expref: 2257 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694281:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694281:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694282:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 3/0,1 mode: PW/PW res: [0x2b087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694288:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 4/0,1 mode: PW/PW res: [0x2b087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694304:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.694311:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2256:41278:x1731746395632768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.694315:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10429 00000100:00100000:0.0:1651529338.694324:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10431 00000100:00100000:0.0:1651529338.694326:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2254:41278:x1731746395632576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.694329:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.694330:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3b3444 lrc: 4/0,0 mode: PR/PR res: [0x2b083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4902 expref: 2254 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694334:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3b3444 lrc: 3/0,0 mode: PR/PR res: [0x2b083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4902 expref: 2254 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694339:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3b3444 lrc: 0/0,0 mode: --/PR res: [0x2b083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4902 expref: 2253 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694343:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694344:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694344:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bc886 lrc: 3/0,1 mode: PW/PW res: [0x2b083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694347:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bc886 lrc: 4/0,1 mode: PW/PW res: [0x2b083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694356:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.694362:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2252:41278:x1731746395632576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.694365:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10431 00010000:00010000:0.0:1651529338.694372:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,1 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694375:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,1 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694378:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,1 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694381:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 2/0,0 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694432:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+970:39030:x1731745946308864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1017us (1112us total) trans 30064892331 rc 0/0 00000100:00100000:0.0:1651529338.694440:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151416 00010000:00010000:0.0:1651529338.694448:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 2/0,0 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694473:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc76f821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.694474:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 2/0,0 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694480:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 3/0,0 mode: PW/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694499:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 1/0,0 mode: --/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694502:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc88d lrc: 0/0,0 mode: --/PW res: [0x2b084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694507:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 2/0,0 mode: PW/PW res: [0x2b087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694509:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009212f0c2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.694511:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 2/0,0 mode: PW/PW res: [0x2b087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694513:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 3/0,0 mode: PW/PW res: [0x2b087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694517:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 1/0,0 mode: --/PW res: [0x2b087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694519:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009212f0c2/0xa29a79078f3bc8a2 lrc: 0/0,0 mode: --/PW res: [0x2b087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694591:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.694659:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966568320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.694678:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,1 mode: --/PW res: [0x2b086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694687:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966568448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.694690:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: --/PW res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694697:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10433 00000100:00100000:0.0:1651529338.694699:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2254:41279:x1731746395632960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.694702:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.694703:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 4/0,0 mode: PR/PR res: [0x2b089:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2254 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694707:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 3/0,0 mode: PR/PR res: [0x2b089:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2254 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694713:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3b5bce lrc: 0/0,0 mode: --/PR res: [0x2b089:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae64a expref: 2253 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694718:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694721:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 4/0,1 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694749:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.694756:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2251:41279:x1731746395632960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.694761:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10433 00000100:00100000:0.0:1651529338.694767:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10435 00000100:00100000:0.0:1651529338.694769:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2250:41279:x1731746395633024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.694772:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.694773:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 5/0,0 mode: PR/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2250 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694777:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 4/0,0 mode: PR/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2250 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.694782:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694782:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.694783:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694786:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 4/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694832:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.694839:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2249:41279:x1731746395633024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.694843:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10435 00010000:00010000:0.0:1651529338.694852:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,1 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694856:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,1 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694859:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,1 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694861:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 2/0,0 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.694908:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+970:39030:x1731745946308992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1434us (1575us total) trans 30064892334 rc 0/0 00000100:00100000:0.0:1651529338.694911:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151418 00010000:00010000:0.0:1651529338.694918:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 2/0,0 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694921:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000245df374 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.694922:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 2/0,0 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694925:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 3/0,0 mode: PW/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694929:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 1/0,0 mode: --/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694932:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245df374/0xa29a79078f3bc89b lrc: 0/0,0 mode: --/PW res: [0x2b086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694936:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc8a9 lrc: 2/0,0 mode: PW/PW res: [0x2b088:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694939:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0297d1b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.694940:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc8a9 lrc: 2/0,0 mode: PW/PW res: [0x2b088:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694943:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc8a9 lrc: 3/0,0 mode: PW/PW res: [0x2b088:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694946:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc8a9 lrc: 1/0,0 mode: --/PW res: [0x2b088:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694948:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc8a9 lrc: 0/0,0 mode: --/PW res: [0x2b088:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694954:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694957:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694960:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 3/0,1 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.694963:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e2fdca5/0xa29a79078f3bc8b0 lrc: 2/0,0 mode: PW/PW res: [0x2b089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.695010:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946309184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1473us (1615us total) trans 30064892336 rc 0/0 00000100:00100000:0.0:1651529338.695013:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151421 00000100:00100000:0.0:1651529338.695018:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309312 00000100:00100000:0.0:1651529338.695024:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309440 00000100:00100000:0.0:1651529338.695032:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309376 00000100:00100000:0.0:1651529338.695038:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309504 00000100:00100000:0.0:1651529338.695044:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151423 00000100:00100000:0.0:1651529338.695046:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+972:39030:x1731745946309312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.695051:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176267 count 1 00010000:00010000:0.0:1651529338.695055:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: --/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695060:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 2/0,0 mode: PR/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2247 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695063:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695064:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695064:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 4/0,1 mode: --/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695087:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 3/0,0 mode: PR/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2247 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695094:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 4/0,0 mode: PR/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2247 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.695098:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966568576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.695113:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.695132:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151425 00000100:00100000:0.0:1651529338.695134:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+972:39030:x1731745946309376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.695139:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176268 count 1 00010000:00010000:0.0:1651529338.695142:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,1 mode: --/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695147:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3b2b8b lrc: 2/0,0 mode: PR/PR res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a261e expref: 2247 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695150:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695151:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695151:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 4/0,1 mode: --/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695158:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3b2b8b lrc: 3/0,0 mode: PR/PR res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a261e expref: 2247 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695162:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3b2b8b lrc: 4/0,0 mode: PR/PR res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a261e expref: 2247 pid: 127525 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.695182:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966568704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.695191:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.695200:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3b5c5a lrc: 0/0,0 mode: --/PR res: [0x2b08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae88f expref: 2247 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.695204:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.695208:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695212:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695214:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695217:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,1 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695220:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 2/0,0 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.695259:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+973:39030:x1731745946309248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1245us total) trans 30064892337 rc 0/0 00000100:00100000:0.0:1651529338.695262:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151422 00000100:00100000:0.0:1651529338.695267:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309568 00000100:00100000:0.0:1651529338.695278:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309696 00000100:00100000:0.0:1651529338.695282:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309632 00000100:00100000:0.0:1651529338.695288:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151427 00000100:00100000:0.0:1651529338.695290:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+975:39030:x1731745946309568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.695295:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176271 count 1 00010000:00010000:0.0:1651529338.695299:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: --/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695303:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 2/0,0 mode: PR/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2246 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695306:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695307:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695308:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 4/0,1 mode: --/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695314:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 3/0,0 mode: PR/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2246 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695318:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 4/0,0 mode: PR/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2246 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.695322:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.695335:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.695340:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 2/0,0 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695343:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042e455a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.695344:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 2/0,0 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695347:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 3/0,0 mode: PW/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695352:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 1/0,0 mode: --/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695355:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e455a4/0xa29a79078f3bc8b7 lrc: 0/0,0 mode: --/PW res: [0x2b08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.695362:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151429 00000100:00100000:0.0:1651529338.695364:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+975:39030:x1731745946309632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.695369:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176272 count 1 00010000:00010000:0.0:1651529338.695372:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 3/0,1 mode: --/PW res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695376:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3b5ae7 lrc: 2/0,0 mode: PR/PR res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae261 expref: 2246 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695379:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695380:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.695380:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 4/0,1 mode: --/PW res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.695402:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3b5ae7 lrc: 3/0,0 mode: PR/PR res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae261 expref: 2246 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.695409:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3b5ae7 lrc: 4/0,0 mode: PR/PR res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae261 expref: 2246 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.695413:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966568960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.695422:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.695932:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966568576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.695942:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: --/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.695951:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966568704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.695954:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,1 mode: --/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.696469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.696635:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966568960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.696639:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 3/0,1 mode: --/PW res: [0x2b090:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.696649:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395633280 00010000:00010000:0.0:1651529338.696655:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3b4d49 lrc: 5/0,0 mode: PR/PR res: [0x2b08e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac1a expref: 2251 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.696662:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10437 00000100:00100000:0.0:1651529338.696663:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2252:41278:x1731746395633088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.696667:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.696668:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 4/0,0 mode: PR/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2252 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696672:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 3/0,0 mode: PR/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2252 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696678:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3b2cdb lrc: 0/0,0 mode: --/PR res: [0x2b08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2bd5 expref: 2252 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696682:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696682:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696683:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696686:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 4/0,1 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696693:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.696708:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2250:41278:x1731746395633088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.696711:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10437 00000100:00100000:0.0:1651529338.696716:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10439 00000100:00100000:0.0:1651529338.696718:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2248:41279:x1731746395633344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.696721:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.696723:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 5/0,0 mode: PR/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2248 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696727:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 4/0,0 mode: PR/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2248 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696742:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696743:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696743:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696747:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 4/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696751:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.696758:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2247:41279:x1731746395633344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.696760:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10439 00000100:00100000:0.0:1651529338.696772:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10441 00000100:00100000:0.0:1651529338.696774:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2246:41279:x1731746395633408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.696776:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.696778:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3b365f lrc: 5/0,0 mode: PR/PR res: [0x2b091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50bf expref: 2245 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696782:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3b365f lrc: 4/0,0 mode: PR/PR res: [0x2b091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a50bf expref: 2245 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696788:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba40a04e/0xa29a79078f3bc8e1 lrc: 3/0,1 mode: PW/PW res: [0x2b091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696791:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba40a04e/0xa29a79078f3bc8e1 lrc: 4/0,1 mode: PW/PW res: [0x2b091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696795:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.696800:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2245:41279:x1731746395633408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.696813:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10441 00000100:00100000:0.0:1651529338.696818:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10443 00000100:00100000:0.0:1651529338.696820:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2244:41279:x1731746395633536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.696828:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.696829:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3b5b11 lrc: 5/0,0 mode: PR/PR res: [0x2b092:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae309 expref: 2244 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696833:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3b5b11 lrc: 4/0,0 mode: PR/PR res: [0x2b092:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae309 expref: 2244 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.696838:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696847:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.696848:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bc8ef lrc: 3/0,1 mode: PW/PW res: [0x2b092:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696851:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bc8ef lrc: 4/0,1 mode: PW/PW res: [0x2b092:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696855:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.696863:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2242:41279:x1731746395633536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.696866:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10443 00010000:00010000:0.0:1651529338.696884:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3bc8d3 lrc: 2/0,0 mode: PW/PW res: [0x2b08e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696888:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000107d2bf4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.696889:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3bc8d3 lrc: 2/0,0 mode: PW/PW res: [0x2b08e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696892:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3bc8d3 lrc: 3/0,0 mode: PW/PW res: [0x2b08e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696897:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3bc8d3 lrc: 1/0,0 mode: --/PW res: [0x2b08e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696899:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107d2bf4/0xa29a79078f3bc8d3 lrc: 0/0,0 mode: --/PW res: [0x2b08e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696905:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,1 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696918:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,1 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696921:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,1 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696924:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 2/0,0 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.696975:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946309376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1840us (1990us total) trans 30064892339 rc 0/0 00000100:00100000:0.0:1651529338.696979:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151425 00010000:00010000:0.0:1651529338.696986:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 2/0,0 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696989:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014d87497 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.696990:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 2/0,0 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696993:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 3/0,0 mode: PW/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.696998:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 1/0,0 mode: --/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697001:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d87497/0xa29a79078f3bc8cc lrc: 0/0,0 mode: --/PW res: [0x2b08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697015:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 3/0,1 mode: PW/PW res: [0x2b090:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697018:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 3/0,1 mode: PW/PW res: [0x2b090:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697021:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 3/0,1 mode: PW/PW res: [0x2b090:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697024:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f389188/0xa29a79078f3bc8e8 lrc: 2/0,0 mode: PW/PW res: [0x2b090:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.697062:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946309632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1697us (1804us total) trans 30064892341 rc 0/0 00000100:00100000:0.0:1651529338.697065:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151429 00010000:00010000:0.0:1651529338.697073:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697076:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697086:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,1 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697089:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 2/0,0 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.697137:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946309312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2090us (2188us total) trans 30064892343 rc 0/0 00000100:00100000:0.0:1651529338.697140:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151423 00010000:00010000:0.0:1651529338.697148:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 2/0,0 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697151:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076f6605b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.697152:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 2/0,0 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697155:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 3/0,0 mode: PW/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697160:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 1/0,0 mode: --/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697162:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076f6605b/0xa29a79078f3bc8be lrc: 0/0,0 mode: --/PW res: [0x2b08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697172:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051a4949/0xa29a79078f3b4045 lrc: 0/0,0 mode: --/PR res: [0x2b08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a78ce expref: 2239 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.697176:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966568832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.697179:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697185:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697195:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697199:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,1 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697201:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 2/0,0 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.697242:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946309568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1951us (2010us total) trans 30064892345 rc 0/0 00000100:00100000:0.0:1651529338.697245:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151427 00010000:00010000:0.0:1651529338.697265:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 2/0,0 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697269:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063c1deaa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.697270:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 2/0,0 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697272:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 3/0,0 mode: PW/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697277:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 1/0,0 mode: --/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697280:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063c1deaa/0xa29a79078f3bc8da lrc: 0/0,0 mode: --/PW res: [0x2b08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.697560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697606:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697645:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.697663:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946309824 00000100:00100000:0.0:1651529338.697669:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310208 00000100:00100000:0.0:1651529338.697673:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151432 00000100:00100000:0.0:1651529338.697675:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+984:39029:x1731745946310016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.697681:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176278 count 1 00010000:00010000:0.0:1651529338.697685:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,1 mode: --/PW res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697690:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3b2d83 lrc: 2/0,0 mode: PR/PR res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ebb expref: 2238 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697693:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697694:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697695:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 4/0,1 mode: --/PW res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697705:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3b2d83 lrc: 3/0,0 mode: PR/PR res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ebb expref: 2238 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697709:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3b2d83 lrc: 4/0,0 mode: PR/PR res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ebb expref: 2238 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.697713:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.697722:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.697740:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151434 00000100:00100000:0.0:1651529338.697742:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+984:39029:x1731745946310272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.697747:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176282 count 1 00010000:00010000:0.0:1651529338.697757:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,1 mode: --/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697761:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3b54ea lrc: 2/0,0 mode: PR/PR res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acbe7 expref: 2238 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697765:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697765:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697766:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 4/0,1 mode: --/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697772:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3b54ea lrc: 3/0,0 mode: PR/PR res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acbe7 expref: 2238 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697775:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3b54ea lrc: 4/0,0 mode: PR/PR res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acbe7 expref: 2238 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.697780:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966569216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.697788:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.697794:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151435 00000100:00100000:0.0:1651529338.697796:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+984:39029:x1731745946309952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.697800:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176277 count 1 00010000:00010000:0.0:1651529338.697820:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,1 mode: --/PW res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697825:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e300c90/0xa29a79078f3b3b98 lrc: 2/0,0 mode: PR/PR res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6556 expref: 2238 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697828:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697829:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697830:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 4/0,1 mode: --/PW res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697837:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e300c90/0xa29a79078f3b3b98 lrc: 3/0,0 mode: PR/PR res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6556 expref: 2238 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697840:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e300c90/0xa29a79078f3b3b98 lrc: 4/0,0 mode: PR/PR res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6556 expref: 2238 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.697844:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966569408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.697854:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.697861:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151438 00000100:00100000:0.0:1651529338.697863:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+984:39029:x1731745946310208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.697868:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176281 count 1 00010000:00010000:0.0:1651529338.697871:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: --/PW res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697875:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 2/0,0 mode: PR/PR res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2238 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697878:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697879:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.697879:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 4/0,1 mode: --/PW res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.697885:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 3/0,0 mode: PR/PR res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2238 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.697889:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 4/0,0 mode: PR/PR res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2238 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.697893:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966569536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.697899:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.698320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.698326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.698338:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.698342:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,1 mode: --/PW res: [0x2b096:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.698352:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395633600 00010000:00010000:0.0:1651529338.698357:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3b457e lrc: 4/0,0 mode: PR/PR res: [0x2b094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ec3 expref: 2240 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.698368:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10445 00000100:00100000:0.0:1651529338.698370:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2240:41278:x1731746395633600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.698372:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.698374:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3b457e lrc: 4/0,0 mode: PR/PR res: [0x2b094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ec3 expref: 2240 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.698378:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3b457e lrc: 3/0,0 mode: PR/PR res: [0x2b094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ec3 expref: 2240 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.698384:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3b457e lrc: 0/0,0 mode: --/PR res: [0x2b094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ec3 expref: 2239 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.698387:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.698388:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.698389:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc8f6 lrc: 3/0,1 mode: PW/PW res: [0x2b094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698392:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc8f6 lrc: 4/0,1 mode: PW/PW res: [0x2b094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698405:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.698413:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2238:41278:x1731746395633600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.698417:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10445 00010000:00010000:0.0:1651529338.698425:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,1 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698428:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,1 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698431:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,1 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698434:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 2/0,0 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.698493:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+986:39029:x1731745946310016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 817us (887us total) trans 30064892347 rc 0/0 00000100:00100000:0.0:1651529338.698497:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151432 00010000:00010000:0.0:1651529338.698504:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 2/0,0 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698507:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c6323f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.698508:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 2/0,0 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698511:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 3/0,0 mode: PW/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698515:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 1/0,0 mode: --/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698519:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6323f1/0xa29a79078f3bc8fd lrc: 0/0,0 mode: --/PW res: [0x2b096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.698709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.698717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.698737:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310336 00000100:00100000:0.0:1651529338.698747:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151439 00000100:00100000:0.0:1651529338.698748:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+986:39030:x1731745946310336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.698754:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176283 count 1 00010000:00010000:0.0:1651529338.698758:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 3/0,1 mode: --/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698763:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3b5de9 lrc: 2/0,0 mode: PR/PR res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef8f expref: 2236 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.698766:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.698767:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.698767:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 4/0,1 mode: --/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.698774:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3b5de9 lrc: 3/0,0 mode: PR/PR res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef8f expref: 2236 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.698778:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3b5de9 lrc: 4/0,0 mode: PR/PR res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef8f expref: 2236 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.698785:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.698799:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.699016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699033:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699039:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.699062:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966569216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.699067:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,1 mode: --/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699101:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966569408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.699104:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,1 mode: --/PW res: [0x2b095:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699112:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10447 00000100:00100000:0.0:1651529338.699114:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2242:41279:x1731746395633856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.699117:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.699119:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019e36bc0/0xa29a79078f3b3a17 lrc: 4/0,0 mode: PR/PR res: [0x2b093:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f67 expref: 2242 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699122:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019e36bc0/0xa29a79078f3b3a17 lrc: 3/0,0 mode: PR/PR res: [0x2b093:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f67 expref: 2241 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699128:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019e36bc0/0xa29a79078f3b3a17 lrc: 0/0,0 mode: --/PR res: [0x2b093:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f67 expref: 2241 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699140:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699141:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699141:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 3/0,1 mode: PW/PW res: [0x2b093:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699149:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 4/0,1 mode: PW/PW res: [0x2b093:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699158:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.699165:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2239:41279:x1731746395633856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.699168:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10447 00000100:00100000:0.0:1651529338.699174:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10449 00000100:00100000:0.0:1651529338.699176:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2238:41279:x1731746395633792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.699179:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.699180:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed3c086e/0xa29a79078f3b5481 lrc: 4/0,0 mode: PR/PR res: [0x2b098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aca51 expref: 2238 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699184:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed3c086e/0xa29a79078f3b5481 lrc: 3/0,0 mode: PR/PR res: [0x2b098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aca51 expref: 2238 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699189:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3c086e/0xa29a79078f3b5481 lrc: 0/0,0 mode: --/PR res: [0x2b098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aca51 expref: 2238 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699196:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699196:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699197:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 3/0,1 mode: PW/PW res: [0x2b098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699200:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 4/0,1 mode: PW/PW res: [0x2b098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699208:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.699214:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2236:41279:x1731746395633792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.699216:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10449 00000100:00100000:0.0:1651529338.699240:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10451 00000100:00100000:0.0:1651529338.699242:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2234:41279:x1731746395634048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.699245:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.699246:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 5/0,0 mode: PR/PR res: [0x2b099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2234 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699250:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 4/0,0 mode: PR/PR res: [0x2b099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2234 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699255:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699256:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699257:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699262:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 4/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699266:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.699272:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2233:41279:x1731746395634048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.699275:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10451 00010000:00010000:0.0:1651529338.699289:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 2/0,0 mode: PW/PW res: [0x2b093:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699292:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014c085c9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.699294:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 2/0,0 mode: PW/PW res: [0x2b093:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699296:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 3/0,0 mode: PW/PW res: [0x2b093:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699301:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 1/0,0 mode: --/PW res: [0x2b093:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699304:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c085c9/0xa29a79078f3bc919 lrc: 0/0,0 mode: --/PW res: [0x2b093:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699310:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,1 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699313:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,1 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699316:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,1 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699319:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 2/0,0 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699371:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+988:39029:x1731745946310272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1628us (1747us total) trans 30064892349 rc 0/0 00000100:00100000:0.0:1651529338.699374:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151434 00010000:00010000:0.0:1651529338.699381:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 2/0,0 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699384:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ff0eeeb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.699385:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 2/0,0 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699388:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 3/0,0 mode: PW/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699393:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 1/0,0 mode: --/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699395:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff0eeeb/0xa29a79078f3bc90b lrc: 0/0,0 mode: --/PW res: [0x2b09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699399:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 2/0,0 mode: PW/PW res: [0x2b098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699402:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa865cce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.699403:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 2/0,0 mode: PW/PW res: [0x2b098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699406:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 3/0,0 mode: PW/PW res: [0x2b098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699409:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 1/0,0 mode: --/PW res: [0x2b098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699411:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bc904 lrc: 0/0,0 mode: --/PW res: [0x2b098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699416:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,1 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699419:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,1 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699422:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,1 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699425:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 2/0,0 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699473:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+988:39029:x1731745946309952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1676us (1834us total) trans 30064892352 rc 0/0 00000100:00100000:0.0:1651529338.699476:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151435 00010000:00010000:0.0:1651529338.699483:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 2/0,0 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699487:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f55bae0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.699488:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 2/0,0 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699491:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 3/0,0 mode: PW/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699495:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 1/0,0 mode: --/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699498:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f55bae0/0xa29a79078f3bc912 lrc: 0/0,0 mode: --/PW res: [0x2b095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699507:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3b4500 lrc: 0/0,0 mode: --/PR res: [0x2b099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8caf expref: 2231 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.699511:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966569536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.699514:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699525:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699530:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699534:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,1 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699536:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 2/0,0 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699577:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+987:39029:x1731745946310208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1713us (1922us total) trans 30064892353 rc 0/0 00000100:00100000:0.0:1651529338.699580:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151438 00010000:00010000:0.0:1651529338.699586:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 2/0,0 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699589:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc76f821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.699590:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 2/0,0 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699593:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 3/0,0 mode: PW/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699598:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 1/0,0 mode: --/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699600:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc76f821/0xa29a79078f3bc927 lrc: 0/0,0 mode: --/PW res: [0x2b099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699609:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.699613:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 3/0,1 mode: --/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699619:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395634176 00010000:00010000:0.0:1651529338.699624:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3b4737 lrc: 5/0,0 mode: PR/PR res: [0x2b09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9584 expref: 2231 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.699635:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395634112 00010000:00010000:0.0:1651529338.699638:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3b5de9 lrc: 4/0,0 mode: PR/PR res: [0x2b09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef8f expref: 2232 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.699659:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10452 00000100:00100000:0.0:1651529338.699661:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2232:41278:x1731746395634176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.699664:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.699666:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3b4737 lrc: 5/0,0 mode: PR/PR res: [0x2b09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9584 expref: 2232 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699669:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3b4737 lrc: 4/0,0 mode: PR/PR res: [0x2b09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9584 expref: 2232 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.699675:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699676:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699676:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc935 lrc: 3/0,1 mode: PW/PW res: [0x2b09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699682:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc935 lrc: 4/0,1 mode: PW/PW res: [0x2b09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699686:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.699699:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2231:41278:x1731746395634176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.699702:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10452 00010000:00010000:0.0:1651529338.699755:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 3/0,1 mode: PW/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699759:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 3/0,1 mode: PW/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699762:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 3/0,1 mode: PW/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699765:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373fc508/0xa29a79078f3bc92e lrc: 2/0,0 mode: PW/PW res: [0x2b09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.699877:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946310336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1127us (1168us total) trans 30064892355 rc 0/0 00000100:00100000:0.0:1651529338.699880:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151439 00000100:00100000:0.0:1651529338.699915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.699926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.699934:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310464 00000100:00100000:0.0:1651529338.699946:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310592 00000100:00100000:0.0:1651529338.699951:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151441 00000100:00100000:0.0:1651529338.699952:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+988:39030:x1731745946310464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.699958:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176285 count 1 00010000:00010000:0.0:1651529338.699963:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,1 mode: --/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699968:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3b372a lrc: 2/0,0 mode: PR/PR res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5477 expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.699971:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699971:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.699972:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 4/0,1 mode: --/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.699979:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3b372a lrc: 3/0,0 mode: PR/PR res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5477 expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.699983:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3b372a lrc: 4/0,0 mode: PR/PR res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5477 expref: 2228 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.699987:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.700002:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.700016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.700051:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310528 00000100:00100000:0.0:1651529338.700066:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310656 00000100:00100000:0.0:1651529338.700070:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310720 00000100:00100000:0.0:1651529338.700083:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310784 00000100:00100000:0.0:1651529338.700104:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151444 00000100:00100000:0.0:1651529338.700106:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+992:39030:x1731745946310656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.700111:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176288 count 1 00010000:00010000:0.0:1651529338.700116:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: --/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700121:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 2/0,0 mode: PR/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700124:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700124:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700125:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 4/0,1 mode: --/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700132:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 3/0,0 mode: PR/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700135:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 4/0,0 mode: PR/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2228 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.700140:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966569920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.700149:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.700156:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151446 00000100:00100000:0.0:1651529338.700158:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+992:39030:x1731745946310784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.700162:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176290 count 1 00010000:00010000:0.0:1651529338.700165:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,1 mode: --/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700170:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3b478b lrc: 2/0,0 mode: PR/PR res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96c6 expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700173:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700173:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700174:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 4/0,1 mode: --/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700180:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3b478b lrc: 3/0,0 mode: PR/PR res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96c6 expref: 2228 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700183:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3b478b lrc: 4/0,0 mode: PR/PR res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96c6 expref: 2228 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.700187:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966570048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.700194:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.700243:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310912 00000100:00100000:0.0:1651529338.700251:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310848 00000100:00100000:0.0:1651529338.700258:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151447 00000100:00100000:0.0:1651529338.700260:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+994:39029:x1731745946310912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.700264:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176292 count 1 00010000:00010000:0.0:1651529338.700269:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: --/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700273:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 2/0,0 mode: PR/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2228 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700276:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700277:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.700278:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 4/0,1 mode: --/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.700284:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2228 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.700303:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 4/0,0 mode: PR/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2228 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.700308:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.700317:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.701447:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966570048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.701451:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,1 mode: --/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.701459:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966569728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.701462:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,1 mode: --/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.701468:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966569920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.701471:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: --/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.701682:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.701685:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: --/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.701769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701817:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701827:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.701871:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395634496 00010000:00010000:0.0:1651529338.701876:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017b9dcc5/0xa29a79078f3b3ea8 lrc: 4/0,0 mode: PR/PR res: [0x2b0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7181 expref: 2236 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.701883:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10455 00000100:00100000:0.0:1651529338.701885:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2236:41278:x1731746395634432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.701888:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.701890:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 4/0,0 mode: PR/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2236 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701893:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 3/0,0 mode: PR/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2236 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701899:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3b3b1a lrc: 0/0,0 mode: --/PR res: [0x2b0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a638f expref: 2236 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701903:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.701912:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.701913:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.701916:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 4/0,1 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.701924:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.701932:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2234:41278:x1731746395634432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.701934:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10455 00000100:00100000:0.0:1651529338.701940:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10457 00000100:00100000:0.0:1651529338.701942:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2232:41278:x1731746395634688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.701944:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.701946:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 4/0,0 mode: PR/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2232 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701950:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2232 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701955:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc29f8d7/0xa29a79078f3b5ec9 lrc: 0/0,0 mode: --/PR res: [0x2b0a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af4dd expref: 2231 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.701958:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.701959:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.701960:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.701975:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 4/0,1 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.701981:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.701988:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2229:41278:x1731746395634688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.701991:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10457 00000100:00100000:0.0:1651529338.702000:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10459 00000100:00100000:0.0:1651529338.702002:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2227:41278:x1731746395634368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.702005:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.702006:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d11d120/0xa29a79078f3b3f5e lrc: 4/0,0 mode: PR/PR res: [0x2b09e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a748a expref: 2227 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702010:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d11d120/0xa29a79078f3b3f5e lrc: 3/0,0 mode: PR/PR res: [0x2b09e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a748a expref: 2227 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702022:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d11d120/0xa29a79078f3b3f5e lrc: 0/0,0 mode: --/PR res: [0x2b09e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a748a expref: 2227 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702026:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702027:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702028:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 3/0,1 mode: PW/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702030:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 4/0,1 mode: PW/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702046:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.702054:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2224:41278:x1731746395634368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.702057:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10459 00000100:00100000:0.0:1651529338.702062:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10461 00000100:00100000:0.0:1651529338.702063:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2223:41278:x1731746395634496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.702066:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.702068:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017b9dcc5/0xa29a79078f3b3ea8 lrc: 4/0,0 mode: PR/PR res: [0x2b0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7181 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702071:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017b9dcc5/0xa29a79078f3b3ea8 lrc: 3/0,0 mode: PR/PR res: [0x2b0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7181 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702076:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017b9dcc5/0xa29a79078f3b3ea8 lrc: 0/0,0 mode: --/PR res: [0x2b0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7181 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.702080:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702081:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702081:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 3/0,1 mode: PW/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702084:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 4/0,1 mode: PW/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702092:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.702098:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2221:41278:x1731746395634496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.702106:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10461 00010000:00010000:0.0:1651529338.702119:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 2/0,0 mode: PW/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702123:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc0dc607 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702124:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 2/0,0 mode: PW/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702127:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 3/0,0 mode: PW/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702131:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 1/0,0 mode: --/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702134:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc0dc607/0xa29a79078f3bc94a lrc: 0/0,0 mode: --/PW res: [0x2b09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702140:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,1 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702143:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,1 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702146:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,1 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702154:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 2/0,0 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.702198:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+995:39030:x1731745946310784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2039us (2125us total) trans 30064892357 rc 0/0 00000100:00100000:0.0:1651529338.702201:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151446 00010000:00010000:0.0:1651529338.702208:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 2/0,0 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702212:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f70ac4c9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702213:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 2/0,0 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702216:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 3/0,0 mode: PW/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702220:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 1/0,0 mode: --/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702223:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f70ac4c9/0xa29a79078f3bc95f lrc: 0/0,0 mode: --/PW res: [0x2b0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702227:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 2/0,0 mode: PW/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702229:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016ab12a9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702230:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 2/0,0 mode: PW/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702236:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 3/0,0 mode: PW/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702239:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 1/0,0 mode: --/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702241:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016ab12a9/0xa29a79078f3bc958 lrc: 0/0,0 mode: --/PW res: [0x2b0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702245:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc96d lrc: 3/0,0 mode: PW/PW res: [0x2b0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702255:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a62e1735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702256:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc96d lrc: 2/0,0 mode: PW/PW res: [0x2b0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702259:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc96d lrc: 3/0,0 mode: PW/PW res: [0x2b0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702262:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc96d lrc: 1/0,0 mode: --/PW res: [0x2b0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702265:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a62e1735/0xa29a79078f3bc96d lrc: 0/0,0 mode: --/PW res: [0x2b0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702272:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,1 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702275:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,1 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702278:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,1 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702280:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 2/0,0 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.702328:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+996:39030:x1731745946310464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2374us (2413us total) trans 30064892360 rc 0/0 00000100:00100000:0.0:1651529338.702331:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151441 00010000:00010000:0.0:1651529338.702338:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 2/0,0 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702341:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086c708e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702342:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 2/0,0 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702345:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 3/0,0 mode: PW/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702349:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 1/0,0 mode: --/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702352:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c708e4/0xa29a79078f3bc93c lrc: 0/0,0 mode: --/PW res: [0x2b09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702358:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702361:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702364:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 3/0,1 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702367:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d51c759/0xa29a79078f3bc951 lrc: 2/0,0 mode: PW/PW res: [0x2b0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.702402:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+995:39030:x1731745946310656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2295us (2366us total) trans 30064892362 rc 0/0 00000100:00100000:0.0:1651529338.702404:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151444 00010000:00010000:0.0:1651529338.702412:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702415:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702418:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,1 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702421:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 2/0,0 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.702465:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+995:39029:x1731745946310912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2204us (2263us total) trans 30064892363 rc 0/0 00000100:00100000:0.0:1651529338.702468:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151447 00010000:00010000:0.0:1651529338.702475:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 2/0,0 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702478:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000667a1836 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.702479:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 2/0,0 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702482:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 3/0,0 mode: PW/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702486:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 1/0,0 mode: --/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702489:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000667a1836/0xa29a79078f3bc966 lrc: 0/0,0 mode: --/PW res: [0x2b0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.702626:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311040 00000100:00100000:0.0:1651529338.702648:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946310976 00000100:00100000:0.0:1651529338.702656:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151449 00000100:00100000:0.0:1651529338.702658:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+996:39029:x1731745946311040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.702664:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176294 count 1 00010000:00010000:0.0:1651529338.702668:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: --/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702676:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 2/0,0 mode: PR/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2220 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702679:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702679:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702680:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 4/0,1 mode: --/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702687:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 3/0,0 mode: PR/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2220 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702718:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 4/0,0 mode: PR/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2220 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.702723:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.702742:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.702757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.702771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.702852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.702878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.702888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.702899:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311232 00000100:00100000:0.0:1651529338.702904:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311360 00000100:00100000:0.0:1651529338.702913:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311424 00000100:00100000:0.0:1651529338.702917:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151453 00000100:00100000:0.0:1651529338.702918:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1002:39029:x1731745946311296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.702925:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176298 count 1 00010000:00010000:0.0:1651529338.702929:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,1 mode: --/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702934:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4b49bf/0xa29a79078f3b3ee0 lrc: 2/0,0 mode: PR/PR res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7268 expref: 2220 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702937:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702938:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702939:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 4/0,1 mode: --/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702945:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f4b49bf/0xa29a79078f3b3ee0 lrc: 3/0,0 mode: PR/PR res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7268 expref: 2220 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702949:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f4b49bf/0xa29a79078f3b3ee0 lrc: 4/0,0 mode: PR/PR res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7268 expref: 2220 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.702953:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966570496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.702962:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.702969:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151455 00000100:00100000:0.0:1651529338.702971:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1002:39029:x1731745946311360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.702975:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176299 count 1 00010000:00010000:0.0:1651529338.702979:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 3/0,1 mode: --/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702983:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3b5d64 lrc: 2/0,0 mode: PR/PR res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed3c expref: 2220 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702987:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702987:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.702988:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 4/0,1 mode: --/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.702994:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3b5d64 lrc: 3/0,0 mode: PR/PR res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed3c expref: 2220 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.702997:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3b5d64 lrc: 4/0,0 mode: PR/PR res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed3c expref: 2220 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.703001:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966570624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.703008:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.703109:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.703114:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: --/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.703483:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395634752 00010000:00010000:0.0:1651529338.703489:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3b609e lrc: 4/0,0 mode: PR/PR res: [0x2b0a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afeca expref: 2222 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.703500:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395634816 00010000:00010000:0.0:1651529338.703503:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abe54449/0xa29a79078f3b54a4 lrc: 4/0,0 mode: PR/PR res: [0x2b0a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acab3 expref: 2223 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.703509:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10463 00000100:00100000:0.0:1651529338.703511:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2223:41279:x1731746395634880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.703513:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.703515:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 4/0,0 mode: PR/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703519:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 3/0,0 mode: PR/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703525:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3b4776 lrc: 0/0,0 mode: --/PR res: [0x2b0a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9664 expref: 2223 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703528:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703529:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703530:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703533:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 4/0,1 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703540:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.703549:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2221:41279:x1731746395634880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.703551:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10463 00000100:00100000:0.0:1651529338.703556:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10464 00000100:00100000:0.0:1651529338.703558:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2220:41279:x1731746395634816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.703560:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.703562:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abe54449/0xa29a79078f3b54a4 lrc: 4/0,0 mode: PR/PR res: [0x2b0a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acab3 expref: 2220 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703566:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abe54449/0xa29a79078f3b54a4 lrc: 3/0,0 mode: PR/PR res: [0x2b0a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acab3 expref: 2219 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703570:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abe54449/0xa29a79078f3b54a4 lrc: 0/0,0 mode: --/PR res: [0x2b0a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acab3 expref: 2219 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.703573:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703574:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703574:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 3/0,1 mode: PW/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703577:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 4/0,1 mode: PW/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703586:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.703592:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2218:41279:x1731746395634816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.703594:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10464 00010000:00010000:0.0:1651529338.703605:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703608:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703611:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 3/0,1 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703617:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc974 lrc: 2/0,0 mode: PW/PW res: [0x2b0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.703659:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1003:39029:x1731745946311040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1044us total) trans 30064892365 rc 0/0 00000100:00100000:0.0:1651529338.703662:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151449 00010000:00010000:0.0:1651529338.703714:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 2/0,0 mode: PW/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703718:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b51f0a30 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.703719:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 2/0,0 mode: PW/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703722:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 3/0,0 mode: PW/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703735:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 1/0,0 mode: --/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703738:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51f0a30/0xa29a79078f3bc982 lrc: 0/0,0 mode: --/PW res: [0x2b0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.703906:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311488 00000100:00100000:0.0:1651529338.703915:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151458 00000100:00100000:0.0:1651529338.703917:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946311488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.703944:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176301 count 1 00010000:00010000:0.0:1651529338.703949:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: --/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703955:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 2/0,0 mode: PR/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2217 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.703958:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703958:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.703959:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 4/0,1 mode: --/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.703966:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 3/0,0 mode: PR/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2217 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.703970:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 4/0,0 mode: PR/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2217 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.703974:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.703983:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.704022:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311616 00000100:00100000:0.0:1651529338.704032:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151459 00000100:00100000:0.0:1651529338.704034:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1005:39029:x1731745946311616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.704039:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176303 count 1 00010000:00010000:0.0:1651529338.704044:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 3/0,1 mode: --/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.704048:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3b2e2b lrc: 2/0,0 mode: PR/PR res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3100 expref: 2217 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.704054:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.704054:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.704055:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 4/0,1 mode: --/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.704061:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3b2e2b lrc: 3/0,0 mode: PR/PR res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3100 expref: 2217 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.704064:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3b2e2b lrc: 4/0,0 mode: PR/PR res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3100 expref: 2217 pid: 144528 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.704068:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966570880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.704085:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.705912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.705920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706040:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.706057:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.706067:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4b49bf/0xa29a79078f3b3ee0 lrc: 0/0,0 mode: --/PR res: [0x2b0aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7268 expref: 2222 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.706072:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966570496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.706076:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,1 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706080:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,1 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706082:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,1 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706085:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,1 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706088:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 2/0,0 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706140:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1006:39029:x1731745946311296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3220us (3368us total) trans 30064892367 rc 0/0 00000100:00100000:0.0:1651529338.706143:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151453 00010000:00010000:0.0:1651529338.706150:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 2/0,0 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706154:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000880bfee7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.706154:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 2/0,0 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706157:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 3/0,0 mode: PW/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706165:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 1/0,0 mode: --/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706168:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000880bfee7/0xa29a79078f3bc990 lrc: 0/0,0 mode: --/PW res: [0x2b0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706178:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966570624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.706181:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 3/0,1 mode: --/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706188:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966570816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.706191:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: --/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706197:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10469 00000100:00100000:0.0:1651529338.706199:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2220:41278:x1731746395635328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.706202:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.706204:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 4/0,0 mode: PR/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2220 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.706208:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 3/0,0 mode: PR/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2220 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.706213:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c98457da/0xa29a79078f3b4b9e lrc: 0/0,0 mode: --/PR res: [0x2b0ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa61d expref: 2220 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.706216:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.706217:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.706218:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706221:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 4/0,1 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706227:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.706234:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2218:41278:x1731746395635328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.706236:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10469 00000100:00100000:0.0:1651529338.706242:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10471 00000100:00100000:0.0:1651529338.706243:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2216:41278:x1731746395635264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.706246:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.706247:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3b4810 lrc: 5/0,0 mode: PR/PR res: [0x2b0ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9919 expref: 2216 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.706251:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3b4810 lrc: 4/0,0 mode: PR/PR res: [0x2b0ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9919 expref: 2216 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.706255:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.706256:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.706257:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 3/0,1 mode: PW/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706270:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 4/0,1 mode: PW/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706275:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.706281:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2215:41278:x1731746395635264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.706283:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10471 00010000:00010000:0.0:1651529338.706294:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 3/0,1 mode: PW/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706297:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 3/0,1 mode: PW/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706300:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 3/0,1 mode: PW/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706303:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bc99e lrc: 2/0,0 mode: PW/PW res: [0x2b0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706345:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1006:39029:x1731745946311360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3373us (3466us total) trans 30064892368 rc 0/0 00000100:00100000:0.0:1651529338.706348:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151455 00010000:00010000:0.0:1651529338.706355:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706358:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706361:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,1 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706364:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 2/0,0 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706404:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946311488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2486us (2517us total) trans 30064892369 rc 0/0 00000100:00100000:0.0:1651529338.706407:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151458 00010000:00010000:0.0:1651529338.706414:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 2/0,0 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706417:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e468780d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.706418:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 2/0,0 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706421:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 3/0,0 mode: PW/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706425:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 1/0,0 mode: --/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706428:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bc9b3 lrc: 0/0,0 mode: --/PW res: [0x2b0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706432:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bc997 lrc: 2/0,0 mode: PW/PW res: [0x2b0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706435:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025d7113b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.706436:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bc997 lrc: 2/0,0 mode: PW/PW res: [0x2b0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706439:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bc997 lrc: 3/0,0 mode: PW/PW res: [0x2b0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706442:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bc997 lrc: 1/0,0 mode: --/PW res: [0x2b0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706444:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bc997 lrc: 0/0,0 mode: --/PW res: [0x2b0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706454:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3b2e2b lrc: 0/0,0 mode: --/PR res: [0x2b0af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3100 expref: 2211 pid: 144528 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.706457:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966570880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.706460:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 3/0,1 mode: PW/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706463:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 3/0,1 mode: PW/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706466:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 3/0,1 mode: PW/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706472:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 3/0,1 mode: PW/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706474:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bc9ba lrc: 2/0,0 mode: PW/PW res: [0x2b0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706510:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1006:39029:x1731745946311616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2475us (2517us total) trans 30064892372 rc 0/0 00000100:00100000:0.0:1651529338.706513:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151459 00010000:00010000:0.0:1651529338.706596:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc989 lrc: 2/0,0 mode: PW/PW res: [0x2b0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706600:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edf74e92 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.706601:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc989 lrc: 2/0,0 mode: PW/PW res: [0x2b0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706604:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc989 lrc: 3/0,0 mode: PW/PW res: [0x2b0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706609:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc989 lrc: 1/0,0 mode: --/PW res: [0x2b0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706612:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bc989 lrc: 0/0,0 mode: --/PW res: [0x2b0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706722:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 2/0,0 mode: PW/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706735:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db9bfbbf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.706736:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 2/0,0 mode: PW/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706739:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 3/0,0 mode: PW/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706750:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 1/0,0 mode: --/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.706753:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bc9ac lrc: 0/0,0 mode: --/PW res: [0x2b0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.706886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.706990:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946311872 00000100:00100000:0.0:1651529338.706996:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312000 00000100:00100000:0.0:1651529338.706998:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312064 00000100:00100000:0.0:1651529338.707000:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312128 00000100:00100000:0.0:1651529338.707003:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151461 00000100:00100000:0.0:1651529338.707004:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946311744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.707010:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176305 count 1 00010000:00010000:0.0:1651529338.707014:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,1 mode: --/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707020:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3b5f71 lrc: 2/0,0 mode: PR/PR res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af8b1 expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707023:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707023:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707024:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 4/0,1 mode: --/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707031:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3b5f71 lrc: 3/0,0 mode: PR/PR res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af8b1 expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707035:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3b5f71 lrc: 4/0,0 mode: PR/PR res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af8b1 expref: 2209 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.707039:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966571008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.707049:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.707056:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151463 00000100:00100000:0.0:1651529338.707057:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1013:39029:x1731745946311936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.707061:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176308 count 1 00010000:00010000:0.0:1651529338.707065:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: --/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707069:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 2/0,0 mode: PR/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2209 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707072:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707073:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707074:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 4/0,1 mode: --/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707079:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 3/0,0 mode: PR/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2209 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707083:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 4/0,0 mode: PR/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2209 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.707087:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966571136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.707093:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.707099:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151465 00000100:00100000:0.0:1651529338.707101:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946312000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.707105:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176309 count 1 00010000:00010000:0.0:1651529338.707108:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: --/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707112:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 2/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707115:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707115:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707116:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 4/0,1 mode: --/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707124:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 3/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707128:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 4/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2209 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.707132:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966571264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.707139:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.707144:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151467 00000100:00100000:0.0:1651529338.707146:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946312128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.707150:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176311 count 1 00010000:00010000:0.0:1651529338.707153:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 3/0,1 mode: --/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707157:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3b56fe lrc: 2/0,0 mode: PR/PR res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad388 expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707160:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707160:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.707161:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 4/0,1 mode: --/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.707167:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3b56fe lrc: 3/0,0 mode: PR/PR res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad388 expref: 2209 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.707171:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3b56fe lrc: 4/0,0 mode: PR/PR res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad388 expref: 2209 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.707175:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.707181:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.710191:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966571008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.710200:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,1 mode: --/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710226:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966571136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.710239:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: --/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710248:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966571264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.710261:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: --/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710275:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.710278:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 3/0,1 mode: --/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710285:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395635456 00010000:00010000:0.0:1651529338.710291:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3b56d4 lrc: 4/0,0 mode: PR/PR res: [0x2b0b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad2f5 expref: 2210 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.710296:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395635584 00010000:00010000:0.0:1651529338.710298:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3b574b lrc: 5/0,0 mode: PR/PR res: [0x2b0b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad492 expref: 2211 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.710303:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395635840 00010000:00010000:0.0:1651529338.710305:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000705e6e48/0xa29a79078f3b529e lrc: 5/0,0 mode: PR/PR res: [0x2b0b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac2a9 expref: 2213 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.710309:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395635520 00010000:00010000:0.0:1651529338.710311:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3b5f71 lrc: 4/0,0 mode: PR/PR res: [0x2b0b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af8b1 expref: 2214 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.710315:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395635776 00010000:00010000:0.0:1651529338.710318:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 4/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2216 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.710323:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10473 00000100:00100000:0.0:1651529338.710324:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2217:41278:x1731746395635456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.710327:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.710329:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3b56d4 lrc: 4/0,0 mode: PR/PR res: [0x2b0b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad2f5 expref: 2217 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710333:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3b56d4 lrc: 3/0,0 mode: PR/PR res: [0x2b0b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad2f5 expref: 2217 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710338:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3b56d4 lrc: 0/0,0 mode: --/PR res: [0x2b0b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad2f5 expref: 2217 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710345:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710345:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710346:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 3/0,1 mode: PW/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710349:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 4/0,1 mode: PW/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710360:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.710370:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2216:41278:x1731746395635456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.710373:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10473 00000100:00100000:0.0:1651529338.710379:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10475 00000100:00100000:0.0:1651529338.710381:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2214:41278:x1731746395635840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.710383:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.710385:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000705e6e48/0xa29a79078f3b529e lrc: 5/0,0 mode: PR/PR res: [0x2b0b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac2a9 expref: 2214 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710389:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000705e6e48/0xa29a79078f3b529e lrc: 4/0,0 mode: PR/PR res: [0x2b0b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac2a9 expref: 2214 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710394:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710394:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710395:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 3/0,1 mode: PW/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710400:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 4/0,1 mode: PW/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710404:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.710410:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2214:41278:x1731746395635840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.710412:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10475 00000100:00100000:0.0:1651529338.710417:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10478 00000100:00100000:0.0:1651529338.710418:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2212:41278:x1731746395635648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.710420:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.710422:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 4/0,0 mode: PR/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2212 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710426:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 3/0,0 mode: PR/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2212 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710430:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3b3333 lrc: 0/0,0 mode: --/PR res: [0x2b0b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a453c expref: 2212 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710433:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710434:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710434:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710437:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 4/0,1 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710443:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.710455:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2210:41278:x1731746395635648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.710458:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10478 00000100:00100000:0.0:1651529338.710463:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10479 00000100:00100000:0.0:1651529338.710464:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2208:41278:x1731746395635776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529338.710467:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.710468:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 4/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2208 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710472:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 3/0,0 mode: PR/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2208 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710476:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3b573d lrc: 0/0,0 mode: --/PR res: [0x2b0b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad46f expref: 2208 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.710480:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710480:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.710481:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710484:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 4/0,1 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710489:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.710495:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2206:41278:x1731746395635776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.710503:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10479 00010000:00010000:0.0:1651529338.710510:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710513:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710517:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710519:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 2/0,0 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710580:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1015:39029:x1731745946311936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3521us (3658us total) trans 30064892375 rc 0/0 00000100:00100000:0.0:1651529338.710583:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151463 00010000:00010000:0.0:1651529338.710590:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 2/0,0 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710593:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7bf54e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710594:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 2/0,0 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710597:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 3/0,0 mode: PW/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710602:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 1/0,0 mode: --/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710605:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bc9d6 lrc: 0/0,0 mode: --/PW res: [0x2b0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710609:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bc9cf lrc: 2/0,0 mode: PW/PW res: [0x2b0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710612:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004ad47f2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710612:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bc9cf lrc: 2/0,0 mode: PW/PW res: [0x2b0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710615:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bc9cf lrc: 3/0,0 mode: PW/PW res: [0x2b0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710619:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bc9cf lrc: 1/0,0 mode: --/PW res: [0x2b0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710621:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bc9cf lrc: 0/0,0 mode: --/PW res: [0x2b0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710626:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710629:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710632:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710635:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 2/0,0 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710683:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946311744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3677us (3785us total) trans 30064892378 rc 0/0 00000100:00100000:0.0:1651529338.710686:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151461 00010000:00010000:0.0:1651529338.710693:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 2/0,0 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710697:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb6b1ff6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710698:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 2/0,0 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710700:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 3/0,0 mode: PW/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710705:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 1/0,0 mode: --/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710708:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bc9c8 lrc: 0/0,0 mode: --/PW res: [0x2b0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710713:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710716:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710720:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710722:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710768:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1014:39030:x1731745946312000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3666us (3796us total) trans 30064892379 rc 0/0 00000100:00100000:0.0:1651529338.710771:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151465 00010000:00010000:0.0:1651529338.710778:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710781:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099bc0c8d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710782:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710785:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 3/0,0 mode: PW/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710789:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 1/0,0 mode: --/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710792:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bc9e4 lrc: 0/0,0 mode: --/PW res: [0x2b0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710796:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 2/0,0 mode: PW/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710799:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710800:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 2/0,0 mode: PW/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710824:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 3/0,0 mode: PW/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710828:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 1/0,0 mode: --/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710831:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bc9eb lrc: 0/0,0 mode: --/PW res: [0x2b0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710835:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 3/0,0 mode: PW/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710843:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0297d1b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.710844:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 2/0,0 mode: PW/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710847:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 3/0,0 mode: PW/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710850:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 1/0,0 mode: --/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710855:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bc9c1 lrc: 0/0,0 mode: --/PW res: [0x2b0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710862:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710865:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710868:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.710871:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bc9f2 lrc: 2/0,0 mode: PW/PW res: [0x2b0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.710911:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1014:39030:x1731745946312128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3764us (3926us total) trans 30064892382 rc 0/0 00000100:00100000:0.0:1651529338.710914:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151467 00000100:00100000:0.0:1651529338.711102:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711109:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312192 00000100:00100000:0.0:1651529338.711123:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151468 00000100:00100000:0.0:1651529338.711125:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1014:39029:x1731745946312192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.711131:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176312 count 1 00010000:00010000:0.0:1651529338.711135:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,1 mode: --/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711143:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3b47e6 lrc: 2/0,0 mode: PR/PR res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a988d expref: 2201 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711146:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711146:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711147:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 4/0,1 mode: --/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711154:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3b47e6 lrc: 3/0,0 mode: PR/PR res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a988d expref: 2201 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711158:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3b47e6 lrc: 4/0,0 mode: PR/PR res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a988d expref: 2201 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.711162:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.711197:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.711229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711293:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.711306:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312640 00000100:00100000:0.0:1651529338.711312:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312576 00000100:00100000:0.0:1651529338.711315:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151470 00000100:00100000:0.0:1651529338.711317:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1021:39030:x1731745946312384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.711351:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176315 count 1 00010000:00010000:0.0:1651529338.711357:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: --/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711362:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 2/0,0 mode: PR/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2201 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711370:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711371:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711372:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 4/0,1 mode: --/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711380:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 3/0,0 mode: PR/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2201 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711384:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 4/0,0 mode: PR/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2201 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.711388:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966571584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.711397:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.711404:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151472 00000100:00100000:0.0:1651529338.711405:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1021:39030:x1731745946312512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.711423:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176317 count 1 00010000:00010000:0.0:1651529338.711427:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,1 mode: --/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711432:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3b3dcf lrc: 2/0,0 mode: PR/PR res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6e24 expref: 2201 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711435:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711436:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711436:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 4/0,1 mode: --/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711442:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3b3dcf lrc: 3/0,0 mode: PR/PR res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6e24 expref: 2201 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711446:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3b3dcf lrc: 4/0,0 mode: PR/PR res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6e24 expref: 2201 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.711450:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966571712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.711458:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.711465:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151474 00000100:00100000:0.0:1651529338.711466:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1021:39030:x1731745946312640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.711471:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176319 count 1 00010000:00010000:0.0:1651529338.711474:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: --/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711478:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 2/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2201 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711481:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711481:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711482:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 4/0,1 mode: --/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711490:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2201 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711494:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2201 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.711498:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966571840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.711504:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.711531:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.711536:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,1 mode: --/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.711567:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.711657:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,1 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711661:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,1 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711664:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,1 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711667:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 2/0,0 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.711715:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1022:39029:x1731745946312192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 589us (613us total) trans 30064892383 rc 0/0 00000100:00100000:0.0:1651529338.711718:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151468 00010000:00010000:0.0:1651529338.711725:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 2/0,0 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711738:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009833c6fb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.711740:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 2/0,0 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711743:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 3/0,0 mode: PW/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711748:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 1/0,0 mode: --/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711750:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bc9f9 lrc: 0/0,0 mode: --/PW res: [0x2b0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.711949:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312704 00000100:00100000:0.0:1651529338.711960:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151476 00000100:00100000:0.0:1651529338.711962:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1022:39029:x1731745946312704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.711967:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176320 count 1 00010000:00010000:0.0:1651529338.711972:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 3/0,1 mode: --/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711988:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091ed8424/0xa29a79078f3b2cfe lrc: 2/0,0 mode: PR/PR res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c37 expref: 2200 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.711991:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711991:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.711992:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 4/0,1 mode: --/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.711999:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091ed8424/0xa29a79078f3b2cfe lrc: 3/0,0 mode: PR/PR res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c37 expref: 2200 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.712003:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091ed8424/0xa29a79078f3b2cfe lrc: 4/0,0 mode: PR/PR res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c37 expref: 2200 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.712007:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.712019:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.712116:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966571584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.712126:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: --/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712168:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966571712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.712171:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,1 mode: --/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.712296:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966571840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.712300:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: --/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712307:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395636352 00010000:00010000:0.0:1651529338.712312:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2206 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.712318:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10483 00000100:00100000:0.0:1651529338.712320:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2206:41279:x1731746395636160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.712323:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.712325:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3b539a lrc: 4/0,0 mode: PR/PR res: [0x2b0ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ae expref: 2206 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712329:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3b539a lrc: 3/0,0 mode: PR/PR res: [0x2b0ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ae expref: 2206 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712335:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3b539a lrc: 0/0,0 mode: --/PR res: [0x2b0ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac6ae expref: 2205 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712339:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712339:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712348:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bca0e lrc: 3/0,1 mode: PW/PW res: [0x2b0ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712352:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bca0e lrc: 4/0,1 mode: PW/PW res: [0x2b0ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712360:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.712368:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2204:41279:x1731746395636160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.712371:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10483 00000100:00100000:0.0:1651529338.712377:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10485 00000100:00100000:0.0:1651529338.712379:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2202:41279:x1731746395636096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.712382:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.712383:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 4/0,0 mode: PR/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2202 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712387:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 3/0,0 mode: PR/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2202 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712392:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3b303f lrc: 0/0,0 mode: --/PR res: [0x2b0bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3949 expref: 2201 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712396:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712396:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712397:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712400:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 4/0,1 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712437:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.712444:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2199:41279:x1731746395636096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.712447:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10485 00000100:00100000:0.0:1651529338.712457:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10487 00000100:00100000:0.0:1651529338.712459:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2197:41279:x1731746395636352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.712468:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.712470:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2197 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712474:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2196 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712480:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e39a933d/0xa29a79078f3b57c9 lrc: 0/0,0 mode: --/PR res: [0x2b0bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad701 expref: 2196 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.712483:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712484:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.712485:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712487:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 4/0,1 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712493:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.712499:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2195:41279:x1731746395636352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.712502:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10487 00010000:00010000:0.0:1651529338.712514:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,1 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712518:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,1 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712521:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,1 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712524:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 2/0,0 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712569:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946312512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1304us total) trans 30064892385 rc 0/0 00000100:00100000:0.0:1651529338.712572:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151472 00010000:00010000:0.0:1651529338.712580:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 2/0,0 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712583:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ecccf98a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.712584:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 2/0,0 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712587:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 3/0,0 mode: PW/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712592:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 1/0,0 mode: --/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712595:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bca15 lrc: 0/0,0 mode: --/PW res: [0x2b0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712601:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712603:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712613:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,1 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712616:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 2/0,0 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712657:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946312384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1340us (1417us total) trans 30064892387 rc 0/0 00000100:00100000:0.0:1651529338.712660:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151470 00010000:00010000:0.0:1651529338.712668:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 2/0,0 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712671:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000957ae578 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.712672:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 2/0,0 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712675:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 3/0,0 mode: PW/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712680:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 1/0,0 mode: --/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712682:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bca07 lrc: 0/0,0 mode: --/PW res: [0x2b0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712688:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712691:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712694:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,1 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712703:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 2/0,0 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712752:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946312640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1458us total) trans 30064892389 rc 0/0 00000100:00100000:0.0:1651529338.712755:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151474 00010000:00010000:0.0:1651529338.712762:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 2/0,0 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712766:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe0c139f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.712767:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 2/0,0 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712770:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 3/0,0 mode: PW/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712775:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 1/0,0 mode: --/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712777:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bca23 lrc: 0/0,0 mode: --/PW res: [0x2b0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.712873:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966571968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.712878:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 3/0,1 mode: --/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712982:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bca2a lrc: 2/0,0 mode: PW/PW res: [0x2b0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712986:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5440c0c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.712987:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bca2a lrc: 2/0,0 mode: PW/PW res: [0x2b0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712990:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bca2a lrc: 3/0,0 mode: PW/PW res: [0x2b0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.712995:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bca2a lrc: 1/0,0 mode: --/PW res: [0x2b0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713000:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bca2a lrc: 0/0,0 mode: --/PW res: [0x2b0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.713092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713119:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713168:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946312832 00000100:00100000:0.0:1651529338.713175:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313024 00000100:00100000:0.0:1651529338.713187:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151478 00000100:00100000:0.0:1651529338.713188:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1028:39030:x1731745946312896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.713194:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176323 count 1 00010000:00010000:0.0:1651529338.713231:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 3/0,1 mode: --/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713236:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3b5e98 lrc: 2/0,0 mode: PR/PR res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af38d expref: 2192 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713239:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713240:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713241:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 4/0,1 mode: --/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713248:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3b5e98 lrc: 3/0,0 mode: PR/PR res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af38d expref: 2192 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713255:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3b5e98 lrc: 4/0,0 mode: PR/PR res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af38d expref: 2192 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.713259:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966572096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.713268:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.713276:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151480 00000100:00100000:0.0:1651529338.713277:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1028:39030:x1731745946312960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.713282:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176324 count 1 00010000:00010000:0.0:1651529338.713286:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: --/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713290:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 2/0,0 mode: PR/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2192 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713293:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713294:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713294:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 4/0,1 mode: --/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713301:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 3/0,0 mode: PR/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2192 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713304:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 4/0,0 mode: PR/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2192 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.713311:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966572224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.713317:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.713323:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151482 00000100:00100000:0.0:1651529338.713325:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1028:39030:x1731745946313024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.713329:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176325 count 1 00010000:00010000:0.0:1651529338.713333:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: --/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713337:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 2/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2192 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713339:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713340:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713340:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 4/0,1 mode: --/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713346:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 3/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2192 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713350:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 4/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2192 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.713354:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966572352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.713360:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.713364:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 3/0,1 mode: PW/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713367:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 3/0,1 mode: PW/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713371:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 3/0,1 mode: PW/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713373:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bca31 lrc: 2/0,0 mode: PW/PW res: [0x2b0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.713424:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1029:39029:x1731745946312704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1461us (1493us total) trans 30064892391 rc 0/0 00000100:00100000:0.0:1651529338.713427:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151476 00000100:00100000:0.0:1651529338.713432:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313152 00000100:00100000:0.0:1651529338.713440:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151483 00000100:00100000:0.0:1651529338.713442:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1029:39029:x1731745946313152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.713446:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176327 count 1 00010000:00010000:0.0:1651529338.713465:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: --/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713471:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 2/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2192 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713474:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713474:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713475:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 4/0,1 mode: --/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713484:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 3/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2192 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713488:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 4/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2192 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.713492:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966572416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.713506:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.713656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.713663:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313216 00000100:00100000:0.0:1651529338.713670:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151484 00000100:00100000:0.0:1651529338.713672:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1030:39030:x1731745946313216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.713677:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176328 count 1 00010000:00010000:0.0:1651529338.713681:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: --/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713686:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 2/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2192 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713689:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713690:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.713690:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 4/0,1 mode: --/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.713697:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 3/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2192 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.713703:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 4/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2192 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.713707:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966572480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.713724:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.714009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.714018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.714029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.714038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.714056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.714065:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966572096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.714070:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 3/0,1 mode: --/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714077:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966572224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.714080:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: --/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714087:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10491 00000100:00100000:0.0:1651529338.714089:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2197:41278:x1731746395636736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.714092:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.714094:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 4/0,0 mode: PR/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2197 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714100:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 3/0,0 mode: PR/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2197 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714106:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5f195d8/0xa29a79078f3b37cb lrc: 0/0,0 mode: --/PR res: [0x2b0c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a56b5 expref: 2196 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714109:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714110:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714111:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714121:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 4/0,1 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714127:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.714135:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2194:41278:x1731746395636736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.714138:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10491 00000100:00100000:0.0:1651529338.714144:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10493 00000100:00100000:0.0:1651529338.714146:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2193:41278:x1731746395636672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.714149:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.714150:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052e0e5e1/0xa29a79078f3b351d lrc: 4/0,0 mode: PR/PR res: [0x2b0c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4bfd expref: 2193 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714154:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052e0e5e1/0xa29a79078f3b351d lrc: 3/0,0 mode: PR/PR res: [0x2b0c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4bfd expref: 2192 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714159:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052e0e5e1/0xa29a79078f3b351d lrc: 0/0,0 mode: --/PR res: [0x2b0c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4bfd expref: 2192 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714164:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 3/0,1 mode: PW/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714167:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 4/0,1 mode: PW/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714176:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.714182:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2191:41278:x1731746395636672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.714184:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10493 00000100:00100000:0.0:1651529338.714189:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10494 00000100:00100000:0.0:1651529338.714191:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2189:41278:x1731746395636800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.714193:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.714195:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3b491a lrc: 4/0,0 mode: PR/PR res: [0x2b0c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d8e expref: 2189 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714198:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3b491a lrc: 3/0,0 mode: PR/PR res: [0x2b0c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d8e expref: 2189 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714203:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3b491a lrc: 0/0,0 mode: --/PR res: [0x2b0c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d8e expref: 2189 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.714209:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714209:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714210:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 3/0,1 mode: PW/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714219:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 4/0,1 mode: PW/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714228:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.714234:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41278:x1731746395636800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.714236:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10494 00010000:00010000:0.0:1651529338.714243:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 2/0,0 mode: PW/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714247:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba636fc8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.714248:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 2/0,0 mode: PW/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714251:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 3/0,0 mode: PW/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714255:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 1/0,0 mode: --/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714257:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba636fc8/0xa29a79078f3bca46 lrc: 0/0,0 mode: --/PW res: [0x2b0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714272:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714275:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714278:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,1 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714280:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 2/0,0 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714320:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1032:39030:x1731745946312960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1042us (1200us total) trans 30064892393 rc 0/0 00000100:00100000:0.0:1651529338.714323:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151480 00010000:00010000:0.0:1651529338.714330:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 2/0,0 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714334:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025d7113b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.714335:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 2/0,0 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714337:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 3/0,0 mode: PW/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714342:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 1/0,0 mode: --/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714345:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d7113b/0xa29a79078f3bca4d lrc: 0/0,0 mode: --/PW res: [0x2b0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714350:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 3/0,1 mode: PW/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714353:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 3/0,1 mode: PW/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714356:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 3/0,1 mode: PW/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714359:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74e92/0xa29a79078f3bca3f lrc: 2/0,0 mode: PW/PW res: [0x2b0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714393:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946312896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1204us (1288us total) trans 30064892395 rc 0/0 00000100:00100000:0.0:1651529338.714396:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151478 00010000:00010000:0.0:1651529338.714410:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 2/0,0 mode: PW/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714414:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0d871e1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.714415:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 2/0,0 mode: PW/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714417:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 3/0,0 mode: PW/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714422:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 1/0,0 mode: --/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714425:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0d871e1/0xa29a79078f3bca54 lrc: 0/0,0 mode: --/PW res: [0x2b0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714708:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313344 00000100:00100000:0.0:1651529338.714716:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313472 00000100:00100000:0.0:1651529338.714720:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313280 00000100:00100000:0.0:1651529338.714735:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313408 00000100:00100000:0.0:1651529338.714738:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313536 00000100:00100000:0.0:1651529338.714743:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151485 00000100:00100000:0.0:1651529338.714744:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1035:39029:x1731745946313344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.714750:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176330 count 1 00010000:00010000:0.0:1651529338.714754:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: --/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714759:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 2/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2187 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.714762:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714763:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714764:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 4/0,1 mode: --/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714770:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 3/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2187 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.714776:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2187 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.714781:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966572544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.714792:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.714798:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151487 00000100:00100000:0.0:1651529338.714799:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1035:39029:x1731745946313280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.714801:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1035:39029:x1731745946313408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.714823:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176329 count 1 00010000:00010000:0.0:1651529338.714827:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: --/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714832:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 2/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2187 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.714834:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176331 count 1 00010000:00010000:0.0:1651529338.714835:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714835:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714836:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 4/0,1 mode: --/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.714838:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: --/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714842:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 3/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2187 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.714843:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 2/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2187 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.714846:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714846:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 4/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2187 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.714847:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.714847:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 4/0,1 mode: --/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.714853:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966572672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.714854:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 3/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2187 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.714857:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 4/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2187 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.714861:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.714862:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966572736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.714867:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151489 00000100:00100000:0.0:1651529338.714869:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1035:39029:x1731745946313536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.714870:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.714873:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176333 count 1 00010000:00010000:0.0:1651529338.714892:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: --/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714897:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 2/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2187 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.714900:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714900:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.714901:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 4/0,1 mode: --/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.714908:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 3/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2187 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.714911:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 4/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2187 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.714915:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966572800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.714940:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.714996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.715006:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966572352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.715010:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: --/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715024:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966572416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.715027:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: --/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715033:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395636864 00010000:00010000:0.0:1651529338.715038:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 4/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2188 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.715049:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10495 00000100:00100000:0.0:1651529338.715051:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41278:x1731746395636864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.715054:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.715055:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 4/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2188 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715059:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 3/0,0 mode: PR/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2188 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715065:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e24781/0xa29a79078f3b34ec lrc: 0/0,0 mode: --/PR res: [0x2b0c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b01 expref: 2188 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715068:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715069:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715070:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715073:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 4/0,1 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715079:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.715090:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2187:41278:x1731746395636864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.715093:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10495 00010000:00010000:0.0:1651529338.715099:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715103:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715106:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,1 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715109:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 2/0,0 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715120:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 2/0,0 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715124:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.715125:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 2/0,0 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715128:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 3/0,0 mode: PW/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715141:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 1/0,0 mode: --/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715144:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bca5b lrc: 0/0,0 mode: --/PW res: [0x2b0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715154:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1036:39030:x1731745946313024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1828us (2020us total) trans 30064892397 rc 0/0 00000100:00100000:0.0:1651529338.715157:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151482 00000100:00100000:0.0:1651529338.715168:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966572480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.715172:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: --/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.715213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.715223:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395636992 00000100:00100000:0.0:1651529338.715224:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395636928 00010000:00010000:1.0:1651529338.715229:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 4/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715229:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 4/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.715243:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10496 00000100:00100000:1.0:1651529338.715245:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41278:x1731746395636992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529338.715245:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10497 00000100:00100000:0.0:1651529338.715247:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41278:x1731746395636928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.715248:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.715249:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 4/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715250:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.715252:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 4/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.715253:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 3/0,0 mode: PR/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715256:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 3/0,0 mode: PR/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.715259:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7ae5e3/0xa29a79078f3b2e16 lrc: 0/0,0 mode: --/PR res: [0x2b0c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3097 expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.715261:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3b476f lrc: 0/0,0 mode: --/PR res: [0x2b0c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9656 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.715263:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.715264:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.715265:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715265:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715265:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715266:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715269:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 4/0,1 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715270:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 4/0,1 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.715280:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.715285:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.715290:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2186:41278:x1731746395636992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.715292:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10496 00000100:00100000:0.0:1651529338.715293:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2186:41278:x1731746395636928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.715296:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10497 00010000:00010000:0.0:1651529338.715302:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715306:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715309:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,1 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715311:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 2/0,0 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715372:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1036:39029:x1731745946313152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1929us (2016us total) trans 30064892398 rc 0/0 00000100:00100000:0.0:1651529338.715375:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151483 00000100:00100000:1.0:1651529338.715382:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.715382:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 2/0,0 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715385:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1222f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.715391:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 2/0,0 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715397:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 3/0,0 mode: PW/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715402:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 1/0,0 mode: --/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715404:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1222f1/0xa29a79078f3bca62 lrc: 0/0,0 mode: --/PW res: [0x2b0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715412:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313600 00000100:00100000:0.0:1651529338.715418:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151490 00000100:00100000:0.0:1651529338.715420:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1036:39029:x1731745946313600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.715424:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176334 count 1 00010000:00010000:0.0:1651529338.715428:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: --/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715433:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 2/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715436:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715436:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715437:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 4/0,1 mode: --/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715444:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 3/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715450:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 4/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.715454:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966572864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.715468:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.715474:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715477:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715480:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,1 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715483:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 2/0,0 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715524:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1037:39030:x1731745946313216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1851us (1868us total) trans 30064892399 rc 0/0 00000100:00100000:0.0:1651529338.715527:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151484 00010000:00010000:0.0:1651529338.715555:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 2/0,0 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715559:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000125d8480 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.715560:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 2/0,0 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.715563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.715563:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 3/0,0 mode: PW/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715573:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 1/0,0 mode: --/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715576:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125d8480/0xa29a79078f3bca69 lrc: 0/0,0 mode: --/PW res: [0x2b0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715584:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313664 00000100:00100000:0.0:1651529338.715591:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151491 00000100:00100000:0.0:1651529338.715592:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1037:39030:x1731745946313664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.715597:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176335 count 1 00010000:00010000:0.0:1651529338.715601:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: --/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715605:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 2/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2184 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715608:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715609:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715609:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 4/0,1 mode: --/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715616:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 3/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2184 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715622:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 4/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2184 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.715626:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966572928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.715656:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.715674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.715684:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313728 00000100:00100000:0.0:1651529338.715695:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151492 00000100:00100000:0.0:1651529338.715697:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1038:39029:x1731745946313728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.715701:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176336 count 1 00010000:00010000:0.0:1651529338.715705:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: --/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715710:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 2/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2184 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715713:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715714:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.715714:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 4/0,1 mode: --/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.715720:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 3/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2184 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.715724:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2184 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.715739:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966572992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.715750:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.715935:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966572544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.715946:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: --/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.715951:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966572608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.715956:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,1 mode: --/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.715964:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966572736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.715966:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: --/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715967:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966572672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.715971:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: --/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.715992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.716002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.716011:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637056 00000100:00100000:0.0:1651529338.716012:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.716021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.716022:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2185 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716029:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637184 00000100:00100000:1.0:1651529338.716033:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637120 00010000:00010000:0.0:1651529338.716034:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 4/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2187 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716036:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3b5d33 lrc: 4/0,0 mode: PR/PR res: [0x2b0cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aebde expref: 2187 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716040:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637248 00000100:00100000:1.0:1651529338.716043:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10498 00010000:00010000:0.0:1651529338.716043:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 4/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2188 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.716045:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41279:x1731746395637056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.716048:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.716048:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10499 00010000:00010000:1.0:1651529338.716049:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716050:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2188:41279:x1731746395637184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.716053:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 3/0,0 mode: PR/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716054:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.716055:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 4/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716059:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3b53d9 lrc: 0/0,0 mode: --/PR res: [0x2b0ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac79c expref: 2188 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716059:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 3/0,0 mode: PR/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2188 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716062:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716063:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716064:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716064:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ab2d24/0xa29a79078f3b2e55 lrc: 0/0,0 mode: --/PR res: [0x2b0c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a31d9 expref: 2187 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716067:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 4/0,1 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716068:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716069:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716070:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716073:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 4/0,1 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716077:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.716086:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2186:41279:x1731746395637056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.716089:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10498 00000100:00100000:1.0:1651529338.716094:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10500 00010000:00010000:0.0:1651529338.716100:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.716104:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2185:41279:x1731746395637120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.716106:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.716108:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3b5d33 lrc: 4/0,0 mode: PR/PR res: [0x2b0cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aebde expref: 2185 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716108:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2185:41279:x1731746395637184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.716111:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10499 00010000:00010000:1.0:1651529338.716112:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3b5d33 lrc: 3/0,0 mode: PR/PR res: [0x2b0cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aebde expref: 2185 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716117:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3b5d33 lrc: 0/0,0 mode: --/PR res: [0x2b0cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aebde expref: 2184 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716121:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716121:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.716121:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10501 00010000:00010000:1.0:1651529338.716122:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,1 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716122:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2183:41279:x1731746395637248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.716125:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 4/0,1 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716125:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.716127:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 4/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2183 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716131:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.716133:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 3/0,0 mode: PR/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2183 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.716137:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2183:41279:x1731746395637120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.716138:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3b5c53 lrc: 0/0,0 mode: --/PR res: [0x2b0cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae865 expref: 2183 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.716140:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10500 00010000:00010000:0.0:1651529338.716142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716143:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716146:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 4/0,1 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716147:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,1 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716151:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,1 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716156:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.716163:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2181:41279:x1731746395637248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.716165:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10501 00010000:00010000:1.0:1651529338.716167:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,1 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716170:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 2/0,0 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716172:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716176:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716179:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,1 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716184:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 2/0,0 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716213:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1040:39029:x1731745946313472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1465us (1516us total) trans 30064892400 rc 0/0 00000100:00100000:1.0:1651529338.716216:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151486 00010000:00010000:1.0:1651529338.716223:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 2/0,0 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716224:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1039:39029:x1731745946313280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1424us (1516us total) trans 30064892401 rc 0/0 00010000:00010000:1.0:1651529338.716227:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529338.716227:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151487 00010000:00010000:1.0:1651529338.716228:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 2/0,0 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716231:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 3/0,0 mode: PW/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716235:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 1/0,0 mode: --/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716235:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 2/0,0 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716238:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bca77 lrc: 0/0,0 mode: --/PW res: [0x2b0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716238:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0297d1b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.716244:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716253:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 2/0,0 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716256:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716257:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 3/0,0 mode: PW/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716260:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,1 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716262:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 2/0,0 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716262:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 1/0,0 mode: --/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716264:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0297d1b/0xa29a79078f3bca7e lrc: 0/0,0 mode: --/PW res: [0x2b0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716283:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 2/0,0 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716287:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ac732b7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.716288:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 2/0,0 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716291:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 3/0,0 mode: PW/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716294:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 1/0,0 mode: --/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716297:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac732b7/0xa29a79078f3bca85 lrc: 0/0,0 mode: --/PW res: [0x2b0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716303:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1039:39029:x1731745946313408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1501us (1589us total) trans 30064892402 rc 0/0 00000100:00100000:1.0:1651529338.716306:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151488 00010000:00010000:0.0:1651529338.716315:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716319:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716321:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,1 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716324:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 2/0,0 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716381:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1039:39029:x1731745946313344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1631us (1696us total) trans 30064892403 rc 0/0 00000100:00100000:0.0:1651529338.716385:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151485 00000100:00100000:1.0:1651529338.716395:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.716406:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.716418:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966572800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716422:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: --/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716430:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966572992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716432:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: --/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.716439:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966572864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716441:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: --/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716448:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637376 00010000:00010000:0.0:1651529338.716452:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 4/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2181 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716463:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637504 00010000:00010000:0.0:1651529338.716466:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2182 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716470:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637312 00010000:00010000:0.0:1651529338.716472:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 4/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2183 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.716473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.716476:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637440 00010000:00010000:0.0:1651529338.716478:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 5/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2184 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716485:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10502 00000100:00100000:0.0:1651529338.716487:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2184:41278:x1731746395637376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.716489:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.716491:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 4/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716494:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 3/0,0 mode: PR/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716499:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 2/0,0 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716499:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3b3c86 lrc: 0/0,0 mode: --/PR res: [0x2b0ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a695b expref: 2184 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716503:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d79163f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.716503:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716504:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 2/0,0 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716504:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716505:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716507:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 3/0,0 mode: PW/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716508:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 4/0,1 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716514:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529338.716522:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 1/0,0 mode: --/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716525:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d79163f/0xa29a79078f3bca70 lrc: 0/0,0 mode: --/PW res: [0x2b0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716539:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10503 00000100:00100000:1.0:1651529338.716541:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2183:41278:x1731746395637504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529338.716541:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2183:41278:x1731746395637376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.716544:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10502 00010000:00010000:1.0:1651529338.716545:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.716546:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2183 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716549:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10504 00010000:00010000:1.0:1651529338.716550:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 3/0,0 mode: PR/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2182 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716551:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2182:41278:x1731746395637312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.716554:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.716555:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3b38b9 lrc: 0/0,0 mode: --/PR res: [0x2b0d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5a90 expref: 2182 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716556:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 4/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2182 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716558:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716560:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716560:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 3/0,0 mode: PR/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2181 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716563:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 4/0,1 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716565:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3b518d lrc: 0/0,0 mode: --/PR res: [0x2b0cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abe3b expref: 2181 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716568:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716570:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716575:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.716579:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 4/0,1 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716583:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2180:41278:x1731746395637504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.716586:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10503 00010000:00010000:0.0:1651529338.716586:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.716592:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10505 00000100:00100000:1.0:1651529338.716593:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2179:41278:x1731746395637440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529338.716593:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2179:41278:x1731746395637312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529338.716596:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.716597:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 5/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2179 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716601:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 4/0,0 mode: PR/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2179 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716606:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716607:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716607:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716607:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10504 00010000:00010000:1.0:1651529338.716610:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 4/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716614:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.716614:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716618:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716619:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2178:41278:x1731746395637440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.716621:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10505 00010000:00010000:0.0:1651529338.716623:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,1 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716626:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 2/0,0 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.716654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.716687:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1039:39029:x1731745946313536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1817us (1966us total) trans 30064892404 rc 0/0 00000100:00100000:1.0:1651529338.716690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.716690:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151489 00000100:00100000:0.0:1651529338.716704:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313792 00000100:00100000:0.0:1651529338.716713:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313856 00000100:00100000:0.0:1651529338.716716:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313920 00000100:00100000:0.0:1651529338.716722:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151493 00000100:00100000:1.0:1651529338.716742:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.716744:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946313792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.716750:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946313984 00002000:00080000:0.0:1651529338.716750:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176337 count 1 00010000:00010000:0.0:1651529338.716754:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: --/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716757:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151494 00000100:00100000:1.0:1651529338.716758:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946313856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.716759:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 2/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2177 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.716762:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716763:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529338.716764:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176338 count 1 00010000:00010000:0.0:1651529338.716764:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 4/0,1 mode: --/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716769:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: --/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716771:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 3/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2177 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.716774:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 2/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2177 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.716775:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 4/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2177 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.716777:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716777:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716778:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 4/0,1 mode: --/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716779:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966573056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.716785:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 3/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2177 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.716789:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 4/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2177 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716794:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.716799:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 2/0,0 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716800:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966573120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716819:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.716820:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 2/0,0 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716823:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 3/0,0 mode: PW/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716827:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.716827:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 1/0,0 mode: --/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716830:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bca8c lrc: 0/0,0 mode: --/PW res: [0x2b0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716834:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151495 00000100:00100000:1.0:1651529338.716836:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946313920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.716841:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176339 count 1 00010000:00010000:1.0:1651529338.716845:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: --/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716850:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 2/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2177 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.716853:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716853:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716854:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 4/0,1 mode: --/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716854:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151496 00000100:00100000:0.0:1651529338.716856:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946313984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.716860:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 3/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2177 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.716862:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176340 count 1 00010000:00010000:1.0:1651529338.716863:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 4/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2177 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.716865:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: --/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716867:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966573184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716870:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 2/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2177 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.716873:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.716873:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529338.716874:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.716874:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 4/0,1 mode: --/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716880:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 3/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2177 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.716884:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2177 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.716888:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966573248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.716889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.716897:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.716902:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716905:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716908:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,1 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716910:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 2/0,0 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716929:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314048 00000100:00100000:1.0:1651529338.716938:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151497 00000100:00100000:1.0:1651529338.716940:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1044:39030:x1731745946314048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.716945:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176341 count 1 00010000:00010000:1.0:1651529338.716949:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: --/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.716956:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1044:39029:x1731745946313728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1258us (1281us total) trans 30064892405 rc 0/0 00000100:00100000:0.0:1651529338.716959:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151492 00010000:00010000:1.0:1651529338.716962:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 2/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2177 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.716965:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716966:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.716966:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 4/0,1 mode: --/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716967:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 2/0,0 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.716973:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 3/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2177 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.716976:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 4/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2177 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.716980:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966573312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.716985:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d998f81 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.716986:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 2/0,0 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.716989:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.716989:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 3/0,0 mode: PW/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716994:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 1/0,0 mode: --/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.716996:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d998f81/0xa29a79078f3bcaa1 lrc: 0/0,0 mode: --/PW res: [0x2b0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717003:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717006:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717009:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,1 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717012:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 2/0,0 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717049:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 2/0,0 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717056:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1044:39029:x1731745946313600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1635us (1674us total) trans 30064892406 rc 0/0 00010000:00010000:1.0:1651529338.717057:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004ad47f2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.717058:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 2/0,0 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717059:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151490 00010000:00010000:1.0:1651529338.717061:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 3/0,0 mode: PW/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717069:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 1/0,0 mode: --/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717071:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3b4921 lrc: 0/0,0 mode: --/PR res: [0x2b0cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d9c expref: 2177 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717072:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ad47f2/0xa29a79078f3bca93 lrc: 0/0,0 mode: --/PW res: [0x2b0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717075:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966572928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.717078:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717082:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717084:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717087:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,1 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717090:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 2/0,0 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717131:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1044:39030:x1731745946313664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1538us (1568us total) trans 30064892407 rc 0/0 00000100:00100000:0.0:1651529338.717146:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151491 00010000:00010000:0.0:1651529338.717153:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 2/0,0 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717156:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009833c6fb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.717157:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 2/0,0 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717160:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 3/0,0 mode: PW/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717165:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 1/0,0 mode: --/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717168:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009833c6fb/0xa29a79078f3bca9a lrc: 0/0,0 mode: --/PW res: [0x2b0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.717212:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314112 00000100:00100000:0.0:1651529338.717219:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151498 00000100:00100000:0.0:1651529338.717221:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1044:39030:x1731745946314112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.717226:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176342 count 1 00010000:00010000:0.0:1651529338.717230:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: --/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717237:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 2/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2176 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.717240:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717241:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717241:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 4/0,1 mode: --/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717277:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 3/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2176 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.717281:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 4/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.717285:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966573376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.717298:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.717306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.717316:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.717335:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314176 00000100:00100000:0.0:1651529338.717345:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314240 00000100:00100000:1.0:1651529338.717349:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151499 00000100:00100000:1.0:1651529338.717351:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1046:39030:x1731745946314176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.717353:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151500 00000100:00100000:0.0:1651529338.717355:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1046:39030:x1731745946314240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.717356:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176343 count 1 00010000:00010000:1.0:1651529338.717360:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: --/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.717360:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176344 count 1 00010000:00010000:0.0:1651529338.717364:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: --/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717365:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 2/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2176 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.717368:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717369:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717369:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 4/0,1 mode: --/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717369:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 2/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2176 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.717376:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 3/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2176 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.717380:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 4/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2176 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.717384:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966573440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.717395:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717395:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717396:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 4/0,1 mode: --/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717404:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.717417:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 3/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2176 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.717427:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 4/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.717431:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966573504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.717440:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.717462:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966573056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.717466:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: --/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.717495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.717501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.717510:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966573120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.717514:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: --/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717521:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637568 00010000:00010000:1.0:1651529338.717526:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 4/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2177 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.717537:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637696 00010000:00010000:1.0:1651529338.717540:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 5/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2178 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.717540:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637632 00000100:00100000:1.0:1651529338.717545:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10506 00010000:00010000:0.0:1651529338.717545:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 4/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2179 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.717547:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2179:41279:x1731746395637568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717550:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.717551:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 4/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2179 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.717551:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10507 00000100:00100000:0.0:1651529338.717553:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2179:41279:x1731746395637696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717555:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 3/0,0 mode: PR/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2179 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717556:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.717558:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 5/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2179 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717561:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3b5982 lrc: 0/0,0 mode: --/PR res: [0x2b0d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add1a expref: 2179 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717561:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 4/0,0 mode: PR/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2179 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717565:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717566:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717566:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717567:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717567:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717568:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717569:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 4/0,1 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717571:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 4/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717576:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529338.717578:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.717588:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2178:41279:x1731746395637568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.717591:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10506 00000100:00100000:0.0:1651529338.717594:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2177:41279:x1731746395637696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.717597:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10507 00000100:00100000:1.0:1651529338.717601:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10508 00000100:00100000:1.0:1651529338.717603:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2176:41279:x1731746395637632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717606:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.717606:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717607:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 4/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717609:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717611:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 3/0,0 mode: PR/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717612:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,1 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717615:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 2/0,0 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717616:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3b5ced lrc: 0/0,0 mode: --/PR res: [0x2b0d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeae2 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717622:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717623:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717623:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717626:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 4/0,1 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717632:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.717638:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2175:41279:x1731746395637632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.717640:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10508 00010000:00010000:1.0:1651529338.717647:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717651:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717654:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,1 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717656:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 2/0,0 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717665:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946313792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 920us (1028us total) trans 30064892408 rc 0/0 00000100:00100000:0.0:1651529338.717669:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151493 00010000:00010000:0.0:1651529338.717691:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 2/0,0 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717695:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099bc0c8d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.717696:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 2/0,0 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717699:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 3/0,0 mode: PW/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717704:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 1/0,0 mode: --/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717705:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946313856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (1050us total) trans 30064892409 rc 0/0 00010000:00010000:0.0:1651529338.717707:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099bc0c8d/0xa29a79078f3bcaa8 lrc: 0/0,0 mode: --/PW res: [0x2b0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717708:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151494 00010000:00010000:0.0:1651529338.717711:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 2/0,0 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717720:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3b3292 lrc: 0/0,0 mode: --/PR res: [0x2b0d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a430c expref: 2174 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717723:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456e8054 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.717724:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 2/0,0 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717725:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966573184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.717738:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717739:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 3/0,0 mode: PW/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717742:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717743:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 1/0,0 mode: --/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717744:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717746:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcaaf lrc: 0/0,0 mode: --/PW res: [0x2b0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717748:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,1 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.717750:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 2/0,0 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717800:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946313920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 962us (1109us total) trans 30064892410 rc 0/0 00000100:00100000:1.0:1651529338.717819:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151495 00000100:00100000:1.0:1651529338.717846:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966573312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.717863:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: --/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717871:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 2/0,0 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717875:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db9bfbbf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.717876:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 2/0,0 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717879:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 3/0,0 mode: PW/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.717884:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 1/0,0 mode: --/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717887:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcab6 lrc: 0/0,0 mode: --/PW res: [0x2b0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.717897:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966573248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.717899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.717901:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: --/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717905:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637824 00000100:00100000:0.0:1651529338.717907:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966573376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.717910:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 4/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2174 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717910:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: --/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717921:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637760 00010000:00010000:1.0:1651529338.717923:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2175 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.717924:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637888 00000100:00100000:1.0:1651529338.717928:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10509 00000100:00100000:1.0:1651529338.717930:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2176:41279:x1731746395637824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717933:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.717934:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 4/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2176 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717938:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 3/0,0 mode: PR/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2176 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717943:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 4/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2176 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717944:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3b2c9c lrc: 0/0,0 mode: --/PR res: [0x2b0d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2acb expref: 2176 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717947:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717948:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.717949:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.717949:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10510 00000100:00100000:0.0:1651529338.717951:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2175:41279:x1731746395637760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717952:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 4/0,1 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717955:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.717956:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 4/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2175 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717960:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 3/0,0 mode: PR/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2175 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.717965:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d4c2a4/0xa29a79078f3b46b9 lrc: 0/0,0 mode: --/PR res: [0x2b0d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93b6 expref: 2175 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717967:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.717969:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717969:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.717970:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.717973:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 4/0,1 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.717979:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2174:41279:x1731746395637824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.717982:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10509 00000100:00100000:1.0:1651529338.717988:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10511 00000100:00100000:1.0:1651529338.717989:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2173:41279:x1731746395637888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.717992:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.717994:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 4/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2173 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.717998:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 3/0,0 mode: PR/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2173 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718003:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3b5f8d lrc: 0/0,0 mode: --/PR res: [0x2b0d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af975 expref: 2173 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.718010:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.718019:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2173:41279:x1731746395637760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529338.718020:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718021:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718022:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718022:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10510 00010000:00010000:1.0:1651529338.718025:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 4/0,1 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718029:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718033:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.718040:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2171:41279:x1731746395637888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.718049:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10511 00010000:00010000:0.0:1651529338.718051:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718055:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,1 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718057:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718058:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 2/0,0 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718061:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718069:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,1 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718072:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 2/0,0 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718106:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946313984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1364us total) trans 30064892411 rc 0/0 00000100:00100000:0.0:1651529338.718109:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151496 00000100:00100000:1.0:1651529338.718116:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946314048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1175us (1227us total) trans 30064892412 rc 0/0 00010000:00010000:0.0:1651529338.718117:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 2/0,0 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718119:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151497 00010000:00010000:0.0:1651529338.718120:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe0c139f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.718121:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 2/0,0 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718125:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 3/0,0 mode: PW/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718127:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 2/0,0 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718129:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 1/0,0 mode: --/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718130:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a60fe4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.718131:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 2/0,0 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718132:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe0c139f/0xa29a79078f3bcabd lrc: 0/0,0 mode: --/PW res: [0x2b0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718134:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 3/0,0 mode: PW/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718137:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718139:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 1/0,0 mode: --/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718140:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718143:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,1 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718146:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 2/0,0 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718149:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcac4 lrc: 0/0,0 mode: --/PW res: [0x2b0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718154:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 2/0,0 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718157:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000957ae578 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.718157:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 2/0,0 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718160:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 3/0,0 mode: PW/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718164:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 1/0,0 mode: --/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718166:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957ae578/0xa29a79078f3bcacb lrc: 0/0,0 mode: --/PW res: [0x2b0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718179:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946314112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 957us (978us total) trans 30064892413 rc 0/0 00000100:00100000:0.0:1651529338.718182:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151498 00000100:00100000:0.0:1651529338.718211:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966573504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.718216:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: --/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.718233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.718239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.718258:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314304 00000100:00100000:0.0:1651529338.718264:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314432 00000100:00100000:1.0:1651529338.718267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.718277:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314368 00000100:00100000:0.0:1651529338.718282:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151501 00000100:00100000:0.0:1651529338.718283:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1049:39030:x1731745946314304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.718289:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176345 count 1 00010000:00010000:0.0:1651529338.718293:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: --/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718298:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 2/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718301:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718302:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718302:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 4/0,1 mode: --/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718304:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151502 00000100:00100000:1.0:1651529338.718306:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1049:39030:x1731745946314432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.718309:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 3/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.718312:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176347 count 1 00010000:00010000:0.0:1651529338.718312:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 4/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718316:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: --/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718316:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966573568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.718331:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.718335:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 2/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2170 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718338:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.718338:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151503 00010000:00010000:1.0:1651529338.718339:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718340:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 4/0,1 mode: --/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718340:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1049:39030:x1731745946314368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.718344:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176346 count 1 00010000:00010000:1.0:1651529338.718347:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 3/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2170 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718348:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: --/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718351:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 4/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2170 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.718355:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966573632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.718364:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.718368:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 2/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2170 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718371:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718371:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718372:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 4/0,1 mode: --/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718374:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966573440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.718378:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: --/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718379:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 3/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2170 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718383:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 4/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2170 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.718385:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395637952 00000100:00100000:0.0:1651529338.718387:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966573696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.718390:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 4/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2171 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718395:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.718397:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10512 00000100:00100000:1.0:1651529338.718399:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2171:41279:x1731746395637952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.718402:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.718403:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 4/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2171 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718407:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 3/0,0 mode: PR/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2171 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.718412:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177708c4/0xa29a79078f3b418e lrc: 0/0,0 mode: --/PR res: [0x2b0d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7e5b expref: 2171 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718422:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718423:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718424:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718427:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 4/0,1 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718433:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.718440:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2170:41279:x1731746395637952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.718463:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10512 00000100:00100000:1.0:1651529338.718472:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638016 00010000:00010000:1.0:1651529338.718476:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 4/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2170 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.718488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.718499:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10513 00000100:00100000:1.0:1651529338.718501:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2170:41279:x1731746395638016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.718504:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.718506:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 4/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2170 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718509:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 3/0,0 mode: PR/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2170 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718515:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3b3421 lrc: 0/0,0 mode: --/PR res: [0x2b0d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4884 expref: 2170 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.718523:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718524:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718524:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718525:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314496 00010000:00010000:1.0:1651529338.718528:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 4/0,1 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718532:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314624 00010000:00010000:1.0:1651529338.718536:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.718541:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314560 00000100:00100000:1.0:1651529338.718546:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2169:41279:x1731746395638016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.718553:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10513 00000100:00100000:0.0:1651529338.718554:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151504 00000100:00100000:0.0:1651529338.718556:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946314496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.718561:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176348 count 1 00000100:00100000:1.0:1651529338.718565:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151505 00010000:00010000:0.0:1651529338.718566:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: --/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718567:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946314624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.718570:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 2/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2168 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.718573:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176350 count 1 00010000:00010000:0.0:1651529338.718573:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718574:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718575:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 4/0,1 mode: --/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718577:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: --/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718581:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 3/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2168 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718584:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 2/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2168 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718585:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 4/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.718587:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718587:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718588:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 4/0,1 mode: --/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718589:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966573760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.718594:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 3/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2168 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718598:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 4/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2168 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718598:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.718602:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966573824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.718604:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151506 00000100:00100000:0.0:1651529338.718606:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946314560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.718610:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.718611:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176349 count 1 00010000:00010000:1.0:1651529338.718616:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718619:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718622:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,1 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718624:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: --/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718625:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 2/0,0 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718628:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 2/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2168 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718631:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718632:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718638:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 4/0,1 mode: --/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718646:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 3/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2168 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718650:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 4/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2168 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718654:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966573888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.718661:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.718666:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718669:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718671:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1053:39030:x1731745946314176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1365us total) trans 30064892414 rc 0/0 00010000:00010000:0.0:1651529338.718672:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,1 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718674:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151499 00010000:00010000:0.0:1651529338.718683:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 2/0,0 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.718726:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1053:39030:x1731745946314240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1409us total) trans 30064892415 rc 0/0 00000100:00100000:0.0:1651529338.718739:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151500 00010000:00010000:0.0:1651529338.718747:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 2/0,0 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718751:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494eede9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.718752:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 2/0,0 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718755:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 3/0,0 mode: PW/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718760:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 1/0,0 mode: --/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718763:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcad2 lrc: 0/0,0 mode: --/PW res: [0x2b0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718767:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 2/0,0 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718770:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ecccf98a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.718777:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 2/0,0 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718780:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 3/0,0 mode: PW/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718784:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 1/0,0 mode: --/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718787:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecccf98a/0xa29a79078f3bcad9 lrc: 0/0,0 mode: --/PW res: [0x2b0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.718901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.718911:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314752 00000100:00100000:1.0:1651529338.718912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.718925:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314688 00000100:00100000:1.0:1651529338.718929:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151507 00000100:00100000:1.0:1651529338.718931:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1054:39029:x1731745946314752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.718935:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151508 00000100:00100000:0.0:1651529338.718937:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1054:39029:x1731745946314688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.718942:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176352 count 1 00002000:00080000:0.0:1651529338.718942:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176351 count 1 00010000:00010000:1.0:1651529338.718947:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: --/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718947:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: --/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718951:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 2/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2168 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718952:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 2/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2168 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.718954:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718955:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718955:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.718955:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 4/0,1 mode: --/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.718956:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.718957:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 4/0,1 mode: --/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.718962:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 3/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2168 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718964:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 3/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2168 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.718967:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 4/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2168 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.718972:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966574016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.718974:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 4/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2168 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.718978:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966573952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.718987:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.718994:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.720925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.720928:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966573568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.720932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.720933:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: --/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.720941:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966573632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.720945:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: --/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.720953:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638080 00010000:00010000:1.0:1651529338.720958:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 4/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2169 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.720965:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638144 00010000:00010000:1.0:1651529338.720967:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 4/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2170 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.720973:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10514 00000100:00100000:1.0:1651529338.720975:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2170:41279:x1731746395638080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.720978:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.720979:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 4/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.720983:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 3/0,0 mode: PR/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.720988:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0ee9189/0xa29a79078f3b45ee lrc: 0/0,0 mode: --/PR res: [0x2b0d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a90d7 expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.720995:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.720995:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.720996:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.720999:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 4/0,1 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721010:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.721018:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.721021:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2169:41279:x1731746395638080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.721024:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10514 00010000:00010000:0.0:1651529338.721026:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.721029:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10515 00010000:00010000:0.0:1651529338.721029:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,1 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.721031:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2168:41279:x1731746395638144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.721032:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 2/0,0 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721033:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.721035:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 4/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.721038:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 3/0,0 mode: PR/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.721043:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b94478/0xa29a79078f3b4a40 lrc: 0/0,0 mode: --/PR res: [0x2b0db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa1c4 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.721046:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.721047:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.721048:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721051:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 4/0,1 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721057:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.721062:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2167:41279:x1731746395638144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.721065:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10515 00010000:00010000:1.0:1651529338.721071:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721074:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.721081:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946314304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2796us (2863us total) trans 30064892416 rc 0/0 00010000:00010000:1.0:1651529338.721083:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,1 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.721084:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151501 00010000:00010000:1.0:1651529338.721087:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 2/0,0 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721092:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 2/0,0 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721103:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb6b1ff6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.721104:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 2/0,0 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721107:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 3/0,0 mode: PW/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721112:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 1/0,0 mode: --/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721115:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b1ff6/0xa29a79078f3bcae0 lrc: 0/0,0 mode: --/PW res: [0x2b0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721120:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 2/0,0 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721122:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a97431c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.721123:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 2/0,0 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721126:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 3/0,0 mode: PW/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.721127:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946314432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2820us (2888us total) trans 30064892417 rc 0/0 00010000:00010000:0.0:1651529338.721129:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 1/0,0 mode: --/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.721131:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151502 00010000:00010000:0.0:1651529338.721135:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcae7 lrc: 0/0,0 mode: --/PW res: [0x2b0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.721355:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.721370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.721375:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314880 00000100:00100000:0.0:1651529338.721377:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314816 00000100:00100000:1.0:1651529338.721387:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151509 00000100:00100000:1.0:1651529338.721394:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1056:39029:x1731745946314880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.721395:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151510 00000100:00100000:0.0:1651529338.721397:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1056:39029:x1731745946314816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.721400:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176354 count 1 00002000:00080000:0.0:1651529338.721402:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176353 count 1 00010000:00010000:1.0:1651529338.721405:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: --/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721407:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: --/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721409:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 2/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2166 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.721412:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 2/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2166 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.721413:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.721413:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.721414:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 4/0,1 mode: --/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.721415:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.721415:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.721416:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 4/0,1 mode: --/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.721421:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 3/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2166 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.721423:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 3/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2166 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.721424:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 4/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2166 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.721427:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2166 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.721429:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.721434:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966574144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.721440:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.721443:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.722461:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966573696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.722463:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966573824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.722465:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: --/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.722468:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: --/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.722473:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966573760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.722476:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.722476:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: --/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.722479:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: --/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.722482:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966573888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.722485:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: --/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.722486:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966574016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.722488:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: --/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.722491:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966573952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.722494:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: --/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725056:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.725105:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638272 00000100:00100000:0.0:1651529338.725106:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966574144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.725110:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 4/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2167 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725111:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: --/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725116:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638400 00010000:00010000:1.0:1651529338.725119:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 4/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2168 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725123:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638528 00010000:00010000:1.0:1651529338.725125:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 4/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2169 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725128:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638208 00010000:00010000:1.0:1651529338.725130:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 4/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2170 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725135:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638336 00010000:00010000:1.0:1651529338.725136:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 4/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2171 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725140:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638464 00010000:00010000:1.0:1651529338.725142:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 4/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2172 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725145:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638592 00010000:00010000:1.0:1651529338.725147:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 4/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2173 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725151:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638656 00010000:00010000:1.0:1651529338.725153:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2174 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725157:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10516 00000100:00100000:1.0:1651529338.725159:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2174:41278:x1731746395638272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.725162:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725163:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 4/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2174 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725166:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 3/0,0 mode: PR/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2174 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725172:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3b48c6 lrc: 0/0,0 mode: --/PR res: [0x2b0dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bd5 expref: 2174 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725176:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725177:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725178:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725181:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 4/0,1 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725192:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.725200:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725203:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2173:41278:x1731746395638272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725206:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10516 00010000:00010000:0.0:1651529338.725208:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725211:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10517 00010000:00010000:0.0:1651529338.725212:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,1 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725213:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2172:41278:x1731746395638400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.725215:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 2/0,0 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725216:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725217:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 4/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2172 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725221:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 3/0,0 mode: PR/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2172 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725226:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3b5fef lrc: 0/0,0 mode: --/PR res: [0x2b0dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afbb3 expref: 2172 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725229:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725230:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725230:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725233:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 4/0,1 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725241:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.725247:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2171:41278:x1731746395638400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725249:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10517 00000100:00100000:1.0:1651529338.725253:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10518 00000100:00100000:1.0:1651529338.725255:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2170:41278:x1731746395638528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.725257:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725258:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 4/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725262:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 3/0,0 mode: PR/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.725269:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1057:39029:x1731745946314496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 6712us (6789us total) trans 30064892418 rc 0/0 00000100:00100000:0.0:1651529338.725273:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151504 00010000:00010000:1.0:1651529338.725274:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118dfb6e/0xa29a79078f3b41f0 lrc: 0/0,0 mode: --/PR res: [0x2b0df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a805a expref: 2170 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725277:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725278:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725279:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725281:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 2/0,0 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725284:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e468780d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725285:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 2/0,0 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725288:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 3/0,0 mode: PW/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725292:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 4/0,1 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725294:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 1/0,0 mode: --/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725297:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e468780d/0xa29a79078f3bcaf5 lrc: 0/0,0 mode: --/PW res: [0x2b0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725300:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.725307:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2169:41278:x1731746395638528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.725309:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725310:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10518 00010000:00010000:0.0:1651529338.725312:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725314:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10519 00010000:00010000:0.0:1651529338.725315:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,1 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725316:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2168:41278:x1731746395638208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.725318:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 2/0,0 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725319:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725320:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 4/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725332:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 3/0,0 mode: PR/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725338:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048386c08/0xa29a79078f3b4e29 lrc: 0/0,0 mode: --/PR res: [0x2b0da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab0c7 expref: 2168 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725341:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725342:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725343:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725345:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 4/0,1 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.725356:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1057:39029:x1731745946314560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 6749us (6841us total) trans 30064892419 rc 0/0 00010000:00010000:1.0:1651529338.725360:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.725366:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151506 00000100:00100000:1.0:1651529338.725367:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2167:41278:x1731746395638208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725370:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10519 00010000:00010000:0.0:1651529338.725372:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725374:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10520 00000100:00100000:1.0:1651529338.725376:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2166:41278:x1731746395638336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.725376:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725378:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,1 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725379:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725380:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 4/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2166 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725381:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 2/0,0 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725384:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 3/0,0 mode: PR/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2166 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725388:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ab3f3a9/0xa29a79078f3b347c lrc: 0/0,0 mode: --/PR res: [0x2b0de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4987 expref: 2166 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725392:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725393:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725393:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725396:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 4/0,1 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725402:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.725407:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2165:41278:x1731746395638336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725417:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10520 00000100:00100000:0.0:1651529338.725417:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1057:39030:x1731745946314368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 7077us (7151us total) trans 30064892420 rc 0/0 00000100:00100000:0.0:1651529338.725420:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151503 00000100:00100000:1.0:1651529338.725426:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10521 00000100:00100000:1.0:1651529338.725427:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2164:41278:x1731746395638464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.725427:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 2/0,0 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725430:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.725430:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5440c0c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.725431:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 4/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725431:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 2/0,0 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725434:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 3/0,0 mode: PW/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725435:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 3/0,0 mode: PR/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725438:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 1/0,0 mode: --/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725440:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3b3953 lrc: 0/0,0 mode: --/PR res: [0x2b0e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5c8f expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725441:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5440c0c/0xa29a79078f3bcb03 lrc: 0/0,0 mode: --/PW res: [0x2b0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725443:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725444:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725444:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725445:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 2/0,0 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725447:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 4/0,1 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725447:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7bf54e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725448:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 2/0,0 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725454:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.725454:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 3/0,0 mode: PW/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725457:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 1/0,0 mode: --/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725459:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2163:41278:x1731746395638464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (381us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.725459:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7bf54e9/0xa29a79078f3bcaee lrc: 0/0,0 mode: --/PW res: [0x2b0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725462:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10521 00010000:00010000:0.0:1651529338.725464:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725466:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10522 00010000:00010000:0.0:1651529338.725467:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725470:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,1 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725473:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 2/0,0 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725474:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2162:41278:x1731746395638592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.725477:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725478:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 4/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2162 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725482:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 3/0,0 mode: PR/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2162 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725487:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3b3aaa lrc: 0/0,0 mode: --/PR res: [0x2b0e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61b3 expref: 2162 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725490:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725491:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725491:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725494:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 4/0,1 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725500:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.725505:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1057:39029:x1731745946314688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 6567us (6592us total) trans 30064892421 rc 0/0 00000100:00100000:1.0:1651529338.725506:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2161:41278:x1731746395638592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725508:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10522 00000100:00100000:0.0:1651529338.725508:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151508 00000100:00100000:1.0:1651529338.725512:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10523 00000100:00100000:1.0:1651529338.725514:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2160:41279:x1731746395638656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.725514:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 2/0,0 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725516:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.725517:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2160 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725519:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000947d23cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725520:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 2/0,0 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725523:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 3/0,0 mode: PW/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725527:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 1/0,0 mode: --/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725528:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 3/0,0 mode: PR/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2160 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.725530:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000947d23cc/0xa29a79078f3bcb0a lrc: 0/0,0 mode: --/PW res: [0x2b0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725533:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0616ca9/0xa29a79078f3b56a3 lrc: 0/0,0 mode: --/PR res: [0x2b0e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad223 expref: 2160 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.725536:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725537:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725538:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725540:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 4/0,1 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725548:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.725555:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2159:41279:x1731746395638656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.725557:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10523 00010000:00010000:1.0:1651529338.725566:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725569:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725572:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,1 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725587:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 2/0,0 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725616:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 2/0,0 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725620:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a9ad643 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725621:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 2/0,0 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725624:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 3/0,0 mode: PW/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725629:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 1/0,0 mode: --/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725634:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a9ad643/0xa29a79078f3bcafc lrc: 0/0,0 mode: --/PW res: [0x2b0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725640:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725642:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725646:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,1 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725650:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1057:39029:x1731745946314624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 7082us (7161us total) trans 30064892422 rc 0/0 00000100:00100000:1.0:1651529338.725653:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151505 00010000:00010000:1.0:1651529338.725662:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725665:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725668:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 2/0,0 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725669:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,1 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725671:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 2/0,0 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.725708:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946314816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4311us (4338us total) trans 30064892423 rc 0/0 00000100:00100000:1.0:1651529338.725709:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946314880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4315us (4354us total) trans 30064892424 rc 0/0 00000100:00100000:0.0:1651529338.725711:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151510 00000100:00100000:1.0:1651529338.725713:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151509 00010000:00010000:0.0:1651529338.725719:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 2/0,0 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725720:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 2/0,0 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725722:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088f9eee5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725723:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 2/0,0 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725724:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058936903 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.725725:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 2/0,0 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725726:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 3/0,0 mode: PW/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725739:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 3/0,0 mode: PW/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725743:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 1/0,0 mode: --/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725744:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 1/0,0 mode: --/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725746:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088f9eee5/0xa29a79078f3bcb1f lrc: 0/0,0 mode: --/PW res: [0x2b0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725747:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcb18 lrc: 0/0,0 mode: --/PW res: [0x2b0e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725754:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725757:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725760:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,1 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725762:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 2/0,0 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725780:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 2/0,0 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725798:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.725800:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 2/0,0 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725824:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 3/0,0 mode: PW/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725826:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1057:39029:x1731745946314752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 6894us (6926us total) trans 30064892425 rc 0/0 00000100:00100000:1.0:1651529338.725829:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151507 00010000:00010000:0.0:1651529338.725838:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 1/0,0 mode: --/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.725842:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcb11 lrc: 0/0,0 mode: --/PW res: [0x2b0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.725909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.725918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.725924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.725934:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946314944 00000100:00100000:1.0:1651529338.725936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.725942:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315008 00000100:00100000:1.0:1651529338.725943:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315136 00000100:00100000:0.0:1651529338.725946:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315072 00000100:00100000:1.0:1651529338.725954:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151511 00000100:00100000:1.0:1651529338.725956:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946314944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.725961:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176355 count 1 00010000:00010000:1.0:1651529338.725966:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: --/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.725971:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 2/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.725974:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151512 00010000:00010000:1.0:1651529338.725975:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725975:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.725976:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 4/0,1 mode: --/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.725976:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946315008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.725982:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 3/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.725986:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 4/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2158 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.725991:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966574208:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529338.726000:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176356 count 1 00010000:00010000:0.0:1651529338.726005:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: --/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.726010:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 2/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.726012:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.726013:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726014:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726015:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 4/0,1 mode: --/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.726018:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151513 00000100:00100000:1.0:1651529338.726020:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946315136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.726022:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 3/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.726026:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176358 count 1 00010000:00010000:0.0:1651529338.726026:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 4/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.726030:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: --/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.726030:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966574272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.726035:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 2/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.726038:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726038:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726039:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 4/0,1 mode: --/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.726039:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.726045:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 3/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.726048:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151514 00010000:00010000:1.0:1651529338.726049:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 4/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.726053:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.726060:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.726069:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000093e60af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946315072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.726075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529338.726079:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176357 count 1 00010000:00010000:0.0:1651529338.726085:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: --/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.726089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.726091:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 2/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.726105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.726107:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726108:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726109:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 4/0,1 mode: --/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.726120:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 3/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.726126:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 4/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.726133:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966574400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.726137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.726145:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315200 00000100:00100000:0.0:1651529338.726153:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.726156:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315328 00000100:00100000:1.0:1651529338.726159:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315264 00000100:00100000:0.0:1651529338.726161:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315392 00000100:00100000:1.0:1651529338.726162:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151515 00000100:00100000:1.0:1651529338.726164:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1064:39030:x1731745946315200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.726168:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151516 00002000:00080000:1.0:1651529338.726169:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176359 count 1 00000100:00100000:0.0:1651529338.726171:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1064:39030:x1731745946315328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.726174:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: --/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.726178:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 2/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.726179:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176361 count 1 00010000:00010000:1.0:1651529338.726181:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726182:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726183:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 4/0,1 mode: --/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.726186:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: --/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.726190:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 3/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.726193:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 4/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2158 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.726194:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 2/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.726197:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966574464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.726199:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726200:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726201:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 4/0,1 mode: --/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.726206:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.726212:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151517 00010000:00010000:0.0:1651529338.726213:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 3/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2158 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.726214:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1064:39030:x1731745946315264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.726217:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00002000:00080000:1.0:1651529338.726219:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176360 count 1 00010000:00010000:1.0:1651529338.726222:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: --/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.726222:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966574528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.726229:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 2/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.726231:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.726232:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726232:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.726233:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 4/0,1 mode: --/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.726238:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151518 00010000:00010000:1.0:1651529338.726239:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 3/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.726240:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1064:39029:x1731745946315392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.726242:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 4/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2158 pid: 161133 timeout: 13088 lvb_type: 1 00002000:00080000:0.0:1651529338.726245:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176362 count 1 00000100:00100000:1.0:1651529338.726246:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966574592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.726249:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: --/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.726252:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.726253:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 2/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.726256:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726257:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.726257:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 4/0,1 mode: --/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.726263:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 3/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2158 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.726267:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 4/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2158 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.726271:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966574656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.726277:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.727397:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966574208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.727402:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: --/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727426:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.727430:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: --/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.727432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.727441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.727447:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966574464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.727449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.727451:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: --/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.727458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.727466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.727468:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638720 00000100:00100000:0.0:1651529338.727471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.727473:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 4/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2159 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.727486:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638848 00000100:00100000:0.0:1651529338.727486:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966574528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.727489:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 4/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2160 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.727490:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: --/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727493:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638976 00010000:00010000:1.0:1651529338.727495:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 4/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2161 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.727498:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966574400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.727499:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638784 00010000:00010000:1.0:1651529338.727501:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 5/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2162 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.727501:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: --/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727505:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395638912 00010000:00010000:1.0:1651529338.727507:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 4/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2163 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.727507:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966574272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.727510:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639040 00010000:00010000:0.0:1651529338.727510:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: --/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727512:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2164 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.727517:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10524 00000100:00100000:1.0:1651529338.727527:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2164:41279:x1731746395638720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727530:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727532:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 4/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727535:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 3/0,0 mode: PR/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727541:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3b3e46 lrc: 0/0,0 mode: --/PR res: [0x2b0e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6fba expref: 2164 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727545:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727546:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727547:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727550:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 4/0,1 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727557:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.727565:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2163:41279:x1731746395638720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727568:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10524 00000100:00100000:1.0:1651529338.727573:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10525 00000100:00100000:1.0:1651529338.727575:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2162:41279:x1731746395638848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727577:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727579:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 4/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2162 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727590:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 3/0,0 mode: PR/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2162 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727595:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003366cade/0xa29a79078f3b4f64 lrc: 0/0,0 mode: --/PR res: [0x2b0e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab520 expref: 2162 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727598:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727599:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727599:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727602:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 4/0,1 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727608:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.727614:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2161:41279:x1731746395638848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727616:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10525 00000100:00100000:1.0:1651529338.727621:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10526 00000100:00100000:1.0:1651529338.727622:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2160:41279:x1731746395638976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727625:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727626:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 4/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2160 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727629:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 3/0,0 mode: PR/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2160 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727641:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3b4228 lrc: 0/0,0 mode: --/PR res: [0x2b0e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8164 expref: 2160 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727645:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727645:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727646:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727649:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 4/0,1 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727654:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.727660:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2159:41279:x1731746395638976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727663:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10526 00000100:00100000:1.0:1651529338.727667:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10527 00000100:00100000:1.0:1651529338.727668:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2158:41279:x1731746395638784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727671:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727672:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 4/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727676:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 3/0,0 mode: PR/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727680:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3b3222 lrc: 0/0,0 mode: --/PR res: [0x2b0e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4129 expref: 2158 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727693:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727693:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727694:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727697:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 4/0,1 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727707:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.727714:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2157:41279:x1731746395638784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727716:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10527 00010000:00010000:0.0:1651529338.727717:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727721:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727725:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10528 00010000:00010000:0.0:1651529338.727725:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,1 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727736:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 2/0,0 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727737:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2156:41279:x1731746395638912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727740:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727742:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 4/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2156 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727746:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 3/0,0 mode: PR/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2156 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727751:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3b5561 lrc: 0/0,0 mode: --/PR res: [0x2b0e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd53 expref: 2156 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727754:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727755:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727756:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727759:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 4/0,1 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727767:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.727773:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2155:41279:x1731746395638912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727776:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10528 00000100:00100000:1.0:1651529338.727780:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10529 00000100:00100000:1.0:1651529338.727782:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2154:41279:x1731746395639040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.727784:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.727785:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 4/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727789:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 3/0,0 mode: PR/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.727789:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946315008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1812us (1870us total) trans 30064892426 rc 0/0 00000100:00100000:0.0:1651529338.727792:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151512 00010000:00010000:1.0:1651529338.727794:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fbff31b/0xa29a79078f3b4fa3 lrc: 0/0,0 mode: --/PR res: [0x2b0e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab631 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.727797:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727798:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.727798:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727800:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 2/0,0 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727816:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 4/0,1 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727816:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a97431c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.727817:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 2/0,0 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727820:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 3/0,0 mode: PW/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727824:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.727830:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 1/0,0 mode: --/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727831:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2153:41279:x1731746395639040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.727833:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10529 00010000:00010000:0.0:1651529338.727833:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a97431c/0xa29a79078f3bcb2d lrc: 0/0,0 mode: --/PW res: [0x2b0e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727840:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727843:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966574592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.727843:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727846:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,1 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727847:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: --/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727848:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 2/0,0 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727853:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727862:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727865:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,1 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727868:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 2/0,0 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.727898:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946315328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1726us (1808us total) trans 30064892427 rc 0/0 00000100:00100000:0.0:1651529338.727901:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151516 00010000:00010000:0.0:1651529338.727908:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 2/0,0 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727911:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db9bfbbf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.727912:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 2/0,0 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727913:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946315136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1892us (1989us total) trans 30064892428 rc 0/0 00010000:00010000:0.0:1651529338.727915:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 3/0,0 mode: PW/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.727916:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151513 00010000:00010000:0.0:1651529338.727919:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 1/0,0 mode: --/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727922:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcb49 lrc: 0/0,0 mode: --/PW res: [0x2b0e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727925:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 2/0,0 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727928:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.727929:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727930:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 2/0,0 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727932:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 3/0,0 mode: PW/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727932:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727934:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,1 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727937:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 1/0,0 mode: --/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727937:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 2/0,0 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727940:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcb34 lrc: 0/0,0 mode: --/PW res: [0x2b0e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727944:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 2/0,0 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727947:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494eede9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.727948:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 2/0,0 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727951:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 3/0,0 mode: PW/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727954:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 1/0,0 mode: --/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727959:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcb3b lrc: 0/0,0 mode: --/PW res: [0x2b0e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727965:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727967:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.727971:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,1 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.727971:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000093e60af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1065:39030:x1731745946315072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1920us (2035us total) trans 30064892429 rc 0/0 00010000:00010000:1.0:1651529338.727973:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 2/0,0 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.727974:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151514 00010000:00010000:0.0:1651529338.727990:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 2/0,0 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727993:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a60fe4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.727994:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 2/0,0 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.727997:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 3/0,0 mode: PW/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728001:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 1/0,0 mode: --/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728005:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcb26 lrc: 0/0,0 mode: --/PW res: [0x2b0e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728014:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1065:39030:x1731745946314944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2057us (2105us total) trans 30064892430 rc 0/0 00000100:00100000:1.0:1651529338.728017:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151511 00010000:00010000:1.0:1651529338.728038:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728041:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728051:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,1 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728057:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 2/0,0 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728130:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1065:39030:x1731745946315200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1965us (2054us total) trans 30064892431 rc 0/0 00000100:00100000:1.0:1651529338.728133:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151515 00010000:00010000:1.0:1651529338.728140:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 2/0,0 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728143:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.728144:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 2/0,0 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728147:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 3/0,0 mode: PW/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728152:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 1/0,0 mode: --/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728155:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcb42 lrc: 0/0,0 mode: --/PW res: [0x2b0e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.728271:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.728282:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315456 00000100:00100000:0.0:1651529338.728283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.728291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.728303:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315584 00000100:00100000:1.0:1651529338.728310:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315712 00000100:00100000:0.0:1651529338.728312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.728320:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315520 00000100:00100000:1.0:1651529338.728327:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151519 00000100:00100000:1.0:1651529338.728329:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1068:39030:x1731745946315456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.728331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529338.728339:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176363 count 1 00000100:00100000:0.0:1651529338.728341:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315648 00010000:00010000:1.0:1651529338.728344:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: --/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.728347:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151520 00010000:00010000:1.0:1651529338.728349:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 2/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728352:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728352:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728353:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 4/0,1 mode: --/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.728364:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1069:39030:x1731745946315584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.728365:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 3/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728370:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 4/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00002000:00080000:0.0:1651529338.728370:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176365 count 1 00000100:00100000:1.0:1651529338.728374:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966574720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.728375:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: --/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728380:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 2/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2152 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.728389:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.728396:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151521 00000100:00100000:1.0:1651529338.728397:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1069:39030:x1731745946315712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.728402:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176367 count 1 00010000:00010000:0.0:1651529338.728403:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.728404:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.728405:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 4/0,1 mode: --/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728406:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: --/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728413:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 3/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2152 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.728417:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 4/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2152 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728421:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 2/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2152 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.728422:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966574784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.728424:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728425:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728425:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 4/0,1 mode: --/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.728431:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.728432:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 3/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2152 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728436:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 4/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2152 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.728438:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151522 00000100:00100000:1.0:1651529338.728440:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.728440:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946315520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.728444:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176364 count 1 00000100:00100000:1.0:1651529338.728447:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.728448:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: --/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728453:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 2/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2152 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.728454:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151523 00000100:00100000:1.0:1651529338.728456:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946315648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.728456:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.728456:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.728457:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 4/0,1 mode: --/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.728460:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176366 count 1 00010000:00010000:0.0:1651529338.728463:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 3/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2152 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728464:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: --/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728467:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 4/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2152 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728468:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 2/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728471:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.728471:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966574912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.728477:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.728479:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728479:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 4/0,1 mode: --/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728487:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 3/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728490:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 4/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.728494:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966574976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.728502:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.728504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.728519:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315776 00000100:00100000:1.0:1651529338.728530:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151524 00000100:00100000:1.0:1651529338.728532:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1070:39029:x1731745946315776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.728559:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176368 count 1 00010000:00010000:1.0:1651529338.728564:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: --/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728569:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 2/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728572:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728572:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728573:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 4/0,1 mode: --/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728579:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 3/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.728591:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 4/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.728596:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.728609:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.728684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.728698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.728708:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639168 00000100:00100000:0.0:1651529338.728708:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966574656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.728713:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: --/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728714:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 4/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2153 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.728722:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639104 00010000:00010000:1.0:1651529338.728725:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 4/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2154 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.728741:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10530 00000100:00100000:1.0:1651529338.728743:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2154:41278:x1731746395639168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.728746:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.728747:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 4/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2154 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728751:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 3/0,0 mode: PR/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2154 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728757:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3b396f lrc: 0/0,0 mode: --/PR res: [0x2b0ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5cc7 expref: 2154 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728772:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728773:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728776:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 4/0,1 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728784:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.728788:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728792:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728794:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2153:41278:x1731746395639168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.728795:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,1 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728797:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10530 00010000:00010000:0.0:1651529338.728797:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 2/0,0 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728801:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10531 00000100:00100000:1.0:1651529338.728819:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2152:41278:x1731746395639104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.728822:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.728824:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 4/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728828:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 3/0,0 mode: PR/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728833:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3b3c6a lrc: 0/0,0 mode: --/PR res: [0x2b0e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a68f2 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.728837:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728844:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.728845:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728848:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 4/0,1 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728854:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.728856:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1071:39029:x1731745946315392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2615us (2726us total) trans 30064892432 rc 0/0 00000100:00100000:0.0:1651529338.728859:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151518 00000100:00100000:1.0:1651529338.728861:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2151:41278:x1731746395639104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.728864:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10531 00010000:00010000:0.0:1651529338.728866:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 2/0,0 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728869:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456e8054 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.728870:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728870:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 2/0,0 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728873:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728876:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,1 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728876:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 3/0,0 mode: PW/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.728879:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 2/0,0 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728881:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 1/0,0 mode: --/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728883:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcb57 lrc: 0/0,0 mode: --/PW res: [0x2b0ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728896:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 2/0,0 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728898:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072624c54 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.728899:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 2/0,0 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728902:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 3/0,0 mode: PW/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728905:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 1/0,0 mode: --/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.728908:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcb50 lrc: 0/0,0 mode: --/PW res: [0x2b0e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.728921:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1071:39030:x1731745946315264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2706us (2816us total) trans 30064892433 rc 0/0 00000100:00100000:1.0:1651529338.728924:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151517 00000100:00100000:1.0:1651529338.729139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.729153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.729164:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315840 00000100:00100000:1.0:1651529338.729185:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315904 00000100:00100000:1.0:1651529338.729191:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151525 00000100:00100000:1.0:1651529338.729193:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1072:39030:x1731745946315840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.729196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529338.729198:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176369 count 1 00000100:00100000:0.0:1651529338.729207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.729208:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: --/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.729218:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 2/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2150 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.729225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.729226:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729226:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729231:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 4/0,1 mode: --/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729239:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 3/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2150 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.729243:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 4/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2150 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.729243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.729253:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966574784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.729255:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966575104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.729257:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: --/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729265:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966574912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.729267:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.729268:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: --/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729274:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966574848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.729275:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151526 00000100:00100000:0.0:1651529338.729276:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1072:39029:x1731745946315904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.729279:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: --/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.729282:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176370 count 1 00010000:00010000:0.0:1651529338.729286:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: --/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729288:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966574976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.729291:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: --/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729291:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 2/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2150 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.729294:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.729294:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.729295:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 4/0,1 mode: --/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729297:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966574720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.729300:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: --/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729302:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 3/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2150 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.729306:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639296 00010000:00010000:0.0:1651529338.729306:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 4/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2150 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729310:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 4/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2151 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.729315:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639424 00010000:00010000:1.0:1651529338.729318:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 4/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2152 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.729322:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639232 00010000:00010000:1.0:1651529338.729324:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 4/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2153 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.729326:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966575168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.729328:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639360 00010000:00010000:1.0:1651529338.729330:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 4/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.729334:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639488 00010000:00010000:1.0:1651529338.729336:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 4/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2155 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.729336:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.729340:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10532 00000100:00100000:1.0:1651529338.729342:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2155:41278:x1731746395639296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729344:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.729346:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 4/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2155 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729349:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 3/0,0 mode: PR/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2155 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729363:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003509550/0xa29a79078f3b6090 lrc: 0/0,0 mode: --/PR res: [0x2b0ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe8b expref: 2155 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.729366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.729367:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729367:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729368:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729371:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 4/0,1 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729380:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.729390:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729394:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729398:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2154:41278:x1731746395639296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.729401:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10532 00010000:00010000:0.0:1651529338.729402:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,1 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729405:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 2/0,0 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729406:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639552 00010000:00010000:1.0:1651529338.729420:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 5/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2154 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.729426:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10533 00000100:00100000:1.0:1651529338.729428:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2154:41278:x1731746395639424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729430:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.729431:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 4/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729435:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 3/0,0 mode: PR/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729440:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3b5124 lrc: 0/0,0 mode: --/PR res: [0x2b0ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc97 expref: 2154 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729443:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729444:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729445:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729448:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 4/0,1 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729449:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1073:39030:x1731745946315584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1099us (1166us total) trans 30064892434 rc 0/0 00000100:00100000:0.0:1651529338.729452:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151520 00010000:00010000:1.0:1651529338.729457:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.729464:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2153:41278:x1731746395639424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.729466:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10533 00010000:00010000:0.0:1651529338.729466:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729469:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729470:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10534 00010000:00010000:0.0:1651529338.729473:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,1 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729475:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 2/0,0 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729479:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2152:41278:x1731746395639232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729481:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.729483:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 4/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729487:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 3/0,0 mode: PR/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729492:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3b3b36 lrc: 0/0,0 mode: --/PR res: [0x2b0eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a63e3 expref: 2152 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729495:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729496:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729496:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729499:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 4/0,1 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729506:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.729510:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1073:39029:x1731745946315520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1069us (1202us total) trans 30064892435 rc 0/0 00000100:00100000:1.0:1651529338.729511:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2151:41278:x1731746395639232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.729513:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151522 00000100:00100000:1.0:1651529338.729514:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10534 00010000:00010000:0.0:1651529338.729519:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 2/0,0 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729522:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10535 00010000:00010000:0.0:1651529338.729522:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000295d0cfb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.729523:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 2/0,0 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729524:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2150:41278:x1731746395639360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729526:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.729526:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 3/0,0 mode: PW/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729527:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 4/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2150 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729531:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 3/0,0 mode: PR/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2150 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.729531:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 1/0,0 mode: --/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729534:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcb65 lrc: 0/0,0 mode: --/PW res: [0x2b0ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729536:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3b3054 lrc: 0/0,0 mode: --/PR res: [0x2b0ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a39b9 expref: 2150 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.729538:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 2/0,0 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729539:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729539:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729540:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729542:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079306074 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.729542:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 2/0,0 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729543:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 4/0,1 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729545:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 3/0,0 mode: PW/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729548:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 1/0,0 mode: --/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729549:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.729551:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcb73 lrc: 0/0,0 mode: --/PW res: [0x2b0ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729553:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2149:41278:x1731746395639360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.729555:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10535 00000100:00100000:1.0:1651529338.729559:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10536 00000100:00100000:1.0:1651529338.729561:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2148:41278:x1731746395639488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729563:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.729564:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 4/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2148 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729567:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 3/0,0 mode: PR/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2148 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729572:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7e1808/0xa29a79078f3b3a72 lrc: 0/0,0 mode: --/PR res: [0x2b0ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60d3 expref: 2148 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729576:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729579:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 4/0,1 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729593:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.729609:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2147:41278:x1731746395639488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.729612:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10536 00000100:00100000:1.0:1651529338.729616:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10537 00000100:00100000:1.0:1651529338.729618:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2146:41279:x1731746395639552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.729620:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.729622:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 5/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2146 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729632:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 4/0,0 mode: PR/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2146 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.729637:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729644:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729645:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729648:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 4/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729653:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.729663:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2146:41279:x1731746395639552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.729666:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10537 00010000:00010000:1.0:1651529338.729673:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729677:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729687:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,1 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729690:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 2/0,0 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729701:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 2/0,0 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729705:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.729706:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 2/0,0 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729722:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 3/0,0 mode: PW/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729738:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 1/0,0 mode: --/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729743:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1073:39029:x1731745946315648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1286us (1412us total) trans 30064892436 rc 0/0 00010000:00010000:0.0:1651529338.729744:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcb7a lrc: 0/0,0 mode: --/PW res: [0x2b0ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729746:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151523 00010000:00010000:1.0:1651529338.729754:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.729767:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729776:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,1 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729779:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 2/0,0 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.729821:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 2/0,0 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729824:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.729825:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 2/0,0 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729828:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 3/0,0 mode: PW/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729833:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 1/0,0 mode: --/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729836:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcb6c lrc: 0/0,0 mode: --/PW res: [0x2b0ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.729848:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1073:39030:x1731745946315712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1449us (1556us total) trans 30064892437 rc 0/0 00000100:00100000:0.0:1651529338.729849:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946315968 00000100:00100000:1.0:1651529338.729851:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151521 00000100:00100000:1.0:1651529338.729856:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316032 00000100:00100000:0.0:1651529338.729857:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151527 00000100:00100000:0.0:1651529338.729859:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1074:39030:x1731745946315968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.729865:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151528 00000100:00100000:1.0:1651529338.729866:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1074:39029:x1731745946316032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.729870:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176371 count 1 00002000:00080000:1.0:1651529338.729871:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176372 count 1 00010000:00010000:0.0:1651529338.729874:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: --/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729876:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: --/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729879:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 2/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2145 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.729881:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 2/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2145 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.729882:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.729883:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.729883:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 4/0,1 mode: --/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729884:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729884:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.729885:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 4/0,1 mode: --/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.729890:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 3/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2145 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.729894:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2145 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.729894:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2145 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.729898:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966575232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.729899:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2145 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.729903:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966575296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.729907:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.729911:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.729916:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729919:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729922:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,1 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.729925:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 2/0,0 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.729940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.729961:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1075:39030:x1731745946315456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1631us (1690us total) trans 30064892438 rc 0/0 00000100:00100000:1.0:1651529338.729979:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151519 00000100:00100000:0.0:1651529338.729984:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316096 00000100:00100000:1.0:1651529338.729990:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151529 00000100:00100000:1.0:1651529338.729992:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1075:39030:x1731745946316096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.729997:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176373 count 1 00010000:00010000:1.0:1651529338.730002:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: --/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730006:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 2/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2145 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730009:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730010:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730010:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 4/0,1 mode: --/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730017:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 3/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2145 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730021:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 4/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2145 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.730025:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966575360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.730039:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.730045:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 2/0,0 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730048:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.730049:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 2/0,0 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730052:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 3/0,0 mode: PW/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730057:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 1/0,0 mode: --/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730068:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcb5e lrc: 0/0,0 mode: --/PW res: [0x2b0eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730080:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3b4784 lrc: 0/0,0 mode: --/PR res: [0x2b0f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96b8 expref: 2145 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.730083:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.730086:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730090:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730092:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730095:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,1 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730098:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 2/0,0 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730109:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 2/0,0 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730126:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049f87c51 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.730127:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 2/0,0 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730130:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 3/0,0 mode: PW/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730135:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 1/0,0 mode: --/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.730138:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1076:39029:x1731745946315776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1606us (1634us total) trans 30064892439 rc 0/0 00010000:00010000:0.0:1651529338.730138:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcb81 lrc: 0/0,0 mode: --/PW res: [0x2b0f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.730142:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151524 00000100:00100000:0.0:1651529338.730153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.730186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.730197:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316224 00000100:00100000:1.0:1651529338.730206:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316160 00000100:00100000:0.0:1651529338.730209:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151530 00000100:00100000:1.0:1651529338.730216:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151531 00000100:00100000:0.0:1651529338.730216:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1077:39030:x1731745946316224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.730218:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1077:39029:x1731745946316160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.730222:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176375 count 1 00002000:00080000:1.0:1651529338.730224:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176374 count 1 00010000:00010000:0.0:1651529338.730227:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: --/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730228:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: --/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730231:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 2/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2144 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730233:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 2/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2144 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.730234:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.730235:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730236:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.730236:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 4/0,1 mode: --/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730237:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730238:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 4/0,1 mode: --/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.730242:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 3/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2144 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730244:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 3/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2144 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.730246:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 4/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2144 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.730248:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 4/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2144 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.730251:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966575424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.730252:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.730265:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.730270:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.730325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.730336:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316288 00000100:00100000:1.0:1651529338.730347:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151532 00000100:00100000:1.0:1651529338.730356:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1078:39030:x1731745946316288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.730361:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176376 count 1 00010000:00010000:1.0:1651529338.730366:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: --/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730370:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 2/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2144 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730373:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730374:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.730375:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 4/0,1 mode: --/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.730381:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 3/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2144 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.730385:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 4/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2144 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.730389:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966575552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.730400:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.731564:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966575104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.731569:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: --/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.731596:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966575296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.731599:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: --/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.731601:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966575168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.731605:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: --/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.731613:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966575232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.731616:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966575360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.731616:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: --/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.731619:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: --/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.731622:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966575424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.731625:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: --/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.731761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.731780:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966575552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.731784:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: --/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.731791:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.731794:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: --/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.731800:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639616 00010000:00010000:1.0:1651529338.731822:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 4/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2145 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.731831:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10538 00000100:00100000:1.0:1651529338.731832:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2145:41279:x1731746395639616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.731835:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.731837:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 4/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2145 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.731843:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 3/0,0 mode: PR/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2145 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.731843:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.731855:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3b312d lrc: 0/0,0 mode: --/PR res: [0x2b0f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d1d expref: 2145 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.731859:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.731859:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.731860:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.731863:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 4/0,1 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.731869:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.731874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.731892:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2144:41279:x1731746395639616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.731894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.731895:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10538 00000100:00100000:1.0:1651529338.731900:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639744 00010000:00010000:1.0:1651529338.731903:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2144 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.731908:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639872 00010000:00010000:1.0:1651529338.731910:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 4/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2145 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.731922:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640000 00010000:00010000:1.0:1651529338.731925:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 4/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2146 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.731925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.731929:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639680 00010000:00010000:1.0:1651529338.731931:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 4/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2147 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.731932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.731935:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639808 00000100:00100000:0.0:1651529338.731937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.731938:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2148 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.731941:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395639936 00010000:00010000:1.0:1651529338.731943:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 4/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2149 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.731947:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10539 00000100:00100000:1.0:1651529338.731949:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2149:41279:x1731746395639744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.731951:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.731953:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 4/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2149 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.731956:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 3/0,0 mode: PR/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2149 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.731961:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3b61d9 lrc: 0/0,0 mode: --/PR res: [0x2b0f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b04d5 expref: 2149 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.731967:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.731968:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.731969:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.731970:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.731971:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 4/0,1 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.731988:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.731991:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.731998:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2148:41279:x1731746395639744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732001:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10539 00010000:00010000:0.0:1651529338.732003:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732006:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640064 00010000:00010000:0.0:1651529338.732006:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,1 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732009:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 4/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2148 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.732009:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 2/0,0 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732014:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10540 00000100:00100000:1.0:1651529338.732015:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2148:41279:x1731746395639872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.732018:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.732019:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 4/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2148 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732022:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 3/0,0 mode: PR/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2148 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732027:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000812e8fa8/0xa29a79078f3b3524 lrc: 0/0,0 mode: --/PR res: [0x2b0f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c0b expref: 2148 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732031:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732031:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732032:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732035:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 4/0,1 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732041:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.732046:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2147:41279:x1731746395639872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732048:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10540 00000100:00100000:1.0:1651529338.732052:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10541 00000100:00100000:1.0:1651529338.732053:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2146:41279:x1731746395640000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529338.732053:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1079:39030:x1731745946315968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2192us (2287us total) trans 30064892440 rc 0/0 00010000:00010000:1.0:1651529338.732056:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.732056:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151527 00010000:00010000:1.0:1651529338.732057:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 4/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2146 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732060:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 3/0,0 mode: PR/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2146 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.732063:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 2/0,0 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732065:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3b49d7 lrc: 0/0,0 mode: --/PR res: [0x2b0f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa06d expref: 2146 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.732067:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008363109c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.732068:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732068:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732068:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 2/0,0 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732069:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732071:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 3/0,0 mode: PW/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732072:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 4/0,1 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732076:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 1/0,0 mode: --/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732077:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.732078:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcb96 lrc: 0/0,0 mode: --/PW res: [0x2b0f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732082:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2145:41279:x1731746395640000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732084:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10541 00000100:00100000:1.0:1651529338.732091:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10542 00000100:00100000:1.0:1651529338.732093:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2144:41279:x1731746395639680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.732095:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.732096:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 4/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2144 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732100:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 3/0,0 mode: PR/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2144 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732104:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028f65f79/0xa29a79078f3b2e1d lrc: 0/0,0 mode: --/PR res: [0x2b0f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30c1 expref: 2144 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732108:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732108:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732109:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732121:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 4/0,1 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732136:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.732140:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732146:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2143:41279:x1731746395639680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732148:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10542 00010000:00010000:0.0:1651529338.732149:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732152:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,1 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732153:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10543 00000100:00100000:1.0:1651529338.732154:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2142:41279:x1731746395639808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.732155:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 2/0,0 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732157:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.732158:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2142 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732167:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2142 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732173:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3b51e8 lrc: 0/0,0 mode: --/PR res: [0x2b0f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf53 expref: 2142 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732176:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732177:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732177:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732180:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 4/0,1 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732194:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.732201:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2141:41279:x1731746395639808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732204:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10543 00000100:00100000:1.0:1651529338.732208:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10544 00000100:00100000:1.0:1651529338.732210:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2140:41279:x1731746395639936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.732212:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.732212:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1079:39029:x1731745946315904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2934us (3058us total) trans 30064892441 rc 0/0 00010000:00010000:1.0:1651529338.732213:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 4/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2140 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.732215:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151526 00010000:00010000:1.0:1651529338.732217:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 3/0,0 mode: PR/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2140 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732222:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3b5b73 lrc: 0/0,0 mode: --/PR res: [0x2b0f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4e5 expref: 2140 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732225:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732225:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732226:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732229:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 4/0,1 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732237:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.732243:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2139:41279:x1731746395639936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732251:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10544 00000100:00100000:1.0:1651529338.732255:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10545 00000100:00100000:0.0:1651529338.732256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.732257:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2138:41279:x1731746395640064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.732260:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.732261:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 4/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732265:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 3/0,0 mode: PR/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732269:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3b5140 lrc: 0/0,0 mode: --/PR res: [0x2b0f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abccf expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732273:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732274:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732274:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732283:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 4/0,1 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732290:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732294:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732297:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,1 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732298:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.732300:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 2/0,0 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732309:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2137:41279:x1731746395640064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.732312:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10545 00010000:00010000:1.0:1651529338.732320:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 2/0,0 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732329:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5e7eeed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.732331:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 2/0,0 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732334:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 3/0,0 mode: PW/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732338:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 1/0,0 mode: --/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732341:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcb8f lrc: 0/0,0 mode: --/PW res: [0x2b0f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732342:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1079:39030:x1731745946316224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2125us (2189us total) trans 30064892442 rc 0/0 00010000:00010000:1.0:1651529338.732345:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 2/0,0 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732345:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151530 00010000:00010000:1.0:1651529338.732348:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.732349:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 2/0,0 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732350:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316352 00010000:00010000:1.0:1651529338.732352:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 3/0,0 mode: PW/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732355:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 1/0,0 mode: --/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732358:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151533 00000100:00100000:0.0:1651529338.732359:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1079:39030:x1731745946316352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.732365:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcbab lrc: 0/0,0 mode: --/PW res: [0x2b0f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.732365:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176377 count 1 00010000:00010000:0.0:1651529338.732369:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: --/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732371:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732373:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732374:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 2/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732377:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,1 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732377:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732377:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732378:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 4/0,1 mode: --/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732380:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 2/0,0 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732385:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 3/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.732411:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2136 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.732415:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966575616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.732424:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1080:39030:x1731745946315840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3230us (3285us total) trans 30064892443 rc 0/0 00000100:00100000:1.0:1651529338.732427:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151525 00010000:00010000:1.0:1651529338.732434:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732435:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.732437:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732440:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,1 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732441:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 2/0,0 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732445:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c367a96 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.732446:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 2/0,0 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732446:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 2/0,0 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732449:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 3/0,0 mode: PW/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732453:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 1/0,0 mode: --/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732456:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c367a96/0xa29a79078f3bcb88 lrc: 0/0,0 mode: --/PW res: [0x2b0f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732461:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 2/0,0 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732463:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9325b78 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.732464:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 2/0,0 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732467:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 3/0,0 mode: PW/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732470:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 1/0,0 mode: --/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732478:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1080:39030:x1731745946316288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2122us (2153us total) trans 30064892444 rc 0/0 00010000:00010000:0.0:1651529338.732480:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9325b78/0xa29a79078f3bcbb9 lrc: 0/0,0 mode: --/PW res: [0x2b0f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732481:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151532 00010000:00010000:1.0:1651529338.732488:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732492:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732495:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,1 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732497:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 2/0,0 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732497:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.732544:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946316032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2676us (2746us total) trans 30064892445 rc 0/0 00000100:00100000:1.0:1651529338.732547:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151528 00000100:00100000:1.0:1651529338.732552:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316416 00010000:00010000:0.0:1651529338.732557:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 2/0,0 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732561:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb1f1485 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.732562:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 2/0,0 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732565:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 3/0,0 mode: PW/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732569:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 1/0,0 mode: --/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732572:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f1485/0xa29a79078f3bcb9d lrc: 0/0,0 mode: --/PW res: [0x2b0f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732584:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151534 00000100:00100000:1.0:1651529338.732585:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1080:39030:x1731745946316416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.732590:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176378 count 1 00010000:00010000:1.0:1651529338.732595:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: --/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732600:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 2/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732603:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732604:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732604:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 4/0,1 mode: --/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732611:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 3/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732615:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 4/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.732619:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966575680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.732634:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.732640:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732643:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732646:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,1 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732649:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 2/0,0 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732664:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 2/0,0 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732669:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6f14d7e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.732670:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 2/0,0 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732682:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 3/0,0 mode: PW/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732687:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 1/0,0 mode: --/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732690:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f14d7e/0xa29a79078f3bcba4 lrc: 0/0,0 mode: --/PW res: [0x2b0f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732700:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1081:39030:x1731745946316096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2707us (2760us total) trans 30064892446 rc 0/0 00000100:00100000:1.0:1651529338.732704:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151529 00010000:00010000:1.0:1651529338.732712:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732716:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732719:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,1 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732738:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 2/0,0 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.732782:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1081:39029:x1731745946316160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2562us (2595us total) trans 30064892447 rc 0/0 00000100:00100000:1.0:1651529338.732785:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151531 00000100:00100000:1.0:1651529338.732789:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316544 00000100:00100000:0.0:1651529338.732791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.732827:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316480 00000100:00100000:1.0:1651529338.732833:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151535 00000100:00100000:0.0:1651529338.732833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.732835:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1082:39029:x1731745946316544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.732845:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176380 count 1 00010000:00010000:1.0:1651529338.732849:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: --/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732856:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 2/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.732856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.732860:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732860:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732861:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 4/0,1 mode: --/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.732867:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 3/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732871:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 4/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2136 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.732872:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316672 00000100:00100000:1.0:1651529338.732875:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.732880:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316608 00000100:00100000:0.0:1651529338.732883:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316736 00000100:00100000:0.0:1651529338.732886:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151536 00000100:00100000:1.0:1651529338.732889:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.732894:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1085:39030:x1731745946316480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.732895:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 2/0,0 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732898:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058936903 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.732899:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 2/0,0 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.732900:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176379 count 1 00010000:00010000:1.0:1651529338.732902:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 3/0,0 mode: PW/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732905:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: --/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732910:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 2/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.732913:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732917:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 1/0,0 mode: --/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732920:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcbb2 lrc: 0/0,0 mode: --/PW res: [0x2b0f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732921:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529338.732928:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151537 00000100:00100000:1.0:1651529338.732930:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1085:39029:x1731745946316672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.732936:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176382 count 1 00010000:00010000:1.0:1651529338.732939:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: --/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732942:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 4/0,1 mode: --/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.732943:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 2/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.732951:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 3/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2136 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732955:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732955:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 4/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2136 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.732956:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.732957:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 4/0,1 mode: --/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.732959:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966575808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.732964:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 3/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.732968:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 4/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.732968:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.732975:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151538 00000100:00100000:0.0:1651529338.732977:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1085:39030:x1731745946316608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.732982:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966575872:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529338.732982:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176381 count 1 00010000:00010000:0.0:1651529338.732986:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: --/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.732990:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 2/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.732991:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.732993:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732994:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.732995:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 4/0,1 mode: --/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.732998:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151539 00000100:00100000:1.0:1651529338.732999:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1085:39030:x1731745946316736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.733001:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 3/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.733004:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176383 count 1 00010000:00010000:0.0:1651529338.733007:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 4/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.733008:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: --/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.733011:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966575936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.733013:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 2/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.733016:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.733016:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.733017:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 4/0,1 mode: --/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.733018:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.733023:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 3/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.733026:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 4/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.733030:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966576000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.733034:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.733036:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.733042:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316800 00000100:00100000:1.0:1651529338.733053:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151540 00000100:00100000:1.0:1651529338.733055:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1086:39030:x1731745946316800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.733059:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176384 count 1 00010000:00010000:1.0:1651529338.733063:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: --/PW res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.733067:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 2/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.733070:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.733071:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.733092:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 4/0,1 mode: --/PW res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.733105:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2136 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.733109:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.733113:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.733128:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.734005:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966575680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734010:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: --/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734031:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966575872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734039:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: --/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734047:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966576000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734049:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: --/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734060:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966575616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.734061:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734064:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: --/PW res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734065:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: --/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734071:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966575744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.734072:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966575808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734073:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: --/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734075:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: --/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734082:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966575936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.734084:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: --/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.734157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.734163:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640128 00010000:00010000:1.0:1651529338.734169:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2137 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734176:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10546 00000100:00100000:1.0:1651529338.734177:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2137:41279:x1731746395640128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734180:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734181:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 4/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2137 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734186:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 3/0,0 mode: PR/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2137 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734191:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3b30a8 lrc: 0/0,0 mode: --/PR res: [0x2b0f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3adf expref: 2137 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734195:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734196:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734197:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734200:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 4/0,1 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734212:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.734219:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734223:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2136:41279:x1731746395640128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734226:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10546 00010000:00010000:0.0:1651529338.734228:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734231:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640192 00010000:00010000:1.0:1651529338.734234:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 4/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734241:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10547 00000100:00100000:1.0:1651529338.734243:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2136:41279:x1731746395640192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734245:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734246:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 4/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734250:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 3/0,0 mode: PR/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.734256:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,1 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734267:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 2/0,0 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734269:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007904e2ea/0xa29a79078f3b3914 lrc: 0/0,0 mode: --/PR res: [0x2b0fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5baf expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734273:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734274:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734274:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734277:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 4/0,1 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734283:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.734289:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2135:41279:x1731746395640192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734292:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10547 00010000:00010000:1.0:1651529338.734299:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734302:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734305:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734311:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734312:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946316352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1951us (2055us total) trans 30064892448 rc 0/0 00000100:00100000:0.0:1651529338.734315:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151533 00010000:00010000:0.0:1651529338.734330:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 2/0,0 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734334:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456e8054 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.734335:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 2/0,0 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734338:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 3/0,0 mode: PW/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734343:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 1/0,0 mode: --/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734346:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456e8054/0xa29a79078f3bcbc0 lrc: 0/0,0 mode: --/PW res: [0x2b0f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734350:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734353:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072624c54 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.734354:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734356:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946316416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1770us (1858us total) trans 30064892449 rc 0/0 00010000:00010000:0.0:1651529338.734357:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 3/0,0 mode: PW/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734359:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151534 00010000:00010000:0.0:1651529338.734360:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 1/0,0 mode: --/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734363:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072624c54/0xa29a79078f3bcbc7 lrc: 0/0,0 mode: --/PW res: [0x2b0fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.734416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.734427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.734436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.734444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.734449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.734450:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640256 00010000:00010000:1.0:1651529338.734456:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 4/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2135 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734462:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640320 00010000:00010000:1.0:1651529338.734464:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 4/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2136 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734468:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640384 00010000:00010000:1.0:1651529338.734470:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 4/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2137 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734474:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640448 00010000:00010000:1.0:1651529338.734476:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 4/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2138 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734480:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640576 00010000:00010000:1.0:1651529338.734482:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2139 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734488:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640512 00010000:00010000:1.0:1651529338.734490:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 4/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2140 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734494:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10548 00000100:00100000:1.0:1651529338.734496:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2140:41279:x1731746395640256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734498:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734500:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 4/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2140 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734503:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 3/0,0 mode: PR/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2140 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734509:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3b3268 lrc: 0/0,0 mode: --/PR res: [0x2b0fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4248 expref: 2140 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734513:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734514:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734514:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734517:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 4/0,1 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734524:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.734532:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2139:41279:x1731746395640256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734545:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10548 00000100:00100000:1.0:1651529338.734554:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10549 00000100:00100000:1.0:1651529338.734556:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2138:41279:x1731746395640320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734558:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734560:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 4/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734564:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 3/0,0 mode: PR/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734569:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ed4fdd/0xa29a79078f3b2d98 lrc: 0/0,0 mode: --/PR res: [0x2b0fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f01 expref: 2138 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734572:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734573:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734574:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734577:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 4/0,1 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734586:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.734591:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734592:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2137:41279:x1731746395640320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734595:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10549 00010000:00010000:0.0:1651529338.734595:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734599:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10550 00010000:00010000:0.0:1651529338.734599:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,1 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734604:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 2/0,0 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.734607:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2136:41279:x1731746395640384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734610:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734618:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 4/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734622:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 3/0,0 mode: PR/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734627:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3b473e lrc: 0/0,0 mode: --/PR res: [0x2b0fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9592 expref: 2136 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734630:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734631:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734631:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734634:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 4/0,1 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734640:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.734646:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2135:41279:x1731746395640384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.734646:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946316480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1751us (1855us total) trans 30064892450 rc 0/0 00000100:00100000:1.0:1651529338.734649:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10550 00000100:00100000:0.0:1651529338.734649:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151536 00000100:00100000:1.0:1651529338.734653:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10551 00000100:00100000:1.0:1651529338.734655:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2134:41279:x1731746395640448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734657:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734658:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 4/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734662:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 3/0,0 mode: PR/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734666:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3b5b8f lrc: 0/0,0 mode: --/PR res: [0x2b0fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae59b expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734669:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734670:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734671:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.734682:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 4/0,1 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734691:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.734697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.734698:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2133:41279:x1731746395640448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734706:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10551 00000100:00100000:1.0:1651529338.734710:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10552 00000100:00100000:1.0:1651529338.734712:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2132:41278:x1731746395640576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734715:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734716:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2132 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734725:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x2b100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2132 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.734739:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734744:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734745:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008437fdd0/0xa29a79078f3b5bf8 lrc: 0/0,0 mode: --/PR res: [0x2b100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6c1 expref: 2132 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.734747:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,1 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734748:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734749:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734750:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734750:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 2/0,0 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734753:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 4/0,1 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734759:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.734771:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2131:41278:x1731746395640576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.734774:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10552 00000100:00100000:1.0:1651529338.734778:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10553 00000100:00100000:1.0:1651529338.734780:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2130:41278:x1731746395640512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.734783:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.734784:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 4/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2130 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734788:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 3/0,0 mode: PR/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2130 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734793:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3b58be lrc: 0/0,0 mode: --/PR res: [0x2b0ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada1f expref: 2130 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734821:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734822:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.734823:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734825:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946316608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1846us (1968us total) trans 30064892451 rc 0/0 00010000:00010000:1.0:1651529338.734826:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 4/0,1 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734832:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.734839:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2129:41278:x1731746395640512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.734840:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151538 00000100:00100000:1.0:1651529338.734842:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10553 00000100:00100000:0.0:1651529338.734846:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316864 00010000:00010000:1.0:1651529338.734849:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 2/0,0 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734852:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a60fe4e already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529338.734852:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316928 00010000:00010000:1.0:1651529338.734853:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 2/0,0 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734856:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 3/0,0 mode: PW/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734856:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151541 00000100:00100000:0.0:1651529338.734858:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1088:39030:x1731745946316864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.734860:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 1/0,0 mode: --/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734863:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcbd5 lrc: 0/0,0 mode: --/PW res: [0x2b0fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.734863:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176385 count 1 00010000:00010000:0.0:1651529338.734868:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: --/PW res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734873:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 2/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.734876:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 2/0,0 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734876:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.734877:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.734877:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 4/0,1 mode: --/PW res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734879:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db9bfbbf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.734880:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 2/0,0 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734883:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 3/0,0 mode: PW/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734884:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 3/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.734886:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 1/0,0 mode: --/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734888:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 4/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.734889:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcbe3 lrc: 0/0,0 mode: --/PW res: [0x2b0fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734892:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966576128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.734894:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734897:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734900:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,1 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734901:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.734903:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 2/0,0 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734911:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151542 00000100:00100000:0.0:1651529338.734913:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1088:39029:x1731745946316928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.734925:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176386 count 1 00010000:00010000:0.0:1651529338.734929:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: --/PW res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734936:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 2/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.734939:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.734939:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.734940:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 4/0,1 mode: --/PW res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734946:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 3/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.734949:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 4/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2128 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.734951:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946316672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2020us (2118us total) trans 30064892452 rc 0/0 00000100:00100000:0.0:1651529338.734953:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966576192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.734954:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151537 00010000:00010000:1.0:1651529338.734961:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.734961:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.734965:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734966:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 2/0,0 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734968:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,1 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734969:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494eede9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.734970:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 2/0,0 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.734971:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 2/0,0 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734973:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 3/0,0 mode: PW/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734980:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 1/0,0 mode: --/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734983:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcbdc lrc: 0/0,0 mode: --/PW res: [0x2b0fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734988:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 2/0,0 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734990:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.734991:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 2/0,0 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734994:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 3/0,0 mode: PW/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734997:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 1/0,0 mode: --/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.734999:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcbea lrc: 0/0,0 mode: --/PW res: [0x2b0ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735002:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1089:39030:x1731745946316736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2002us (2137us total) trans 30064892453 rc 0/0 00000100:00100000:1.0:1651529338.735005:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151539 00010000:00010000:1.0:1651529338.735012:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735015:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.735016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.735018:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,1 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735030:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 2/0,0 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735079:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 2/0,0 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735082:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1089:39030:x1731745946316800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2026us (2047us total) trans 30064892454 rc 0/0 00010000:00010000:0.0:1651529338.735083:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d02b17d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.735084:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 2/0,0 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735085:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151540 00010000:00010000:0.0:1651529338.735087:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 3/0,0 mode: PW/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735091:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946316992 00010000:00010000:0.0:1651529338.735092:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 1/0,0 mode: --/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735095:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcbf1 lrc: 0/0,0 mode: --/PW res: [0x2b100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735100:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151543 00000100:00100000:1.0:1651529338.735102:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0bfd62c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1089:39030:x1731745946316992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.735107:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176387 count 1 00010000:00010000:1.0:1651529338.735118:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: --/PW res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735129:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 2/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.735133:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.735134:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.735134:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 4/0,1 mode: --/PW res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735142:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 3/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.735145:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 4/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.735152:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.735167:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.735175:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735178:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735181:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,1 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735184:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 2/0,0 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735201:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 2/0,0 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735205:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025259e02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.735206:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 2/0,0 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735209:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 3/0,0 mode: PW/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735214:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 1/0,0 mode: --/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735216:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025259e02/0xa29a79078f3bcbce lrc: 0/0,0 mode: --/PW res: [0x2b0fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735235:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1090:39029:x1731745946316544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2399us (2477us total) trans 30064892455 rc 0/0 00000100:00100000:1.0:1651529338.735238:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151535 00000100:00100000:1.0:1651529338.735292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.735299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.735322:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.735339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.735349:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317120 00000100:00100000:0.0:1651529338.735349:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317056 00000100:00100000:0.0:1651529338.735356:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317184 00000100:00100000:1.0:1651529338.735358:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317248 00000100:00100000:0.0:1651529338.735362:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151544 00000100:00100000:1.0:1651529338.735369:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151545 00000100:00100000:0.0:1651529338.735369:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946317056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.735371:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1093:39030:x1731745946317120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.735375:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176388 count 1 00002000:00080000:1.0:1651529338.735378:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176389 count 1 00010000:00010000:1.0:1651529338.735382:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: --/PW res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735387:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 2/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.735390:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.735391:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735391:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: --/PW res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735392:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 4/0,1 mode: --/PW res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735396:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 2/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.735398:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735399:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735400:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735401:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 4/0,1 mode: --/PW res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735402:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2128 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.735406:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966576320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.735409:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 3/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735412:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 4/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2128 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.735416:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966576384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.735417:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.735423:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151546 00000100:00100000:1.0:1651529338.735424:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946317184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.735425:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00002000:00080000:1.0:1651529338.735429:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176390 count 1 00010000:00010000:1.0:1651529338.735432:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: --/PW res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.735432:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151547 00000100:00100000:0.0:1651529338.735434:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1093:39030:x1731745946317248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.735437:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 2/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.735438:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176391 count 1 00010000:00010000:1.0:1651529338.735440:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.735440:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.735441:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 4/0,1 mode: --/PW res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735442:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: --/PW res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.735447:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 3/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2128 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735447:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 2/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.735450:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 4/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.735450:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735450:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735451:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 4/0,1 mode: --/PW res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.735454:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966576448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.735457:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 3/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2128 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735460:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 4/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2128 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.735461:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.735464:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966576512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.735470:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.735475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.735512:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317312 00000100:00100000:0.0:1651529338.735521:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151548 00000100:00100000:0.0:1651529338.735522:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1094:39030:x1731745946317312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.735527:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176392 count 1 00010000:00010000:0.0:1651529338.735531:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: --/PW res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735538:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 2/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2128 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735541:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735542:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.735543:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 4/0,1 mode: --/PW res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.735549:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 3/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2128 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.735553:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 4/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2128 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.735557:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966576576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.735573:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.736068:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966576128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.736071:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966576320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.736072:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: --/PW res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.736076:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: --/PW res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.736080:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966576192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.736083:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: --/PW res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736084:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.736087:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: --/PW res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.736743:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966576384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.736747:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: --/PW res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.736773:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966576512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.736775:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.736776:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: --/PW res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.736784:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966576576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.736786:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: --/PW res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736789:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736818:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736835:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.736849:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966576448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.736854:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: --/PW res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736861:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640704 00010000:00010000:1.0:1651529338.736866:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 4/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2129 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736871:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640832 00010000:00010000:1.0:1651529338.736873:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2130 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736878:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640960 00010000:00010000:1.0:1651529338.736879:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 4/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2131 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736883:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641088 00010000:00010000:1.0:1651529338.736885:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 4/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2132 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736889:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640640 00010000:00010000:1.0:1651529338.736891:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 4/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2133 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736905:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640768 00010000:00010000:1.0:1651529338.736908:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 4/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2134 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736912:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395640896 00010000:00010000:1.0:1651529338.736914:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 4/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2135 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736917:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641024 00010000:00010000:1.0:1651529338.736919:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 4/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.736924:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10554 00000100:00100000:1.0:1651529338.736925:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2136:41278:x1731746395640704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.736928:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.736929:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 4/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.736933:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 3/0,0 mode: PR/PR res: [0x2b102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.736939:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3b5c3e lrc: 0/0,0 mode: --/PR res: [0x2b102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae82d expref: 2136 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.736942:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.736949:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.736950:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.736953:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 4/0,1 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.736964:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.736973:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736976:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2135:41278:x1731746395640704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.736979:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10554 00010000:00010000:0.0:1651529338.736981:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736984:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10555 00010000:00010000:0.0:1651529338.736984:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,1 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.736985:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2134:41278:x1731746395640832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.736987:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 2/0,0 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.736988:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.736990:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737000:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x2b105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737006:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3b5cd1 lrc: 0/0,0 mode: --/PR res: [0x2b105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea80 expref: 2134 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737009:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737010:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737011:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737023:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 4/0,1 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737030:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.737038:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1095:39029:x1731745946316928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2124us (2347us total) trans 30064892456 rc 0/0 00000100:00100000:1.0:1651529338.737042:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2133:41278:x1731746395640832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.737042:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151542 00000100:00100000:1.0:1651529338.737044:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10555 00000100:00100000:1.0:1651529338.737053:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10556 00000100:00100000:1.0:1651529338.737055:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2132:41278:x1731746395640960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.737057:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737059:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 4/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2132 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737063:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 3/0,0 mode: PR/PR res: [0x2b106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2132 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737068:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3b3093 lrc: 0/0,0 mode: --/PR res: [0x2b106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a99 expref: 2132 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737071:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737072:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737072:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737082:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 4/0,1 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737099:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.737115:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2131:41278:x1731746395640960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.737118:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10556 00000100:00100000:1.0:1651529338.737123:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10557 00000100:00100000:1.0:1651529338.737124:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2130:41278:x1731746395641088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.737127:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737128:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 4/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2130 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737132:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 3/0,0 mode: PR/PR res: [0x2b108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2130 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737137:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3b4618 lrc: 0/0,0 mode: --/PR res: [0x2b108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9155 expref: 2130 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737148:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737149:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737150:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737153:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 4/0,1 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737161:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.737165:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737171:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2129:41278:x1731746395641088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (353us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.737173:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737177:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,1 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737179:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 2/0,0 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737180:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10557 00000100:00100000:1.0:1651529338.737184:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10558 00000100:00100000:1.0:1651529338.737186:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2128:41278:x1731746395640640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.737188:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737190:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 4/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737194:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 3/0,0 mode: PR/PR res: [0x2b101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737199:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3b4d2d lrc: 0/0,0 mode: --/PR res: [0x2b101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aabd4 expref: 2128 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737202:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737203:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737204:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737207:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 4/0,1 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737215:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.737239:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2127:41278:x1731746395640640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.737240:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946317312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1716us (1764us total) trans 30064892457 rc 0/0 00000100:00100000:1.0:1651529338.737242:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10558 00000100:00100000:0.0:1651529338.737243:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151548 00000100:00100000:1.0:1651529338.737245:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10559 00000100:00100000:1.0:1651529338.737247:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2126:41278:x1731746395640768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.737249:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737251:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 4/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.737251:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 2/0,0 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737254:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 3/0,0 mode: PR/PR res: [0x2b103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.737254:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737255:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 2/0,0 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737258:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 3/0,0 mode: PW/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737259:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3b5362 lrc: 0/0,0 mode: --/PR res: [0x2b103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac59d expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737262:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737262:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737263:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737263:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 1/0,0 mode: --/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737266:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 4/0,1 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737268:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcbff lrc: 0/0,0 mode: --/PW res: [0x2b102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737272:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.737272:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 2/0,0 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737275:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000701a7492 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737276:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 2/0,0 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737277:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2125:41278:x1731746395640768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.737279:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10559 00010000:00010000:0.0:1651529338.737279:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 3/0,0 mode: PW/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737282:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10560 00010000:00010000:0.0:1651529338.737282:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 1/0,0 mode: --/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737284:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2124:41278:x1731746395640896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.737284:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bcc29 lrc: 0/0,0 mode: --/PW res: [0x2b108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737286:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737287:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 4/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2124 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.737290:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737291:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 3/0,0 mode: PR/PR res: [0x2b104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2124 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.737292:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737295:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3b599e lrc: 0/0,0 mode: --/PR res: [0x2b104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add9f expref: 2124 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.737295:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,1 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737298:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.737298:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 2/0,0 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737299:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737300:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737303:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 4/0,1 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737310:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.737315:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2123:41278:x1731746395640896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.737318:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10560 00000100:00100000:1.0:1651529338.737322:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10561 00000100:00100000:1.0:1651529338.737323:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2122:41278:x1731746395641024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.737325:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.737327:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 4/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2122 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737330:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 3/0,0 mode: PR/PR res: [0x2b107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2122 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737335:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000567589f3/0xa29a79078f3b5f08 lrc: 0/0,0 mode: --/PR res: [0x2b107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5f5 expref: 2122 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737338:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737339:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737340:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737342:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 4/0,1 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.737342:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946316864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2483us (2667us total) trans 30064892458 rc 0/0 00000100:00100000:0.0:1651529338.737345:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151541 00010000:00010000:1.0:1651529338.737350:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.737355:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2121:41278:x1731746395641024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.737357:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10561 00010000:00010000:0.0:1651529338.737358:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 2/0,0 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737362:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049f87c51 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737363:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 2/0,0 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737364:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737366:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 3/0,0 mode: PW/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737367:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737370:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 1/0,0 mode: --/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737371:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,1 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737373:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 2/0,0 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737373:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f87c51/0xa29a79078f3bcbf8 lrc: 0/0,0 mode: --/PW res: [0x2b101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737379:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737387:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737391:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,1 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737394:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 2/0,0 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737426:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1096:39029:x1731745946317184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2001us (2104us total) trans 30064892459 rc 0/0 00000100:00100000:1.0:1651529338.737430:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151546 00000100:00100000:0.0:1651529338.737433:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946317248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1998us (2093us total) trans 30064892460 rc 0/0 00000100:00100000:0.0:1651529338.737436:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151547 00010000:00010000:1.0:1651529338.737437:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 2/0,0 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737441:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003482d8c9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.737442:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 2/0,0 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737443:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 2/0,0 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737445:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 3/0,0 mode: PW/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737446:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737447:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 2/0,0 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737449:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 1/0,0 mode: --/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737450:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 3/0,0 mode: PW/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737452:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcc1b lrc: 0/0,0 mode: --/PW res: [0x2b106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737454:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 1/0,0 mode: --/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737457:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcc22 lrc: 0/0,0 mode: --/PW res: [0x2b107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737458:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737461:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737463:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737464:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,1 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737466:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737467:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 2/0,0 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737469:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,1 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737471:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 2/0,0 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737515:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1096:39030:x1731745946317120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2142us (2215us total) trans 30064892461 rc 0/0 00000100:00100000:0.0:1651529338.737517:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1096:39029:x1731745946317056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2147us (2225us total) trans 30064892462 rc 0/0 00000100:00100000:1.0:1651529338.737518:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151545 00000100:00100000:0.0:1651529338.737520:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151544 00010000:00010000:1.0:1651529338.737524:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 2/0,0 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737527:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 2/0,0 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737528:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695a17e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.737529:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 2/0,0 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737530:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737531:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 2/0,0 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737532:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 3/0,0 mode: PW/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737534:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 3/0,0 mode: PW/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737536:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 1/0,0 mode: --/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737538:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 1/0,0 mode: --/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737539:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcc14 lrc: 0/0,0 mode: --/PW res: [0x2b105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737541:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcc0d lrc: 0/0,0 mode: --/PW res: [0x2b104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737545:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737548:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737551:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,1 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737554:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 2/0,0 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.737556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.737595:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0bfd62c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946316992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2492us (2578us total) trans 30064892463 rc 0/0 00000100:00100000:1.0:1651529338.737604:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151543 00010000:00010000:0.0:1651529338.737628:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 2/0,0 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737632:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4a8ae88 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.737633:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 2/0,0 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737636:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 3/0,0 mode: PW/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737638:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317376 00010000:00010000:0.0:1651529338.737641:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 1/0,0 mode: --/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737644:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4a8ae88/0xa29a79078f3bcc06 lrc: 0/0,0 mode: --/PW res: [0x2b103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.737646:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151549 00000100:00100000:1.0:1651529338.737647:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946317376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.737652:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176393 count 1 00010000:00010000:1.0:1651529338.737656:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: --/PW res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737661:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 2/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.737665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737666:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 4/0,1 mode: --/PW res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737672:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 3/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.737679:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 4/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2120 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.737683:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.737697:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.737872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.737896:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.737906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.737907:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317440 00000100:00100000:1.0:1651529338.737915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.737921:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317568 00000100:00100000:1.0:1651529338.737922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.737931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.737937:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317504 00000100:00100000:1.0:1651529338.737939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.737949:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317696 00000100:00100000:0.0:1651529338.737952:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317632 00000100:00100000:1.0:1651529338.737954:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317824 00000100:00100000:0.0:1651529338.737955:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317760 00000100:00100000:0.0:1651529338.737958:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151550 00000100:00100000:0.0:1651529338.737960:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946317440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.737962:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151551 00000100:00100000:1.0:1651529338.737963:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946317568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.737965:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176394 count 1 00002000:00080000:1.0:1651529338.737969:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176396 count 1 00010000:00010000:0.0:1651529338.737969:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: --/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737973:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: --/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737974:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 2/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.737978:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 2/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.737978:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.737978:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.737979:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 4/0,1 mode: --/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.737981:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737982:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.737982:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 4/0,1 mode: --/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.737986:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 3/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.737990:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 4/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2120 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.737992:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 3/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.737994:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966576704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.737996:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 4/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.738000:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966576768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738006:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.738009:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.738012:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151552 00000100:00100000:0.0:1651529338.738014:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946317504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.738016:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151553 00000100:00100000:1.0:1651529338.738018:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946317696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.738018:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176395 count 1 00002000:00080000:1.0:1651529338.738022:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176398 count 1 00010000:00010000:0.0:1651529338.738022:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: --/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738026:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: --/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738026:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 2/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738029:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738030:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 2/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738030:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.738031:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 4/0,1 mode: --/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738033:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738034:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738034:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 4/0,1 mode: --/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738037:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 3/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2120 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.738040:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 3/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738041:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 4/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2120 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.738044:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 4/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.738045:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966576832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.738049:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966576896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738051:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.738055:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.738057:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151554 00000100:00100000:0.0:1651529338.738059:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946317632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.738060:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151555 00000100:00100000:1.0:1651529338.738062:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946317760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.738063:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176397 count 1 00002000:00080000:1.0:1651529338.738066:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176399 count 1 00010000:00010000:0.0:1651529338.738066:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: --/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738069:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: --/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738070:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 2/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.738073:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 2/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738073:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.738073:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.738074:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 4/0,1 mode: --/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738076:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738077:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738078:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 4/0,1 mode: --/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738079:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 3/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.738083:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 3/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2120 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738086:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 4/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.738087:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 4/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.738090:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966576960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.738091:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738095:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.738098:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.738101:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151556 00000100:00100000:0.0:1651529338.738102:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946317824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.738106:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176400 count 1 00010000:00010000:0.0:1651529338.738110:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: --/PW res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738114:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 2/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2120 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738117:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.738117:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.738118:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 4/0,1 mode: --/PW res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738123:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 3/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2120 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.738127:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 4/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2120 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.738134:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738140:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.738500:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966576768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738501:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966576704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.738505:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: --/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738506:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: --/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.738513:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966576640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.738516:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: --/PW res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.738685:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966576896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.738688:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: --/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.738691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.738701:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.738703:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966576832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.738704:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: --/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.738707:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: --/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.738711:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641152 00010000:00010000:1.0:1651529338.738715:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 4/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2121 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.738715:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966576960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.738717:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: --/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.738723:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10562 00000100:00100000:0.0:1651529338.738724:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.738725:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2121:41279:x1731746395641152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.738726:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: --/PW res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738737:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.738739:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 4/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2121 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.738758:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 3/0,0 mode: PR/PR res: [0x2b109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2121 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.738764:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005557d4c3/0xa29a79078f3b2f5f lrc: 0/0,0 mode: --/PR res: [0x2b109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35de expref: 2121 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.738768:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738769:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.738770:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738773:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 4/0,1 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738779:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.738794:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2120:41279:x1731746395641152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.738797:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10562 00010000:00010000:1.0:1651529338.738824:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738828:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738831:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,1 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738843:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 2/0,0 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.738853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.738878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.738887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.738896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.738925:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946317376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1276us (1368us total) trans 30064892464 rc 0/0 00000100:00100000:1.0:1651529338.738928:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151549 00010000:00010000:1.0:1651529338.738935:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 2/0,0 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738939:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe763644 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.738940:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 2/0,0 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738943:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 3/0,0 mode: PW/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.738947:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 1/0,0 mode: --/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.738948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.738958:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcc30 lrc: 0/0,0 mode: --/PW res: [0x2b109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.738973:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641216 00010000:00010000:1.0:1651529338.738978:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 4/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2120 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.738986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.738993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.738995:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641280 00010000:00010000:1.0:1651529338.738998:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 4/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2121 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739002:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641344 00010000:00010000:1.0:1651529338.739004:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 4/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2122 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739008:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641408 00010000:00010000:1.0:1651529338.739010:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 4/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2123 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739013:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641472 00010000:00010000:1.0:1651529338.739015:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 4/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2124 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739019:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641536 00010000:00010000:1.0:1651529338.739021:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 4/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2125 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739024:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641600 00010000:00010000:1.0:1651529338.739026:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 4/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2126 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739030:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10563 00000100:00100000:1.0:1651529338.739032:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2126:41279:x1731746395641216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.739041:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739042:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 4/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739046:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 3/0,0 mode: PR/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739051:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3b4809 lrc: 0/0,0 mode: --/PR res: [0x2b10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9904 expref: 2126 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739055:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739055:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739056:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739059:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 4/0,1 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739070:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739079:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2125:41279:x1731746395641216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.739082:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10563 00000100:00100000:1.0:1651529338.739087:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10564 00000100:00100000:1.0:1651529338.739088:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2124:41279:x1731746395641280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.739091:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739092:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 4/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2124 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739094:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739098:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 3/0,0 mode: PR/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2124 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739098:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739101:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,1 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739103:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000570b466b/0xa29a79078f3b4768 lrc: 0/0,0 mode: --/PR res: [0x2b10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9633 expref: 2124 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739104:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 2/0,0 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739106:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739107:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739107:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739110:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 4/0,1 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739117:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739121:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2123:41279:x1731746395641280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.739124:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10564 00000100:00100000:1.0:1651529338.739127:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10565 00000100:00100000:1.0:1651529338.739129:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2122:41279:x1731746395641344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.739131:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739132:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 4/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2122 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739136:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 3/0,0 mode: PR/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2122 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739140:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3b32ed lrc: 0/0,0 mode: --/PR res: [0x2b10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a445c expref: 2122 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739144:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739144:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739145:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.739146:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946317440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1186us (1275us total) trans 30064892465 rc 0/0 00010000:00010000:1.0:1651529338.739148:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 4/0,1 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.739150:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151550 00010000:00010000:1.0:1651529338.739156:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739161:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2121:41279:x1731746395641344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.739163:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10565 00010000:00010000:0.0:1651529338.739164:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 2/0,0 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.739167:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10566 00010000:00010000:0.0:1651529338.739168:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008363109c already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529338.739169:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2120:41279:x1731746395641408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.739169:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 2/0,0 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739171:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739172:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 4/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739172:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 3/0,0 mode: PW/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739175:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 3/0,0 mode: PR/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739179:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50fb92f/0xa29a79078f3b468f lrc: 0/0,0 mode: --/PR res: [0x2b10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92e4 expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739180:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 1/0,0 mode: --/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739183:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008363109c/0xa29a79078f3bcc37 lrc: 0/0,0 mode: --/PW res: [0x2b10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739185:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739186:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739186:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739189:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 4/0,1 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739189:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739191:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739194:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,1 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739197:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739201:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2119:41279:x1731746395641408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (305us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.739202:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 2/0,0 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.739203:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10566 00000100:00100000:1.0:1651529338.739207:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10567 00000100:00100000:1.0:1651529338.739208:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2118:41279:x1731746395641472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.739211:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739212:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 4/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2118 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739215:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 3/0,0 mode: PR/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2118 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739219:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608ea5f4/0xa29a79078f3b378c lrc: 0/0,0 mode: --/PR res: [0x2b10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55d5 expref: 2118 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739223:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739223:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739224:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739227:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 4/0,1 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739233:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739237:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2117:41279:x1731746395641472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.739238:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946317504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1331us total) trans 30064892466 rc 0/0 00000100:00100000:1.0:1651529338.739239:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10567 00000100:00100000:0.0:1651529338.739241:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151552 00000100:00100000:1.0:1651529338.739243:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10568 00000100:00100000:1.0:1651529338.739244:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2116:41279:x1731746395641536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.739246:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.739247:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739248:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 4/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739251:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 3/0,0 mode: PR/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739251:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739255:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3b3697 lrc: 0/0,0 mode: --/PR res: [0x2b10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a520f expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739256:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,1 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739259:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739259:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.739259:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 2/0,0 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739260:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739277:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 4/0,1 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739283:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739289:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2115:41279:x1731746395641536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.739292:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10568 00000100:00100000:1.0:1651529338.739296:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10569 00000100:00100000:0.0:1651529338.739296:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946317632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1373us total) trans 30064892467 rc 0/0 00000100:00100000:1.0:1651529338.739297:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2114:41279:x1731746395641600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529338.739299:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151554 00010000:00010000:1.0:1651529338.739300:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.739301:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 4/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2114 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.739305:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 3/0,0 mode: PR/PR res: [0x2b110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2114 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739305:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 2/0,0 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739308:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079306074 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739309:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 2/0,0 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739310:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c864c8b/0xa29a79078f3b579f lrc: 0/0,0 mode: --/PR res: [0x2b110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad621 expref: 2114 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.739312:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 3/0,0 mode: PW/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739313:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739314:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739315:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739317:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 4/0,1 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739317:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 1/0,0 mode: --/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739319:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079306074/0xa29a79078f3bcc45 lrc: 0/0,0 mode: --/PW res: [0x2b10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739323:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 2/0,0 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739326:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000295d0cfb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739327:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 2/0,0 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739330:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 3/0,0 mode: PW/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739333:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.739340:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2113:41279:x1731746395641600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.739343:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10569 00010000:00010000:0.0:1651529338.739343:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 1/0,0 mode: --/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739348:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295d0cfb/0xa29a79078f3bcc53 lrc: 0/0,0 mode: --/PW res: [0x2b10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739352:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739356:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739358:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739359:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,1 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739362:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 2/0,0 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739363:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739378:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,1 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739382:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 2/0,0 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.739403:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1104:39030:x1731745946317760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1340us (1463us total) trans 30064892468 rc 0/0 00000100:00100000:1.0:1651529338.739406:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151555 00010000:00010000:1.0:1651529338.739413:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739416:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739419:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,1 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.739423:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946317824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1319us (1491us total) trans 30064892469 rc 0/0 00000100:00100000:0.0:1651529338.739426:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151556 00010000:00010000:1.0:1651529338.739430:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 2/0,0 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739435:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 2/0,0 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739439:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8b58569 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739440:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 2/0,0 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739442:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 3/0,0 mode: PW/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739447:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 1/0,0 mode: --/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739450:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcc5a lrc: 0/0,0 mode: --/PW res: [0x2b10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739454:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 2/0,0 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739457:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb781374 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739458:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 2/0,0 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739461:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 3/0,0 mode: PW/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739466:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 1/0,0 mode: --/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.739467:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946317568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1503us (1577us total) trans 30064892470 rc 0/0 00010000:00010000:0.0:1651529338.739469:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb781374/0xa29a79078f3bcc61 lrc: 0/0,0 mode: --/PW res: [0x2b110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.739470:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151551 00010000:00010000:0.0:1651529338.739472:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 2/0,0 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739475:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b6d6b45 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739476:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 2/0,0 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739477:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739478:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 3/0,0 mode: PW/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739480:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739482:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 1/0,0 mode: --/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739483:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,1 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739484:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcc3e lrc: 0/0,0 mode: --/PW res: [0x2b10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739486:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 2/0,0 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.739507:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.739532:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946317696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1513us (1616us total) trans 30064892471 rc 0/0 00000100:00100000:1.0:1651529338.739535:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151553 00000100:00100000:1.0:1651529338.739539:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317888 00000100:00100000:1.0:1651529338.739562:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151557 00000100:00100000:1.0:1651529338.739564:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946317888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.739578:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176401 count 1 00010000:00010000:0.0:1651529338.739588:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 2/0,0 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739592:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac50bd95 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.739593:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 2/0,0 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739596:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 3/0,0 mode: PW/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739600:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: --/PW res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739601:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 1/0,0 mode: --/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739603:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcc4c lrc: 0/0,0 mode: --/PW res: [0x2b10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739605:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 2/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.739608:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739609:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739609:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 4/0,1 mode: --/PW res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739617:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 3/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.739620:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 4/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739624:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966577152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.739640:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.739845:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.739855:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946317952 00000100:00100000:0.0:1651529338.739855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.739862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.739863:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318016 00000100:00100000:1.0:1651529338.739871:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318080 00000100:00100000:1.0:1651529338.739877:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151558 00000100:00100000:0.0:1651529338.739878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.739879:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1106:39029:x1731745946317952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.739888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529338.739889:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176402 count 1 00010000:00010000:1.0:1651529338.739894:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: --/PW res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.739895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.739898:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 2/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.739901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.739902:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739902:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739903:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 4/0,1 mode: --/PW res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739915:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 3/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.739915:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318144 00010000:00010000:1.0:1651529338.739919:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 4/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.739923:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966577216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.739924:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318272 00000100:00100000:0.0:1651529338.739929:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318208 00000100:00100000:1.0:1651529338.739934:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.739934:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318336 00000100:00100000:0.0:1651529338.739939:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151559 00000100:00100000:0.0:1651529338.739941:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946318016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.739942:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151560 00000100:00100000:1.0:1651529338.739943:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1110:39029:x1731745946318080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.739949:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176403 count 1 00010000:00010000:0.0:1651529338.739956:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: --/PW res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739970:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 2/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.739974:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176404 count 1 00010000:00010000:0.0:1651529338.739975:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.739976:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739978:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: --/PW res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739978:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 4/0,1 mode: --/PW res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.739983:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 2/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2112 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.739986:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739986:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.739987:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 4/0,1 mode: --/PW res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.739987:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 3/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.739991:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 4/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.739995:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.739996:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 3/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2112 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.740000:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 4/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2112 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.740004:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966577344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.740005:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.740011:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.740013:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151561 00000100:00100000:0.0:1651529338.740015:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946318144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.740020:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176405 count 1 00010000:00010000:0.0:1651529338.740024:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: --/PW res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.740028:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 2/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2112 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.740031:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.740032:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.740033:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 4/0,1 mode: --/PW res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.740039:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 3/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2112 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.740043:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 4/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2112 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.740048:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966577408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.740052:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151562 00000100:00100000:1.0:1651529338.740054:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946318272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.740059:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176407 count 1 00000100:00100000:0.0:1651529338.740060:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.740063:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: --/PW res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.740067:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 2/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.740069:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151563 00010000:00010000:1.0:1651529338.740070:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.740071:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.740072:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 4/0,1 mode: --/PW res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.740072:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1110:39029:x1731745946318208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.740078:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 3/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2112 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.740079:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176406 count 1 00010000:00010000:1.0:1651529338.740081:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 4/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.740085:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: --/PW res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.740086:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.740092:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 2/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2112 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.740094:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.740097:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529338.740100:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151564 00000100:00100000:1.0:1651529338.740101:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1110:39029:x1731745946318336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.740106:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176408 count 1 00010000:00010000:1.0:1651529338.740109:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: --/PW res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.740113:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 2/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2112 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.740116:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.740117:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.740117:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 4/0,1 mode: --/PW res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.740123:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 3/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2112 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.740126:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 4/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2112 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.740126:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.740128:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 4/0,1 mode: --/PW res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.740142:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 3/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2112 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.740143:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966577536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.740153:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 4/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2112 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.740161:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966577600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.740163:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.740175:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.740191:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966577152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.740196:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: --/PW res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.740391:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966577216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.740395:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: --/PW res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.740593:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966577344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.740606:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: --/PW res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.740614:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.740615:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.740617:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: --/PW res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.740620:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: --/PW res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.740624:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966577536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.740626:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: --/PW res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.740628:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966577408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.740631:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: --/PW res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.740637:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966577600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.740639:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: --/PW res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741373:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.741421:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641728 00010000:00010000:1.0:1651529338.741426:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 4/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2113 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741432:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641856 00010000:00010000:1.0:1651529338.741434:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 4/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2114 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741438:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641984 00010000:00010000:1.0:1651529338.741440:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 4/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2115 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741444:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642112 00010000:00010000:1.0:1651529338.741446:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 4/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2116 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741450:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641664 00010000:00010000:1.0:1651529338.741452:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 4/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2117 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741455:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641792 00010000:00010000:1.0:1651529338.741457:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 4/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2118 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741461:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395641920 00010000:00010000:1.0:1651529338.741463:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 4/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2119 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741469:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642048 00010000:00010000:1.0:1651529338.741471:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 4/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2120 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.741475:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10570 00000100:00100000:1.0:1651529338.741477:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2120:41278:x1731746395641728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741480:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741481:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 4/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741485:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 3/0,0 mode: PR/PR res: [0x2b112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741491:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1387113/0xa29a79078f3b3b4b lrc: 0/0,0 mode: --/PR res: [0x2b112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a643e expref: 2120 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741494:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741495:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741496:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741499:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 4/0,1 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741505:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741521:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2119:41278:x1731746395641728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741532:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10570 00000100:00100000:1.0:1651529338.741537:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10571 00000100:00100000:1.0:1651529338.741539:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2118:41278:x1731746395641856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741541:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741543:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 4/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2118 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741555:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 3/0,0 mode: PR/PR res: [0x2b114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2118 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741561:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3183b30/0xa29a79078f3b60c1 lrc: 0/0,0 mode: --/PR res: [0x2b114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2affe2 expref: 2118 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741565:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741565:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741566:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741569:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 4/0,1 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741576:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741584:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2117:41278:x1731746395641856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741587:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10571 00000100:00100000:1.0:1651529338.741591:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10572 00000100:00100000:1.0:1651529338.741600:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2116:41278:x1731746395641984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741603:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741605:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 4/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741608:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 3/0,0 mode: PR/PR res: [0x2b117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741613:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221a7d1a/0xa29a79078f3b3dc1 lrc: 0/0,0 mode: --/PR res: [0x2b117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dde expref: 2116 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741617:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741618:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741618:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741621:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 4/0,1 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741627:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741633:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2115:41278:x1731746395641984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741635:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10572 00000100:00100000:1.0:1651529338.741639:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10573 00000100:00100000:1.0:1651529338.741641:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2114:41278:x1731746395642112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741643:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741645:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 4/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2114 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741648:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 3/0,0 mode: PR/PR res: [0x2b116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2114 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741653:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3b30fc lrc: 0/0,0 mode: --/PR res: [0x2b116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c7c expref: 2114 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741656:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741656:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741657:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741660:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 4/0,1 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741670:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741676:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2113:41278:x1731746395642112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741678:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10573 00010000:00010000:0.0:1651529338.741679:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741682:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10574 00010000:00010000:0.0:1651529338.741683:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741684:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2112:41278:x1731746395641664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741686:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741687:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 4/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.741687:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,1 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741690:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 2/0,0 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741691:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 3/0,0 mode: PR/PR res: [0x2b111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741696:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094642a30/0xa29a79078f3b4084 lrc: 0/0,0 mode: --/PR res: [0x2b111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79a0 expref: 2112 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741699:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741700:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741700:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741703:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 4/0,1 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741709:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741713:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2111:41278:x1731746395641664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741716:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10574 00000100:00100000:1.0:1651529338.741719:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10575 00000100:00100000:1.0:1651529338.741721:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2110:41278:x1731746395641792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741723:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741724:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 4/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741737:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 3/0,0 mode: PR/PR res: [0x2b113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.741742:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec528a0a/0xa29a79078f3b2e40 lrc: 0/0,0 mode: --/PR res: [0x2b113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a317e expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.741747:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1111:39029:x1731745946318208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1675us (1852us total) trans 30064892472 rc 0/0 00000100:00100000:0.0:1651529338.741751:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151563 00010000:00010000:1.0:1651529338.741755:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741756:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741756:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741758:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 2/0,0 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741759:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 4/0,1 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741762:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494eede9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.741763:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 2/0,0 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741766:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 3/0,0 mode: PW/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741768:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741775:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2109:41278:x1731746395641792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (372us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.741777:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 1/0,0 mode: --/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741778:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10575 00010000:00010000:0.0:1651529338.741780:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494eede9/0xa29a79078f3bcc92 lrc: 0/0,0 mode: --/PW res: [0x2b116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741782:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10576 00000100:00100000:1.0:1651529338.741784:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2108:41278:x1731746395641920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741786:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.741787:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741788:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 4/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2108 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.741790:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741791:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 3/0,0 mode: PR/PR res: [0x2b115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2108 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.741793:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,1 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741796:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aece80b/0xa29a79078f3b5791 lrc: 0/0,0 mode: --/PR res: [0x2b115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5cd expref: 2108 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.741796:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 2/0,0 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741799:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741822:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741823:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741827:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 4/0,1 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741835:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.741842:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2107:41278:x1731746395641920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.741844:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10576 00000100:00100000:1.0:1651529338.741853:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10577 00000100:00100000:1.0:1651529338.741854:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2106:41278:x1731746395642048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.741857:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.741859:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 4/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2106 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.741859:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1111:39030:x1731745946318016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1917us (2004us total) trans 30064892473 rc 0/0 00010000:00010000:1.0:1651529338.741862:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 3/0,0 mode: PR/PR res: [0x2b118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2106 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.741862:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151559 00010000:00010000:1.0:1651529338.741867:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d75090a2/0xa29a79078f3b4f95 lrc: 0/0,0 mode: --/PR res: [0x2b118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab5dd expref: 2106 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.741870:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 2/0,0 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741871:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741871:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.741872:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741873:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5e7eeed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.741874:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 2/0,0 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741877:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 4/0,1 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741877:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 3/0,0 mode: PW/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741881:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 1/0,0 mode: --/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741884:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.741884:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e7eeed/0xa29a79078f3bcc76 lrc: 0/0,0 mode: --/PW res: [0x2b113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741889:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2105:41278:x1731746395642048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (473us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.741890:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741891:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10577 00010000:00010000:0.0:1651529338.741893:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741896:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,1 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741897:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741899:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 2/0,0 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741900:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741904:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,1 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741913:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 2/0,0 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.741945:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946318144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1930us (2076us total) trans 30064892474 rc 0/0 00000100:00100000:0.0:1651529338.741948:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151561 00010000:00010000:0.0:1651529338.741955:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 2/0,0 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741958:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d02b17d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.741959:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 2/0,0 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741960:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1111:39029:x1731745946318080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2015us (2097us total) trans 30064892475 rc 0/0 00010000:00010000:0.0:1651529338.741962:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 3/0,0 mode: PW/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.741963:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151560 00010000:00010000:0.0:1651529338.741966:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 1/0,0 mode: --/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.741969:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02b17d6/0xa29a79078f3bcc84 lrc: 0/0,0 mode: --/PW res: [0x2b115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741971:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 2/0,0 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741974:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a60fe4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.741976:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 2/0,0 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741979:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 3/0,0 mode: PW/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741983:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 1/0,0 mode: --/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741986:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcc7d lrc: 0/0,0 mode: --/PW res: [0x2b114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741992:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741995:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.741998:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,1 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742001:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 2/0,0 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742035:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 2/0,0 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742039:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff4d85ca already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.742040:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 2/0,0 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742043:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 3/0,0 mode: PW/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742047:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 1/0,0 mode: --/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742050:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d85ca/0xa29a79078f3bcc8b lrc: 0/0,0 mode: --/PW res: [0x2b117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742091:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1111:39030:x1731745946318272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2036us (2202us total) trans 30064892476 rc 0/0 00000100:00100000:1.0:1651529338.742094:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151562 00010000:00010000:1.0:1651529338.742101:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742120:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742123:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,1 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742126:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 2/0,0 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742136:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 2/0,0 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742141:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db9bfbbf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.742142:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 2/0,0 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742144:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 3/0,0 mode: PW/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742152:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 1/0,0 mode: --/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742155:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9bfbbf/0xa29a79078f3bcc6f lrc: 0/0,0 mode: --/PW res: [0x2b112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742169:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1111:39029:x1731745946317952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2289us (2324us total) trans 30064892477 rc 0/0 00000100:00100000:1.0:1651529338.742172:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151558 00010000:00010000:1.0:1651529338.742179:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742182:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742185:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,1 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742196:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 2/0,0 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.742220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.742231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.742240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.742257:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1111:39030:x1731745946317888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2693us (2750us total) trans 30064892478 rc 0/0 00000100:00100000:1.0:1651529338.742268:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151557 00000100:00100000:1.0:1651529338.742274:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318400 00000100:00100000:1.0:1651529338.742282:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318528 00000100:00100000:1.0:1651529338.742294:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318464 00000100:00100000:1.0:1651529338.742302:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151565 00000100:00100000:1.0:1651529338.742304:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1113:39030:x1731745946318400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.742309:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176409 count 1 00000100:00100000:0.0:1651529338.742312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.742313:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: --/PW res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742318:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 2/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.742320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.742321:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742322:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742323:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 4/0,1 mode: --/PW res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.742326:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318656 00010000:00010000:1.0:1651529338.742329:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 3/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.742333:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 4/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.742333:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318592 00000100:00100000:1.0:1651529338.742337:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966577664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.742337:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151566 00000100:00100000:0.0:1651529338.742338:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1115:39030:x1731745946318528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.742344:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176411 count 1 00000100:00100000:1.0:1651529338.742351:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.742356:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: --/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742357:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 2/0,0 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742361:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029a4ee9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.742361:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 2/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.742362:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 2/0,0 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742364:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742365:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 3/0,0 mode: PW/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742365:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742366:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 4/0,1 mode: --/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742369:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 1/0,0 mode: --/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742372:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcc68 lrc: 0/0,0 mode: --/PW res: [0x2b111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742376:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 3/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.742380:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151567 00000100:00100000:1.0:1651529338.742382:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1115:39030:x1731745946318464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.742386:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176410 count 1 00010000:00010000:1.0:1651529338.742390:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: --/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742394:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 2/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.742397:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742397:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742398:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 4/0,1 mode: --/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742404:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 4/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.742409:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966577728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.742416:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 3/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.742419:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.742420:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 4/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.742424:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966577792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.742426:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151568 00000100:00100000:0.0:1651529338.742428:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1115:39030:x1731745946318656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.742432:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.742433:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176413 count 1 00010000:00010000:0.0:1651529338.742437:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: --/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742439:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151569 00000100:00100000:1.0:1651529338.742441:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1115:39030:x1731745946318592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.742442:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 2/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.742445:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176412 count 1 00010000:00010000:0.0:1651529338.742445:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742446:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742446:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 4/0,1 mode: --/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742448:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: --/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742453:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 2/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2104 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.742456:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742456:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742457:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 4/0,1 mode: --/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742462:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 3/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2104 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.742466:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 4/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2104 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.742467:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 3/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742471:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 4/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.742475:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.742480:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.742482:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.742488:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.742494:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742497:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.742498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.742500:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,1 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742508:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 2/0,0 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.742524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.742566:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946318336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2463us (2664us total) trans 30064892479 rc 0/0 00000100:00100000:1.0:1651529338.742569:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151564 00010000:00010000:0.0:1651529338.742572:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 2/0,0 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742576:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058936903 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.742577:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 2/0,0 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742580:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318720 00010000:00010000:0.0:1651529338.742580:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 3/0,0 mode: PW/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742585:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 1/0,0 mode: --/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742590:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318784 00000100:00100000:1.0:1651529338.742596:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151570 00000100:00100000:1.0:1651529338.742598:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1117:39030:x1731745946318720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.742603:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176414 count 1 00010000:00010000:1.0:1651529338.742607:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: --/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742612:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 2/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742614:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcc99 lrc: 0/0,0 mode: --/PW res: [0x2b118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.742623:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742623:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.742624:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 4/0,1 mode: --/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.742624:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151571 00000100:00100000:0.0:1651529338.742626:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1117:39030:x1731745946318784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.742631:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 3/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2104 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.742631:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176415 count 1 00010000:00010000:1.0:1651529338.742635:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 4/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.742635:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: --/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742639:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966577984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.742642:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 2/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2104 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742645:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742646:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742647:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 4/0,1 mode: --/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.742652:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.742661:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 3/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2104 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742664:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 4/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2104 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.742669:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.742677:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.742722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.742738:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318848 00000100:00100000:0.0:1651529338.742747:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151572 00000100:00100000:0.0:1651529338.742748:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a920734 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1118:39030:x1731745946318848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.742753:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176416 count 1 00010000:00010000:0.0:1651529338.742758:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: --/PW res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742762:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 2/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742768:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742769:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.742769:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 4/0,1 mode: --/PW res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.742776:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 3/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.742779:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 4/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.742783:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966578112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.742799:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.743872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.743883:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966577664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.743888:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: --/PW res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.743895:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642176 00010000:00010000:1.0:1651529338.743901:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 4/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2105 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.743909:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10578 00000100:00100000:1.0:1651529338.743910:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2105:41278:x1731746395642176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.743913:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.743915:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 4/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2105 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.743918:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 3/0,0 mode: PR/PR res: [0x2b119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2105 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.743924:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0fc803/0xa29a79078f3b3b75 lrc: 0/0,0 mode: --/PR res: [0x2b119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a64e6 expref: 2105 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.743927:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.743928:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.743929:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.743932:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 4/0,1 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.743938:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.743946:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2104:41278:x1731746395642176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.743949:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10578 00010000:00010000:1.0:1651529338.743954:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.743958:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.743961:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,1 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.743964:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 2/0,0 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.743984:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 2/0,0 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.743988:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2dec8c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.743989:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 2/0,0 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.743992:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 3/0,0 mode: PW/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.743997:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 1/0,0 mode: --/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744003:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcca0 lrc: 0/0,0 mode: --/PW res: [0x2b119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744017:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1119:39030:x1731745946318400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1712us (1796us total) trans 30064892480 rc 0/0 00000100:00100000:1.0:1651529338.744020:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151565 00000100:00100000:0.0:1651529338.744233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.744252:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318912 00000100:00100000:1.0:1651529338.744264:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151573 00000100:00100000:1.0:1651529338.744266:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1119:39030:x1731745946318912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.744276:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176417 count 1 00010000:00010000:1.0:1651529338.744280:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: --/PW res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744285:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 2/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2103 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.744288:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744289:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744290:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 4/0,1 mode: --/PW res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744296:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 3/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2103 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.744300:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 4/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2103 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744307:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966578176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.744322:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.744357:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966577792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.744370:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: --/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744378:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966577856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.744381:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: --/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.744381:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966577728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.744387:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966577984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.744390:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: --/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744398:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: --/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.744408:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966577920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.744410:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: --/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.744427:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.744429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.744431:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: --/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.744448:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966578112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.744451:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: --/PW res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744452:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.744458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.744474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.744486:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642240 00010000:00010000:1.0:1651529338.744492:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 4/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2104 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744498:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642368 00010000:00010000:1.0:1651529338.744500:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 4/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2105 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744504:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642496 00000100:00100000:0.0:1651529338.744504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.744506:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 4/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2106 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744510:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642624 00000100:00100000:0.0:1651529338.744511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.744512:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 4/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2107 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744516:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642304 00010000:00010000:1.0:1651529338.744518:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 4/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2108 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744522:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642432 00010000:00010000:1.0:1651529338.744524:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 4/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2109 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744528:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642560 00010000:00010000:1.0:1651529338.744530:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 4/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2110 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.744534:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10579 00000100:00100000:1.0:1651529338.744536:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2110:41278:x1731746395642240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.744539:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744540:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 4/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744555:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 3/0,0 mode: PR/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744562:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3b4340 lrc: 0/0,0 mode: --/PR res: [0x2b11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85fc expref: 2110 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744565:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744566:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744567:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744570:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 4/0,1 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744581:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.744592:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2109:41278:x1731746395642240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.744595:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10579 00000100:00100000:1.0:1651529338.744600:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10580 00000100:00100000:1.0:1651529338.744601:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2108:41278:x1731746395642368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.744603:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744604:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744606:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 4/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2108 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744609:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 3/0,0 mode: PR/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2108 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744609:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744613:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,1 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744615:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 2/0,0 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744627:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015ae0bf6/0xa29a79078f3b415d lrc: 0/0,0 mode: --/PR res: [0x2b11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d3c expref: 2108 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744632:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744632:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744633:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744636:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 4/0,1 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744645:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.744652:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2107:41278:x1731746395642368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.744654:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10580 00000100:00100000:1.0:1651529338.744659:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10581 00000100:00100000:1.0:1651529338.744660:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2106:41278:x1731746395642496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.744663:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744664:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 4/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2106 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744668:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 3/0,0 mode: PR/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2106 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.744669:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2329us (2437us total) trans 30064892481 rc 0/0 00010000:00010000:1.0:1651529338.744672:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fceb30a/0xa29a79078f3b41b1 lrc: 0/0,0 mode: --/PR res: [0x2b11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f8f expref: 2106 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.744672:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151566 00010000:00010000:1.0:1651529338.744678:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744679:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744680:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744680:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744682:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 4/0,1 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744684:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744687:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,1 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744688:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.744689:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 2/0,0 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744693:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2105:41278:x1731746395642496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.744695:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10581 00000100:00100000:1.0:1651529338.744698:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10582 00000100:00100000:1.0:1651529338.744700:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2104:41278:x1731746395642624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.744702:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744703:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 4/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744707:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 3/0,0 mode: PR/PR res: [0x2b120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744711:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3b4991 lrc: 0/0,0 mode: --/PR res: [0x2b120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9f7f expref: 2104 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744714:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744715:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744715:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744718:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 4/0,1 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.744723:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2294us (2411us total) trans 30064892482 rc 0/0 00010000:00010000:1.0:1651529338.744726:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.744741:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2103:41278:x1731746395642624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.744743:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151568 00000100:00100000:1.0:1651529338.744744:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10582 00000100:00100000:1.0:1651529338.744748:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10583 00000100:00100000:1.0:1651529338.744750:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2102:41278:x1731746395642304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.744750:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 2/0,0 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744752:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744753:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 4/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2102 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744753:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744754:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 2/0,0 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744757:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 3/0,0 mode: PR/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2102 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744757:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 3/0,0 mode: PW/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744762:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3b3e2a lrc: 0/0,0 mode: --/PR res: [0x2b11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f74 expref: 2102 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744762:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 1/0,0 mode: --/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744765:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcca7 lrc: 0/0,0 mode: --/PW res: [0x2b11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744766:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744766:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744767:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744769:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 2/0,0 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744772:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 4/0,1 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744772:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000701a7492 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744773:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 2/0,0 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744776:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 3/0,0 mode: PW/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744778:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.744781:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 1/0,0 mode: --/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744783:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2101:41278:x1731746395642304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (309us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.744784:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701a7492/0xa29a79078f3bccb5 lrc: 0/0,0 mode: --/PW res: [0x2b11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744785:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10583 00010000:00010000:0.0:1651529338.744789:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744792:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.744793:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10584 00000100:00100000:1.0:1651529338.744794:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2100:41278:x1731746395642432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.744794:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,1 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744797:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.744797:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 2/0,0 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744798:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 4/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2100 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744802:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 3/0,0 mode: PR/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2100 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744823:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3b359b lrc: 0/0,0 mode: --/PR res: [0x2b11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4dbd expref: 2100 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.744827:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744827:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744828:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744831:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 4/0,1 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744837:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.744843:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2099:41278:x1731746395642432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.744846:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10584 00000100:00100000:0.0:1651529338.744849:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a920734 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2099us (2127us total) trans 30064892483 rc 0/0 00000100:00100000:1.0:1651529338.744851:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10585 00000100:00100000:1.0:1651529338.744852:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2098:41278:x1731746395642560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529338.744852:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151572 00010000:00010000:1.0:1651529338.744855:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.744856:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 4/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2098 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744859:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 2/0,0 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744860:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 3/0,0 mode: PR/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2098 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744862:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744863:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 2/0,0 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744864:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3b3150 lrc: 0/0,0 mode: --/PR res: [0x2b11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d9b expref: 2098 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.744866:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 3/0,0 mode: PW/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744867:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744868:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.744869:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744871:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 4/0,1 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744871:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 1/0,0 mode: --/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744874:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bccd1 lrc: 0/0,0 mode: --/PW res: [0x2b120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744879:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.744885:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2097:41278:x1731746395642560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.744887:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10585 00010000:00010000:0.0:1651529338.744888:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744892:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744895:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744895:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,1 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744897:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 2/0,0 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744898:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744901:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,1 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744904:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 2/0,0 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.744939:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1121:39030:x1731745946318784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2312us (2415us total) trans 30064892484 rc 0/0 00000100:00100000:0.0:1651529338.744942:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151571 00000100:00100000:1.0:1651529338.744947:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2565us (2707us total) trans 30064892485 rc 0/0 00000100:00100000:1.0:1651529338.744950:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151567 00010000:00010000:0.0:1651529338.744950:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 2/0,0 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744955:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744956:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 2/0,0 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744958:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744959:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 3/0,0 mode: PW/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744961:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744963:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 1/0,0 mode: --/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744964:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,1 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.744966:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 2/0,0 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744966:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bccca lrc: 0/0,0 mode: --/PW res: [0x2b11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744970:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 2/0,0 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744972:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695a17e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744973:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 2/0,0 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744976:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 3/0,0 mode: PW/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744979:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 1/0,0 mode: --/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744984:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bccae lrc: 0/0,0 mode: --/PW res: [0x2b11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744988:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 2/0,0 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744990:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003482d8c9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.744991:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 2/0,0 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744994:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 3/0,0 mode: PW/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744997:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 1/0,0 mode: --/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.744999:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bccbc lrc: 0/0,0 mode: --/PW res: [0x2b11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.745003:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2561us (2683us total) trans 30064892486 rc 0/0 00000100:00100000:1.0:1651529338.745006:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151569 00010000:00010000:1.0:1651529338.745014:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745018:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745021:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,1 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745023:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 2/0,0 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.745095:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946318720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2496us (2596us total) trans 30064892487 rc 0/0 00010000:00010000:0.0:1651529338.745104:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 2/0,0 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745108:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058383ed8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.745109:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 2/0,0 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745114:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 3/0,0 mode: PW/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745118:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 1/0,0 mode: --/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.745121:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151570 00010000:00010000:0.0:1651529338.745121:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bccc3 lrc: 0/0,0 mode: --/PW res: [0x2b11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.745147:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966578176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.745152:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: --/PW res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.745328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.745339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.745345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.745353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.745355:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319040 00000100:00100000:0.0:1651529338.745360:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.745371:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319168 00000100:00100000:1.0:1651529338.745377:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319296 00000100:00100000:0.0:1651529338.745380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.745390:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946318976 00000100:00100000:1.0:1651529338.745397:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319104 00000100:00100000:1.0:1651529338.745399:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319232 00000100:00100000:0.0:1651529338.745399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.745402:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319360 00000100:00100000:1.0:1651529338.745405:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151574 00000100:00100000:1.0:1651529338.745406:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.745407:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151575 00000100:00100000:0.0:1651529338.745409:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.745412:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176419 count 1 00002000:00080000:0.0:1651529338.745416:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176421 count 1 00010000:00010000:1.0:1651529338.745417:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: --/PW res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745420:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: --/PW res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745421:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 2/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745424:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745425:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745425:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 2/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745426:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 4/0,1 mode: --/PW res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745429:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745430:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745430:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 4/0,1 mode: --/PW res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745432:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 3/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745436:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 4/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.745438:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 3/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.745440:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966578240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.745442:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 4/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.745446:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.745452:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.745455:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.745458:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151576 00000100:00100000:1.0:1651529338.745460:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.745462:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151577 00000100:00100000:0.0:1651529338.745464:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946318976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.745466:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176423 count 1 00002000:00080000:0.0:1651529338.745468:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176418 count 1 00010000:00010000:1.0:1651529338.745469:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: --/PW res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745472:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: --/PW res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745474:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 2/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.745476:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 2/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745477:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745477:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745478:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 4/0,1 mode: --/PW res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745479:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745480:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745480:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 4/0,1 mode: --/PW res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745484:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 3/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.745486:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 3/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745488:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 4/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.745492:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966578368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.745493:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 4/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.745496:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966578432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.745499:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.745503:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.745505:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151578 00000100:00100000:1.0:1651529338.745507:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.745509:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151579 00002000:00080000:1.0:1651529338.745510:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176420 count 1 00000100:00100000:0.0:1651529338.745510:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.745514:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: --/PW res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.745514:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176422 count 1 00010000:00010000:1.0:1651529338.745518:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 2/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2096 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745521:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745522:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745522:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 4/0,1 mode: --/PW res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.745527:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: --/PW res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745528:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 3/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2096 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745531:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 4/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2096 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.745532:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 2/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.745535:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966578496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.745535:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745536:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.745536:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 4/0,1 mode: --/PW res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.745541:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.745543:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 3/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2096 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.745546:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 4/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.745547:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151580 00000100:00100000:1.0:1651529338.745549:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1126:39030:x1731745946319360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.745553:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176424 count 1 00000100:00100000:0.0:1651529338.745553:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966578560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.745556:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: --/PW res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745560:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 2/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2096 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.745561:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.745563:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745564:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.745564:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 4/0,1 mode: --/PW res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.745573:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 3/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2096 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.745577:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 4/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2096 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.745580:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966578624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.745587:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.746227:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966578240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.746232:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: --/PW res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746265:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966578368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.746269:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: --/PW res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746283:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966578496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.746286:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: --/PW res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.746288:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.746298:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642752 00010000:00010000:1.0:1651529338.746303:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 4/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2097 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.746317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.746327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.746336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.746339:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642880 00000100:00100000:0.0:1651529338.746341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.746343:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 4/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2098 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.746346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.746348:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643008 00010000:00010000:1.0:1651529338.746350:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 4/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2099 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.746352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.746354:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642688 00010000:00010000:1.0:1651529338.746356:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 4/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2100 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.746360:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642816 00000100:00100000:0.0:1651529338.746361:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.746362:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 4/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2101 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.746365:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: --/PW res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746366:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395642944 00010000:00010000:1.0:1651529338.746368:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 5/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2102 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.746371:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643072 00010000:00010000:1.0:1651529338.746373:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 5/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2103 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.746373:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966578432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.746375:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: --/PW res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746378:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10586 00000100:00100000:1.0:1651529338.746380:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2103:41278:x1731746395642752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529338.746382:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966578560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.746384:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: --/PW res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746391:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746392:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 4/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2103 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746396:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 3/0,0 mode: PR/PR res: [0x2b123:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2103 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746402:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3b4d50 lrc: 0/0,0 mode: --/PR res: [0x2b123:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac28 expref: 2103 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746406:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746406:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746407:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746410:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 4/0,1 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746417:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746426:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2102:41278:x1731746395642752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746429:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10586 00000100:00100000:1.0:1651529338.746434:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10587 00000100:00100000:1.0:1651529338.746435:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2101:41278:x1731746395642880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746438:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746439:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 4/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2101 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746453:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 3/0,0 mode: PR/PR res: [0x2b127:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2101 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746458:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c4e1e4/0xa29a79078f3b550d lrc: 0/0,0 mode: --/PR res: [0x2b127:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc81 expref: 2101 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746461:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746462:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746463:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.746470:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.746472:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 4/0,1 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746478:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746489:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2100:41278:x1731746395642880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746492:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10587 00000100:00100000:1.0:1651529338.746497:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643136 00010000:00010000:1.0:1651529338.746500:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 5/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2100 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.746505:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10588 00000100:00100000:1.0:1651529338.746513:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2100:41278:x1731746395643008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746516:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746518:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 4/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2100 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746521:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 3/0,0 mode: PR/PR res: [0x2b124:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2100 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746526:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3b35e8 lrc: 0/0,0 mode: --/PR res: [0x2b124:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4eff expref: 2100 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746530:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746530:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746531:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746534:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 4/0,1 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746540:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746553:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2099:41278:x1731746395643008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746556:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10588 00000100:00100000:1.0:1651529338.746561:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10589 00000100:00100000:1.0:1651529338.746562:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2098:41278:x1731746395642688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746565:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746566:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 4/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2098 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746570:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 3/0,0 mode: PR/PR res: [0x2b121:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2098 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746583:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3b33fe lrc: 0/0,0 mode: --/PR res: [0x2b121:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4822 expref: 2098 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746586:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746587:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746587:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746596:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 4/0,1 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746609:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746620:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2097:41278:x1731746395642688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746623:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10589 00000100:00100000:1.0:1651529338.746628:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10590 00000100:00100000:1.0:1651529338.746629:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2096:41278:x1731746395642816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746632:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746633:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 4/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746643:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 3/0,0 mode: PR/PR res: [0x2b125:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746649:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000495f24c4/0xa29a79078f3b30b6 lrc: 0/0,0 mode: --/PR res: [0x2b125:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b33 expref: 2096 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746667:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746667:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746668:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746671:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 4/0,1 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746681:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746691:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2095:41278:x1731746395642816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746694:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10590 00010000:00010000:0.0:1651529338.746695:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746702:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746704:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10591 00000100:00100000:1.0:1651529338.746705:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2094:41278:x1731746395642944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.746705:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,1 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746707:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 2/0,0 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746708:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746709:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 4/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2094 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746713:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 3/0,0 mode: PR/PR res: [0x2b122:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2094 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746718:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3b490c lrc: 0/0,0 mode: --/PR res: [0x2b122:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9d6b expref: 2094 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746721:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746737:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746738:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746741:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 4/0,1 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746749:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746756:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2093:41278:x1731746395642944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746759:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10591 00000100:00100000:1.0:1651529338.746764:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10592 00000100:00100000:1.0:1651529338.746765:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2092:41278:x1731746395643072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746768:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.746769:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 4/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2092 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.746769:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946319168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1358us (1429us total) trans 30064892488 rc 0/0 00000100:00100000:0.0:1651529338.746772:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151575 00010000:00010000:1.0:1651529338.746773:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 3/0,0 mode: PR/PR res: [0x2b126:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2092 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746778:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a8b700/0xa29a79078f3b54f1 lrc: 0/0,0 mode: --/PR res: [0x2b126:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc03 expref: 2092 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.746780:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 2/0,0 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746781:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746782:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746782:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746783:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe763644 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.746784:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 2/0,0 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746787:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 3/0,0 mode: PW/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746792:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 1/0,0 mode: --/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746794:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 4/0,1 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746795:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcce6 lrc: 0/0,0 mode: --/PW res: [0x2b125:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746816:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746824:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2091:41278:x1731746395643072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746827:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10592 00000100:00100000:1.0:1651529338.746831:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10593 00010000:00010000:0.0:1651529338.746831:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746833:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2090:41278:x1731746395643136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.746835:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.746835:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746837:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 5/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2090 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.746838:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,1 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746840:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 2/0,0 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746841:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 4/0,0 mode: PR/PR res: [0x2b128:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2090 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.746852:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746853:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.746854:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746857:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 4/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746861:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.746867:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2090:41278:x1731746395643136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.746877:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10593 00000100:00100000:0.0:1651529338.746881:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946318976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1416us (1527us total) trans 30064892489 rc 0/0 00010000:00010000:1.0:1651529338.746884:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 2/0,0 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.746884:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151577 00010000:00010000:1.0:1651529338.746887:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac50bd95 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.746888:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 2/0,0 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746891:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 3/0,0 mode: PW/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746891:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746894:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746895:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 1/0,0 mode: --/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746897:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,1 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746898:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bccf4 lrc: 0/0,0 mode: --/PW res: [0x2b122:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746900:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 2/0,0 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746904:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746907:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746910:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,1 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746913:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 2/0,0 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.746952:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1128:39030:x1731745946319232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1440us (1576us total) trans 30064892490 rc 0/0 00000100:00100000:0.0:1651529338.746955:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151579 00010000:00010000:0.0:1651529338.746964:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 2/0,0 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.746965:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946319296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1504us (1619us total) trans 30064892491 rc 0/0 00000100:00100000:1.0:1651529338.746968:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151576 00010000:00010000:0.0:1651529338.746968:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b6d6b45 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.746969:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 2/0,0 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746972:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 3/0,0 mode: PW/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746976:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746976:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 1/0,0 mode: --/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746979:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746979:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcd02 lrc: 0/0,0 mode: --/PW res: [0x2b126:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746982:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,1 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746983:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 2/0,0 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.746985:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 2/0,0 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.746986:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.746987:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 2/0,0 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747001:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 3/0,0 mode: PW/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747004:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 1/0,0 mode: --/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747007:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcced lrc: 0/0,0 mode: --/PW res: [0x2b127:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747011:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 2/0,0 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747014:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3014153 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.747015:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 2/0,0 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747017:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 3/0,0 mode: PW/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747018:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946319104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1511us (1658us total) trans 30064892492 rc 0/0 00010000:00010000:0.0:1651529338.747020:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 1/0,0 mode: --/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747021:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151578 00010000:00010000:0.0:1651529338.747023:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bccfb lrc: 0/0,0 mode: --/PW res: [0x2b124:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747029:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747033:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747035:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,1 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747048:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 2/0,0 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747088:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 2/0,0 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747098:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000974e13db already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.747099:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 2/0,0 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747102:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 3/0,0 mode: PW/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747110:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946319040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1702us (1781us total) trans 30064892493 rc 0/0 00010000:00010000:0.0:1651529338.747112:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 1/0,0 mode: --/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747113:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151574 00010000:00010000:0.0:1651529338.747115:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974e13db/0xa29a79078f3bccdf lrc: 0/0,0 mode: --/PW res: [0x2b123:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747120:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747123:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747126:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,1 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747129:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 2/0,0 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747179:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946318912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2912us (2946us total) trans 30064892494 rc 0/0 00000100:00100000:1.0:1651529338.747182:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151573 00010000:00010000:1.0:1651529338.747189:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 2/0,0 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747192:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748b0d4c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.747193:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 2/0,0 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747207:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 3/0,0 mode: PW/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747213:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 1/0,0 mode: --/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747215:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bccd8 lrc: 0/0,0 mode: --/PW res: [0x2b121:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747228:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006103cf6b/0xa29a79078f3b3d90 lrc: 0/0,0 mode: --/PR res: [0x2b128:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d52 expref: 2089 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.747232:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966578624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.747236:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747239:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747242:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747245:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,1 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747247:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 2/0,0 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747262:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 2/0,0 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747266:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a79d5d88 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.747267:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 2/0,0 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747270:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 3/0,0 mode: PW/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747275:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 1/0,0 mode: --/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747289:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946319360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1739us (1895us total) trans 30064892495 rc 0/0 00000100:00100000:1.0:1651529338.747292:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151580 00010000:00010000:0.0:1651529338.747295:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd09 lrc: 0/0,0 mode: --/PW res: [0x2b128:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747393:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319424 00000100:00100000:1.0:1651529338.747406:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319552 00000100:00100000:1.0:1651529338.747409:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319680 00000100:00100000:1.0:1651529338.747412:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319488 00000100:00100000:1.0:1651529338.747415:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319616 00000100:00100000:1.0:1651529338.747421:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151581 00000100:00100000:1.0:1651529338.747422:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946319424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.747428:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176425 count 1 00010000:00010000:1.0:1651529338.747433:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: --/PW res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747438:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 2/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.747439:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151582 00010000:00010000:1.0:1651529338.747441:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747441:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.747441:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946319552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.747442:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 4/0,1 mode: --/PW res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.747447:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176427 count 1 00010000:00010000:1.0:1651529338.747452:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 3/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.747452:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: --/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747456:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 4/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.747457:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 2/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.747460:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966578688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.747460:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747461:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747462:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 4/0,1 mode: --/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747471:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.747477:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151583 00000100:00100000:1.0:1651529338.747479:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946319680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.747483:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176429 count 1 00010000:00010000:1.0:1651529338.747487:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: --/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.747491:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 3/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.747495:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 4/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2088 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.747500:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.747501:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 2/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747504:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747505:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747506:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 4/0,1 mode: --/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.747509:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.747513:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 3/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747516:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 4/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.747517:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151584 00000100:00100000:0.0:1651529338.747526:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946319488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.747531:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966578816:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529338.747532:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176426 count 1 00010000:00010000:0.0:1651529338.747536:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: --/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747539:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.747541:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 2/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.747544:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747544:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747545:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 4/0,1 mode: --/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747546:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151585 00000100:00100000:1.0:1651529338.747548:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946319616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.747552:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176428 count 1 00010000:00010000:0.0:1651529338.747552:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 3/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.747555:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 4/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2088 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.747556:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: --/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.747559:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966578880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.747560:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 2/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747563:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747564:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747565:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 4/0,1 mode: --/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.747567:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.747571:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 3/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2088 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747574:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 4/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.747578:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966578944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.747582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747585:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.747590:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319808 00000100:00100000:0.0:1651529338.747596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.747608:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319744 00000100:00100000:1.0:1651529338.747615:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151586 00000100:00100000:1.0:1651529338.747616:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1133:39030:x1731745946319808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.747618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529338.747621:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176431 count 1 00010000:00010000:1.0:1651529338.747625:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: --/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747629:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 2/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2088 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747632:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747633:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747633:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 4/0,1 mode: --/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747639:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 3/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2088 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.747646:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319872 00000100:00100000:0.0:1651529338.747653:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151587 00000100:00100000:0.0:1651529338.747655:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1134:39030:x1731745946319744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.747668:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176430 count 1 00010000:00010000:1.0:1651529338.747669:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 4/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2088 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.747673:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: --/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747674:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966579008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.747677:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 2/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2088 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.747680:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747681:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.747682:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 4/0,1 mode: --/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.747688:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.747695:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151588 00010000:00010000:0.0:1651529338.747695:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 3/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2088 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.747697:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1134:39030:x1731745946319872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.747699:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 4/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2088 pid: 161133 timeout: 13088 lvb_type: 1 00002000:00080000:1.0:1651529338.747702:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176432 count 1 00000100:00100000:0.0:1651529338.747703:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.747706:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: --/PW res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747710:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 2/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.747712:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.747714:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747714:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.747715:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 4/0,1 mode: --/PW res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.747721:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 3/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2088 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.747725:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 4/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2088 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.747737:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966579136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.747745:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.748643:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966578752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.748648:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: --/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.748663:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966578880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.748666:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: --/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.748674:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966578816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.748679:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: --/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.748687:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966578688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.748689:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: --/PW res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.748696:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966578944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.748698:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: --/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.748704:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966579008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.748707:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: --/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.749400:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.749429:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643264 00010000:00010000:1.0:1651529338.749435:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 4/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2089 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.749443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.749454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.749461:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643392 00000100:00100000:0.0:1651529338.749463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.749465:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 4/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2090 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.749468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.749470:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643520 00010000:00010000:1.0:1651529338.749472:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 4/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2091 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.749473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.749476:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643200 00010000:00010000:1.0:1651529338.749478:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 4/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2092 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.749482:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643328 00010000:00010000:1.0:1651529338.749484:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 4/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2093 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.749493:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.749494:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643456 00010000:00010000:1.0:1651529338.749504:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 4/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2094 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749512:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: --/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749515:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10594 00000100:00100000:1.0:1651529338.749517:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2094:41278:x1731746395643264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.749520:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749522:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 4/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2094 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749525:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 3/0,0 mode: PR/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2094 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749532:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3b57d7 lrc: 0/0,0 mode: --/PR res: [0x2b12b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad72b expref: 2094 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749535:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749536:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749537:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749540:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 4/0,1 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749552:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.749560:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749563:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2093:41278:x1731746395643264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749566:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10594 00010000:00010000:0.0:1651529338.749568:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749571:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10595 00010000:00010000:0.0:1651529338.749572:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,1 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749575:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 2/0,0 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749580:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2092:41278:x1731746395643392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.749589:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749590:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 4/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2092 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749594:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 3/0,0 mode: PR/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2092 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749600:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8d6fa1/0xa29a79078f3b572f lrc: 0/0,0 mode: --/PR res: [0x2b12a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad414 expref: 2092 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749603:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749604:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749604:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749607:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 4/0,1 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749616:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.749622:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2091:41278:x1731746395643392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749625:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10595 00000100:00100000:0.0:1651529338.749628:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1135:39030:x1731745946319552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2186us (2259us total) trans 30064892496 rc 0/0 00000100:00100000:1.0:1651529338.749630:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10596 00000100:00100000:1.0:1651529338.749631:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2090:41278:x1731746395643520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529338.749632:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151582 00010000:00010000:1.0:1651529338.749634:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749635:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 4/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2090 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749639:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 3/0,0 mode: PR/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2090 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749640:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749643:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3b3d12 lrc: 0/0,0 mode: --/PR res: [0x2b12f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b61 expref: 2090 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749643:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749646:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.749646:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,1 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749647:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749648:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749649:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 2/0,0 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749651:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 4/0,1 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749657:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.749661:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2089:41278:x1731746395643520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749664:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10596 00000100:00100000:1.0:1651529338.749667:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10597 00000100:00100000:1.0:1651529338.749669:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2088:41278:x1731746395643200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.749671:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749672:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 4/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749676:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 3/0,0 mode: PR/PR res: [0x2b129:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749680:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3b4ee6 lrc: 0/0,0 mode: --/PR res: [0x2b129:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3bb expref: 2088 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749684:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749684:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.749684:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1135:39030:x1731745946319488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2157us (2304us total) trans 30064892497 rc 0/0 00010000:00010000:1.0:1651529338.749685:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.749687:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151584 00010000:00010000:1.0:1651529338.749688:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 4/0,1 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749693:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.749694:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 2/0,0 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749697:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2087:41278:x1731746395643200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.749697:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8b58569 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.749698:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 2/0,0 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749700:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10597 00010000:00010000:0.0:1651529338.749701:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 3/0,0 mode: PW/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749706:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 1/0,0 mode: --/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749707:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10598 00000100:00100000:1.0:1651529338.749709:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2086:41278:x1731746395643328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.749711:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.749711:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcd17 lrc: 0/0,0 mode: --/PW res: [0x2b12b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749712:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 4/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2086 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749715:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 2/0,0 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749716:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 3/0,0 mode: PR/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2086 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749718:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029a4ee9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.749719:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 2/0,0 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749720:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3b55bc lrc: 0/0,0 mode: --/PR res: [0x2b12d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aceb1 expref: 2086 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.749721:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 3/0,0 mode: PW/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749725:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 1/0,0 mode: --/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749726:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749726:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749736:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749737:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcd25 lrc: 0/0,0 mode: --/PW res: [0x2b12a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749740:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 4/0,1 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749746:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.749753:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2085:41278:x1731746395643328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.749753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.749755:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10598 00000100:00100000:1.0:1651529338.749760:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643648 00010000:00010000:1.0:1651529338.749763:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 5/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2085 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.749768:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10599 00000100:00100000:1.0:1651529338.749770:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2085:41278:x1731746395643456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.749772:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749773:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 4/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2085 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.749776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.749777:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 3/0,0 mode: PR/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2085 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749791:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3b5220 lrc: 0/0,0 mode: --/PR res: [0x2b12c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac033 expref: 2085 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749795:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749795:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749796:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749822:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 4/0,1 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749829:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.749840:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2084:41278:x1731746395643456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 70us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749843:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10599 00000100:00100000:1.0:1651529338.749848:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643584 00010000:00010000:1.0:1651529338.749852:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 4/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2084 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.749864:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10600 00000100:00100000:1.0:1651529338.749866:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2084:41278:x1731746395643648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.749869:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749870:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 5/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2084 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749873:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 4/0,0 mode: PR/PR res: [0x2b130:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2084 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749879:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749887:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749888:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749891:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 4/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749895:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.749908:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2084:41278:x1731746395643648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749910:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10600 00000100:00100000:1.0:1651529338.749915:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10601 00000100:00100000:1.0:1651529338.749917:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2083:41278:x1731746395643584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.749919:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.749921:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 4/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2083 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749925:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 3/0,0 mode: PR/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2083 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749929:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c5505bd/0xa29a79078f3b37c4 lrc: 0/0,0 mode: --/PR res: [0x2b12e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5692 expref: 2083 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.749940:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749941:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.749942:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749954:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 4/0,1 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749962:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.749968:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.749969:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2082:41278:x1731746395643584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.749972:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10601 00010000:00010000:0.0:1651529338.749972:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749978:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,1 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749981:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.749981:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 2/0,0 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749984:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749988:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,1 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.749990:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 2/0,0 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750034:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1136:39030:x1731745946319424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2610us (2673us total) trans 30064892498 rc 0/0 00000100:00100000:1.0:1651529338.750037:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151581 00000100:00100000:0.0:1651529338.750040:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1135:39030:x1731745946319744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2384us (2443us total) trans 30064892499 rc 0/0 00000100:00100000:0.0:1651529338.750043:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151587 00010000:00010000:1.0:1651529338.750044:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750047:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750051:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,1 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750051:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 2/0,0 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750054:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 2/0,0 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750054:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058936903 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.750055:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 2/0,0 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750058:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 3/0,0 mode: PW/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750063:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 1/0,0 mode: --/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750065:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058936903/0xa29a79078f3bcd3a lrc: 0/0,0 mode: --/PW res: [0x2b12e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750070:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 2/0,0 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750073:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a60fe4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.750074:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 2/0,0 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750076:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 3/0,0 mode: PW/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750079:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 1/0,0 mode: --/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750082:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a60fe4e/0xa29a79078f3bcd10 lrc: 0/0,0 mode: --/PW res: [0x2b129:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750085:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 2/0,0 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750087:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1135:39030:x1731745946319680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2607us (2712us total) trans 30064892500 rc 0/0 00010000:00010000:0.0:1651529338.750088:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.750089:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 2/0,0 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750090:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151583 00010000:00010000:0.0:1651529338.750091:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 3/0,0 mode: PW/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750094:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 1/0,0 mode: --/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750098:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750100:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcd1e lrc: 0/0,0 mode: --/PW res: [0x2b12d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750101:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750104:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,1 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750107:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 2/0,0 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750114:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.750145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.750155:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1135:39030:x1731745946319616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2606us (2768us total) trans 30064892501 rc 0/0 00000100:00100000:1.0:1651529338.750158:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151585 00000100:00100000:1.0:1651529338.750163:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946319936 00000100:00100000:0.0:1651529338.750172:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320000 00000100:00100000:0.0:1651529338.750180:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151589 00000100:00100000:0.0:1651529338.750182:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1136:39030:x1731745946319936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.750188:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176433 count 1 00000100:00100000:1.0:1651529338.750191:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151590 00010000:00010000:0.0:1651529338.750192:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: --/PW res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750197:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 2/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2081 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.750198:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1136:39029:x1731745946320000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.750200:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750202:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 4/0,1 mode: --/PW res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.750204:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176434 count 1 00010000:00010000:0.0:1651529338.750208:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 3/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2081 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.750209:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: --/PW res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750212:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 4/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2081 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.750213:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 2/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2081 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.750216:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.750217:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.750218:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 4/0,1 mode: --/PW res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750219:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.750225:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 3/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2081 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.750229:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 4/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2081 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.750233:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966579264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.750242:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.750248:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 2/0,0 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750248:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.750251:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.750252:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 2/0,0 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750267:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 3/0,0 mode: PW/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750272:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 1/0,0 mode: --/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750275:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcd2c lrc: 0/0,0 mode: --/PW res: [0x2b12c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750291:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750294:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750297:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,1 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750300:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 2/0,0 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750320:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 2/0,0 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750324:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f6ebc24 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.750325:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 2/0,0 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750328:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 3/0,0 mode: PW/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750333:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 1/0,0 mode: --/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750336:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f6ebc24/0xa29a79078f3bcd33 lrc: 0/0,0 mode: --/PW res: [0x2b12f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750349:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946319808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2732us (2766us total) trans 30064892502 rc 0/0 00000100:00100000:1.0:1651529338.750352:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151586 00010000:00010000:1.0:1651529338.750363:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ca8472d/0xa29a79078f3b578a lrc: 0/0,0 mode: --/PR res: [0x2b130:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5b8 expref: 2081 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.750377:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966579136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.750381:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750384:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750387:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.750409:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,1 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.750422:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 2/0,0 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.750431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.750445:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320064 00000100:00100000:0.0:1651529338.750452:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320128 00000100:00100000:0.0:1651529338.750456:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320192 00000100:00100000:0.0:1651529338.750459:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320256 00000100:00100000:0.0:1651529338.750463:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151591 00000100:00100000:0.0:1651529338.750465:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1141:39030:x1731745946320064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.750471:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1141:39030:x1731745946319872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2773us (2852us total) trans 30064892503 rc 0/0 00000100:00100000:1.0:1651529338.750474:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151588 00002000:00080000:0.0:1651529338.750476:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176435 count 1 00000100:00100000:1.0:1651529338.750480:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151592 00010000:00010000:0.0:1651529338.750481:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: --/PW res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750482:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1140:39029:x1731745946320128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.750486:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 2/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.750487:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176436 count 1 00010000:00010000:0.0:1651529338.750489:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750489:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750490:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 4/0,1 mode: --/PW res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750491:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: --/PW res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750497:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 3/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750500:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 4/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.750504:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966579328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.750505:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 2/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.750508:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.750509:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.750510:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 4/0,1 mode: --/PW res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.750513:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.750517:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 3/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750519:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 2/0,0 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750520:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 4/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.750522:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000937c0735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.750523:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 2/0,0 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750525:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966579392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.750533:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.750540:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151593 00000100:00100000:1.0:1651529338.750542:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1140:39030:x1731745946320192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.750544:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 3/0,0 mode: PW/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.750546:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176437 count 1 00010000:00010000:0.0:1651529338.750549:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 1/0,0 mode: --/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750550:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: --/PW res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750552:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcd41 lrc: 0/0,0 mode: --/PW res: [0x2b130:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750554:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 2/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2080 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.750557:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.750561:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151594 00000100:00100000:0.0:1651529338.750563:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1140:39029:x1731745946320256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.750564:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.750565:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 4/0,1 mode: --/PW res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.750568:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176438 count 1 00010000:00010000:1.0:1651529338.750572:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 3/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2080 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750572:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: --/PW res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.750575:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 4/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.750576:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 2/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.750579:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966579456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.750579:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750580:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750580:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 4/0,1 mode: --/PW res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750586:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.750587:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 3/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750593:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 4/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.750597:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966579520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.750603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.750605:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.750611:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320320 00000100:00100000:0.0:1651529338.750623:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151595 00000100:00100000:0.0:1651529338.750625:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1141:39029:x1731745946320320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.750629:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176439 count 1 00010000:00010000:0.0:1651529338.750633:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: --/PW res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750637:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 2/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750640:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750641:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750641:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 4/0,1 mode: --/PW res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750660:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 3/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750664:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 4/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.750671:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966579584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.750686:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.750801:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.750835:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320384 00000100:00100000:0.0:1651529338.750844:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151596 00000100:00100000:0.0:1651529338.750845:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1142:39029:x1731745946320384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.750850:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176440 count 1 00010000:00010000:0.0:1651529338.750855:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: --/PW res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750860:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 2/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750863:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750864:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.750864:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 4/0,1 mode: --/PW res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.750888:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 3/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2080 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.750892:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 4/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.750896:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966579648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.750912:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.750966:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.750970:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: --/PW res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.750971:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966579264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.750976:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: --/PW res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.751037:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643712 00000100:00100000:0.0:1651529338.751038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.751048:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 4/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2081 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751056:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643776 00010000:00010000:1.0:1651529338.751058:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 4/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2082 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751064:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10602 00000100:00100000:1.0:1651529338.751066:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2082:41279:x1731746395643712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.751077:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751078:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 4/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2082 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751082:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 3/0,0 mode: PR/PR res: [0x2b131:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2082 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751088:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3b31b2 lrc: 0/0,0 mode: --/PR res: [0x2b131:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ec1 expref: 2082 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751092:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751093:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751094:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751097:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 4/0,1 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751106:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.751109:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751112:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751115:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2081:41279:x1731746395643712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (89us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.751115:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,1 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751118:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10602 00010000:00010000:0.0:1651529338.751118:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 2/0,0 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751123:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10603 00000100:00100000:1.0:1651529338.751131:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2080:41279:x1731746395643776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.751134:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751135:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 4/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751148:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 3/0,0 mode: PR/PR res: [0x2b132:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751155:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3b4650 lrc: 0/0,0 mode: --/PR res: [0x2b132:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a91e8 expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751158:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751159:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751159:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751162:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 4/0,1 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751165:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1143:39030:x1731745946319936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 982us (1051us total) trans 30064892504 rc 0/0 00010000:00010000:1.0:1651529338.751169:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.751169:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151589 00000100:00100000:1.0:1651529338.751175:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2079:41279:x1731746395643776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.751177:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10603 00010000:00010000:1.0:1651529338.751186:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 2/0,0 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751189:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2dec8c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.751190:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 2/0,0 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751193:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 3/0,0 mode: PW/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751214:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 1/0,0 mode: --/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751218:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec8c6/0xa29a79078f3bcd48 lrc: 0/0,0 mode: --/PW res: [0x2b131:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751225:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751227:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751231:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,1 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751233:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 2/0,0 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751251:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 2/0,0 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751265:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d9b8ce9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.751266:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 2/0,0 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751272:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 3/0,0 mode: PW/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751277:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 1/0,0 mode: --/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751278:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1143:39029:x1731745946320000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1079us (1133us total) trans 30064892505 rc 0/0 00010000:00010000:0.0:1651529338.751280:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcd4f lrc: 0/0,0 mode: --/PW res: [0x2b132:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751282:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151590 00000100:00100000:1.0:1651529338.751333:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966579392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.751333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.751342:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: --/PW res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751350:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966579456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.751361:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: --/PW res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751367:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.751368:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643904 00010000:00010000:1.0:1651529338.751380:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 4/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2079 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751392:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643840 00010000:00010000:1.0:1651529338.751395:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 5/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2080 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751401:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10604 00000100:00100000:0.0:1651529338.751402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.751403:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2080:41278:x1731746395643904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.751411:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751412:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 4/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.751412:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.751416:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 3/0,0 mode: PR/PR res: [0x2b134:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751422:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eefc83f/0xa29a79078f3b5f01 lrc: 0/0,0 mode: --/PR res: [0x2b134:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af5e7 expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751426:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751426:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751427:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751439:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 4/0,1 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751446:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.751454:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966579328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.751459:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: --/PW res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751461:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2079:41278:x1731746395643904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.751464:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10604 00000100:00100000:1.0:1651529338.751473:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395643968 00000100:00100000:0.0:1651529338.751474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.751476:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 4/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2079 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751482:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10605 00000100:00100000:1.0:1651529338.751483:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2079:41278:x1731746395643840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.751486:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751487:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 4/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2079 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751491:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 3/0,0 mode: PR/PR res: [0x2b133:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2079 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.751498:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320448 00010000:00010000:1.0:1651529338.751504:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fdeb5e9/0xa29a79078f3b47a7 lrc: 0/0,0 mode: --/PR res: [0x2b133:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96fe expref: 2079 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.751505:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320512 00010000:00010000:1.0:1651529338.751507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751508:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.751513:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151597 00000100:00100000:0.0:1651529338.751515:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1144:39029:x1731745946320448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.751518:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.751520:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176441 count 1 00010000:00010000:1.0:1651529338.751521:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 4/0,1 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751525:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: --/PW res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751531:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.751540:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2078:41278:x1731746395643840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.751543:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10605 00000100:00100000:1.0:1651529338.751548:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10606 00000100:00100000:1.0:1651529338.751550:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2077:41278:x1731746395643968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.751552:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751554:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 4/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2077 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.751555:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 2/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2077 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.751557:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 3/0,0 mode: PR/PR res: [0x2b135:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2077 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.751558:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.751559:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.751559:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 4/0,1 mode: --/PW res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751563:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3b5904 lrc: 0/0,0 mode: --/PR res: [0x2b135:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adb68 expref: 2077 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751567:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751567:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751568:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751571:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 4/0,1 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751578:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 3/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2076 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.751582:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 4/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2076 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751584:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.751586:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.751591:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2076:41278:x1731746395643968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.751593:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10606 00000100:00100000:0.0:1651529338.751595:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.751601:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751602:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151598 00010000:00010000:1.0:1651529338.751604:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751607:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,1 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751610:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 2/0,0 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751622:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1144:39029:x1731745946320512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.751630:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176442 count 1 00010000:00010000:0.0:1651529338.751637:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: --/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751644:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 2/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2075 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.751649:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.751650:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529338.751651:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1145:39030:x1731745946320192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1109us (1229us total) trans 30064892506 rc 0/0 00010000:00010000:0.0:1651529338.751651:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 4/0,1 mode: --/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751655:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151593 00010000:00010000:1.0:1651529338.751663:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751663:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 3/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2075 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.751666:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751667:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 4/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2075 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.751669:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,1 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751672:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966579776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.751680:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 2/0,0 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751682:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.751687:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751690:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751693:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,1 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751696:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 2/0,0 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.751716:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1146:39029:x1731745946320128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1233us (1303us total) trans 30064892507 rc 0/0 00000100:00100000:1.0:1651529338.751719:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151592 00010000:00010000:1.0:1651529338.751726:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 2/0,0 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751738:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f5195f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.751739:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 2/0,0 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751742:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 3/0,0 mode: PW/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751747:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 1/0,0 mode: --/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751748:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1145:39030:x1731745946320064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1282us (1359us total) trans 30064892508 rc 0/0 00010000:00010000:1.0:1651529338.751750:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcd64 lrc: 0/0,0 mode: --/PW res: [0x2b135:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751751:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151591 00010000:00010000:1.0:1651529338.751754:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 2/0,0 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751757:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d889f791 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.751759:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 2/0,0 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751763:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058383ed8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.751764:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 2/0,0 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751764:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 2/0,0 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751767:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 3/0,0 mode: PW/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751768:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 3/0,0 mode: PW/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751771:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 1/0,0 mode: --/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751772:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 1/0,0 mode: --/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751773:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcd5d lrc: 0/0,0 mode: --/PW res: [0x2b134:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.751775:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcd56 lrc: 0/0,0 mode: --/PW res: [0x2b133:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751860:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966579520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.751865:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: --/PW res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751879:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966579584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.751887:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: --/PW res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.751913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.751926:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644032 00010000:00010000:1.0:1651529338.751947:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 4/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.751955:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10607 00000100:00100000:0.0:1651529338.751955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.751957:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2076:41278:x1731746395644032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.751960:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.751967:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 4/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.751968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.751975:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 3/0,0 mode: PR/PR res: [0x2b136:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.751980:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966579648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.751981:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b5cf9b/0xa29a79078f3b46b2 lrc: 0/0,0 mode: --/PR res: [0x2b136:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93a1 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.751985:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: --/PW res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751988:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751988:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.751989:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.751992:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 4/0,1 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752001:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.752004:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752008:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.752011:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2075:41278:x1731746395644032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.752011:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,1 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.752013:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10607 00010000:00010000:0.0:1651529338.752013:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 2/0,0 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.752018:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644160 00010000:00010000:1.0:1651529338.752027:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 4/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2075 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.752033:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644096 00010000:00010000:1.0:1651529338.752035:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 4/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.752039:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10608 00000100:00100000:1.0:1651529338.752041:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2076:41278:x1731746395644160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.752043:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.752044:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 4/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.752050:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 3/0,0 mode: PR/PR res: [0x2b138:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.752055:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3b40a0 lrc: 0/0,0 mode: --/PR res: [0x2b138:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7a17 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.752058:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752059:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752060:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752063:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 4/0,1 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752072:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.752078:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2075:41278:x1731746395644160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.752080:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10608 00000100:00100000:0.0:1651529338.752080:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946320256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1516us (1649us total) trans 30064892509 rc 0/0 00000100:00100000:1.0:1651529338.752084:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10609 00000100:00100000:0.0:1651529338.752084:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151594 00000100:00100000:1.0:1651529338.752086:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2074:41278:x1731746395644096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.752088:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.752089:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 4/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.752091:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752093:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 3/0,0 mode: PR/PR res: [0x2b137:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.752094:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752097:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,1 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752100:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 2/0,0 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752106:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3b42de lrc: 0/0,0 mode: --/PR res: [0x2b137:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8458 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.752110:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752110:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752111:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752114:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 4/0,1 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752122:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.752128:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2073:41278:x1731746395644096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.752131:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10609 00000100:00100000:0.0:1651529338.752144:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946320384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1298us (1343us total) trans 30064892510 rc 0/0 00000100:00100000:0.0:1651529338.752148:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151596 00010000:00010000:0.0:1651529338.752154:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 2/0,0 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752158:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe763644 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.752159:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 2/0,0 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752162:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 3/0,0 mode: PW/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752167:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 1/0,0 mode: --/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752170:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcd6b lrc: 0/0,0 mode: --/PW res: [0x2b136:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752174:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 2/0,0 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752176:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.752177:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 2/0,0 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752183:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 3/0,0 mode: PW/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752186:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 1/0,0 mode: --/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752188:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcd79 lrc: 0/0,0 mode: --/PW res: [0x2b138:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752193:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752196:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752199:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,1 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752202:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 2/0,0 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.752234:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946320320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1609us (1631us total) trans 30064892511 rc 0/0 00000100:00100000:0.0:1651529338.752238:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151595 00010000:00010000:0.0:1651529338.752244:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 2/0,0 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752249:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003482d8c9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.752250:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 2/0,0 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752253:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 3/0,0 mode: PW/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752257:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 1/0,0 mode: --/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752260:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcd72 lrc: 0/0,0 mode: --/PW res: [0x2b137:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1651529338.752265:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064892173 is committed 00000001:00080000:1.0:1651529338.752267:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064892174 is committed 00000100:00100000:0.0:1651529338.752287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.752300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.752312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.752343:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320640 00000100:00100000:0.0:1651529338.752350:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320576 00000100:00100000:0.0:1651529338.752357:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320704 00000100:00100000:0.0:1651529338.752363:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151599 00000100:00100000:0.0:1651529338.752365:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+926:39029:x1731745946320640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.752370:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176444 count 1 00010000:00010000:0.0:1651529338.752375:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: --/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752380:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 2/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2072 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752386:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752387:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752387:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 4/0,1 mode: --/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752410:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 3/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2072 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752414:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 4/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2072 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.752419:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966579840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.752430:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.752436:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151600 00000100:00100000:0.0:1651529338.752438:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+690:39030:x1731745946320576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.752443:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176443 count 1 00010000:00010000:0.0:1651529338.752447:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: --/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752451:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 2/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2072 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752454:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752455:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752456:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 4/0,1 mode: --/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752464:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 3/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2072 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752468:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 4/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2072 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.752472:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966579904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.752478:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.752483:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151601 00000100:00100000:0.0:1651529338.752485:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043e13e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+515:39030:x1731745946320704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.752489:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176445 count 1 00010000:00010000:0.0:1651529338.752492:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: --/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752511:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 2/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752514:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752515:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752516:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 4/0,1 mode: --/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752522:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 3/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752525:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 4/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.752530:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966579968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.752537:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.752572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.752580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.752589:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320768 00000100:00100000:0.0:1651529338.752589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.752598:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320832 00000100:00100000:1.0:1651529338.752601:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320896 00000100:00100000:0.0:1651529338.752608:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151602 00000100:00100000:0.0:1651529338.752609:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+349:39029:x1731745946320768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.752614:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151603 00000100:00100000:1.0:1651529338.752615:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+349:39030:x1731745946320832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.752615:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176446 count 1 00010000:00010000:0.0:1651529338.752619:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: --/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.752621:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176447 count 1 00010000:00010000:0.0:1651529338.752623:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 2/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.752626:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: --/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.752626:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752627:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.752627:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 4/0,1 mode: --/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752631:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 2/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752634:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 3/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.752638:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 4/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.752645:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.752645:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966580032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.752646:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752646:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 4/0,1 mode: --/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752654:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 3/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2072 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.752657:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.752664:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 4/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.752669:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.752679:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.752685:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151604 00000100:00100000:1.0:1651529338.752687:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+349:39029:x1731745946320896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.752692:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176448 count 1 00010000:00010000:1.0:1651529338.752695:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: --/PW res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752700:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 2/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2072 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.752703:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752703:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.752704:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 4/0,1 mode: --/PW res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.752713:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 3/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2072 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.752716:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 4/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2072 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.752720:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.752726:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.753157:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966579712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753162:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: --/PW res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.753169:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966579776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753172:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: --/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.753178:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966579840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753181:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: --/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.753187:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966579904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753189:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: --/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.753589:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966579968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753594:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: --/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.753602:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966580032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.753605:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: --/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753626:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.753633:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644224 00010000:00010000:1.0:1651529338.753638:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 4/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2073 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753644:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644352 00010000:00010000:1.0:1651529338.753647:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 4/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2074 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753651:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644288 00010000:00010000:1.0:1651529338.753653:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 4/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2075 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753657:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644416 00010000:00010000:1.0:1651529338.753659:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 4/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753662:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644544 00010000:00010000:1.0:1651529338.753664:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 4/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2077 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753668:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644672 00010000:00010000:1.0:1651529338.753670:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 5/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2078 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753673:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644480 00010000:00010000:1.0:1651529338.753675:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 4/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2079 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753679:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644608 00010000:00010000:1.0:1651529338.753681:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 5/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.753685:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10610 00000100:00100000:1.0:1651529338.753687:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2080:41279:x1731746395644224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.753690:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.753691:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 4/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753707:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 3/0,0 mode: PR/PR res: [0x2b139:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753713:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a1e1b6/0xa29a79078f3b6082 lrc: 0/0,0 mode: --/PR res: [0x2b139:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afe4c expref: 2080 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753717:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753718:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753718:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753722:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 4/0,1 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753741:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.753750:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2079:41279:x1731746395644224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.753753:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10610 00010000:00010000:0.0:1651529338.753753:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753757:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753758:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10611 00000100:00100000:1.0:1651529338.753760:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2078:41279:x1731746395644352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.753760:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,1 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753763:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.753763:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 2/0,0 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753764:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 4/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2078 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753768:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 3/0,0 mode: PR/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2078 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753781:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da1e402/0xa29a79078f3b4bcf lrc: 0/0,0 mode: --/PR res: [0x2b13c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa6be expref: 2078 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753785:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753786:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753786:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753790:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 4/0,1 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753798:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.753821:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2077:41279:x1731746395644352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.753824:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10611 00000100:00100000:0.0:1651529338.753834:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+350:39029:x1731745946320448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2318us (2432us total) trans 30064892512 rc 0/0 00000100:00100000:0.0:1651529338.753837:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151597 00000100:00100000:1.0:1651529338.753839:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10612 00000100:00100000:1.0:1651529338.753841:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2076:41279:x1731746395644288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.753844:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.753845:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 2/0,0 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753846:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 4/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.753848:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.753849:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 3/0,0 mode: PR/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.753849:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 2/0,0 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753852:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 3/0,0 mode: PW/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753855:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45c6239/0xa29a79078f3b44f9 lrc: 0/0,0 mode: --/PR res: [0x2b13a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8c77 expref: 2076 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753861:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753861:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753862:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753865:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 4/0,1 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753868:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 1/0,0 mode: --/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753871:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcd80 lrc: 0/0,0 mode: --/PW res: [0x2b139:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753874:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.753881:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2075:41279:x1731746395644288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.753883:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10612 00010000:00010000:0.0:1651529338.753883:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753887:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10613 00010000:00010000:0.0:1651529338.753887:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753889:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2074:41279:x1731746395644416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.753890:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,1 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753891:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.753892:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 2/0,0 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753893:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 4/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753896:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 3/0,0 mode: PR/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753901:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3b40ed lrc: 0/0,0 mode: --/PR res: [0x2b13b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b28 expref: 2074 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753904:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753905:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753906:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753909:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 4/0,1 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753916:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.753921:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2073:41279:x1731746395644416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.753924:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10613 00000100:00100000:1.0:1651529338.753927:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10614 00000100:00100000:1.0:1651529338.753929:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2072:41278:x1731746395644544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.753931:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.753932:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 4/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753936:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 3/0,0 mode: PR/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.753936:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+350:39029:x1731745946320640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1570us (1648us total) trans 30064892513 rc 0/0 00000100:00100000:0.0:1651529338.753939:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151599 00010000:00010000:1.0:1651529338.753940:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008933c822/0xa29a79078f3b610e lrc: 0/0,0 mode: --/PR res: [0x2b13e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b010f expref: 2072 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753944:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753944:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753945:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753946:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 2/0,0 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753949:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a79d5d88 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.753950:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 4/0,1 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753950:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 2/0,0 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753957:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.753962:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2071:41278:x1731746395644544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (351us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.753964:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 3/0,0 mode: PW/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753965:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10614 00010000:00010000:0.0:1651529338.753968:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 1/0,0 mode: --/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.753969:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10615 00000100:00100000:1.0:1651529338.753970:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2070:41278:x1731746395644672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.753971:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcd8e lrc: 0/0,0 mode: --/PW res: [0x2b13c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753972:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.753974:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 5/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2070 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.753977:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 4/0,0 mode: PR/PR res: [0x2b140:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2070 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.753978:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753981:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.753981:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753982:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.753982:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753984:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,1 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753985:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 4/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.753986:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 2/0,0 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.753989:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.754000:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2070:41278:x1731746395644672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 22us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.754003:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10615 00000100:00100000:1.0:1651529338.754006:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10616 00000100:00100000:1.0:1651529338.754008:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2069:41278:x1731746395644480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.754010:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.754012:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 4/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2069 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.754015:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 3/0,0 mode: PR/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2069 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.754020:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1498209/0xa29a79078f3b3547 lrc: 0/0,0 mode: --/PR res: [0x2b13d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c7b expref: 2069 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.754023:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.754024:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.754024:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+350:39030:x1731745946320576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1585us (1724us total) trans 30064892514 rc 0/0 00010000:00010000:1.0:1651529338.754025:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754027:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 4/0,1 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.754027:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151600 00010000:00010000:1.0:1651529338.754036:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.754041:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2068:41278:x1731746395644480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (420us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.754042:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.754044:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10616 00000100:00100000:1.0:1651529338.754047:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10617 00000100:00100000:1.0:1651529338.754049:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2067:41278:x1731746395644608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.754051:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.754053:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 5/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2067 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.754055:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754056:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 4/0,0 mode: PR/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2067 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.754058:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,1 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754060:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.754060:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 2/0,0 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754061:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.754061:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754064:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 4/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754068:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.754072:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2067:41278:x1731746395644608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.754075:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10617 00010000:00010000:1.0:1651529338.754082:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 2/0,0 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754085:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3014153 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.754086:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 2/0,0 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754089:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 3/0,0 mode: PW/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754094:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 1/0,0 mode: --/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.754096:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+350:39029:x1731745946320512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2492us (2622us total) trans 30064892515 rc 0/0 00010000:00010000:1.0:1651529338.754097:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcd95 lrc: 0/0,0 mode: --/PW res: [0x2b13b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.754100:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151598 00010000:00010000:1.0:1651529338.754101:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 2/0,0 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754103:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.754104:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 2/0,0 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754106:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754107:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 3/0,0 mode: PW/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754110:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 1/0,0 mode: --/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754110:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754112:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,1 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754113:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcd87 lrc: 0/0,0 mode: --/PW res: [0x2b13a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754115:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 2/0,0 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754122:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3b43c5 lrc: 0/0,0 mode: --/PR res: [0x2b140:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8810 expref: 2066 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.754125:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.754129:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754132:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754135:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754138:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754140:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.754147:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043e13e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+350:39030:x1731745946320704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1661us (1835us total) trans 30064892516 rc 0/0 00000100:00100000:0.0:1651529338.754158:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151601 00010000:00010000:0.0:1651529338.754179:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 2/0,0 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754182:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac50bd95 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.754183:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 2/0,0 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.754184:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+350:39029:x1731745946320896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1495us (1594us total) trans 30064892517 rc 0/0 00010000:00010000:0.0:1651529338.754186:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 3/0,0 mode: PW/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.754187:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151604 00010000:00010000:0.0:1651529338.754191:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 1/0,0 mode: --/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754194:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754194:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bcd9c lrc: 0/0,0 mode: --/PW res: [0x2b13d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754197:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.754198:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754200:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 3/0,0 mode: PW/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754200:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754203:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754206:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,1 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754207:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 1/0,0 mode: --/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754209:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 2/0,0 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754210:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bcdb1 lrc: 0/0,0 mode: --/PW res: [0x2b140:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754215:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 2/0,0 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754217:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b6d6b45 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.754218:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 2/0,0 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754221:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 3/0,0 mode: PW/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754224:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 1/0,0 mode: --/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754227:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bcda3 lrc: 0/0,0 mode: --/PW res: [0x2b13e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754236:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3b5b0a lrc: 0/0,0 mode: --/PR res: [0x2b13f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2fb expref: 2065 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.754239:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.754245:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+350:39029:x1731745946320768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1635us (1673us total) trans 30064892518 rc 0/0 00000100:00100000:0.0:1651529338.754248:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151602 00010000:00010000:1.0:1651529338.754251:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754255:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754257:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754260:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,1 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.754263:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 2/0,0 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.754310:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+350:39030:x1731745946320832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1694us (1730us total) trans 30064892519 rc 0/0 00000100:00100000:1.0:1651529338.754326:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151603 00010000:00010000:0.0:1651529338.754337:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 2/0,0 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754341:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748b0d4c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.754342:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 2/0,0 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754345:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 3/0,0 mode: PW/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754350:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 1/0,0 mode: --/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.754353:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bcdaa lrc: 0/0,0 mode: --/PW res: [0x2b13f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.756149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.756161:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.756168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.756176:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946320960 00000100:00100000:0.0:1651529338.756176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.756182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.756192:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321024 00000100:00100000:1.0:1651529338.756198:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321088 00000100:00100000:1.0:1651529338.756203:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321152 00000100:00100000:0.0:1651529338.756206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.756213:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321216 00000100:00100000:0.0:1651529338.756216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.756218:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321280 00000100:00100000:1.0:1651529338.756220:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321344 00000100:00100000:0.0:1651529338.756222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.756223:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151605 00000100:00100000:1.0:1651529338.756225:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+356:39030:x1731745946320960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.756228:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321408 00002000:00080000:1.0:1651529338.756230:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176449 count 1 00000100:00100000:0.0:1651529338.756235:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151606 00000100:00100000:0.0:1651529338.756237:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+357:39029:x1731745946321024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.756242:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176450 count 1 00010000:00010000:1.0:1651529338.756243:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: --/PW res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756247:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: --/PW res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756248:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 2/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756252:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756252:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756252:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 2/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756253:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 4/0,1 mode: --/PW res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756255:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756256:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756257:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 4/0,1 mode: --/PW res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756260:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 3/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756264:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 4/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.756264:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 3/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.756267:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 4/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.756268:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.756272:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966580288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.756281:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.756281:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.756288:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151607 00000100:00100000:1.0:1651529338.756289:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+357:39030:x1731745946321088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.756293:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151608 00002000:00080000:1.0:1651529338.756294:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176451 count 1 00000100:00100000:0.0:1651529338.756294:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+357:39029:x1731745946321152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.756298:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: --/PW res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.756299:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176452 count 1 00010000:00010000:1.0:1651529338.756302:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 2/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.756303:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: --/PW res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756307:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 2/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2064 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756308:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756309:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756309:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 4/0,1 mode: --/PW res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756310:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756311:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756312:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 4/0,1 mode: --/PW res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756315:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 3/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.756318:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 3/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2064 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756319:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 4/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.756321:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 4/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2064 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.756323:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.756325:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966580416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.756330:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.756332:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.756336:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151609 00000100:00100000:1.0:1651529338.756338:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+357:39030:x1731745946321216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.756338:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151610 00000100:00100000:0.0:1651529338.756340:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+357:39029:x1731745946321280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.756342:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176453 count 1 00002000:00080000:0.0:1651529338.756344:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176454 count 1 00010000:00010000:1.0:1651529338.756345:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: --/PW res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756347:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: --/PW res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756349:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 2/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756352:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756352:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 2/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756353:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756353:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 4/0,1 mode: --/PW res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756357:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756358:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756358:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 4/0,1 mode: --/PW res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756364:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 3/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.756367:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 4/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.756371:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 3/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.756371:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966580480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.756375:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 4/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.756376:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.756379:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966580544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.756382:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151611 00000100:00100000:0.0:1651529338.756384:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+357:39030:x1731745946321344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.756386:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.756388:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176455 count 1 00010000:00010000:0.0:1651529338.756391:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: --/PW res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.756392:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151612 00000100:00100000:1.0:1651529338.756394:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+357:39029:x1731745946321408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.756395:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 2/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.756398:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176456 count 1 00010000:00010000:0.0:1651529338.756398:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756398:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.756399:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 4/0,1 mode: --/PW res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756402:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: --/PW res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.756406:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 2/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.756407:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 3/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756409:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756410:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.756410:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 4/0,1 mode: --/PW res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.756411:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 4/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.756415:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966580608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.756416:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 3/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.756420:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 4/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.756421:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.756424:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966580672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.756430:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.756915:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.756919:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: --/PW res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.756940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.756948:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.756950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.756952:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: --/PW res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.756959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.756969:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644800 00000100:00100000:0.0:1651529338.756970:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966580288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.756974:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 4/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2065 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.756974:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: --/PW res: [0x2b142:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.756982:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644736 00010000:00010000:1.0:1651529338.756984:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 4/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2066 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.756988:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644864 00010000:00010000:1.0:1651529338.756990:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 4/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2067 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.756995:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10618 00000100:00100000:1.0:1651529338.756996:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2067:41278:x1731746395644800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.757000:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757002:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 4/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2067 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757005:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 3/0,0 mode: PR/PR res: [0x2b142:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2067 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757011:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3b4339 lrc: 0/0,0 mode: --/PR res: [0x2b142:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a85e7 expref: 2067 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757014:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757015:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757016:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757019:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 4/0,1 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757030:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.757039:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757040:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2066:41278:x1731746395644800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757043:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10618 00010000:00010000:0.0:1651529338.757043:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757046:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,1 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757049:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 2/0,0 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757052:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10619 00000100:00100000:1.0:1651529338.757054:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2065:41278:x1731746395644736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.757063:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757064:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 4/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2065 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757071:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 3/0,0 mode: PR/PR res: [0x2b141:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2065 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757077:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e84149/0xa29a79078f3b421a lrc: 0/0,0 mode: --/PR res: [0x2b141:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80d8 expref: 2065 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757081:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757081:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757082:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757085:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 4/0,1 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757090:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.757098:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2064:41278:x1731746395644736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.757098:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+358:39029:x1731745946321024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 860us (937us total) trans 30064892520 rc 0/0 00000100:00100000:1.0:1651529338.757101:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10619 00000100:00100000:0.0:1651529338.757102:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151606 00000100:00100000:1.0:1651529338.757105:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10620 00000100:00100000:1.0:1651529338.757106:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2063:41278:x1731746395644864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.757109:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757110:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 4/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2063 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757113:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 3/0,0 mode: PR/PR res: [0x2b143:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2063 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757118:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f0f5dd/0xa29a79078f3b391b lrc: 0/0,0 mode: --/PR res: [0x2b143:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5bcb expref: 2063 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757121:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757122:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757123:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757125:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 4/0,1 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757130:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.757151:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2062:41278:x1731746395644864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757154:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10620 00010000:00010000:1.0:1651529338.757161:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 2/0,0 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757165:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003482d8c9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.757166:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 2/0,0 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757175:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 3/0,0 mode: PW/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757180:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 1/0,0 mode: --/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757185:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003482d8c9/0xa29a79078f3bcdbf lrc: 0/0,0 mode: --/PW res: [0x2b142:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757191:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757194:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757197:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,1 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757200:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 2/0,0 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757217:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 2/0,0 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757221:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0dea987 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757222:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 2/0,0 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757226:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 3/0,0 mode: PW/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757231:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 1/0,0 mode: --/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757234:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0dea987/0xa29a79078f3bcdc6 lrc: 0/0,0 mode: --/PW res: [0x2b143:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757244:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+358:39030:x1731745946321088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 954us (1076us total) trans 30064892521 rc 0/0 00000100:00100000:1.0:1651529338.757247:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151607 00010000:00010000:1.0:1651529338.757255:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757259:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757262:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,1 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757267:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 2/0,0 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757317:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+358:39030:x1731745946320960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1168us total) trans 30064892522 rc 0/0 00000100:00100000:0.0:1651529338.757317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.757320:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151605 00000100:00100000:1.0:1651529338.757333:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321472 00000100:00100000:1.0:1651529338.757349:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151613 00000100:00100000:1.0:1651529338.757351:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+358:39029:x1731745946321472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.757356:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176457 count 1 00010000:00010000:1.0:1651529338.757360:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: --/PW res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757365:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 2/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2061 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.757368:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757375:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757376:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 4/0,1 mode: --/PW res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757394:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 3/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2061 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.757398:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 4/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2061 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.757405:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.757414:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.757420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.757433:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966580544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.757437:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: --/PW res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.757452:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966580672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.757459:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.757460:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: --/PW res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.757477:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321536 00000100:00100000:1.0:1651529338.757488:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151614 00000100:00100000:1.0:1651529338.757489:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+359:39029:x1731745946321536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.757493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529338.757494:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176458 count 1 00010000:00010000:1.0:1651529338.757498:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: --/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.757502:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 2/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2061 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.757505:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757506:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757507:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 4/0,1 mode: --/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757510:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.757515:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 3/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2061 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.757515:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 2/0,0 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757519:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 4/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2061 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757519:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc44840e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757520:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 2/0,0 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757523:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966580800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.757524:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 3/0,0 mode: PW/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757528:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 1/0,0 mode: --/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757531:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3bcdb8 lrc: 0/0,0 mode: --/PW res: [0x2b141:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757535:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.757542:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644992 00010000:00010000:1.0:1651529338.757547:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 5/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2062 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.757547:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966580416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.757551:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: --/PW res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757552:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645120 00010000:00010000:1.0:1651529338.757554:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 4/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2063 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.757558:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321600 00000100:00100000:1.0:1651529338.757559:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395644928 00010000:00010000:1.0:1651529338.757560:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 4/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2064 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.757565:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10621 00000100:00100000:0.0:1651529338.757565:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151615 00000100:00100000:1.0:1651529338.757566:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2064:41279:x1731746395644992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529338.757566:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+360:39029:x1731745946321600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.757569:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757570:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 5/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 13088 lvb_type: 1 00002000:00080000:0.0:1651529338.757571:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176459 count 1 00010000:00010000:0.0:1651529338.757575:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: --/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757582:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 2/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2064 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.757584:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 4/0,0 mode: PR/PR res: [0x2b146:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757585:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.757586:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.757586:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 4/0,1 mode: --/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757590:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757591:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757592:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757593:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 3/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2064 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.757595:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 4/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757597:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 4/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2064 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757599:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.757601:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966580864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.757605:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2064:41279:x1731746395644992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757608:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10621 00000100:00100000:0.0:1651529338.757609:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.757612:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645056 00010000:00010000:1.0:1651529338.757616:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 4/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757617:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3b6185 lrc: 0/0,0 mode: --/PR res: [0x2b146:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b032a expref: 2064 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.757620:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645184 00000100:00100000:0.0:1651529338.757621:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966580480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.757622:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 5/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757624:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757626:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10622 00000100:00100000:1.0:1651529338.757628:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2064:41279:x1731746395645120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.757628:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757630:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757632:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 4/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757633:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757635:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 3/0,0 mode: PR/PR res: [0x2b148:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757636:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,1 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757638:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 2/0,0 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757640:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3b3fdc lrc: 0/0,0 mode: --/PR res: [0x2b148:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a772a expref: 2064 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757644:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757655:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 4/0,1 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757660:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.757666:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2063:41279:x1731746395645120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757669:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10622 00000100:00100000:1.0:1651529338.757673:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10623 00000100:00100000:1.0:1651529338.757675:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2062:41279:x1731746395644928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.757677:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757679:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 4/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2062 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.757683:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946321280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1342us (1486us total) trans 30064892523 rc 0/0 00010000:00010000:1.0:1651529338.757685:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 3/0,0 mode: PR/PR res: [0x2b144:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2062 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.757686:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151610 00010000:00010000:1.0:1651529338.757689:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3b5204 lrc: 0/0,0 mode: --/PR res: [0x2b144:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfc3 expref: 2062 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757693:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757693:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757694:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757697:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 4/0,1 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757697:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966580608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.757700:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: --/PW res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757706:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.757712:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2061:41279:x1731746395644928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757714:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10623 00010000:00010000:0.0:1651529338.757715:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757718:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10624 00010000:00010000:0.0:1651529338.757718:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757720:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2060:41279:x1731746395645056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529338.757721:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,1 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757722:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757723:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 4/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2060 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757724:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 2/0,0 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757735:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 3/0,0 mode: PR/PR res: [0x2b145:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2060 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757747:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3b2efd lrc: 0/0,0 mode: --/PR res: [0x2b145:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3425 expref: 2060 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.757751:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757751:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757752:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757755:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 4/0,1 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757762:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.757768:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2059:41279:x1731746395645056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.757770:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10624 00000100:00100000:0.0:1651529338.757772:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946321152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1476us (1595us total) trans 30064892524 rc 0/0 00000100:00100000:1.0:1651529338.757775:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10625 00000100:00100000:0.0:1651529338.757775:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151608 00000100:00100000:1.0:1651529338.757776:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41279:x1731746395645184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.757779:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.757780:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 4/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757782:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 2/0,0 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757784:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 3/0,0 mode: PR/PR res: [0x2b147:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757786:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029a4ee9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757787:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 2/0,0 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757788:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3b46ce lrc: 0/0,0 mode: --/PR res: [0x2b147:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a93fc expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.757789:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 3/0,0 mode: PW/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757794:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 1/0,0 mode: --/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757797:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029a4ee9f/0xa29a79078f3bcddb lrc: 0/0,0 mode: --/PW res: [0x2b146:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757800:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.757801:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.757801:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 2/0,0 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757802:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757823:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe763644 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757824:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 2/0,0 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757825:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 4/0,1 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757829:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 3/0,0 mode: PW/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757833:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.757838:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 1/0,0 mode: --/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757840:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41279:x1731746395645184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (330us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.757841:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe763644/0xa29a79078f3bcdcd lrc: 0/0,0 mode: --/PW res: [0x2b144:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757843:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10625 00010000:00010000:0.0:1651529338.757847:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757850:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757853:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757853:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,1 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757856:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757856:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 2/0,0 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757860:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,1 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757862:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 2/0,0 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.757900:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+362:39030:x1731745946321344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1515us (1684us total) trans 30064892525 rc 0/0 00000100:00100000:0.0:1651529338.757903:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151611 00000100:00100000:1.0:1651529338.757906:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946321408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1512us (1684us total) trans 30064892526 rc 0/0 00000100:00100000:1.0:1651529338.757909:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151612 00010000:00010000:0.0:1651529338.757910:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 2/0,0 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8b58569 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757917:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 2/0,0 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757920:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 3/0,0 mode: PW/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757924:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 1/0,0 mode: --/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757925:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757927:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b58569/0xa29a79078f3bcde2 lrc: 0/0,0 mode: --/PW res: [0x2b147:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757929:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757931:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 2/0,0 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757932:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,1 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.757934:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 2/0,0 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757934:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe7aa555 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757935:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 2/0,0 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757937:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 3/0,0 mode: PW/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757941:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 1/0,0 mode: --/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757955:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bcde9 lrc: 0/0,0 mode: --/PW res: [0x2b148:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757959:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 2/0,0 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757962:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc763531 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.757963:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 2/0,0 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.757965:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 3/0,0 mode: PW/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757967:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+361:39030:x1731745946321216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1628us (1784us total) trans 30064892527 rc 0/0 00010000:00010000:0.0:1651529338.757969:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 1/0,0 mode: --/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.757970:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151609 00010000:00010000:0.0:1651529338.757971:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcdd4 lrc: 0/0,0 mode: --/PW res: [0x2b145:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.758247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.758256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.758267:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321664 00000100:00100000:0.0:1651529338.758267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.758275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.758289:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321728 00000100:00100000:0.0:1651529338.758289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.758296:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321792 00000100:00100000:1.0:1651529338.758299:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321856 00000100:00100000:0.0:1651529338.758302:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321920 00000100:00100000:1.0:1651529338.758303:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151616 00000100:00100000:1.0:1651529338.758305:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+365:39029:x1731745946321664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.758309:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151617 00002000:00080000:1.0:1651529338.758310:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176460 count 1 00000100:00100000:0.0:1651529338.758311:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946321728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.758322:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: --/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529338.758324:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176461 count 1 00010000:00010000:1.0:1651529338.758327:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 2/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2056 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.758329:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: --/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758334:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 2/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.758337:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758337:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758337:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.758338:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.758338:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 4/0,1 mode: --/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758338:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 4/0,1 mode: --/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758345:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 3/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.758346:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 3/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2056 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.758349:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 4/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.758350:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 4/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2056 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.758353:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966580928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.758354:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.758367:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.758373:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.758374:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151618 00000100:00100000:0.0:1651529338.758376:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+365:39029:x1731745946321792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.758379:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151619 00000100:00100000:1.0:1651529338.758381:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946321856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.758381:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176462 count 1 00010000:00010000:0.0:1651529338.758385:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: --/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.758386:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176463 count 1 00010000:00010000:0.0:1651529338.758389:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 2/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.758390:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: --/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.758394:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 2/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2056 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.758397:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.758398:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.758398:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 4/0,1 mode: --/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758399:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758400:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758401:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 4/0,1 mode: --/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758408:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 3/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.758412:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 4/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.758415:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966581056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.758416:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 3/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2056 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.758419:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 4/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2056 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.758423:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.758423:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.758429:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151620 00000100:00100000:1.0:1651529338.758431:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.758431:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+365:39029:x1731745946321920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.758435:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176464 count 1 00010000:00010000:0.0:1651529338.758439:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: --/PW res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758443:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 2/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.758446:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758446:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.758447:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 4/0,1 mode: --/PW res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.758462:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 3/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.758466:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 4/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.758470:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966581184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.758480:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.758935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.758942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.758951:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966580800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.758955:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: --/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.758963:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966580736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.758965:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: --/PW res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.758972:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645312 00010000:00010000:1.0:1651529338.758976:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 4/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2057 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.758983:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645248 00010000:00010000:1.0:1651529338.758986:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 4/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2058 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759004:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10626 00000100:00100000:1.0:1651529338.759006:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41278:x1731746395645312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.759009:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759010:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 4/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759014:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 3/0,0 mode: PR/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759020:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3b3af7 lrc: 0/0,0 mode: --/PR res: [0x2b14a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a62e7 expref: 2058 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759024:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759024:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759025:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759028:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 4/0,1 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759034:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759049:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41278:x1731746395645312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759052:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10626 00000100:00100000:1.0:1651529338.759056:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10627 00000100:00100000:1.0:1651529338.759065:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41278:x1731746395645248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.759068:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759069:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 4/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2056 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759082:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 3/0,0 mode: PR/PR res: [0x2b149:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2056 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759087:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae0231b/0xa29a79078f3b5a15 lrc: 0/0,0 mode: --/PR res: [0x2b149:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adf3c expref: 2056 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759091:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759092:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759092:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759095:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 4/0,1 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759102:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759109:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41278:x1731746395645248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759112:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10627 00010000:00010000:1.0:1651529338.759118:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759121:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759135:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,1 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759138:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 2/0,0 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759156:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 2/0,0 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759161:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.759162:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 2/0,0 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759165:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 3/0,0 mode: PW/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759170:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 1/0,0 mode: --/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759173:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bcdf7 lrc: 0/0,0 mode: --/PW res: [0x2b14a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759188:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+366:39029:x1731745946321536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1698us (1769us total) trans 30064892528 rc 0/0 00000100:00100000:1.0:1651529338.759192:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151614 00010000:00010000:1.0:1651529338.759200:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759204:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759213:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,1 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759216:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 2/0,0 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759269:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+366:39029:x1731745946321472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1917us (1952us total) trans 30064892529 rc 0/0 00000100:00100000:1.0:1651529338.759272:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151613 00010000:00010000:1.0:1651529338.759280:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 2/0,0 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759299:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.759300:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 2/0,0 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759303:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 3/0,0 mode: PW/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759308:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 1/0,0 mode: --/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759311:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bcdf0 lrc: 0/0,0 mode: --/PW res: [0x2b149:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.759402:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946321984 00000100:00100000:1.0:1651529338.759410:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151621 00000100:00100000:1.0:1651529338.759411:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+366:39029:x1731745946321984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.759422:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176465 count 1 00010000:00010000:1.0:1651529338.759427:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: --/PW res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759431:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 2/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2054 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.759434:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759435:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759450:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 4/0,1 mode: --/PW res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.759470:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 3/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2054 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.759474:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 4/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2054 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.759476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.759478:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966581248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.759485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.759493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.759501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.759502:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.759514:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.759518:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: --/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.759531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.759533:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966580992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.759536:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: --/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759540:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966580864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.759543:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322048 00010000:00010000:0.0:1651529338.759544:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: --/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759554:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151622 00000100:00100000:1.0:1651529338.759556:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+367:39029:x1731745946322048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.759558:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966580928:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529338.759561:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176466 count 1 00010000:00010000:0.0:1651529338.759561:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: --/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759565:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: --/PW res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759568:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966581056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.759569:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 2/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2054 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.759571:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: --/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759572:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759573:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759573:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 4/0,1 mode: --/PW res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759578:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966581184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.759580:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 3/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2054 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.759581:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: --/PW res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759583:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 4/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2054 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759587:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966581312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.759600:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.759606:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645440 00010000:00010000:1.0:1651529338.759611:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 4/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2055 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759616:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645568 00010000:00010000:1.0:1651529338.759618:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 4/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759632:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645696 00010000:00010000:1.0:1651529338.759634:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 4/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2057 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759638:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645376 00010000:00010000:1.0:1651529338.759640:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 4/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2058 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759644:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645504 00010000:00010000:1.0:1651529338.759646:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 4/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2059 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759650:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645632 00010000:00010000:1.0:1651529338.759652:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 4/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2060 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.759656:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10628 00000100:00100000:1.0:1651529338.759658:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2060:41278:x1731746395645440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.759660:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759661:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 4/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2060 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759665:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 3/0,0 mode: PR/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2060 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759670:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081039fcf/0xa29a79078f3b2d91 lrc: 0/0,0 mode: --/PR res: [0x2b14d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2ed7 expref: 2060 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759674:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759675:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759676:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759681:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 4/0,1 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759690:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.759693:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759696:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759700:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2059:41278:x1731746395645440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759703:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10628 00000100:00100000:1.0:1651529338.759707:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10629 00010000:00010000:0.0:1651529338.759707:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,1 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759709:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41278:x1731746395645568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.759709:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 2/0,0 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759712:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759713:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 4/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2058 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759717:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 3/0,0 mode: PR/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2058 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759721:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3b541f lrc: 0/0,0 mode: --/PR res: [0x2b14e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac8e5 expref: 2058 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759725:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759725:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759726:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759737:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 4/0,1 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759746:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759752:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41278:x1731746395645568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759754:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10629 00000100:00100000:1.0:1651529338.759759:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10630 00000100:00100000:1.0:1651529338.759760:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41278:x1731746395645696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.759763:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759764:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 4/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759767:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 3/0,0 mode: PR/PR res: [0x2b150:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759772:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3b5044 lrc: 0/0,0 mode: --/PR res: [0x2b150:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8bc expref: 2056 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.759772:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+368:39030:x1731745946321728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1460us (1515us total) trans 30064892530 rc 0/0 00000100:00100000:0.0:1651529338.759775:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151617 00010000:00010000:1.0:1651529338.759776:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759776:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759777:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759780:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 4/0,1 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759783:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 2/0,0 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759787:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759793:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41278:x1731746395645696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (300us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.759793:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.759794:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 2/0,0 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759797:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 3/0,0 mode: PW/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759812:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 1/0,0 mode: --/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759815:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10630 00010000:00010000:0.0:1651529338.759816:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bce0c lrc: 0/0,0 mode: --/PW res: [0x2b14d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.759820:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10631 00000100:00100000:1.0:1651529338.759822:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41278:x1731746395645376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.759822:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759825:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.759826:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759827:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 4/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2054 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.759828:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,1 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759831:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 3/0,0 mode: PR/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2054 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.759831:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 2/0,0 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759836:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098f378ad/0xa29a79078f3b5f39 lrc: 0/0,0 mode: --/PR res: [0x2b14b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af761 expref: 2054 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759839:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759840:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759841:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759843:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 4/0,1 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759852:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759858:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41278:x1731746395645376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759861:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10631 00000100:00100000:1.0:1651529338.759865:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10632 00000100:00100000:1.0:1651529338.759873:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41278:x1731746395645504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529338.759873:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+368:39029:x1731745946321792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1496us (1606us total) trans 30064892531 rc 0/0 00010000:00010000:1.0:1651529338.759876:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.759876:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151618 00010000:00010000:1.0:1651529338.759877:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 4/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759881:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 3/0,0 mode: PR/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.759883:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759886:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3b5cbc lrc: 0/0,0 mode: --/PR res: [0x2b14c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea25 expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.759886:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759889:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.759889:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,1 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759890:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759891:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759892:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 2/0,0 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759894:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 4/0,1 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759900:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.759906:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746395645504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759908:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10632 00000100:00100000:1.0:1651529338.759916:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10633 00000100:00100000:1.0:1651529338.759924:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41278:x1731746395645632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.759927:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.759928:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 4/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2050 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759939:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 3/0,0 mode: PR/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2050 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759945:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3b57fa lrc: 0/0,0 mode: --/PR res: [0x2b14f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad79b expref: 2050 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.759949:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759950:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.759950:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759953:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 4/0,1 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.759955:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+368:39029:x1731745946321920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1523us (1671us total) trans 30064892532 rc 0/0 00010000:00010000:1.0:1651529338.759959:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.759960:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151620 00000100:00100000:1.0:1651529338.759966:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746395645632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.759969:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10633 00010000:00010000:1.0:1651529338.759975:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 2/0,0 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759979:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.759980:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 2/0,0 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759980:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 2/0,0 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759983:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 3/0,0 mode: PW/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759984:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748b0d4c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.759985:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 2/0,0 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759988:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 3/0,0 mode: PW/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759992:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 1/0,0 mode: --/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759994:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 1/0,0 mode: --/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.759995:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bce21 lrc: 0/0,0 mode: --/PW res: [0x2b150:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.759997:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bce13 lrc: 0/0,0 mode: --/PW res: [0x2b14e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760001:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760003:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760004:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760006:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760007:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,1 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760009:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,1 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760009:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 2/0,0 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760012:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 2/0,0 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.760051:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+369:39029:x1731745946321600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2484us (2550us total) trans 30064892533 rc 0/0 00000100:00100000:0.0:1651529338.760054:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151615 00000100:00100000:1.0:1651529338.760056:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+369:39030:x1731745946321856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1674us (1780us total) trans 30064892534 rc 0/0 00000100:00100000:1.0:1651529338.760059:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151619 00010000:00010000:0.0:1651529338.760062:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 2/0,0 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760065:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.760066:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760066:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 2/0,0 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760069:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 3/0,0 mode: PW/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760070:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760073:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 1/0,0 mode: --/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760076:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcdfe lrc: 0/0,0 mode: --/PW res: [0x2b14b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760080:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 2/0,0 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760082:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,1 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760083:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.760084:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 2/0,0 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760085:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 2/0,0 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760089:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 3/0,0 mode: PW/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760092:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 1/0,0 mode: --/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760095:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bce1a lrc: 0/0,0 mode: --/PW res: [0x2b14f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760098:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 2/0,0 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760101:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.760102:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 2/0,0 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760104:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 3/0,0 mode: PW/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760107:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 1/0,0 mode: --/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760110:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3bce05 lrc: 0/0,0 mode: --/PW res: [0x2b14c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.760122:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+368:39029:x1731745946321664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1816us (1875us total) trans 30064892535 rc 0/0 00000100:00100000:1.0:1651529338.760125:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151616 00000100:00100000:1.0:1651529338.760144:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966581248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.760148:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: --/PW res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.760171:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966581312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.760175:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: --/PW res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.760371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.760385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.760396:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645760 00010000:00010000:1.0:1651529338.760402:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 4/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2049 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.760414:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645824 00010000:00010000:1.0:1651529338.760417:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 4/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2050 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.760435:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10634 00000100:00100000:1.0:1651529338.760436:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746395645760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.760440:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.760441:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 4/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2050 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760445:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 3/0,0 mode: PR/PR res: [0x2b151:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2050 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760451:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3b4ae1 lrc: 0/0,0 mode: --/PR res: [0x2b151:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa3d1 expref: 2050 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760455:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760455:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760456:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760459:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 4/0,1 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760465:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.760478:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746395645760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.760480:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10634 00000100:00100000:1.0:1651529338.760485:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10635 00000100:00100000:1.0:1651529338.760493:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746395645824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529338.760495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.760511:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.760512:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 4/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2048 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760516:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 3/0,0 mode: PR/PR res: [0x2b152:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2048 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.760520:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.760530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.760532:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3b358d lrc: 0/0,0 mode: --/PR res: [0x2b152:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4d70 expref: 2048 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760536:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760536:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.760536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.760537:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760540:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 4/0,1 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.760542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.760546:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.760548:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.760558:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746395645824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.760560:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10635 00000100:00100000:0.0:1651529338.760560:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322112 00000100:00100000:0.0:1651529338.760567:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322176 00000100:00100000:1.0:1651529338.760568:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322240 00000100:00100000:0.0:1651529338.760571:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322304 00000100:00100000:1.0:1651529338.760574:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322432 00000100:00100000:0.0:1651529338.760574:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322368 00000100:00100000:0.0:1651529338.760577:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151623 00000100:00100000:0.0:1651529338.760578:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+373:39030:x1731745946322112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.760580:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151624 00000100:00100000:1.0:1651529338.760581:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+373:39029:x1731745946322176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.760584:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176467 count 1 00010000:00010000:0.0:1651529338.760588:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: --/PW res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760593:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 2/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2046 pid: 142996 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.760594:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176468 count 1 00010000:00010000:0.0:1651529338.760596:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760597:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760598:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 4/0,1 mode: --/PW res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760599:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: --/PW res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760604:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 2/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.760605:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 3/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2046 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.760607:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760607:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760608:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 4/0,1 mode: --/PW res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760608:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 4/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2046 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.760613:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966581376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.760615:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 3/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.760619:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 4/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.760622:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.760623:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.760629:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151625 00000100:00100000:0.0:1651529338.760630:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+373:39030:x1731745946322240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.760632:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.760634:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176469 count 1 00000100:00100000:1.0:1651529338.760638:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151626 00010000:00010000:0.0:1651529338.760638:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: --/PW res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.760640:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+373:39029:x1731745946322304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.760642:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 2/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.760644:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176470 count 1 00010000:00010000:0.0:1651529338.760645:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760646:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760646:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 4/0,1 mode: --/PW res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760648:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: --/PW res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760652:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 2/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2046 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.760652:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 3/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.760656:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 4/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.760660:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966581504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.760663:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760664:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.760665:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 4/0,1 mode: --/PW res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.760666:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.760672:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 3/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2046 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.760672:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151627 00000100:00100000:0.0:1651529338.760674:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+373:39030:x1731745946322368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.760676:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 4/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2046 pid: 128009 timeout: 13088 lvb_type: 1 00002000:00080000:0.0:1651529338.760678:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176471 count 1 00000100:00100000:1.0:1651529338.760680:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966581568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.760681:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: --/PW res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760685:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 2/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.760687:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.760688:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760688:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760689:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 4/0,1 mode: --/PW res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760692:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760695:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 3/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.760696:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760699:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,1 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760699:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 4/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.760701:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 2/0,0 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.760703:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966581632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.760717:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.760723:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151628 00000100:00100000:0.0:1651529338.760725:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+374:39029:x1731745946322432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.760738:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176472 count 1 00010000:00010000:0.0:1651529338.760742:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: --/PW res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760749:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 2/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2046 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.760752:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760753:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.760754:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 4/0,1 mode: --/PW res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.760755:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+374:39029:x1731745946322048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1198us (1291us total) trans 30064892536 rc 0/0 00010000:00010000:0.0:1651529338.760759:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 3/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2046 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.760763:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 4/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2046 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.760765:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151622 00000100:00100000:0.0:1651529338.760767:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966581696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.760774:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.760776:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760779:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760781:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 2/0,0 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.760782:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,1 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760784:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3014153 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.760785:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 2/0,0 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760785:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 2/0,0 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760788:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 3/0,0 mode: PW/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760802:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 1/0,0 mode: --/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760814:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bce2f lrc: 0/0,0 mode: --/PW res: [0x2b152:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760822:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 2/0,0 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760825:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a79d5d88 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.760826:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 2/0,0 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760829:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 3/0,0 mode: PW/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760832:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 1/0,0 mode: --/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.760835:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bce28 lrc: 0/0,0 mode: --/PW res: [0x2b151:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.760841:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+374:39029:x1731745946321984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1429us (1454us total) trans 30064892537 rc 0/0 00000100:00100000:1.0:1651529338.760845:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151621 00000100:00100000:0.0:1651529338.761027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.761043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.761051:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322560 00000100:00100000:0.0:1651529338.761051:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322496 00000100:00100000:0.0:1651529338.761058:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151629 00000100:00100000:1.0:1651529338.761060:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151630 00000100:00100000:0.0:1651529338.761060:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b0309f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+375:39030:x1731745946322496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.761062:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+375:39029:x1731745946322560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.761065:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176473 count 1 00002000:00080000:1.0:1651529338.761067:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176474 count 1 00010000:00010000:0.0:1651529338.761070:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: --/PW res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761072:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: --/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761074:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 2/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2046 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.761077:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 2/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.761078:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.761078:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.761079:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 4/0,1 mode: --/PW res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761085:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 3/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2046 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.761089:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 4/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2046 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761090:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761091:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761091:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 4/0,1 mode: --/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761093:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966581760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.761099:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 3/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.761103:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 4/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.761107:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.761113:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966581824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.761123:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.761460:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.761469:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: --/PW res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761477:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966581568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.761480:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: --/PW res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.761518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.761523:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645888 00010000:00010000:1.0:1651529338.761528:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 5/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2047 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.761545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.761562:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646016 00000100:00100000:0.0:1651529338.761564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.761566:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 5/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2048 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.761570:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646144 00000100:00100000:0.0:1651529338.761570:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.761572:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 5/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2049 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.761575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.761576:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395645952 00010000:00010000:1.0:1651529338.761578:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 4/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2050 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.761582:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646080 00010000:00010000:1.0:1651529338.761584:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 4/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2051 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.761584:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966581376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.761587:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646208 00010000:00010000:1.0:1651529338.761589:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 5/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761589:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: --/PW res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761594:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10636 00000100:00100000:1.0:1651529338.761595:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41279:x1731746395645888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529338.761597:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966581504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.761598:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.761599:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 4/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761600:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: --/PW res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761606:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 3/0,0 mode: PR/PR res: [0x2b153:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.761606:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966581632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.761608:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: --/PW res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761612:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000009a66f7/0xa29a79078f3b60ba lrc: 0/0,0 mode: --/PR res: [0x2b153:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff6b expref: 2052 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761615:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.761615:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966581696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.761616:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761617:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761617:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: --/PW res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761620:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 4/0,1 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761629:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.761632:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761635:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761639:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,1 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761640:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746395645888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.761641:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 2/0,0 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761642:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10636 00000100:00100000:1.0:1651529338.761647:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10637 00000100:00100000:1.0:1651529338.761648:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746395646016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.761657:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.761658:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 4/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2050 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761662:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 3/0,0 mode: PR/PR res: [0x2b155:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2050 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761667:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f0813ab/0xa29a79078f3b3b44 lrc: 0/0,0 mode: --/PR res: [0x2b155:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a641b expref: 2050 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761671:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761672:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761672:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761675:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 4/0,1 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761684:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.761690:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746395646016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.761692:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10637 00000100:00100000:1.0:1651529338.761696:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10638 00000100:00100000:0.0:1651529338.761697:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+376:39030:x1731745946322112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1117us (1201us total) trans 30064892538 rc 0/0 00000100:00100000:1.0:1651529338.761698:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746395646144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.761700:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.761700:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151623 00010000:00010000:1.0:1651529338.761702:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 4/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2048 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761705:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 3/0,0 mode: PR/PR res: [0x2b157:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2048 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761707:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761710:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1df5fb/0xa29a79078f3b2e7f lrc: 0/0,0 mode: --/PR res: [0x2b157:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a326c expref: 2048 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761711:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761714:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,1 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761715:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761716:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761717:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761717:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 2/0,0 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761719:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 4/0,1 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761734:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.761740:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746395646144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.761743:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10638 00000100:00100000:1.0:1651529338.761747:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10639 00000100:00100000:1.0:1651529338.761748:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746395645952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.761750:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.761752:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 4/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761755:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 3/0,0 mode: PR/PR res: [0x2b154:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761760:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3b39df lrc: 0/0,0 mode: --/PR res: [0x2b154:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e87 expref: 2046 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761763:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761764:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761765:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761766:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+376:39030:x1731745946322240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1134us (1236us total) trans 30064892539 rc 0/0 00010000:00010000:1.0:1651529338.761768:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 4/0,1 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761769:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151625 00010000:00010000:1.0:1651529338.761774:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.761776:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 2/0,0 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761779:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746395645952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.761780:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b6d6b45 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529338.761781:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10639 00010000:00010000:0.0:1651529338.761781:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 2/0,0 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761789:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10640 00000100:00100000:1.0:1651529338.761791:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746395646080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.761793:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.761795:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 4/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2044 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761798:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 3/0,0 mode: PR/PR res: [0x2b156:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2044 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761826:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 3/0,0 mode: PW/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761828:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3b5036 lrc: 0/0,0 mode: --/PR res: [0x2b156:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab8a0 expref: 2044 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761831:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 1/0,0 mode: --/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761832:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761833:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761834:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761834:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6d6b45/0xa29a79078f3bce36 lrc: 0/0,0 mode: --/PW res: [0x2b153:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761839:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 4/0,1 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761839:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 2/0,0 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761842:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac50bd95 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.761842:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 2/0,0 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761845:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 3/0,0 mode: PW/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761846:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.761848:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 1/0,0 mode: --/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761851:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac50bd95/0xa29a79078f3bce44 lrc: 0/0,0 mode: --/PW res: [0x2b155:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761852:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746395646080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.761855:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10640 00010000:00010000:0.0:1651529338.761857:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761859:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10641 00010000:00010000:0.0:1651529338.761860:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.761861:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746395646208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.761863:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.761865:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 4/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2042 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761869:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 3/0,0 mode: PR/PR res: [0x2b158:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2042 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.761871:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,1 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761874:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 2/0,0 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761877:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3b35b7 lrc: 0/0,0 mode: --/PR res: [0x2b158:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4e50 expref: 2042 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.761880:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761881:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.761882:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761884:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 4/0,1 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761894:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.761900:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41279:x1731746395646208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.761903:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10641 00010000:00010000:1.0:1651529338.761910:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 2/0,0 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761914:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058383ed8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.761915:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 2/0,0 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761918:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 3/0,0 mode: PW/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761918:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+376:39030:x1731745946322368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1376us total) trans 30064892540 rc 0/0 00000100:00100000:0.0:1651529338.761921:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151627 00010000:00010000:1.0:1651529338.761922:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 1/0,0 mode: --/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761924:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bce52 lrc: 0/0,0 mode: --/PW res: [0x2b157:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761929:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761930:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761933:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761933:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761936:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,1 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.761938:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 2/0,0 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761939:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,1 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761942:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 2/0,0 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.761979:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+377:39029:x1731745946322432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1254us (1431us total) trans 30064892541 rc 0/0 00000100:00100000:0.0:1651529338.761982:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151628 00000100:00100000:1.0:1651529338.761985:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+376:39029:x1731745946322304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1344us (1449us total) trans 30064892542 rc 0/0 00000100:00100000:1.0:1651529338.761988:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151626 00010000:00010000:0.0:1651529338.761989:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 2/0,0 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.761997:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762000:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762003:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,1 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762003:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d889f791 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.762004:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 2/0,0 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762006:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 2/0,0 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762007:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 3/0,0 mode: PW/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762012:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 1/0,0 mode: --/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762014:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bce59 lrc: 0/0,0 mode: --/PW res: [0x2b158:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762019:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 2/0,0 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762022:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051f4e87e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.762023:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 2/0,0 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762025:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 3/0,0 mode: PW/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762028:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 1/0,0 mode: --/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.762038:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+376:39029:x1731745946322176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1456us (1518us total) trans 30064892543 rc 0/0 00010000:00010000:0.0:1651529338.762038:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bce4b lrc: 0/0,0 mode: --/PW res: [0x2b156:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.762041:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151624 00010000:00010000:0.0:1651529338.762042:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 2/0,0 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762044:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e1996d9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.762045:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 2/0,0 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762048:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 3/0,0 mode: PW/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762051:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 1/0,0 mode: --/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762054:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bce3d lrc: 0/0,0 mode: --/PW res: [0x2b154:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762109:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966581760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.762113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.762114:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: --/PW res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.762130:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.762167:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646336 00010000:00010000:1.0:1651529338.762180:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 5/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2041 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762189:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646272 00010000:00010000:1.0:1651529338.762191:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 4/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2042 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762197:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10642 00000100:00100000:1.0:1651529338.762199:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41278:x1731746395646336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.762202:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.762203:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 5/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2042 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.762207:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 4/0,0 mode: PR/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2042 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.762213:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762213:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762214:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762217:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 4/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762222:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.762230:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41278:x1731746395646336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.762244:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10642 00000100:00100000:1.0:1651529338.762249:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10643 00000100:00100000:1.0:1651529338.762250:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41278:x1731746395646272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.762253:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.762255:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 4/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2041 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.762259:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 3/0,0 mode: PR/PR res: [0x2b159:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2041 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.762264:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3b4944 lrc: 0/0,0 mode: --/PR res: [0x2b159:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9df0 expref: 2041 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.762268:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762269:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762270:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762272:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 4/0,1 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762276:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.762286:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.762293:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41278:x1731746395646272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.762296:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10643 00000100:00100000:0.0:1651529338.762309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.762311:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322688 00000100:00100000:1.0:1651529338.762335:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322624 00000100:00100000:1.0:1651529338.762343:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151631 00000100:00100000:1.0:1651529338.762345:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+377:39029:x1731745946322688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.762350:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176476 count 1 00010000:00010000:0.0:1651529338.762351:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762354:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: --/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762359:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 2/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762362:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762362:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762363:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762363:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 4/0,1 mode: --/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762366:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,1 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762368:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 2/0,0 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762370:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 3/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762374:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 4/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762384:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.762394:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.762398:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 2/0,0 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762402:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f5195f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.762403:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 2/0,0 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762414:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 3/0,0 mode: PW/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762419:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 1/0,0 mode: --/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762421:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bce60 lrc: 0/0,0 mode: --/PW res: [0x2b159:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762423:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b0309f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+378:39030:x1731745946322496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1362us (1380us total) trans 30064892544 rc 0/0 00000100:00100000:0.0:1651529338.762426:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151629 00000100:00100000:1.0:1651529338.762430:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151632 00000100:00100000:1.0:1651529338.762432:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+377:39030:x1731745946322624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.762437:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176475 count 1 00010000:00010000:1.0:1651529338.762440:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: --/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762445:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 2/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2039 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762448:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762448:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762449:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 4/0,1 mode: --/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762455:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 3/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2039 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.762468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.762476:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 4/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762480:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966581952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.762496:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.762505:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3b3fd5 lrc: 0/0,0 mode: --/PR res: [0x2b15a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a76eb expref: 2039 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762509:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966581824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.762519:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762523:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762525:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762528:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,1 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762531:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 2/0,0 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.762551:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322752 00000100:00100000:0.0:1651529338.762557:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322816 00000100:00100000:0.0:1651529338.762564:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322944 00000100:00100000:0.0:1651529338.762568:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946322880 00000100:00100000:0.0:1651529338.762574:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151633 00000100:00100000:0.0:1651529338.762576:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+382:39029:x1731745946322752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.762581:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176477 count 1 00010000:00010000:0.0:1651529338.762586:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: --/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762591:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 2/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.762595:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+382:39029:x1731745946322560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1532us (1568us total) trans 30064892545 rc 0/0 00000100:00100000:1.0:1651529338.762598:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151630 00010000:00010000:0.0:1651529338.762608:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762609:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762609:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 4/0,1 mode: --/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762617:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 3/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.762618:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151634 00000100:00100000:1.0:1651529338.762619:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+381:39029:x1731745946322816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.762621:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 4/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00002000:00080000:1.0:1651529338.762624:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176478 count 1 00010000:00010000:1.0:1651529338.762629:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: --/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762633:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 2/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762636:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762637:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762638:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 4/0,1 mode: --/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762640:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966582016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.762644:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 3/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762648:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 4/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.762650:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.762652:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966582080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762657:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151635 00000100:00100000:0.0:1651529338.762659:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+381:39029:x1731745946322944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.762660:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.762664:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176480 count 1 00000100:00100000:1.0:1651529338.762667:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151636 00010000:00010000:0.0:1651529338.762667:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: --/PW res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.762668:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+381:39030:x1731745946322880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.762672:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 2/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529338.762673:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176479 count 1 00010000:00010000:0.0:1651529338.762675:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762676:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: --/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762676:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762676:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 4/0,1 mode: --/PW res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762681:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 2/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762684:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762684:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.762685:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 4/0,1 mode: --/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.762691:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 3/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.762694:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 4/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2038 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.762695:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 3/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.762698:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966582144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.762699:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 4/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2038 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.762703:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.762703:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966582208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762710:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.762716:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 2/0,0 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.762720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529338.762720:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695a17e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.762721:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 2/0,0 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762724:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 3/0,0 mode: PW/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762742:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 1/0,0 mode: --/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762745:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bce67 lrc: 0/0,0 mode: --/PW res: [0x2b15a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.762753:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323008 00000100:00100000:0.0:1651529338.762764:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151637 00000100:00100000:0.0:1651529338.762772:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+382:39029:x1731745946323008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.762777:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176481 count 1 00010000:00010000:0.0:1651529338.762782:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: --/PW res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762786:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 2/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.762789:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762789:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762790:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 4/0,1 mode: --/PW res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762797:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 3/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2038 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.762800:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 4/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.762823:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966582272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762841:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.762894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.762901:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323072 00000100:00100000:0.0:1651529338.762908:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151638 00000100:00100000:0.0:1651529338.762909:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+383:39029:x1731745946323072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.762914:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176482 count 1 00010000:00010000:0.0:1651529338.762919:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: --/PW res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762932:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 2/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.762936:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762936:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.762937:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 4/0,1 mode: --/PW res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.762944:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 3/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2038 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.762947:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 4/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2038 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.762951:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966582336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.762982:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.763425:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966581888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.763429:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: --/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763462:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966581952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.763465:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: --/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763481:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966582144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.763484:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: --/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.763487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.763497:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966582080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.763499:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: --/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.763499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.763508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.763516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.763518:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646464 00000100:00100000:0.0:1651529338.763524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.763527:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 5/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.763533:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646592 00010000:00010000:1.0:1651529338.763535:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 4/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2040 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.763539:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646400 00010000:00010000:1.0:1651529338.763541:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 4/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2041 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763544:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966582016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.763545:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646528 00010000:00010000:1.0:1651529338.763548:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 4/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2042 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.763549:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: --/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763552:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646656 00010000:00010000:1.0:1651529338.763554:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 4/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2043 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763556:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966582208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.763558:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10644 00010000:00010000:0.0:1651529338.763559:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: --/PW res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763560:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41278:x1731746395646464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.763562:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763564:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 4/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2043 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763565:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966582272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.763567:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 3/0,0 mode: PR/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2043 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.763567:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: --/PW res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763573:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea734b5/0xa29a79078f3b308c lrc: 0/0,0 mode: --/PR res: [0x2b15d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a7d expref: 2043 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763574:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966582336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.763576:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: --/PW res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763577:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763577:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763578:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763581:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 4/0,1 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763594:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.763603:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763604:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41278:x1731746395646464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.763606:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763607:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10644 00010000:00010000:0.0:1651529338.763610:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,1 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763612:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10645 00010000:00010000:0.0:1651529338.763612:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 2/0,0 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763621:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41278:x1731746395646592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.763624:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763626:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 4/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2041 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763630:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 3/0,0 mode: PR/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2041 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763635:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e805b45/0xa29a79078f3b3eb6 lrc: 0/0,0 mode: --/PR res: [0x2b15f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71ab expref: 2041 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763639:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763639:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763640:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763643:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 4/0,1 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763649:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.763655:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41278:x1731746395646592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.763657:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10645 00000100:00100000:1.0:1651529338.763661:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10646 00000100:00100000:1.0:1651529338.763663:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41278:x1731746395646400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.763665:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763667:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 4/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763677:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 3/0,0 mode: PR/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763679:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+384:39029:x1731745946322752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1101us (1210us total) trans 30064892546 rc 0/0 00000100:00100000:0.0:1651529338.763682:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151633 00010000:00010000:0.0:1651529338.763690:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 2/0,0 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763691:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3b4d42 lrc: 0/0,0 mode: --/PR res: [0x2b15c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac0c expref: 2039 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.763694:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d9b8ce9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.763695:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763695:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.763695:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 2/0,0 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763696:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.763698:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 3/0,0 mode: PW/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763699:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 4/0,1 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.763703:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 1/0,0 mode: --/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763705:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.763706:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bce7c lrc: 0/0,0 mode: --/PW res: [0x2b15d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.763711:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41278:x1731746395646400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.763714:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10646 00000100:00100000:0.0:1651529338.763720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.763722:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646720 00010000:00010000:1.0:1651529338.763725:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 4/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2038 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.763742:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10647 00000100:00100000:1.0:1651529338.763743:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41278:x1731746395646528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529338.763743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.763746:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763747:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 4/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763757:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 3/0,0 mode: PR/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.763771:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3b51fd lrc: 0/0,0 mode: --/PR res: [0x2b15b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abfa7 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763775:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763775:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763776:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763779:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 4/0,1 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763791:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.763823:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41278:x1731746395646528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.763826:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10647 00000100:00100000:1.0:1651529338.763831:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646848 00010000:00010000:1.0:1651529338.763835:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 4/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2037 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.763839:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646784 00010000:00010000:1.0:1651529338.763841:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 4/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.763846:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10648 00000100:00100000:1.0:1651529338.763860:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41278:x1731746395646656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.763863:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763864:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 4/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763868:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 3/0,0 mode: PR/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763873:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3b53f5 lrc: 0/0,0 mode: --/PR res: [0x2b15e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac7f0 expref: 2038 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763877:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763878:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763878:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763881:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 4/0,1 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763888:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.763900:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41278:x1731746395646656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.763903:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10648 00000100:00100000:1.0:1651529338.763908:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10649 00000100:00100000:1.0:1651529338.763909:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41278:x1731746395646720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.763912:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763914:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 4/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2036 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.763915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.763918:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 3/0,0 mode: PR/PR res: [0x2b160:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2036 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763922:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087a939f0/0xa29a79078f3b3793 lrc: 0/0,0 mode: --/PR res: [0x2b160:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a55e3 expref: 2036 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763926:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763926:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763927:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763930:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 4/0,1 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763943:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.763945:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323136 00000100:00100000:1.0:1651529338.763953:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41278:x1731746395646720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.763956:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10649 00000100:00100000:1.0:1651529338.763960:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10650 00000100:00100000:0.0:1651529338.763960:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151639 00000100:00100000:1.0:1651529338.763961:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41278:x1731746395646848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529338.763962:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+384:39029:x1731745946323136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.763964:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.763965:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 4/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00002000:00080000:0.0:1651529338.763967:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176483 count 1 00010000:00010000:1.0:1651529338.763969:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 3/0,0 mode: PR/PR res: [0x2b162:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.763972:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: --/PW res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763974:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d8e4e1/0xa29a79078f3b3769 lrc: 0/0,0 mode: --/PR res: [0x2b162:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5573 expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.763977:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.763977:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 2/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2034 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.763978:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763979:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.763980:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.763981:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 4/0,1 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.763981:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.763981:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 4/0,1 mode: --/PW res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.763989:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.763994:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41278:x1731746395646848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (251us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.763995:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 3/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2033 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.763997:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10650 00010000:00010000:0.0:1651529338.763998:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 4/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2032 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.764000:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10651 00000100:00100000:1.0:1651529338.764002:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41278:x1731746395646784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529338.764003:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966582400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.764004:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.764005:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 4/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.764009:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 3/0,0 mode: PR/PR res: [0x2b161:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.764012:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.764014:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3b3317 lrc: 0/0,0 mode: --/PR res: [0x2b161:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44f6 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.764017:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764020:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764020:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764020:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764021:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764023:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 4/0,1 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764023:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,1 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764025:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 2/0,0 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764031:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.764043:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41278:x1731746395646784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.764046:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10651 00010000:00010000:1.0:1651529338.764052:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 2/0,0 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764056:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000937c0735 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.764057:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 2/0,0 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764060:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 3/0,0 mode: PW/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764064:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 1/0,0 mode: --/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764066:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bce8a lrc: 0/0,0 mode: --/PW res: [0x2b160:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764075:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764075:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+385:39029:x1731745946322944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1415us (1560us total) trans 30064892547 rc 0/0 00010000:00010000:1.0:1651529338.764078:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764078:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151635 00010000:00010000:1.0:1651529338.764081:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,1 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764084:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 2/0,0 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764086:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764096:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764100:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,1 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764103:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 2/0,0 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764128:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+386:39030:x1731745946322880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1459us (1592us total) trans 30064892548 rc 0/0 00000100:00100000:1.0:1651529338.764131:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151636 00010000:00010000:1.0:1651529338.764139:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764140:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+385:39029:x1731745946323072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1230us (1246us total) trans 30064892549 rc 0/0 00010000:00010000:1.0:1651529338.764142:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764143:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151638 00010000:00010000:1.0:1651529338.764145:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,1 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764147:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 2/0,0 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764150:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764153:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764157:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,1 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764159:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 2/0,0 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764195:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+386:39029:x1731745946322688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1849us (1918us total) trans 30064892550 rc 0/0 00000100:00100000:0.0:1651529338.764195:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+386:39029:x1731745946323008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1422us (1475us total) trans 30064892551 rc 0/0 00000100:00100000:1.0:1651529338.764198:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151631 00000100:00100000:0.0:1651529338.764199:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151637 00010000:00010000:1.0:1651529338.764205:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764206:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 2/0,0 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764208:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764209:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc8f6294 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.764211:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,1 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764211:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 2/0,0 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764213:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 3/0,0 mode: PW/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764214:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 2/0,0 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764218:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 1/0,0 mode: --/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764221:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc8f6294/0xa29a79078f3bce91 lrc: 0/0,0 mode: --/PW res: [0x2b15f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764225:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 2/0,0 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764228:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe7aa555 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.764229:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 2/0,0 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764234:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 3/0,0 mode: PW/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764237:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 1/0,0 mode: --/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764240:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3bce9f lrc: 0/0,0 mode: --/PW res: [0x2b162:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764243:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 2/0,0 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764244:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+385:39030:x1731745946322624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1811us (1935us total) trans 30064892552 rc 0/0 00010000:00010000:0.0:1651529338.764245:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009361fb3d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.764246:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 2/0,0 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764247:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151632 00010000:00010000:0.0:1651529338.764249:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 3/0,0 mode: PW/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764252:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 1/0,0 mode: --/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764253:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 2/0,0 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764255:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009361fb3d/0xa29a79078f3bce6e lrc: 0/0,0 mode: --/PW res: [0x2b15c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764256:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc763531 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.764257:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 2/0,0 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764258:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 2/0,0 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764260:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 3/0,0 mode: PW/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764261:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3767209 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.764262:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 2/0,0 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764265:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 3/0,0 mode: PW/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764268:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 1/0,0 mode: --/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764270:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bce75 lrc: 0/0,0 mode: --/PW res: [0x2b15b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764273:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 1/0,0 mode: --/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764276:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bce98 lrc: 0/0,0 mode: --/PW res: [0x2b161:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764283:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764286:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764289:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,1 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764292:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 2/0,0 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764338:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 2/0,0 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764342:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001b528e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.764343:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 2/0,0 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764345:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 3/0,0 mode: PW/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764350:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 1/0,0 mode: --/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764354:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+385:39029:x1731745946322816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1733us (1859us total) trans 30064892553 rc 0/0 00000100:00100000:1.0:1651529338.764357:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151634 00010000:00010000:0.0:1651529338.764360:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bce83 lrc: 0/0,0 mode: --/PW res: [0x2b15e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.764611:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323200 00000100:00100000:0.0:1651529338.764615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.764624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.764631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.764633:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323328 00000100:00100000:0.0:1651529338.764636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.764638:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151640 00000100:00100000:1.0:1651529338.764640:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+386:39029:x1731745946323200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.764642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529338.764645:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176484 count 1 00000100:00100000:0.0:1651529338.764649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.764658:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323264 00010000:00010000:1.0:1651529338.764660:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: --/PW res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764667:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323456 00010000:00010000:1.0:1651529338.764670:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 2/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2030 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.764670:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323584 00000100:00100000:0.0:1651529338.764672:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323392 00010000:00010000:1.0:1651529338.764673:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764674:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.764674:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323520 00010000:00010000:1.0:1651529338.764675:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 4/0,1 mode: --/PW res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764677:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151641 00000100:00100000:0.0:1651529338.764678:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+391:39029:x1731745946323328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.764682:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 3/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2030 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.764684:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176486 count 1 00010000:00010000:1.0:1651529338.764686:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 4/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2030 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.764688:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: --/PW res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764690:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966582464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.764693:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 2/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.764696:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764697:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764697:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 4/0,1 mode: --/PW res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764701:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.764705:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 3/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.764708:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151642 00010000:00010000:0.0:1651529338.764709:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 4/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.764710:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946323264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.764713:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966582528:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529338.764715:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176485 count 1 00010000:00010000:1.0:1651529338.764719:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: --/PW res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764722:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.764723:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 2/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529338.764738:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151643 00000100:00100000:0.0:1651529338.764740:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+391:39029:x1731745946323456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.764745:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764745:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529338.764745:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176488 count 1 00010000:00010000:1.0:1651529338.764746:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 4/0,1 mode: --/PW res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764749:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,1 mode: --/PW res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764753:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 2/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2030 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.764754:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 3/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.764756:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764757:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764758:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 4/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.764758:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 4/0,1 mode: --/PW res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764762:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966582592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.764764:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 3/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2030 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.764768:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 4/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2030 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.764770:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.764772:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966582656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.764777:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151644 00000100:00100000:1.0:1651529338.764778:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+391:39029:x1731745946323584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.764779:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00002000:00080000:1.0:1651529338.764783:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176490 count 1 00010000:00010000:1.0:1651529338.764786:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: --/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.764786:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151645 00000100:00100000:0.0:1651529338.764787:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946323392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.764791:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 2/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.764791:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176487 count 1 00010000:00010000:1.0:1651529338.764794:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764794:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764795:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 4/0,1 mode: --/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.764828:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: --/PW res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764831:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 3/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.764834:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 2/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.764835:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 4/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.764837:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764837:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.764838:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 4/0,1 mode: --/PW res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.764839:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966582720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.764845:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 3/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.764848:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.764849:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 4/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.764853:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966582784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.764854:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151646 00000100:00100000:1.0:1651529338.764856:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946323520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.764860:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176489 count 1 00000100:00100000:0.0:1651529338.764861:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.764864:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: --/PW res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764869:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 2/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.764872:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764872:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.764873:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 4/0,1 mode: --/PW res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.764879:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 3/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2030 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.764882:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 4/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.764894:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966582848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.764902:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.765785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.765795:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966582592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.765795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.765820:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: --/PW res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.765820:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.765832:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646912 00000100:00100000:0.0:1651529338.765832:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.765843:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 4/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2031 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.765843:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966582400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.765848:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: --/PW res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.765849:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647040 00010000:00010000:1.0:1651529338.765851:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 5/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.765855:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395646976 00000100:00100000:0.0:1651529338.765856:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966582528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.765857:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 5/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2033 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.765858:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: --/PW res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.765861:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647104 00010000:00010000:1.0:1651529338.765864:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 4/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2034 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.765868:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10652 00000100:00100000:1.0:1651529338.765870:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41279:x1731746395646912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.765872:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.765881:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 4/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765885:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 3/0,0 mode: PR/PR res: [0x2b163:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765891:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002baeeb72/0xa29a79078f3b3e38 lrc: 0/0,0 mode: --/PR res: [0x2b163:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f9e expref: 2034 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765895:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.765895:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.765896:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765899:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 4/0,1 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765911:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.765920:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.765921:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41279:x1731746395646912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.765924:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10652 00010000:00010000:0.0:1651529338.765924:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.765927:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,1 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.765929:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10653 00010000:00010000:0.0:1651529338.765930:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 2/0,0 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.765931:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746395647040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.765934:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.765935:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 4/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765949:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 3/0,0 mode: PR/PR res: [0x2b166:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765954:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3b5529 lrc: 0/0,0 mode: --/PR res: [0x2b166:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2accb9 expref: 2032 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.765958:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.765958:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.765959:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765962:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 4/0,1 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765970:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.765976:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746395647040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.765979:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10653 00000100:00100000:0.0:1651529338.765979:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+392:39029:x1731745946323136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2016us (2064us total) trans 30064892554 rc 0/0 00000100:00100000:0.0:1651529338.765982:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151639 00000100:00100000:1.0:1651529338.765988:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10654 00000100:00100000:1.0:1651529338.765989:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746395646976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529338.765990:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 2/0,0 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765992:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.765993:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 5/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2030 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.765993:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a79d5d88 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.765994:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 2/0,0 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.765997:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 4/0,0 mode: PR/PR res: [0x2b164:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2030 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.765997:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 3/0,0 mode: PW/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766002:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766002:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 1/0,0 mode: --/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766003:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766004:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766005:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcea6 lrc: 0/0,0 mode: --/PW res: [0x2b163:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766007:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 4/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766011:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.766011:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766014:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766015:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746395646976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.766017:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10654 00010000:00010000:0.0:1651529338.766017:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,1 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766020:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 2/0,0 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766021:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10655 00000100:00100000:1.0:1651529338.766022:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746395647104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.766024:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.766026:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 4/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766037:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 3/0,0 mode: PR/PR res: [0x2b165:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766042:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3b4eed lrc: 0/0,0 mode: --/PR res: [0x2b165:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab3d0 expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766045:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766046:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766047:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766050:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 4/0,1 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766055:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.766059:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+392:39029:x1731745946323328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1380us (1444us total) trans 30064892555 rc 0/0 00000100:00100000:1.0:1651529338.766060:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746395647104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.766063:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10655 00010000:00010000:1.0:1651529338.766069:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 2/0,0 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766071:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151641 00010000:00010000:1.0:1651529338.766072:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3014153 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.766073:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 2/0,0 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766076:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 3/0,0 mode: PW/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766080:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 1/0,0 mode: --/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766083:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bceb4 lrc: 0/0,0 mode: --/PW res: [0x2b166:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766089:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766094:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766097:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,1 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766099:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 2/0,0 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766169:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+392:39030:x1731745946323264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1458us (1545us total) trans 30064892556 rc 0/0 00000100:00100000:1.0:1651529338.766173:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151642 00000100:00100000:1.0:1651529338.766183:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966582720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.766197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.766205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.766206:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: --/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.766215:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966582848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.766216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.766218:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: --/PW res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766221:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 2/0,0 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766224:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647168 00010000:00010000:1.0:1651529338.766228:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 5/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2028 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.766234:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647296 00010000:00010000:1.0:1651529338.766236:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 5/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.766237:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004d62225 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.766238:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 2/0,0 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766240:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647232 00010000:00010000:0.0:1651529338.766241:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 3/0,0 mode: PW/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766242:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 4/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2030 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.766246:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647360 00010000:00010000:0.0:1651529338.766246:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 1/0,0 mode: --/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766248:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 4/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2031 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.766249:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d62225/0xa29a79078f3bcebb lrc: 0/0,0 mode: --/PW res: [0x2b165:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766253:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10656 00000100:00100000:1.0:1651529338.766254:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746395647168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.766257:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.766258:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 5/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2031 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766262:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 4/0,0 mode: PR/PR res: [0x2b168:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2031 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766267:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766268:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766269:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766272:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 4/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766273:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3b2ee1 lrc: 0/0,0 mode: --/PR res: [0x2b168:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3399 expref: 2031 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.766277:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966582656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.766287:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 4/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766288:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.766295:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746395647168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (99us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.766297:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766298:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10656 00010000:00010000:0.0:1651529338.766300:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766302:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10657 00010000:00010000:0.0:1651529338.766303:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,1 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766304:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746395647296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.766306:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.766306:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 2/0,0 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766308:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 5/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766311:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 4/0,0 mode: PR/PR res: [0x2b167:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2029 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766316:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766317:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766317:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766320:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 4/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766324:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.766328:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746395647296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.766330:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10657 00000100:00100000:1.0:1651529338.766334:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10658 00000100:00100000:1.0:1651529338.766342:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746395647232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.766344:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.766345:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 4/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2028 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766349:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 3/0,0 mode: PR/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2028 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766354:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000555774f1/0xa29a79078f3b3230 lrc: 0/0,0 mode: --/PR res: [0x2b16a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4176 expref: 2028 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766357:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766358:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766359:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766359:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+392:39029:x1731745946323456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1617us (1727us total) trans 30064892557 rc 0/0 00010000:00010000:1.0:1651529338.766362:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 4/0,1 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766362:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151643 00010000:00010000:1.0:1651529338.766368:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.766374:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746395647232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.766374:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e91e6ad/0xa29a79078f3b5083 lrc: 0/0,0 mode: --/PR res: [0x2b167:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9aa expref: 2027 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.766377:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10658 00000100:00100000:0.0:1651529338.766378:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966582784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.766381:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10659 00010000:00010000:0.0:1651529338.766381:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766382:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746395647360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529338.766385:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529338.766385:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766386:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 4/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2025 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766396:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 3/0,0 mode: PR/PR res: [0x2b169:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2025 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.766398:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766401:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3b4ab7 lrc: 0/0,0 mode: --/PR res: [0x2b169:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa33e expref: 2025 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.766401:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,1 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766404:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766404:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 2/0,0 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766405:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766406:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766408:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 4/0,1 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766420:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.766426:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746395647360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.766429:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10659 00010000:00010000:1.0:1651529338.766435:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 2/0,0 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766438:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001afdf7f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.766439:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 2/0,0 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766442:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 3/0,0 mode: PW/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766444:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+392:39030:x1731745946323392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1656us (1801us total) trans 30064892558 rc 0/0 00000100:00100000:0.0:1651529338.766447:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151645 00010000:00010000:1.0:1651529338.766454:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 1/0,0 mode: --/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766454:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 2/0,0 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766457:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcec2 lrc: 0/0,0 mode: --/PW res: [0x2b168:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766458:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748b0d4c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.766459:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 2/0,0 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766462:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 3/0,0 mode: PW/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766463:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766466:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766466:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 1/0,0 mode: --/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766469:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,1 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766469:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748b0d4c/0xa29a79078f3bced0 lrc: 0/0,0 mode: --/PW res: [0x2b167:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766472:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 2/0,0 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766487:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 2/0,0 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766490:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f18b3401 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.766491:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 2/0,0 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766494:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 3/0,0 mode: PW/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766497:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 1/0,0 mode: --/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766500:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18b3401/0xa29a79078f3bcec9 lrc: 0/0,0 mode: --/PW res: [0x2b16a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766515:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+392:39029:x1731745946323584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1735us (1878us total) trans 30064892559 rc 0/0 00000100:00100000:1.0:1651529338.766518:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151644 00000100:00100000:0.0:1651529338.766527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.766542:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.766546:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766554:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.766558:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,1 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766561:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 2/0,0 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766588:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323712 00000100:00100000:0.0:1651529338.766598:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323648 00000100:00100000:0.0:1651529338.766602:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323776 00000100:00100000:0.0:1651529338.766606:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151647 00000100:00100000:0.0:1651529338.766607:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+395:39029:x1731745946323712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.766613:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176492 count 1 00010000:00010000:0.0:1651529338.766617:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: --/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.766623:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+395:39030:x1731745946323520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1766us (1973us total) trans 30064892560 rc 0/0 00000100:00100000:1.0:1651529338.766626:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151646 00000100:00100000:1.0:1651529338.766632:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151648 00000100:00100000:1.0:1651529338.766633:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+394:39029:x1731745946323648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.766638:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176491 count 1 00010000:00010000:1.0:1651529338.766642:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: --/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766644:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 2/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2023 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766647:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 2/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.766647:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766648:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766649:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 4/0,1 mode: --/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766650:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766651:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766651:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 4/0,1 mode: --/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766657:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 3/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2023 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766658:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 3/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.766661:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 4/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2023 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.766665:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966582912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.766672:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 4/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.766674:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.766676:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966582976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.766681:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151649 00000100:00100000:0.0:1651529338.766683:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+394:39029:x1731745946323776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.766685:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00002000:00080000:0.0:1651529338.766688:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176493 count 1 00010000:00010000:1.0:1651529338.766691:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 2/0,0 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766692:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: --/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766694:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9826e6a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.766695:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 2/0,0 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766696:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 2/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766698:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 3/0,0 mode: PW/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766699:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766700:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766701:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 4/0,1 mode: --/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766702:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 1/0,0 mode: --/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766705:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bced7 lrc: 0/0,0 mode: --/PW res: [0x2b169:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766707:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 3/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.766711:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 4/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.766715:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966583040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.766717:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005087dbb4/0xa29a79078f3b3b52 lrc: 0/0,0 mode: --/PR res: [0x2b164:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a644c expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.766721:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966582464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.766721:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.766740:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766744:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766746:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766749:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,1 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766752:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 2/0,0 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.766794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.766823:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+395:39029:x1731745946323200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2182us (2237us total) trans 30064892561 rc 0/0 00000100:00100000:0.0:1651529338.766824:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.766826:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151640 00000100:00100000:1.0:1651529338.766837:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323840 00000100:00100000:1.0:1651529338.766843:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323904 00000100:00100000:1.0:1651529338.766846:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946323968 00000100:00100000:1.0:1651529338.766855:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151650 00000100:00100000:1.0:1651529338.766857:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+397:39029:x1731745946323840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.766860:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 2/0,0 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766864:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a3674e4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.766865:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 2/0,0 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529338.766868:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176494 count 1 00010000:00010000:0.0:1651529338.766868:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 3/0,0 mode: PW/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766872:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 1/0,0 mode: --/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766873:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: --/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766878:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 2/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.766878:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3674e4e/0xa29a79078f3bcead lrc: 0/0,0 mode: --/PW res: [0x2b164:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766886:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151651 00010000:00010000:1.0:1651529338.766888:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766889:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766890:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 4/0,1 mode: --/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766897:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766901:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.766901:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946323904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529338.766905:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966583104:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529338.766907:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176495 count 1 00010000:00010000:0.0:1651529338.766911:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: --/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766916:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 2/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.766919:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.766926:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151652 00000100:00100000:1.0:1651529338.766928:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+397:39029:x1731745946323968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.766932:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176496 count 1 00010000:00010000:0.0:1651529338.766936:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766937:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.766938:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 4/0,1 mode: --/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.766943:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: --/PW res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.766946:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 3/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766948:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 2/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.766950:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 4/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2022 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.766951:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766951:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.766952:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 4/0,1 mode: --/PW res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.766954:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.766962:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.766966:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 3/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.766969:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 4/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2022 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.766973:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966583232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.766981:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.767002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.767013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.767041:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324032 00000100:00100000:1.0:1651529338.767048:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324096 00000100:00100000:1.0:1651529338.767056:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151653 00000100:00100000:1.0:1651529338.767058:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+399:39029:x1731745946324032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.767063:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176497 count 1 00000100:00100000:0.0:1651529338.767065:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151654 00010000:00010000:1.0:1651529338.767068:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: --/PW res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.767068:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+399:39029:x1731745946324096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529338.767072:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 2/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2022 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529338.767073:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176498 count 1 00010000:00010000:1.0:1651529338.767075:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.767076:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.767076:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 4/0,1 mode: --/PW res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.767078:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: --/PW res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.767082:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 3/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2022 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.767082:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 2/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.767085:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.767086:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.767087:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 4/0,1 mode: --/PW res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.767094:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 3/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2022 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.767096:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 4/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2022 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.767097:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 4/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2022 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.767101:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966583296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.767102:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966583360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.767112:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.767112:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.767146:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966582912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.767150:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: --/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.767189:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966582976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.767194:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: --/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.767203:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966583040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.767208:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: --/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.767232:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.767235:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: --/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.767237:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966583232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.767241:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: --/PW res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.767248:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966583104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.767250:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: --/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.767990:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966583296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.767992:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966583360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.767994:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: --/PW res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.767996:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: --/PW res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768129:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647424 00010000:00010000:1.0:1651529338.768134:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 4/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2023 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768142:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647488 00010000:00010000:1.0:1651529338.768144:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 4/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2024 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768150:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10660 00000100:00100000:1.0:1651529338.768152:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746395647424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.768155:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768156:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 4/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2024 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768160:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 3/0,0 mode: PR/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2024 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768165:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3b5f7f lrc: 0/0,0 mode: --/PR res: [0x2b16c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af93d expref: 2024 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768169:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768170:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768171:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768174:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 4/0,1 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768178:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529338.768193:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768203:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41279:x1731746395647424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768206:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10660 00010000:00010000:0.0:1651529338.768216:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768220:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768223:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647552 00010000:00010000:1.0:1651529338.768227:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 4/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768233:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10661 00010000:00010000:0.0:1651529338.768233:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,1 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768234:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41279:x1731746395647488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.768236:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 2/0,0 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768237:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768238:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 4/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768242:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 3/0,0 mode: PR/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768247:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3b3d35 lrc: 0/0,0 mode: --/PR res: [0x2b16b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bd8 expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768250:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768251:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768252:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768255:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 4/0,1 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768261:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768267:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41279:x1731746395647488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768270:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10661 00000100:00100000:1.0:1651529338.768273:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10662 00000100:00100000:1.0:1651529338.768275:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41279:x1731746395647552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.768277:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768278:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 4/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2021 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768282:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 3/0,0 mode: PR/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2021 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768286:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3b4156 lrc: 0/0,0 mode: --/PR res: [0x2b16d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7d2e expref: 2021 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768289:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768290:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768291:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768294:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 4/0,1 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768296:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+400:39029:x1731745946323712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1687us (1769us total) trans 30064892562 rc 0/0 00000100:00100000:0.0:1651529338.768299:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151647 00010000:00010000:1.0:1651529338.768303:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768309:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41279:x1731746395647552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768312:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10662 00010000:00010000:0.0:1651529338.768312:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 2/0,0 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768316:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695a17e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.768317:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 2/0,0 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768318:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768320:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 3/0,0 mode: PW/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768321:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768325:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,1 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768325:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 1/0,0 mode: --/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768327:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 2/0,0 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768328:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000695a17e9/0xa29a79078f3bcede lrc: 0/0,0 mode: --/PW res: [0x2b16c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768332:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 2/0,0 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768335:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051f4e87e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.768336:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 2/0,0 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768341:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 3/0,0 mode: PW/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768344:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 1/0,0 mode: --/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768347:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcee5 lrc: 0/0,0 mode: --/PW res: [0x2b16b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768352:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768355:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768358:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,1 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768360:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 2/0,0 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768367:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+400:39029:x1731745946323648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1733us (1824us total) trans 30064892563 rc 0/0 00000100:00100000:1.0:1651529338.768370:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151648 00010000:00010000:1.0:1651529338.768377:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 2/0,0 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768381:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e1996d9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.768382:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 2/0,0 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768384:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 3/0,0 mode: PW/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768389:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 1/0,0 mode: --/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768392:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bceec lrc: 0/0,0 mode: --/PW res: [0x2b16d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768397:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+400:39029:x1731745946323776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1713us (1842us total) trans 30064892564 rc 0/0 00000100:00100000:0.0:1651529338.768400:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151649 00000100:00100000:1.0:1651529338.768465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768480:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.768504:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647680 00010000:00010000:1.0:1651529338.768509:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 4/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2020 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768515:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647616 00010000:00010000:1.0:1651529338.768517:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2021 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768521:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647744 00010000:00010000:1.0:1651529338.768523:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 4/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2022 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768527:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647808 00010000:00010000:1.0:1651529338.768529:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 4/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2023 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768533:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647872 00010000:00010000:1.0:1651529338.768535:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 4/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2024 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768542:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10663 00000100:00100000:1.0:1651529338.768543:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746395647680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.768546:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768547:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 4/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2024 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768550:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 3/0,0 mode: PR/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2024 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768556:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3b4e3e lrc: 0/0,0 mode: --/PR res: [0x2b16f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab106 expref: 2024 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768560:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768560:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768561:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768564:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 4/0,1 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768575:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529338.768578:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768586:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41279:x1731746395647680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768588:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10663 00010000:00010000:0.0:1651529338.768590:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768593:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10664 00010000:00010000:0.0:1651529338.768593:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,1 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768595:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41279:x1731746395647616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.768596:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 2/0,0 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768597:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768599:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768602:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768607:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3b5af5 lrc: 0/0,0 mode: --/PR res: [0x2b16e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae2a7 expref: 2022 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768610:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768611:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768612:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768614:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 4/0,1 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768626:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768631:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41279:x1731746395647616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768634:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10664 00000100:00100000:1.0:1651529338.768638:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10665 00000100:00100000:1.0:1651529338.768639:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41279:x1731746395647744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.768642:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768643:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 4/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2020 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768647:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 3/0,0 mode: PR/PR res: [0x2b170:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2020 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768651:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3b4e5a lrc: 0/0,0 mode: --/PR res: [0x2b170:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab15a expref: 2020 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768654:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768655:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768656:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768658:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 4/0,1 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768659:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+400:39030:x1731745946323904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1757us (1865us total) trans 30064892565 rc 0/0 00000100:00100000:0.0:1651529338.768662:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151651 00010000:00010000:1.0:1651529338.768664:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768669:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41279:x1731746395647744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529338.768670:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 2/0,0 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768671:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10665 00010000:00010000:0.0:1651529338.768673:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f5195f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.768674:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 2/0,0 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768675:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10666 00000100:00100000:1.0:1651529338.768676:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746395647808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529338.768677:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 3/0,0 mode: PW/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768678:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.768680:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 4/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2018 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.768682:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 1/0,0 mode: --/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768683:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 3/0,0 mode: PR/PR res: [0x2b171:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2018 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.768685:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5195f3/0xa29a79078f3bcefa lrc: 0/0,0 mode: --/PW res: [0x2b16f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768688:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe22901/0xa29a79078f3b477d lrc: 0/0,0 mode: --/PR res: [0x2b171:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a96aa expref: 2018 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768692:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768692:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768693:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768696:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 4/0,1 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768701:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.768705:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746395647808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768708:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10666 00000100:00100000:0.0:1651529338.768712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.768720:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10667 00000100:00100000:1.0:1651529338.768722:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41279:x1731746395647872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529338.768724:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529338.768725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.768726:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 4/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2016 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768739:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 3/0,0 mode: PR/PR res: [0x2b172:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2016 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768745:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3b2c17 lrc: 0/0,0 mode: --/PR res: [0x2b172:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28a2 expref: 2016 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.768752:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529338.768755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529338.768758:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768764:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768767:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 4/0,1 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768777:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529338.768786:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324224 00000100:00100000:1.0:1651529338.768793:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41279:x1731746395647872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.768796:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10667 00000100:00100000:0.0:1651529338.768800:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324160 00010000:00010000:1.0:1651529338.768820:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768824:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768827:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,1 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768830:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 2/0,0 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768835:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324288 00000100:00100000:0.0:1651529338.768842:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151655 00000100:00100000:0.0:1651529338.768844:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+402:39029:x1731745946324224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.768849:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176500 count 1 00010000:00010000:0.0:1651529338.768854:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: --/PW res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768871:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 2/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.768875:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.768875:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.768876:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 4/0,1 mode: --/PW res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768877:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946323968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1948us (2053us total) trans 30064892566 rc 0/0 00000100:00100000:1.0:1651529338.768880:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151652 00010000:00010000:0.0:1651529338.768883:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 3/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529338.768886:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151656 00000100:00100000:1.0:1651529338.768887:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+402:39030:x1731745946324160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529338.768887:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 4/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.768891:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966583424:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529338.768892:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176499 count 1 00010000:00010000:1.0:1651529338.768896:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: --/PW res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768900:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529338.768901:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 2/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.768904:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768905:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768905:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 4/0,1 mode: --/PW res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768906:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768909:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768912:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 3/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.768912:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,1 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768915:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 2/0,0 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768916:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 4/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768920:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966583488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.768928:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.768935:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151657 00000100:00100000:1.0:1651529338.768936:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+403:39030:x1731745946324288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.768940:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176501 count 1 00010000:00010000:1.0:1651529338.768944:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: --/PW res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768950:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 2/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.768953:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768954:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.768954:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 4/0,1 mode: --/PW res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.768955:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946324096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1886us (1941us total) trans 30064892567 rc 0/0 00000100:00100000:0.0:1651529338.768957:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151654 00010000:00010000:1.0:1651529338.768960:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 3/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.768964:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 4/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2014 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.768967:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966583552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.768968:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 2/0,0 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768971:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058383ed8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.768972:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 2/0,0 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.768973:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.768975:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 3/0,0 mode: PW/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768978:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 2/0,0 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768981:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d889f791 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.768982:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 2/0,0 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768985:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 3/0,0 mode: PW/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768991:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 1/0,0 mode: --/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768992:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 1/0,0 mode: --/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.768995:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d889f791/0xa29a79078f3bcf0f lrc: 0/0,0 mode: --/PW res: [0x2b172:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.768996:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058383ed8/0xa29a79078f3bcf01 lrc: 0/0,0 mode: --/PW res: [0x2b170:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769002:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769005:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769008:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,1 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769010:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 2/0,0 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769054:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946324032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1995us (2052us total) trans 30064892568 rc 0/0 00000100:00100000:1.0:1651529338.769057:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151653 00010000:00010000:1.0:1651529338.769066:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769069:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769075:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,1 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769077:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 2/0,0 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769078:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 2/0,0 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769081:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056032d3d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.769082:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 2/0,0 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769085:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 3/0,0 mode: PW/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769090:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 1/0,0 mode: --/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769092:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcf08 lrc: 0/0,0 mode: --/PW res: [0x2b171:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769097:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 2/0,0 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769099:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001037b04c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.769100:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 2/0,0 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769105:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 3/0,0 mode: PW/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769109:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 1/0,0 mode: --/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769110:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946323840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2252us (2340us total) trans 30064892569 rc 0/0 00010000:00010000:0.0:1651529338.769111:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcef3 lrc: 0/0,0 mode: --/PW res: [0x2b16e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769113:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151650 00000100:00100000:0.0:1651529338.769128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.769154:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324352 00000100:00100000:0.0:1651529338.769173:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151658 00000100:00100000:0.0:1651529338.769175:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946324352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529338.769181:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176502 count 1 00010000:00010000:0.0:1651529338.769186:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: --/PW res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769191:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 2/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.769193:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769194:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769195:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 4/0,1 mode: --/PW res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769202:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 3/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.769208:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 4/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.769213:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.769258:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.769375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.769391:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324480 00000100:00100000:0.0:1651529338.769397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.769410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.769417:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324416 00000100:00100000:0.0:1651529338.769418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.769430:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324608 00000100:00100000:1.0:1651529338.769436:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324544 00000100:00100000:1.0:1651529338.769440:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151659 00000100:00100000:1.0:1651529338.769442:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000544c90e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+407:39029:x1731745946324480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.769442:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151660 00000100:00100000:0.0:1651529338.769445:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946324416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.769447:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176504 count 1 00002000:00080000:0.0:1651529338.769450:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176503 count 1 00010000:00010000:1.0:1651529338.769452:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: --/PW res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769455:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: --/PW res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769456:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 2/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2014 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.769459:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769460:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769460:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 2/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.769461:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 4/0,1 mode: --/PW res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769463:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769463:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769464:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 4/0,1 mode: --/PW res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769470:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2014 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.769471:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 3/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.769474:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2014 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:0.0:1651529338.769477:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 4/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2014 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.769478:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966583680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.769481:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966583744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.769490:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529338.769490:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.769497:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151661 00000100:00100000:1.0:1651529338.769498:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+407:39029:x1731745946324608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529338.769499:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151662 00000100:00100000:0.0:1651529338.769500:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946324544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.769503:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176506 count 1 00002000:00080000:0.0:1651529338.769505:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176505 count 1 00010000:00010000:1.0:1651529338.769506:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: --/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769508:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: --/PW res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769510:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 2/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.769512:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 2/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.769513:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769514:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769514:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 4/0,1 mode: --/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769515:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769516:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529338.769517:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 4/0,1 mode: --/PW res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769520:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 3/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.769523:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 4/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.769528:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966583808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.769534:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529338.769543:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 3/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2014 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529338.769561:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 4/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2014 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:0.0:1651529338.769568:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966583872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529338.769576:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.769595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529338.769597:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966583424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.769601:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: --/PW res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.769630:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966583488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.769634:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: --/PW res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769652:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966583552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.769654:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: --/PW res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769661:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648000 00010000:00010000:1.0:1651529338.769666:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 4/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2015 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.769673:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395647936 00010000:00010000:1.0:1651529338.769676:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 4/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2016 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.769682:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10668 00000100:00100000:1.0:1651529338.769683:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746395648000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.769686:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.769687:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 4/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2016 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769691:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 3/0,0 mode: PR/PR res: [0x2b173:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2016 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769696:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027de7b24/0xa29a79078f3b5f24 lrc: 0/0,0 mode: --/PR res: [0x2b173:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af6c7 expref: 2016 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769700:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769701:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769701:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769704:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 4/0,1 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769710:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.769718:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746395648000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.769720:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10668 00000100:00100000:1.0:1651529338.769724:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10669 00000100:00100000:1.0:1651529338.769726:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746395647936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.769740:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.769741:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 4/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769753:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 3/0,0 mode: PR/PR res: [0x2b174:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769767:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5028e56/0xa29a79078f3b5abd lrc: 0/0,0 mode: --/PR res: [0x2b174:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae1c7 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.769771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.769772:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769775:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 4/0,1 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769784:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.769795:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746395647936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.769798:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10669 00010000:00010000:0.0:1651529338.769824:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769828:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769830:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769832:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,1 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769834:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769835:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 2/0,0 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769837:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,1 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.769840:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 2/0,0 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.769889:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946324224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1044us (1177us total) trans 30064892570 rc 0/0 00000100:00100000:1.0:1651529338.769893:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+409:39030:x1731745946324160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1168us total) trans 30064892571 rc 0/0 00000100:00100000:0.0:1651529338.769893:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151655 00000100:00100000:1.0:1651529338.769897:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151656 00010000:00010000:0.0:1651529338.769941:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 2/0,0 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769945:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d9b8ce9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.769946:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 2/0,0 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769950:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 3/0,0 mode: PW/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.769954:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 1/0,0 mode: --/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769957:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9b8ce9/0xa29a79078f3bcf16 lrc: 0/0,0 mode: --/PW res: [0x2b174:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769961:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 2/0,0 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769964:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc763531 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529338.769965:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 2/0,0 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.769966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529338.769967:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 3/0,0 mode: PW/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769971:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 1/0,0 mode: --/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529338.769973:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf1d lrc: 0/0,0 mode: --/PW res: [0x2b173:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529338.769997:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529338.770001:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: --/PW res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770020:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f0ef493 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966583808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.770025:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: --/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770032:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648128 00010000:00010000:1.0:1651529338.770037:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 4/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2013 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770044:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648064 00010000:00010000:1.0:1651529338.770046:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 4/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2014 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770052:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10670 00000100:00100000:1.0:1651529338.770054:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746395648128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.770057:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770058:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 4/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770062:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 3/0,0 mode: PR/PR res: [0x2b176:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770077:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eede19/0xa29a79078f3b5d8e lrc: 0/0,0 mode: --/PR res: [0x2b176:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedc1 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770081:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770081:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770082:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770086:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 4/0,1 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770094:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770103:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746395648128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770106:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10670 00000100:00100000:1.0:1651529338.770110:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10671 00000100:00100000:1.0:1651529338.770112:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41278:x1731746395648064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529338.770115:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770116:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 4/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770120:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 3/0,0 mode: PR/PR res: [0x2b175:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770125:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3b36c8 lrc: 0/0,0 mode: --/PR res: [0x2b175:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a52fd expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770138:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770139:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770139:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770142:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 4/0,1 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770149:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770155:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41278:x1731746395648064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770157:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10671 00010000:00010000:1.0:1651529338.770163:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770166:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770169:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,1 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770172:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 2/0,0 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770220:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946324288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1465us total) trans 30064892572 rc 0/0 00000100:00100000:1.0:1651529338.770223:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151657 00010000:00010000:1.0:1651529338.770240:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 2/0,0 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770243:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.770244:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 2/0,0 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770247:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 3/0,0 mode: PW/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770252:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 1/0,0 mode: --/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770255:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf24 lrc: 0/0,0 mode: --/PW res: [0x2b175:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770266:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966583680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.770270:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: --/PW res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.770298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.770331:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.770360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.770368:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648256 00010000:00010000:1.0:1651529338.770372:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 4/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2011 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770390:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648384 00010000:00010000:1.0:1651529338.770393:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 5/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770397:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648192 00010000:00010000:1.0:1651529338.770399:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2013 pid: 128009 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770402:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648320 00010000:00010000:1.0:1651529338.770404:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 5/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2014 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.770409:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10672 00000100:00100000:1.0:1651529338.770410:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746395648256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.770413:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770414:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 4/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770417:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 3/0,0 mode: PR/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770424:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3b5c7d lrc: 0/0,0 mode: --/PR res: [0x2b17a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae929 expref: 2014 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770428:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770434:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770435:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770438:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 4/0,1 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770445:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770453:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746395648256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770456:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10672 00000100:00100000:1.0:1651529338.770461:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10673 00000100:00100000:1.0:1651529338.770463:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41278:x1731746395648384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.770465:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770467:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 5/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770470:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 4/0,0 mode: PR/PR res: [0x2b179:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2012 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770475:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770476:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770479:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 4/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770483:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770495:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41278:x1731746395648384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770498:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10673 00000100:00100000:1.0:1651529338.770501:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10674 00000100:00100000:1.0:1651529338.770503:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41278:x1731746395648192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.770506:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770507:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2011 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770511:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2b178:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2011 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770516:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3b4e6f lrc: 0/0,0 mode: --/PR res: [0x2b178:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab199 expref: 2011 pid: 128009 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770520:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770520:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770521:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770524:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 4/0,1 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770530:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770534:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41278:x1731746395648192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770537:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10674 00000100:00100000:1.0:1651529338.770551:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10675 00000100:00100000:1.0:1651529338.770553:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41278:x1731746395648320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.770556:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.770557:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 5/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2009 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770561:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 4/0,0 mode: PR/PR res: [0x2b177:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2009 pid: 161133 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.770566:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770567:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.770568:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770571:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 4/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770575:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.770580:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41278:x1731746395648320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.770582:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10675 00010000:00010000:1.0:1651529338.770588:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770592:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770595:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,1 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770605:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 2/0,0 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770648:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+408:39029:x1731745946324608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1238us total) trans 30064892573 rc 0/0 00000100:00100000:1.0:1651529338.770651:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151661 00010000:00010000:1.0:1651529338.770659:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770663:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770666:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,1 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.770668:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 2/0,0 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.770706:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000544c90e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+408:39029:x1731745946324480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1263us (1342us total) trans 30064892574 rc 0/0 00000100:00100000:1.0:1651529338.770709:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151659 00010000:00010000:1.0:1651529338.772051:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 2/0,0 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772055:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.772057:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 2/0,0 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772068:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 3/0,0 mode: PW/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772074:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 1/0,0 mode: --/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772076:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf40 lrc: 0/0,0 mode: --/PW res: [0x2b17a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772081:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 2/0,0 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772084:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.772085:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 2/0,0 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772088:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 3/0,0 mode: PW/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772091:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 1/0,0 mode: --/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772093:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf32 lrc: 0/0,0 mode: --/PW res: [0x2b178:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772104:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027b56317/0xa29a79078f3b3e0e lrc: 0/0,0 mode: --/PR res: [0x2b177:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f04 expref: 2008 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.772114:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966583744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.772118:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772122:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772124:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772127:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,1 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772130:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 2/0,0 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.772176:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946324416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2731us (2779us total) trans 30064892575 rc 0/0 00000100:00100000:1.0:1651529338.772179:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151660 00010000:00010000:1.0:1651529338.772186:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 2/0,0 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772189:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001b528e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.772190:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 2/0,0 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772204:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 3/0,0 mode: PW/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772209:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 1/0,0 mode: --/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772212:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcf39 lrc: 0/0,0 mode: --/PW res: [0x2b177:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772223:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce54824d/0xa29a79078f3b370e lrc: 0/0,0 mode: --/PR res: [0x2b179:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5431 expref: 2007 pid: 161133 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.772226:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966583872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.772230:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772233:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772236:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772238:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,1 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772241:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 2/0,0 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.772285:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946324544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2783us (2866us total) trans 30064892576 rc 0/0 00000100:00100000:1.0:1651529338.772288:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151662 00010000:00010000:1.0:1651529338.772295:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772298:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772301:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,1 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772304:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 2/0,0 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.772335:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+408:39029:x1731745946324352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3159us (3207us total) trans 30064892577 rc 0/0 00000100:00100000:1.0:1651529338.772338:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151658 00010000:00010000:1.0:1651529338.772358:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 2/0,0 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772362:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3767209 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.772363:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 2/0,0 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772366:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 3/0,0 mode: PW/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772379:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 1/0,0 mode: --/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772382:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf47 lrc: 0/0,0 mode: --/PW res: [0x2b179:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772386:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 2/0,0 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772389:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000937c0735 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.772389:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 2/0,0 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772392:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 3/0,0 mode: PW/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772395:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 1/0,0 mode: --/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.772398:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c0735/0xa29a79078f3bcf2b lrc: 0/0,0 mode: --/PW res: [0x2b176:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.777146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529338.777157:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324672 00000100:00100000:1.0:1651529338.777169:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151663 00000100:00100000:1.0:1651529338.777171:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946324672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529338.777190:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176507 count 1 00010000:00010000:1.0:1651529338.777198:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: --/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.777204:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 2/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2006 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.777208:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.777209:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.777210:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 4/0,1 mode: --/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.777219:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 3/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2006 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529338.777224:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 4/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2006 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.777229:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529338.777245:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529338.781873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529338.781886:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966583936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529338.781892:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: --/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.781903:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395648448 00010000:00010000:1.0:1651529338.781910:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 4/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2007 pid: 142996 timeout: 13088 lvb_type: 1 00000100:00100000:1.0:1651529338.781931:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10676 00000100:00100000:1.0:1651529338.781933:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41278:x1731746395648448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529338.781938:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529338.781940:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 4/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2007 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.781945:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 3/0,0 mode: PR/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2007 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.781955:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068385fbd/0xa29a79078f3b6100 lrc: 0/0,0 mode: --/PR res: [0x2b17b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b00ec expref: 2007 pid: 142996 timeout: 13088 lvb_type: 1 00010000:00010000:1.0:1651529338.781959:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.781960:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529338.781961:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.781965:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 4/0,1 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.781971:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529338.781982:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41278:x1731746395648448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529338.781986:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10676 00010000:00010000:1.0:1651529338.782027:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782038:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782042:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,1 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782045:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 2/0,0 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529338.782112:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+409:39030:x1731745946324672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4940us (4967us total) trans 30064892578 rc 0/0 00000100:00100000:1.0:1651529338.782116:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151663 00010000:00010000:1.0:1651529338.782123:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 2/0,0 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782127:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529338.782128:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 2/0,0 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782131:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 3/0,0 mode: PW/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782136:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 1/0,0 mode: --/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529338.782139:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf4e lrc: 0/0,0 mode: --/PW res: [0x2b17b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529338.943171:0:166228:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529338.943174:0:166228:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: ls -la time: 5 seconds 00000100:00100000:1.0:1651529339.105176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529339.105203:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324736 00000100:00100000:0.0:1651529339.105225:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 305 00000100:00100000:0.0:1651529339.105227:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+409:39030:x1731745946324736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529339.105244:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580160 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529339.105276:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+409:39030:x1731745946324736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529339.105279:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 305 00000400:00000080:1.0:1651529339.264304:0:166282:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529339.264306:0:166282:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: lru_size = 4006 00000400:00000080:1.0:1651529339.576737:0:166336:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529339.576740:0:166336:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: ls -la is 28% faster with lru resize enabled 00000100:00100000:1.0:1651529342.176384:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529342.176408:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324864 00000100:00100000:1.0:1651529342.176428:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 36 00000100:00100000:1.0:1651529342.176431:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946324864:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529342.176463:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946324864:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529342.176466:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 36 00000400:00000080:0.0:1651529342.950149:0:166662:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529342.950152:0:166662:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 124c: LRUR cancel very aged locks ========= 22:09:02 (1651529342) 00000100:00100000:1.0:1651529343.026350:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529343.026368:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325056 00000100:00100000:1.0:1651529343.026397:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151664 00000100:00100000:1.0:1651529343.026399:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+409:137464:x1731745946325056:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529343.026453:0:128009:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x0 at 178562 00000100:00100000:1.0:1651529343.027727:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+409:137464:x1731745946325056:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 1327us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.027741:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151664 00000100:00100000:1.0:1651529343.080585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.080594:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396187264 00000100:00100000:1.0:1651529343.080608:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151665 00000100:00100000:1.0:1651529343.080610:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41278:x1731746396187264:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.080622:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.080634:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 2/0,0 mode: --/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9141 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.080654:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.080666:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.080667:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.080671:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 3/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 2007 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.080679:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 3/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 2007 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.080685:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017268066, rc 0) 00000100:00100000:1.0:1651529343.080697:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41278:x1731746396187264:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 87us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.080700:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151665 00000100:00100000:1.0:1651529343.082274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.082282:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188032 00000100:00100000:1.0:1651529343.082294:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151666 00000100:00100000:1.0:1651529343.082296:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41278:x1731746396188032:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.082300:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.082316:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 2/0,0 mode: --/PR res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9180 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.082329:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b975:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.082334:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082335:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082337:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 2008 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082342:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 2008 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082346:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eb48a81e, rc 0) 00000100:00100000:1.0:1651529343.082357:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396188032:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 60us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.082360:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151666 00000100:00100000:1.0:1651529343.082404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.082412:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188096 00000100:00100000:1.0:1651529343.082423:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151667 00000100:00100000:1.0:1651529343.082424:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41279:x1731746396188096:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.082428:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.082444:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 2/0,0 mode: --/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9187 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.082451:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.082455:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082455:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082457:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 2009 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082462:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 2009 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082465:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000061446d72, rc 0) 00000100:00100000:1.0:1651529343.082475:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41279:x1731746396188096:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 50us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.082478:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151667 00000100:00100000:1.0:1651529343.082516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.082555:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188160 00000100:00100000:1.0:1651529343.082568:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151668 00000100:00100000:1.0:1651529343.082570:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41278:x1731746396188160:12345-10.240.43.64@tcp:101:ls.0 00010000:00010000:1.0:1651529343.082573:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.082577:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 2/0,0 mode: --/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d918e expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.082583:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082583:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082585:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 2010 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082589:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 2010 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082593:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000313829b, rc 0) 00000100:00100000:1.0:1651529343.082602:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41278:x1731746396188160:12345-10.240.43.64@tcp:101:ls.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.082605:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151668 00000100:00100000:1.0:1651529343.083205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083212:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188736 00000100:00100000:1.0:1651529343.083224:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151669 00000100:00100000:1.0:1651529343.083226:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41279:x1731746396188736:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.083231:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.083236:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 2/0,0 mode: --/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91c6 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.083241:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.083245:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083245:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083247:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 2011 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083251:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 2011 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083255:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba5b8d96, rc 0) 00000100:00100000:1.0:1651529343.083265:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396188736:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 38us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.083267:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151669 00000100:00100000:1.0:1651529343.083518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083526:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188928 00000100:00100000:1.0:1651529343.083538:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151670 00000100:00100000:1.0:1651529343.083540:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41278:x1731746396188928:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.083543:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.083547:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 2/0,0 mode: --/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91db expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.083564:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b94c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.083568:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083569:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083570:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 3/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 2012 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083575:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 3/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 2012 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083579:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e5d5897, rc 0) 00000100:00100000:1.0:1651529343.083589:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41278:x1731746396188928:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 49us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.083592:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151670 00000100:00100000:1.0:1651529343.084515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.084523:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.084535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.084542:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189824 00000100:00100000:0.0:1651529343.084546:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190080 00000100:00100000:1.0:1651529343.084558:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189760 00000100:00100000:1.0:1651529343.084564:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151671 00000100:00100000:1.0:1651529343.084566:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396189824:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00000100:00100000:0.0:1651529343.084574:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151672 00010000:00010000:1.0:1651529343.084575:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.084577:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396189760:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.084582:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.084585:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 2/0,0 mode: --/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9236 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.084596:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b962:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.084597:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 2/0,0 mode: --/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d922f expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.084600:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084601:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084603:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 2015 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084610:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 2015 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084614:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000081ada84a, rc 0) 00000100:00100000:1.0:1651529343.084624:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396189824:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.084632:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151671 00000100:00100000:1.0:1651529343.084645:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151673 00000100:00100000:1.0:1651529343.084647:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396190080:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.084650:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:0.0:1651529343.084650:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b974:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.084654:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 2/0,0 mode: --/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9252 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.084658:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.084658:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529343.084665:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b950:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.084666:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 2015 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084670:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084670:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084672:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 2016 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084672:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 2016 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084676:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 2016 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084677:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004cf161b6, rc 0) 00010000:00010000:1.0:1651529343.084680:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bc763531, rc 0) 00000100:00100000:0.0:1651529343.084690:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746396189760:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.084693:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746396190080:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.084694:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151672 00000100:00100000:1.0:1651529343.084697:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151673 00000100:00100000:1.0:1651529343.084726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.084788:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190208 00000100:00100000:0.0:1651529343.084818:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151674 00000100:00100000:0.0:1651529343.084821:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396190208:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.084825:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.084838:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 2/0,0 mode: --/PR res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9260 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.084892:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b952:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.084898:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.084899:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.084901:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 3/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 2016 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084906:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 3/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 2016 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084911:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3767209, rc 0) 00000100:00100000:1.0:1651529343.084912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.084919:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190400 00000100:00100000:1.0:1651529343.084927:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151675 00000100:00100000:1.0:1651529343.084929:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746396190400:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00000100:00100000:0.0:1651529343.084930:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41278:x1731746396190208:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 109us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529343.084932:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.084933:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151674 00010000:00010000:1.0:1651529343.084936:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 2/0,0 mode: --/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d926e expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.084942:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.084945:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084946:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.084948:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 2017 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084952:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 2017 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.084956:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009e1996d9, rc 0) 00000100:00100000:1.0:1651529343.084963:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746396190400:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 34us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.084966:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151675 00000100:00100000:1.0:1651529343.085858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.085866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.085873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.085892:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190912 00000100:00100000:1.0:1651529343.085898:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191040 00000100:00100000:1.0:1651529343.085903:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151676 00000100:00100000:0.0:1651529343.085903:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190976 00000100:00100000:1.0:1651529343.085905:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41278:x1731746396190912:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.085908:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.085914:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151677 00000100:00100000:0.0:1651529343.085916:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41278:x1731746396191040:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.085919:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 2/0,0 mode: --/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92a6 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.085920:0:144528:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.085925:0:144528:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 2/0,0 mode: --/PR res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92b4 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.085929:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.085937:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.085938:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529343.085938:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b951:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.085939:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 2020 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085943:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.085944:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 2021 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085944:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.085946:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 3/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 2021 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.085948:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051f4e87e, rc 0) 00010000:00010000:0.0:1651529343.085951:0:144528:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 3/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 2021 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085955:0:144528:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000001b528e9, rc 0) 00000100:00100000:1.0:1651529343.085960:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396190912:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.085963:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151676 00000100:00100000:1.0:1651529343.085968:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151678 00000100:00100000:1.0:1651529343.085970:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396190976:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00000100:00100000:0.0:1651529343.085971:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396191040:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 55us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529343.085973:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.085974:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151677 00010000:00010000:1.0:1651529343.085982:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 2/0,0 mode: --/PR res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92ad expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.085998:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b968:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.086002:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086002:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086004:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 3/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 2020 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086008:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 3/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 2020 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086012:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9826e6a, rc 0) 00000100:00100000:1.0:1651529343.086030:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396190976:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.086033:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151678 00000100:00100000:0.0:1651529343.086369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.086392:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191488 00000100:00100000:1.0:1651529343.086404:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151679 00000100:00100000:1.0:1651529343.086406:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41279:x1731746396191488:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.086410:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.086414:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 2/0,0 mode: --/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92de expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.086426:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.086430:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086431:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086432:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 3/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 2021 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086444:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 3/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 2021 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086448:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000001afdf7f, rc 0) 00000100:00100000:1.0:1651529343.086459:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41279:x1731746396191488:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 52us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.086461:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151679 00000100:00100000:0.0:1651529343.087331:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.087354:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191872 00000100:00100000:1.0:1651529343.087366:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151680 00000100:00100000:1.0:1651529343.087368:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396191872:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.087371:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.087376:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 2/0,0 mode: --/PR res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9301 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.087381:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b955:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.087395:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087396:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087397:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 2022 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.087402:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 2022 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.087405:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a79d5d88, rc 0) 00000100:00100000:1.0:1651529343.087416:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41278:x1731746396191872:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 47us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.087424:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151680 00000100:00100000:0.0:1651529343.087441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.087447:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192192 00000100:00100000:1.0:1651529343.087456:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151681 00000100:00100000:1.0:1651529343.087458:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41279:x1731746396192192:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.087461:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.087469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529343.087479:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 2/0,0 mode: --/PR res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9324 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529343.087489:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192128 00002000:00010000:1.0:1651529343.087490:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b961:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529343.087497:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151682 00010000:00010000:1.0:1651529343.087498:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087498:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529343.087499:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192128:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.087500:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 2024 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087503:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.087505:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 2024 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.087508:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c3014153, rc 0) 00010000:00010000:0.0:1651529343.087514:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 2/0,0 mode: --/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d931d expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529343.087516:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192192:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 58us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.087519:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151681 00002000:00010000:0.0:1651529343.087525:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.087530:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087531:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087532:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 2024 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087537:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 2024 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087541:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001037b04c, rc 0) 00000100:00100000:0.0:1651529343.087557:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192128:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 56us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.087562:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151682 00000100:00100000:1.0:1651529343.088264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.088304:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192512 00000100:00100000:0.0:1651529343.088313:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151683 00000100:00100000:0.0:1651529343.088315:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192512:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.088319:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.088324:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 2/0,0 mode: --/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9340 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.088332:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b970:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.088336:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.088337:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.088339:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 2025 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088343:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 2025 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088347:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000056032d3d, rc 0) 00000100:00100000:0.0:1651529343.088365:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746396192512:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.088367:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151683 00000100:00100000:1.0:1651529343.088416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.088432:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192704 00000100:00100000:0.0:1651529343.088441:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151684 00000100:00100000:0.0:1651529343.088443:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746396192704:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.088446:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.088452:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 2/0,0 mode: --/PR res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9355 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.088457:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b973:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.088461:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.088461:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.088463:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 2026 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088470:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 2026 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088474:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c71dcae, rc 0) 00000100:00100000:0.0:1651529343.088484:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41279:x1731746396192704:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.088487:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151684 00000100:00100000:1.0:1651529343.089110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.089133:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193024 00000100:00100000:0.0:1651529343.089142:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151685 00000100:00100000:0.0:1651529343.089144:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41279:x1731746396193024:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.089147:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.089151:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 2/0,0 mode: --/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d936a expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.089157:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b960:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.089161:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089161:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089163:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 2027 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089167:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 2027 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089171:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000459cdb3d, rc 0) 00000100:00100000:0.0:1651529343.089181:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746396193024:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 37us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.089184:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151685 00000100:00100000:1.0:1651529343.090535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.090557:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193664 00000100:00100000:0.0:1651529343.090566:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151686 00000100:00100000:0.0:1651529343.090568:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396193664:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.090571:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.090583:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 2/0,0 mode: --/PR res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d939b expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.090589:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b967:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.090593:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.090594:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.090596:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 2028 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.090600:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 2028 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.090604:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004ed6d64d, rc 0) 00000100:00100000:0.0:1651529343.090615:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396193664:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.090617:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151686 00000100:00100000:1.0:1651529343.092139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.092169:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396194240 00000100:00100000:0.0:1651529343.092178:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151687 00000100:00100000:0.0:1651529343.092180:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746396194240:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.092183:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.092195:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 2/0,0 mode: --/PR res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93c5 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.092201:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b965:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.092205:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.092206:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.092208:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 3/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 2029 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.092212:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 3/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 2029 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.092216:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058da2d42, rc 0) 00000100:00100000:0.0:1651529343.092226:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746396194240:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.092229:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151687 00000100:00100000:1.0:1651529343.092652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.092674:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396194432 00000100:00100000:0.0:1651529343.092683:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151688 00000100:00100000:0.0:1651529343.092685:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41278:x1731746396194432:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.092689:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.092693:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 2/0,0 mode: --/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93d3 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.092698:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.092702:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.092702:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.092704:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 2030 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.092711:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 2030 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.092715:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f158e848, rc 0) 00000100:00100000:0.0:1651529343.092725:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41278:x1731746396194432:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.092728:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151688 00000100:00100000:1.0:1651529343.093028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.093050:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396194624 00000100:00100000:0.0:1651529343.093059:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151689 00000100:00100000:0.0:1651529343.093061:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41278:x1731746396194624:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.093064:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.093077:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 2/0,0 mode: --/PR res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93e1 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.093083:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b978:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.093087:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.093087:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.093089:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 3/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 2031 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.093093:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 3/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 2031 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.093097:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000063f87826, rc 0) 00000100:00100000:0.0:1651529343.093108:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41278:x1731746396194624:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.093111:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151689 00000100:00100000:1.0:1651529343.093989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.094010:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195008 00000100:00100000:0.0:1651529343.094019:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151690 00000100:00100000:0.0:1651529343.094021:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396195008:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.094024:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.094037:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 2/0,0 mode: --/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93fd expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.094043:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b977:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.094047:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094048:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094049:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 2032 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094054:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 2032 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094057:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b2fd99a, rc 0) 00000100:00100000:0.0:1651529343.094068:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396195008:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 46us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.094071:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151690 00000100:00100000:1.0:1651529343.095863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.095884:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195776 00000100:00100000:0.0:1651529343.095893:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151691 00000100:00100000:0.0:1651529343.095895:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41278:x1731746396195776:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.095898:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.095903:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 2/0,0 mode: --/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9435 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.095908:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b953:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.095912:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.095912:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.095914:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 2033 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.095918:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 2033 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.095922:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000045b3e5b9, rc 0) 00000100:00100000:0.0:1651529343.095932:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41278:x1731746396195776:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 37us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.095935:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151691 00000100:00100000:1.0:1651529343.096322:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.096344:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195968 00000100:00100000:0.0:1651529343.096353:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151692 00000100:00100000:0.0:1651529343.096355:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41279:x1731746396195968:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.096358:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.096363:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 2/0,0 mode: --/PR res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9443 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.096369:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b958:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.096373:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.096373:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.096375:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 2034 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.096382:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 2034 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.096385:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036531b38, rc 0) 00000100:00100000:0.0:1651529343.096395:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41279:x1731746396195968:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.096398:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151692 00000100:00100000:1.0:1651529343.098594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.098616:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396196928 00000100:00100000:0.0:1651529343.098625:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151693 00000100:00100000:0.0:1651529343.098627:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41279:x1731746396196928:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.098630:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.098646:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 2/0,0 mode: --/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9489 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.098652:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.098656:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.098656:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.098658:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 3/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 2035 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.098662:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 3/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 2035 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.098666:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014e2ea2c, rc 0) 00000100:00100000:0.0:1651529343.098677:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396196928:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 50us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.098680:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151693 00000100:00100000:1.0:1651529343.099072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.099094:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396197120 00000100:00100000:0.0:1651529343.099103:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151694 00000100:00100000:0.0:1651529343.099105:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396197120:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.099108:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.099120:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 2/0,0 mode: --/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9497 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.099129:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.099134:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.099134:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.099136:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 2036 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.099141:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 2036 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.099144:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a60e195, rc 0) 00000100:00100000:0.0:1651529343.099155:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396197120:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.099158:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151694 00000100:00100000:1.0:1651529343.100479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.100501:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396197696 00000100:00100000:0.0:1651529343.100510:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151695 00000100:00100000:0.0:1651529343.100512:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396197696:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.100515:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.100519:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 2/0,0 mode: --/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94c1 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.100525:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.100529:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.100529:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.100531:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 2037 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.100535:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 2037 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.100539:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748a867f, rc 0) 00000100:00100000:0.0:1651529343.100549:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396197696:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 37us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.100552:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151695 00000100:00100000:1.0:1651529343.100940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.100962:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396197888 00000100:00100000:0.0:1651529343.100971:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151696 00000100:00100000:0.0:1651529343.100973:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396197888:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.100976:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.100996:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 2/0,0 mode: --/PR res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94cf expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.101002:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b954:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.101005:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101006:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101008:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 2038 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101015:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 2038 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101019:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6e2a7ad, rc 0) 00000100:00100000:0.0:1651529343.101029:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41279:x1731746396197888:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 56us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.101032:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151696 00000100:00100000:1.0:1651529343.101388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.101409:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396198080 00000100:00100000:0.0:1651529343.101419:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151697 00000100:00100000:0.0:1651529343.101420:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41278:x1731746396198080:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.101424:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.101428:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 2/0,0 mode: --/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94dd expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.101433:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.101437:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101438:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101440:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 2039 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101444:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 2039 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101448:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6c81810, rc 0) 00000100:00100000:0.0:1651529343.101458:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41278:x1731746396198080:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 37us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.101460:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151697 00000100:00100000:1.0:1651529343.101866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.101887:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396198272 00000100:00100000:0.0:1651529343.101897:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151698 00000100:00100000:0.0:1651529343.101898:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396198272:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.101902:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.101906:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 2/0,0 mode: --/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94eb expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.101911:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b959:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.101922:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101923:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.101925:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 2040 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101929:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 2040 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.101933:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000020ca975c, rc 0) 00000100:00100000:0.0:1651529343.101944:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396198272:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 45us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.101947:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151698 00000100:00100000:1.0:1651529343.103721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.103748:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199040 00000100:00100000:0.0:1651529343.103757:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151699 00000100:00100000:0.0:1651529343.103759:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41278:x1731746396199040:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.103762:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.103774:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 2/0,0 mode: --/PR res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9523 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.103780:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b964:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.103788:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.103789:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.103791:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 2041 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.103795:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 2041 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.103799:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b5513d3, rc 0) 00000100:00100000:0.0:1651529343.103829:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41278:x1731746396199040:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 69us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.103832:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151699 00000100:00100000:1.0:1651529343.104118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.104140:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199232 00000100:00100000:0.0:1651529343.104153:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151700 00000100:00100000:0.0:1651529343.104155:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41279:x1731746396199232:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.104158:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.104162:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 2/0,0 mode: --/PR res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9531 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.104167:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b966:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.104171:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.104172:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.104174:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 3/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 2042 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.104180:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 3/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 2042 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.104184:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d2b771fe, rc 0) 00000100:00100000:0.0:1651529343.104199:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746396199232:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.104202:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151700 00000100:00100000:1.0:1651529343.104994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.105016:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199488 00000100:00100000:0.0:1651529343.105028:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151701 00000100:00100000:0.0:1651529343.105030:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41278:x1731746396199488:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.105034:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.105053:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 2/0,0 mode: --/PR res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9546 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.105059:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b963:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.105062:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.105063:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.105064:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 2043 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.105069:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 2043 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.105073:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002b47d4b3, rc 0) 00000100:00100000:0.0:1651529343.105087:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41278:x1731746396199488:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 56us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.105091:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151701 00000100:00100000:1.0:1651529343.105590:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.105612:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199680 00000100:00100000:0.0:1651529343.105624:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151702 00000100:00100000:0.0:1651529343.105626:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396199680:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.105629:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.105634:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 2/0,0 mode: --/PR res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9554 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.105639:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b972:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.105643:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.105644:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.105645:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 2044 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.105649:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 2044 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.105653:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000038aa8668, rc 0) 00000100:00100000:0.0:1651529343.105668:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746396199680:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 41us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.105671:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151702 00000100:00100000:1.0:1651529343.106244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.106265:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199872 00000100:00100000:0.0:1651529343.106278:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151703 00000100:00100000:0.0:1651529343.106279:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096d08cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41278:x1731746396199872:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.106283:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.106295:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 2/0,0 mode: --/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9562 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.106301:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.106304:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.106305:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.106307:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 3/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 2045 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.106311:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 3/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 2045 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.106315:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba69b7ff, rc 0) 00000100:00100000:0.0:1651529343.106330:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096d08cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41278:x1731746396199872:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.106332:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151703 00000100:00100000:1.0:1651529343.106866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.106888:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396200064 00000100:00100000:0.0:1651529343.106900:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151704 00000100:00100000:0.0:1651529343.106902:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746396200064:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.106906:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.106917:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 2/0,0 mode: --/PR res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9570 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.106923:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b979:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.106927:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.106927:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.106929:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 3/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 2046 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.106942:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 3/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 2046 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.106946:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000ee7ab0, rc 0) 00000100:00100000:0.0:1651529343.106960:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746396200064:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 57us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.106963:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151704 00000100:00100000:1.0:1651529343.107467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.107489:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396200256 00000100:00100000:0.0:1651529343.107502:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151705 00000100:00100000:0.0:1651529343.107503:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41278:x1731746396200256:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.107507:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.107518:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 2/0,0 mode: --/PR res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d957e expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.107524:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b957:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.107528:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.107528:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.107530:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 3/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 2047 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.107534:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 3/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 2047 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.107538:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fcc4fa7a, rc 0) 00000100:00100000:0.0:1651529343.107552:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41278:x1731746396200256:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 48us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.107561:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151705 00000100:00100000:1.0:1651529343.108068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.108089:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396200448 00000100:00100000:0.0:1651529343.108101:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151706 00000100:00100000:0.0:1651529343.108103:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746396200448:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.108106:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.108110:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 2/0,0 mode: --/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d958c expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.108122:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b94f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.108127:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.108127:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.108129:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 3/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 2048 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.108133:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 3/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 2048 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.108137:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000099cae647, rc 0) 00000100:00100000:0.0:1651529343.108152:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746396200448:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.108155:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151706 00000100:00100000:1.0:1651529343.109950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.109969:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201024 00000100:00100000:0.0:1651529343.109982:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151707 00000100:00100000:0.0:1651529343.109984:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41278:x1731746396201024:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.109987:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.110006:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 2/0,0 mode: --/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95b6 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.110012:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b96e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.110016:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.110017:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.110019:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 3/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 2049 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.110023:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 3/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 2049 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.110027:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058733e19, rc 0) 00000100:00100000:0.0:1651529343.110042:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746396201024:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 57us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.110044:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151707 00000100:00100000:1.0:1651529343.110528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.110545:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201216 00000100:00100000:0.0:1651529343.110558:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151708 00000100:00100000:0.0:1651529343.110560:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746396201216:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.110564:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.110575:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 2/0,0 mode: --/PR res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95c4 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.110580:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b956:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.110589:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.110589:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.110591:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 3/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 2050 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.110602:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 3/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 2050 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.110606:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033548aa6, rc 0) 00000100:00100000:0.0:1651529343.110621:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746396201216:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 60us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.110623:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151708 00000100:00100000:1.0:1651529343.113272:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.113289:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201984 00000100:00100000:0.0:1651529343.113303:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151709 00000100:00100000:0.0:1651529343.113304:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746396201984:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.113308:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.113313:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 2/0,0 mode: --/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95fc expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.113325:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b94d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.113329:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.113330:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.113332:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 2051 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.113336:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 2051 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.113340:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c301aeff, rc 0) 00000100:00100000:0.0:1651529343.113355:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396201984:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.113358:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151709 00000100:00100000:1.0:1651529343.113896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.113917:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396202176 00000100:00100000:0.0:1651529343.113929:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151710 00000100:00100000:0.0:1651529343.113931:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396202176:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.113935:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.113939:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 2/0,0 mode: --/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d960a expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.113951:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b94e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.113956:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.113956:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.113958:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 3/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 2052 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.113962:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 3/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 2052 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.113966:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087066587, rc 0) 00000100:00100000:0.0:1651529343.113981:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41278:x1731746396202176:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.113984:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151710 00000100:00100000:1.0:1651529343.116988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.117009:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396203136 00000100:00100000:0.0:1651529343.117021:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151711 00000100:00100000:0.0:1651529343.117023:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41278:x1731746396203136:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.117026:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.117038:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 2/0,0 mode: --/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9650 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.117043:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.117047:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.117048:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.117049:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 3/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 2053 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.117054:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 3/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 2053 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.117058:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000069469436, rc 0) 00000100:00100000:0.0:1651529343.117073:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41278:x1731746396203136:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.117075:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151711 00000100:00100000:1.0:1651529343.117572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.117594:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396203328 00000100:00100000:0.0:1651529343.117606:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151712 00000100:00100000:0.0:1651529343.117608:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41279:x1731746396203328:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.117611:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.117616:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 2/0,0 mode: --/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d965e expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.117621:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b95d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.117625:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.117625:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.117627:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 2054 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.117634:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 2054 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.117638:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006631c7c4, rc 0) 00000100:00100000:0.0:1651529343.117652:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41279:x1731746396203328:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.117654:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151712 00000100:00100000:1.0:1651529343.118191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.118213:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396203520 00000100:00100000:0.0:1651529343.118225:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151713 00000100:00100000:0.0:1651529343.118227:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41278:x1731746396203520:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.118230:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.118242:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 2/0,0 mode: --/PR res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d966c expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.118248:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b971:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.118252:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.118252:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.118254:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 3/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 2055 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.118258:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 3/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 2055 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.118262:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007b85b71d, rc 0) 00000100:00100000:0.0:1651529343.118276:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41278:x1731746396203520:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.118279:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151713 00000100:00100000:1.0:1651529343.118778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.118800:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396203712 00000100:00100000:0.0:1651529343.118820:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151714 00000100:00100000:0.0:1651529343.118822:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41279:x1731746396203712:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.118826:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.118830:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 2/0,0 mode: --/PR res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d967a expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.118835:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b976:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.118839:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.118840:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.118841:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 3/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 2056 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.118845:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 3/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 2056 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.118849:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e8d08924, rc 0) 00000100:00100000:0.0:1651529343.118864:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41279:x1731746396203712:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.118866:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151714 00000100:00100000:1.0:1651529343.119511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.119533:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396204032 00000100:00100000:0.0:1651529343.119545:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151715 00000100:00100000:0.0:1651529343.119547:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41279:x1731746396204032:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.119550:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.119562:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 2/0,0 mode: --/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d968f expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.119567:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b969:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.119571:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.119572:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.119573:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 2057 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.119577:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 2057 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.119581:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e7b700f8, rc 0) 00000100:00100000:0.0:1651529343.119596:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41279:x1731746396204032:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 48us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.119599:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151715 00000100:00100000:1.0:1651529344.224136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.224174:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325184 00000100:00100000:0.0:1651529344.224208:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 306 00000100:00100000:0.0:1651529344.224210:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946325184:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529344.224231:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578368 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529344.224255:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946325184:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.224259:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 306 00000001:00080000:1.0:1651529344.386485:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064892578 is committed 00000100:00100000:1.0:1651529344.387480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.387494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.387502:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387502:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325824 00000100:00100000:1.0:1651529344.387508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387521:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325760 00000100:00100000:1.0:1651529344.387526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387526:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325952 00000100:00100000:0.0:1651529344.387531:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325888 00000100:00100000:1.0:1651529344.387533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387545:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326080 00000100:00100000:1.0:1651529344.387549:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387553:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326016 00000100:00100000:0.0:1651529344.387555:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326208 00000100:00100000:1.0:1651529344.387556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.387558:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326144 00000100:00100000:0.0:1651529344.387562:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151716 00000100:00100000:0.0:1651529344.387564:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946325824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.387565:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151717 00000100:00100000:1.0:1651529344.387567:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.387577:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176508 count 1 00002000:00080000:0.0:1651529344.387577:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176509 count 1 00010000:00010000:1.0:1651529344.387591:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: --/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387591:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: --/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387600:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 2/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387604:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387605:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 2/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387605:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387606:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 4/0,1 mode: --/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387609:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387610:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387610:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 4/0,1 mode: --/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387620:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 3/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387620:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 3/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387625:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 4/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.387626:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 4/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.387631:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966584128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.387638:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966584192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387654:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.387660:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.387663:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151718 00000100:00100000:0.0:1651529344.387665:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946325952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.387667:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151719 00000100:00100000:1.0:1651529344.387669:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.387670:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176511 count 1 00002000:00080000:1.0:1651529344.387676:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176510 count 1 00010000:00010000:0.0:1651529344.387682:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: --/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387687:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 2/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387688:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: --/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387690:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387691:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387692:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 4/0,1 mode: --/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387693:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 2/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387697:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387697:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387698:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 4/0,1 mode: --/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387699:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 3/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387702:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 4/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.387706:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 3/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.387706:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966584256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387710:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 4/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.387714:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966584320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387715:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.387723:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.387723:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151720 00000100:00100000:0.0:1651529344.387725:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946326080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.387730:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176513 count 1 00000100:00100000:1.0:1651529344.387744:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151721 00010000:00010000:0.0:1651529344.387745:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: --/PW res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387752:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946326016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.387756:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 2/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.387758:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176512 count 1 00010000:00010000:1.0:1651529344.387763:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: --/PW res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387766:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387766:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387767:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 4/0,1 mode: --/PW res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387773:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 2/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387774:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 3/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387776:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387776:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387777:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 4/0,1 mode: --/PW res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387778:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 4/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.387782:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966584384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387784:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 3/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387788:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 4/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.387791:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.387792:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966584448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387798:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151722 00000100:00100000:0.0:1651529344.387800:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946326208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.387801:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.387819:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176515 count 1 00000100:00100000:1.0:1651529344.387821:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151723 00000100:00100000:1.0:1651529344.387823:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946326144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.387824:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: --/PW res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.387829:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176514 count 1 00010000:00010000:0.0:1651529344.387829:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 2/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387833:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: --/PW res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387833:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387833:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387834:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 4/0,1 mode: --/PW res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387843:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 3/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.387847:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 2/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.387847:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 4/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.387850:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387851:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387851:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 4/0,1 mode: --/PW res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387851:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966584512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387859:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 3/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2056 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.387859:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.387862:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 4/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.387866:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966584576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.387875:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.388183:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966584128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.388200:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966584192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.388203:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: --/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388205:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: --/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388236:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966584320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.388240:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: --/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.388261:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966584256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.388266:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: --/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.388296:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966584384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.388299:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: --/PW res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.388307:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966584512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.388309:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: --/PW res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388321:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966584448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.388333:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: --/PW res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388342:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966584576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.388344:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: --/PW res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.388383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.388397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.388410:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206848 00010000:00010000:1.0:1651529344.388418:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 4/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2057 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.388428:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206912 00010000:00010000:1.0:1651529344.388431:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 4/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2058 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.388437:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10677 00000100:00100000:1.0:1651529344.388439:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41279:x1731746396206848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388443:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388445:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 4/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388449:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 3/0,0 mode: PR/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388458:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bbbd6 lrc: 0/0,0 mode: --/PR res: [0x2b17d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d22 expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388473:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388473:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388474:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388478:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 4/0,1 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388488:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.388499:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41279:x1731746396206848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.388502:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10677 00000100:00100000:1.0:1651529344.388507:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10678 00000100:00100000:1.0:1651529344.388509:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41279:x1731746396206912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388512:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388513:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 4/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388517:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 3/0,0 mode: PR/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388522:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c78dafe/0xa29a79078f3b93c7 lrc: 0/0,0 mode: --/PR res: [0x2b17c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccd1 expref: 2056 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388526:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.388530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.388539:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388540:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388543:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 4/0,1 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.388551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.388556:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.388557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.388564:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41279:x1731746396206912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.388564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.388567:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10678 00000100:00100000:1.0:1651529344.388572:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206976 00010000:00010000:1.0:1651529344.388575:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 4/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2055 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.388582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.388588:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207104 00000100:00100000:0.0:1651529344.388588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.388591:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 4/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388593:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388596:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207232 00010000:00010000:0.0:1651529344.388597:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388598:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 4/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2057 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388601:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,1 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388602:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207040 00010000:00010000:0.0:1651529344.388604:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 2/0,0 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388605:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 4/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.388608:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207168 00010000:00010000:1.0:1651529344.388611:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 4/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2059 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.388624:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207296 00010000:00010000:1.0:1651529344.388626:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 4/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2060 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.388631:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10679 00000100:00100000:1.0:1651529344.388632:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2060:41278:x1731746396206976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388635:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388636:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 4/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2060 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388639:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 3/0,0 mode: PR/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2060 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388651:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bb848 lrc: 0/0,0 mode: --/PR res: [0x2b17f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f4c expref: 2060 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388655:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388655:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388656:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388659:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 4/0,1 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388668:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.388678:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2059:41278:x1731746396206976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.388686:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10679 00000100:00100000:1.0:1651529344.388690:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10680 00000100:00100000:1.0:1651529344.388692:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41278:x1731746396207104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388695:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388696:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 4/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388700:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 3/0,0 mode: PR/PR res: [0x2b180:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388705:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf8eba/0xa29a79078f3b9aa4 lrc: 0/0,0 mode: --/PR res: [0x2b180:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ae expref: 2058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388709:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388709:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388710:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388713:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 4/0,1 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388720:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.388725:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2057:41278:x1731746396207104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.388728:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10680 00000100:00100000:1.0:1651529344.388740:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10681 00000100:00100000:0.0:1651529344.388747:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946325824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1182us (1276us total) trans 30064892579 rc 0/0 00000100:00100000:1.0:1651529344.388748:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41278:x1731746396207232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388751:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.388751:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151716 00010000:00010000:1.0:1651529344.388752:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 4/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388756:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 3/0,0 mode: PR/PR res: [0x2b183:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388761:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bab0c lrc: 0/0,0 mode: --/PR res: [0x2b183:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b3c expref: 2056 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388761:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 2/0,0 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388764:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388765:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388766:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388767:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000904d533f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.388769:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 4/0,1 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388769:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 2/0,0 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388772:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 3/0,0 mode: PW/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388777:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.388784:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41278:x1731746396207232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.388785:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 1/0,0 mode: --/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388786:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10681 00010000:00010000:0.0:1651529344.388788:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd0ba lrc: 0/0,0 mode: --/PW res: [0x2b17d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388795:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388798:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388802:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,1 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388817:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 2/0,0 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388819:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10682 00000100:00100000:1.0:1651529344.388821:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41278:x1731746396207040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.388824:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388826:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 4/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388835:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 3/0,0 mode: PR/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388841:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bbdab lrc: 0/0,0 mode: --/PR res: [0x2b17e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73b2 expref: 2054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388844:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388845:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388846:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388848:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 4/0,1 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388855:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.388859:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946325952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1193us (1357us total) trans 30064892580 rc 0/0 00000100:00100000:1.0:1651529344.388861:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41278:x1731746396207040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.388863:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151718 00000100:00100000:1.0:1651529344.388864:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10682 00000100:00100000:1.0:1651529344.388869:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10683 00000100:00100000:1.0:1651529344.388870:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41278:x1731746396207168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.388870:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 2/0,0 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388873:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.388873:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007adaf254 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.388874:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 4/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388874:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 2/0,0 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388877:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 3/0,0 mode: PW/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388878:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 3/0,0 mode: PR/PR res: [0x2b181:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388882:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 1/0,0 mode: --/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388885:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007adaf254/0xa29a79078f3bd0c8 lrc: 0/0,0 mode: --/PW res: [0x2b17f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388890:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3b9f0b lrc: 0/0,0 mode: --/PR res: [0x2b181:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa43 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.388891:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388894:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388894:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388894:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388897:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 4/0,1 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388897:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388900:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388906:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.388918:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396207168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.388921:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10683 00000100:00100000:1.0:1651529344.388926:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10684 00000100:00100000:1.0:1651529344.388927:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41278:x1731746396207296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.388930:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.388932:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 4/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388935:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 3/0,0 mode: PR/PR res: [0x2b182:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.388947:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017461874/0xa29a79078f3b9a9d lrc: 0/0,0 mode: --/PR res: [0x2b182:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce892 expref: 2050 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.388952:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946326208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1151us (1402us total) trans 30064892581 rc 0/0 00000100:00100000:0.0:1651529344.388955:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151722 00010000:00010000:1.0:1651529344.388957:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388958:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388959:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388962:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 4/0,1 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388962:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388965:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388968:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.388968:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,1 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388971:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 2/0,0 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388974:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746396207296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.388977:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10684 00010000:00010000:1.0:1651529344.388988:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388991:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006cb4b8c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.388992:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388995:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 3/0,0 mode: PW/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389000:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 1/0,0 mode: --/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389002:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd0e4 lrc: 0/0,0 mode: --/PW res: [0x2b183:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389005:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946326080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1279us (1479us total) trans 30064892582 rc 0/0 00000100:00100000:0.0:1651529344.389008:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151720 00010000:00010000:0.0:1651529344.389014:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 2/0,0 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389017:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e45b7cc5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.389018:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389018:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 2/0,0 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389021:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389021:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 3/0,0 mode: PW/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389025:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,1 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389026:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 1/0,0 mode: --/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389027:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 2/0,0 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389029:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e45b7cc5/0xa29a79078f3bd0d6 lrc: 0/0,0 mode: --/PW res: [0x2b181:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389040:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,0 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389043:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e2029 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.389044:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 2/0,0 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389047:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 3/0,0 mode: PW/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389051:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 1/0,0 mode: --/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389054:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd0cf lrc: 0/0,0 mode: --/PW res: [0x2b17e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389082:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1412us (1573us total) trans 30064892583 rc 0/0 00000100:00100000:1.0:1651529344.389086:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151719 00010000:00010000:1.0:1651529344.389094:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389097:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389107:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,1 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389110:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 2/0,0 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389124:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389127:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389131:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,1 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389134:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 2/0,0 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389200:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946326016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1448us (1667us total) trans 30064892584 rc 0/0 00000100:00100000:1.0:1651529344.389204:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151721 00010000:00010000:1.0:1651529344.389211:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 2/0,0 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389215:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083c4f8c3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.389216:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 2/0,0 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389219:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 3/0,0 mode: PW/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389224:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 1/0,0 mode: --/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389224:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1656us (1729us total) trans 30064892585 rc 0/0 00010000:00010000:1.0:1651529344.389227:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd0c1 lrc: 0/0,0 mode: --/PW res: [0x2b17c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389227:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151717 00010000:00010000:1.0:1651529344.389231:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 2/0,0 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389234:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.389235:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 2/0,0 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389240:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 3/0,0 mode: PW/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389243:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 1/0,0 mode: --/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389246:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd0dd lrc: 0/0,0 mode: --/PW res: [0x2b180:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389251:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389254:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389256:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,1 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389268:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 2/0,0 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389280:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 2/0,0 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389284:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.389285:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 2/0,0 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389288:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 3/0,0 mode: PW/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389306:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 1/0,0 mode: --/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389309:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd0eb lrc: 0/0,0 mode: --/PW res: [0x2b182:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389314:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946326144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1490us (1757us total) trans 30064892586 rc 0/0 00000100:00100000:1.0:1651529344.389317:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151723 00000100:00100000:0.0:1651529344.390439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.390455:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327296 00000100:00100000:0.0:1651529344.390457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.390468:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327424 00000100:00100000:0.0:1651529344.390471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.390481:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327552 00000100:00100000:1.0:1651529344.390487:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327680 00000100:00100000:1.0:1651529344.390492:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327360 00000100:00100000:0.0:1651529344.390495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.390498:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151724 00000100:00100000:1.0:1651529344.390500:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946327296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.390506:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176516 count 1 00000100:00100000:0.0:1651529344.390506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.390518:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: --/PW res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390518:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327488 00010000:00010000:1.0:1651529344.390524:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 2/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.390524:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327616 00000100:00100000:0.0:1651529344.390526:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327744 00010000:00010000:1.0:1651529344.390527:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390527:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390528:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 4/0,1 mode: --/PW res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390529:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151725 00000100:00100000:0.0:1651529344.390531:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.390536:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 3/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.390537:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176518 count 1 00010000:00010000:1.0:1651529344.390540:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 4/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.390542:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: --/PW res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390544:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966584640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390559:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390566:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151726 00000100:00100000:1.0:1651529344.390568:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.390568:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 2/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390572:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390572:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.390573:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176520 count 1 00010000:00010000:0.0:1651529344.390573:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 4/0,1 mode: --/PW res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390581:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 3/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390585:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: --/PW res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390585:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 4/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.390590:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 2/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390593:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390593:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390594:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 4/0,1 mode: --/PW res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390598:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966584704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.390601:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 3/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390604:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 4/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.390608:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390609:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966584768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390616:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151727 00000100:00100000:1.0:1651529344.390617:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.390618:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.390623:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176522 count 1 00000100:00100000:1.0:1651529344.390624:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151728 00000100:00100000:1.0:1651529344.390625:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.390627:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: --/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.390631:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176517 count 1 00010000:00010000:0.0:1651529344.390632:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 2/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390635:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: --/PW res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390635:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390635:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390636:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 4/0,1 mode: --/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390639:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 2/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390642:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 3/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390646:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 4/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.390650:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966584832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.390652:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390653:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390653:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 4/0,1 mode: --/PW res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390656:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.390661:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 3/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.390662:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151729 00010000:00010000:1.0:1651529344.390665:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 4/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.390669:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966584896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390671:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.390676:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176519 count 1 00000100:00100000:1.0:1651529344.390677:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.390681:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: --/PW res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390686:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 2/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.390689:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151730 00010000:00010000:0.0:1651529344.390689:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390689:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390690:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 4/0,1 mode: --/PW res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390691:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.390695:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176521 count 1 00010000:00010000:0.0:1651529344.390696:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 3/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390700:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: --/PW res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390700:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 4/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.390704:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966584960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390711:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.390712:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 2/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390715:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390715:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390716:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 4/0,1 mode: --/PW res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390718:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151731 00000100:00100000:0.0:1651529344.390719:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946327744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.390724:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176523 count 1 00010000:00010000:0.0:1651529344.390728:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: --/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390730:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 3/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390744:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 4/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.390748:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966585024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.390751:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 2/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390754:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390755:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390755:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 4/0,1 mode: --/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390757:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.390763:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 3/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2048 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390766:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 4/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.390770:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966585088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390778:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.391133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.391143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.391150:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966584768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.391151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.391159:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: --/PW res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391167:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208384 00010000:00010000:1.0:1651529344.391173:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 5/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391178:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.391180:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208448 00010000:00010000:1.0:1651529344.391183:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 4/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2050 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391186:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966584832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.391187:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208512 00010000:00010000:1.0:1651529344.391190:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 5/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391194:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208576 00010000:00010000:0.0:1651529344.391207:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: --/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391210:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 4/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391216:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10685 00000100:00100000:1.0:1651529344.391218:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41279:x1731746396208384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.391221:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391223:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 5/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391227:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 4/0,0 mode: PR/PR res: [0x2b184:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2052 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391232:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391233:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.391233:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966584704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391234:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391237:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 4/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391242:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.391251:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: --/PW res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391255:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41279:x1731746396208384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391259:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10685 00000100:00100000:1.0:1651529344.391264:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10686 00000100:00100000:1.0:1651529344.391265:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396208448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.391268:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391276:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 4/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391298:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 3/0,0 mode: PR/PR res: [0x2b188:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391314:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bab7c lrc: 0/0,0 mode: --/PR res: [0x2b188:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2caf expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391318:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391318:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391319:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391322:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 4/0,1 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391322:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966584960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.391326:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: --/PW res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391328:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.391333:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966585088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.391339:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746396208448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391342:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10686 00010000:00010000:0.0:1651529344.391342:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: --/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391346:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10687 00000100:00100000:1.0:1651529344.391348:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746396208512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.391351:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391352:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 4/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391365:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 3/0,0 mode: PR/PR res: [0x2b186:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391375:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bbabe lrc: 0/0,0 mode: --/PR res: [0x2b186:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6844 expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391379:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391380:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391381:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391383:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 4/0,1 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391397:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.391397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.391404:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41278:x1731746396208512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.391405:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.391407:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10687 00000100:00100000:1.0:1651529344.391412:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208640 00010000:00010000:1.0:1651529344.391415:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 5/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391420:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208704 00000100:00100000:0.0:1651529344.391425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.391430:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 4/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.391436:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208832 00010000:00010000:0.0:1651529344.391436:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391439:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391443:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,1 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391445:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 4/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.391445:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 2/0,0 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391450:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208768 00010000:00010000:1.0:1651529344.391452:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 5/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391457:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10688 00000100:00100000:1.0:1651529344.391458:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396208576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.391461:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391462:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 4/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391466:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 3/0,0 mode: PR/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391471:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3bafb9 lrc: 0/0,0 mode: --/PR res: [0x2b18a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d87 expref: 2051 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391475:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391475:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391476:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391479:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 4/0,1 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391488:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.391504:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41278:x1731746396208576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391507:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10688 00000100:00100000:1.0:1651529344.391516:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10689 00000100:00100000:1.0:1651529344.391518:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746396208640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.391520:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391522:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 5/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391526:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 4/0,0 mode: PR/PR res: [0x2b185:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2049 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391527:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946327424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 995us (1077us total) trans 30064892587 rc 0/0 00010000:00010000:1.0:1651529344.391531:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391531:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.391531:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151725 00010000:00010000:1.0:1651529344.391532:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391535:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 4/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391539:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.391539:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 2/0,0 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391542:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007de4133e already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.391544:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746396208640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.391544:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 2/0,0 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391546:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10689 00010000:00010000:0.0:1651529344.391547:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 3/0,0 mode: PW/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391550:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10690 00000100:00100000:1.0:1651529344.391551:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746396208704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.391552:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 1/0,0 mode: --/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391554:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.391555:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd0f9 lrc: 0/0,0 mode: --/PW res: [0x2b186:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391561:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 4/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.391561:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391564:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391565:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 3/0,0 mode: PR/PR res: [0x2b187:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.391567:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,1 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391570:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bb768 lrc: 0/0,0 mode: --/PR res: [0x2b187:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b9b expref: 2048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391573:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391574:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391575:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391578:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 4/0,1 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391579:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 2/0,0 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391586:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.391598:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746396208704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391600:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10690 00000100:00100000:1.0:1651529344.391605:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10691 00000100:00100000:1.0:1651529344.391606:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746396208832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.391609:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391610:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 4/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2046 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391623:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 3/0,0 mode: PR/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391628:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946327680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1009us (1162us total) trans 30064892588 rc 0/0 00010000:00010000:1.0:1651529344.391629:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2cf92ef/0xa29a79078f3bb0d8 lrc: 0/0,0 mode: --/PR res: [0x2b18b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d420a expref: 2046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.391631:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151727 00010000:00010000:1.0:1651529344.391632:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391633:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391634:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391636:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 4/0,1 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391638:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391642:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391644:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.391650:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746396208832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (225us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.391652:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,1 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391653:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10691 00010000:00010000:0.0:1651529344.391655:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 2/0,0 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391657:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10692 00000100:00100000:1.0:1651529344.391659:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746396208768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.391661:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391663:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 5/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2044 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391666:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 4/0,0 mode: PR/PR res: [0x2b189:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2044 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.391677:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391678:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391679:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391682:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 4/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391686:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.391691:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746396208768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391693:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10692 00000100:00100000:0.0:1651529344.391700:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946327488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1028us (1209us total) trans 30064892589 rc 0/0 00010000:00010000:1.0:1651529344.391701:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 2/0,0 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391703:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151729 00010000:00010000:1.0:1651529344.391704:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d446ab0c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.391705:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 2/0,0 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391708:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 3/0,0 mode: PW/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391710:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 2/0,0 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391712:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 1/0,0 mode: --/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391713:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619e83ce already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.391715:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd107 lrc: 0/0,0 mode: --/PW res: [0x2b18a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391715:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 2/0,0 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391725:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 3/0,0 mode: PW/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391739:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 1/0,0 mode: --/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391740:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391742:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd115 lrc: 0/0,0 mode: --/PW res: [0x2b187:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391744:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391747:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,1 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391749:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 2/0,0 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391749:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391752:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391761:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,1 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391764:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 2/0,0 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391824:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946327552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1255us (1366us total) trans 30064892590 rc 0/0 00000100:00100000:0.0:1651529344.391825:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946327744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1105us (1313us total) trans 30064892591 rc 0/0 00000100:00100000:1.0:1651529344.391827:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151726 00000100:00100000:0.0:1651529344.391829:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151731 00010000:00010000:1.0:1651529344.391835:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 2/0,0 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391837:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 2/0,0 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391838:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d288cb7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.391839:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 2/0,0 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391842:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 3/0,0 mode: PW/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391847:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 1/0,0 mode: --/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391850:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000731b1078 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.391851:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 2/0,0 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391854:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 3/0,0 mode: PW/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391857:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd100 lrc: 0/0,0 mode: --/PW res: [0x2b188:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391859:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 1/0,0 mode: --/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391861:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd123 lrc: 0/0,0 mode: --/PW res: [0x2b18b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391868:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3ba062 lrc: 0/0,0 mode: --/PR res: [0x2b185:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff6e expref: 2043 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391871:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966584896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391875:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391878:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391881:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391884:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,1 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391886:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 2/0,0 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391923:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 2/0,0 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391927:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2b66d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.391928:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 2/0,0 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391931:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 3/0,0 mode: PW/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391935:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 1/0,0 mode: --/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391941:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd10e lrc: 0/0,0 mode: --/PW res: [0x2b185:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391974:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bb099 lrc: 0/0,0 mode: --/PR res: [0x2b184:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4138 expref: 2042 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.391978:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946327360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1352us (1506us total) trans 30064892592 rc 0/0 00000100:00100000:1.0:1651529344.391981:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151728 00000100:00100000:0.0:1651529344.391994:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966584640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.391999:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392000:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ccf7f96/0xa29a79078f3bb110 lrc: 0/0,0 mode: --/PR res: [0x2b189:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ce expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.392002:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392004:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966585024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392005:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392008:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392008:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392010:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 2/0,0 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392012:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392014:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392023:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,1 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392027:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 2/0,0 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392062:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946327296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1561us (1623us total) trans 30064892593 rc 0/0 00000100:00100000:0.0:1651529344.392065:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151724 00000100:00100000:1.0:1651529344.392070:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946327616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1378us (1563us total) trans 30064892594 rc 0/0 00000100:00100000:1.0:1651529344.392073:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151730 00010000:00010000:0.0:1651529344.392073:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 2/0,0 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392076:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.392077:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 2/0,0 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392080:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 3/0,0 mode: PW/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392081:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 2/0,0 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392085:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000637c9f02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.392085:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 1/0,0 mode: --/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392086:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 2/0,0 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392088:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd0f2 lrc: 0/0,0 mode: --/PW res: [0x2b184:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392096:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 3/0,0 mode: PW/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392102:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 1/0,0 mode: --/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392104:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd11c lrc: 0/0,0 mode: --/PW res: [0x2b189:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.392195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.392207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.392213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.392222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.392230:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328320 00000100:00100000:0.0:1651529344.392231:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328448 00000100:00100000:1.0:1651529344.392240:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328576 00000100:00100000:1.0:1651529344.392247:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328512 00000100:00100000:0.0:1651529344.392249:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328384 00000100:00100000:1.0:1651529344.392252:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151732 00000100:00100000:1.0:1651529344.392253:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946328320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.392259:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151733 00000100:00100000:0.0:1651529344.392261:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946328448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.392264:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176524 count 1 00002000:00080000:0.0:1651529344.392267:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176526 count 1 00010000:00010000:1.0:1651529344.392269:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: --/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392272:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: --/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392275:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 2/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2040 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392277:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 2/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.392278:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392280:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392281:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392282:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 4/0,1 mode: --/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392286:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392287:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 4/0,1 mode: --/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392288:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 3/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392293:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 4/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.392295:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 3/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2040 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.392297:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966585152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.392299:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 4/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2040 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.392304:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966585216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.392309:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.392313:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.392315:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151734 00000100:00100000:0.0:1651529344.392317:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946328576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.392320:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151735 00002000:00080000:0.0:1651529344.392321:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176528 count 1 00000100:00100000:1.0:1651529344.392322:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946328512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.392327:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176527 count 1 00010000:00010000:1.0:1651529344.392331:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: --/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392346:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 2/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.392350:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392350:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392351:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 4/0,1 mode: --/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392353:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: --/PW res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392359:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 2/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392362:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392363:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392363:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 4/0,1 mode: --/PW res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392366:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 3/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392371:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 3/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392377:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 4/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.392379:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 4/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.392381:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966585344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.392383:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966585280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.392389:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.392391:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.392396:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151736 00000100:00100000:0.0:1651529344.392398:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946328384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.392403:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176525 count 1 00010000:00010000:0.0:1651529344.392407:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: --/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392408:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.392411:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 2/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392414:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392414:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392415:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 4/0,1 mode: --/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392421:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 3/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392424:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 4/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.392431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.392440:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966585408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.392443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.392448:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.392454:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328704 00000100:00100000:0.0:1651529344.392460:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328640 00000100:00100000:0.0:1651529344.392462:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328768 00000100:00100000:0.0:1651529344.392465:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151737 00000100:00100000:0.0:1651529344.392467:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016c8fffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946328704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.392471:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176530 count 1 00010000:00010000:0.0:1651529344.392476:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: --/PW res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392480:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 2/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2040 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392483:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392484:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392484:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 4/0,1 mode: --/PW res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392490:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 3/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2040 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.392492:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151738 00000100:00100000:1.0:1651529344.392494:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946328640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.392494:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 4/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2040 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.392497:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966585472:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.392500:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176529 count 1 00010000:00010000:1.0:1651529344.392505:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: --/PW res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392517:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.392522:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 2/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.392524:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151739 00010000:00010000:1.0:1651529344.392526:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392526:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.392526:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946328768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.392527:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 4/0,1 mode: --/PW res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.392531:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176531 count 1 00010000:00010000:1.0:1651529344.392535:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 3/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392535:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: --/PW res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392538:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 4/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.392546:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 2/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.392548:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966585536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392550:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392550:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392551:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 4/0,1 mode: --/PW res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392557:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.392558:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 3/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2040 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392561:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 4/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2040 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.392565:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966585600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.392573:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.392680:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966585152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392685:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: --/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.392798:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209408 00010000:00010000:0.0:1651529344.392829:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 4/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.392845:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10693 00000100:00100000:0.0:1651529344.392847:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41278:x1731746396209408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.392862:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.392865:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 4/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.392867:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966585216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392869:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 3/0,0 mode: PR/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.392871:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: --/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392879:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966585280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.392882:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: --/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392885:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3ba134 lrc: 0/0,0 mode: --/PR res: [0x2b18e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02b6 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.392889:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392890:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392891:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392902:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 4/0,1 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392909:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.392933:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41278:x1731746396209408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.392943:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10693 00000100:00100000:0.0:1651529344.392965:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966585344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392970:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: --/PW res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392982:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966585408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392989:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: --/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393003:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966585472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.393004:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966585536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393006:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: --/PW res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393008:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: --/PW res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393012:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393014:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393017:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,1 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393020:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 2/0,0 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393074:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946328448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 811us (878us total) trans 30064892595 rc 0/0 00000100:00100000:0.0:1651529344.393077:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151733 00010000:00010000:0.0:1651529344.393126:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 2/0,0 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393130:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000904d533f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393131:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 2/0,0 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393134:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 3/0,0 mode: PW/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393145:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 1/0,0 mode: --/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393148:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000904d533f/0xa29a79078f3bd131 lrc: 0/0,0 mode: --/PW res: [0x2b18e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393152:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.393157:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209472 00000100:00100000:1.0:1651529344.393158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393162:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 4/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2040 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.393164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.393168:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209600 00000100:00100000:1.0:1651529344.393169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393170:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 4/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.393175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.393177:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209728 00010000:00010000:0.0:1651529344.393179:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 4/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2042 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.393181:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209856 00000100:00100000:0.0:1651529344.393183:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209536 00010000:00010000:0.0:1651529344.393186:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 4/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2044 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393187:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 4/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2044 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.393190:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209664 00010000:00010000:0.0:1651529344.393192:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 4/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2045 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.393196:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209792 00010000:00010000:0.0:1651529344.393198:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 5/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.393202:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10694 00000100:00100000:1.0:1651529344.393204:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746396209472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.393204:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10695 00000100:00100000:0.0:1651529344.393206:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746396209600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.393208:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393209:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 4/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2046 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393213:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 3/0,0 mode: PR/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2046 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393219:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c971133/0xa29a79078f3b9843 lrc: 0/0,0 mode: --/PR res: [0x2b18c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf5b expref: 2046 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393223:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393228:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393229:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393230:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393230:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 4/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393234:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 4/0,1 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393234:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 3/0,0 mode: PR/PR res: [0x2b190:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393240:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.393240:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3ba524 lrc: 0/0,0 mode: --/PR res: [0x2b190:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1380 expref: 2045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.393244:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393245:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393246:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393248:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746396209472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.393249:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 4/0,1 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393251:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10694 00000100:00100000:1.0:1651529344.393256:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10696 00010000:00010000:0.0:1651529344.393256:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.393263:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396209600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.393265:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396209728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.393266:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10695 00010000:00010000:1.0:1651529344.393268:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393270:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 4/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2042 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393274:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 3/0,0 mode: PR/PR res: [0x2b192:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2042 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.393276:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10697 00000100:00100000:0.0:1651529344.393278:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746396209536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.393279:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7d6281/0xa29a79078f3b985f lrc: 0/0,0 mode: --/PR res: [0x2b192:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf9a expref: 2042 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.393281:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393282:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393282:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 4/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393283:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393284:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393286:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 3/0,0 mode: PR/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393287:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 4/0,1 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393291:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df35e8a/0xa29a79078f3bbffe lrc: 0/0,0 mode: --/PR res: [0x2b18f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cb1 expref: 2041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393295:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.393302:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41279:x1731746396209728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.393303:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393303:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.393304:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10696 00010000:00010000:0.0:1651529344.393304:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393307:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 4/0,1 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393309:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10698 00000100:00100000:1.0:1651529344.393311:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396209664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.393313:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.393316:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.393321:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 4/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2039 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.393322:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396209536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.393325:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10697 00000100:00100000:0.0:1651529344.393330:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10699 00010000:00010000:1.0:1651529344.393332:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 3/0,0 mode: PR/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2038 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.393332:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41279:x1731746396209856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.393334:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.393336:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 4/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393337:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bc04b lrc: 0/0,0 mode: --/PR res: [0x2b18d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e0f expref: 2038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.393339:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 3/0,0 mode: PR/PR res: [0x2b191:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393341:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393341:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393342:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393345:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 4/0,1 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393345:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6b24db/0xa29a79078f3ba1ff lrc: 0/0,0 mode: --/PR res: [0x2b191:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0595 expref: 2037 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.393348:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393349:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393350:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393353:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.393360:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396209664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.393362:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 4/0,1 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393363:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10698 00000100:00100000:1.0:1651529344.393368:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10700 00010000:00010000:0.0:1651529344.393370:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.393376:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396209792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.393376:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396209856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.393379:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.393379:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10699 00010000:00010000:1.0:1651529344.393380:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 5/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393384:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 4/0,0 mode: PR/PR res: [0x2b193:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.393385:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393389:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393392:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,1 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393395:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 2/0,0 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393396:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393397:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393398:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393401:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 4/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393405:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.393411:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41279:x1731746396209792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.393414:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10700 00010000:00010000:1.0:1651529344.393422:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393425:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393428:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,1 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393431:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 2/0,0 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393443:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946328576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1124us (1235us total) trans 30064892596 rc 0/0 00000100:00100000:0.0:1651529344.393446:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151734 00010000:00010000:0.0:1651529344.393453:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 2/0,0 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393457:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010c4825a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393458:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 2/0,0 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393461:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 3/0,0 mode: PW/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393466:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 1/0,0 mode: --/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393468:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd13f lrc: 0/0,0 mode: --/PW res: [0x2b190:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393473:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 2/0,0 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393475:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946328640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1044us total) trans 30064892597 rc 0/0 00010000:00010000:0.0:1651529344.393476:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bcb3d00 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393476:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 2/0,0 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393478:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151738 00010000:00010000:0.0:1651529344.393479:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 3/0,0 mode: PW/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393482:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 1/0,0 mode: --/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393485:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd154 lrc: 0/0,0 mode: --/PW res: [0x2b191:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393492:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393494:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393495:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393498:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393498:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,1 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393501:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,1 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393501:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 2/0,0 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393504:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 2/0,0 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393544:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946328320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1290us (1358us total) trans 30064892598 rc 0/0 00000100:00100000:1.0:1651529344.393547:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151732 00000100:00100000:0.0:1651529344.393548:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946328384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1149us (1334us total) trans 30064892599 rc 0/0 00000100:00100000:0.0:1651529344.393551:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151736 00010000:00010000:1.0:1651529344.393554:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393558:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393558:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 2/0,0 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393561:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,1 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393561:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fab6f5e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393562:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 2/0,0 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393563:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 2/0,0 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393565:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 3/0,0 mode: PW/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393570:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 1/0,0 mode: --/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393573:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd146 lrc: 0/0,0 mode: --/PW res: [0x2b18d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393577:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 2/0,0 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393580:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059eb6c0f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393581:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 2/0,0 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393584:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 3/0,0 mode: PW/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393587:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 1/0,0 mode: --/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393589:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd12a lrc: 0/0,0 mode: --/PW res: [0x2b18c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393593:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 2/0,0 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393595:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090ee5191 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393596:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 2/0,0 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393598:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946328512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1375us total) trans 30064892600 rc 0/0 00000100:00100000:1.0:1651529344.393609:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151735 00010000:00010000:0.0:1651529344.393611:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 3/0,0 mode: PW/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393615:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 1/0,0 mode: --/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393617:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd138 lrc: 0/0,0 mode: --/PW res: [0x2b18f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393624:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.393627:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393629:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,1 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393632:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 2/0,0 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393674:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016c8fffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946328704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1206us (1266us total) trans 30064892601 rc 0/0 00000100:00100000:0.0:1651529344.393677:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151737 00000100:00100000:0.0:1651529344.393701:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329344 00000100:00100000:0.0:1651529344.393708:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151740 00000100:00100000:0.0:1651529344.393718:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946329344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.393723:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176532 count 1 00010000:00010000:0.0:1651529344.393728:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: --/PW res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393757:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 2/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393761:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393761:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 4/0,1 mode: --/PW res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393769:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 3/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393773:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 2/0,0 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393773:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 4/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.393777:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6a4fca7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.393778:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 2/0,0 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393778:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966585664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.393781:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 3/0,0 mode: PW/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393786:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 1/0,0 mode: --/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393789:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a4fca7/0xa29a79078f3bd14d lrc: 0/0,0 mode: --/PW res: [0x2b192:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393837:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.393840:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bb4f9 lrc: 0/0,0 mode: --/PR res: [0x2b193:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5295 expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.393845:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966585600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.393849:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393852:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393863:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393866:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,1 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393869:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 2/0,0 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393880:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 2/0,0 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393896:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0f70fec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.393897:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 2/0,0 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393914:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946328768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1387us (1470us total) trans 30064892602 rc 0/0 00000100:00100000:1.0:1651529344.393917:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151739 00010000:00010000:0.0:1651529344.393917:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 3/0,0 mode: PW/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393922:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 1/0,0 mode: --/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393925:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f70fec/0xa29a79078f3bd15b lrc: 0/0,0 mode: --/PW res: [0x2b193:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393953:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.393985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.393996:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329472 00000100:00100000:0.0:1651529344.394007:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329408 00000100:00100000:0.0:1651529344.394026:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151741 00000100:00100000:0.0:1651529344.394028:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946329472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.394029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.394033:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176534 count 1 00000100:00100000:1.0:1651529344.394036:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.394038:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: --/PW res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394049:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 2/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394052:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.394053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.394053:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394054:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 4/0,1 mode: --/PW res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.394065:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 3/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.394071:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329536 00000100:00100000:1.0:1651529344.394078:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329664 00010000:00010000:0.0:1651529344.394079:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 4/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394081:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329600 00000100:00100000:1.0:1651529344.394083:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329728 00000100:00100000:0.0:1651529344.394083:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966585728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.394086:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151742 00000100:00100000:1.0:1651529344.394088:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946329408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.394094:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176533 count 1 00010000:00010000:1.0:1651529344.394099:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: --/PW res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394112:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.394115:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 2/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394118:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394119:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.394119:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151743 00010000:00010000:1.0:1651529344.394120:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 4/0,1 mode: --/PW res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394121:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946329536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.394126:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176535 count 1 00010000:00010000:1.0:1651529344.394128:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 3/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394130:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: --/PW res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394131:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 4/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394135:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966585792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394142:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 2/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.394145:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.394152:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151744 00000100:00100000:1.0:1651529344.394154:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946329664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.394157:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394158:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.394159:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176537 count 1 00010000:00010000:0.0:1651529344.394159:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 4/0,1 mode: --/PW res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394167:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 3/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394171:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: --/PW res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394171:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 4/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.394178:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966585856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394180:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 2/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394183:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394188:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394189:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 4/0,1 mode: --/PW res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394196:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 3/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394200:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 4/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394204:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966585920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.394210:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.394218:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151745 00000100:00100000:1.0:1651529344.394220:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.394220:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946329600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.394225:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176536 count 1 00000100:00100000:1.0:1651529344.394227:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151746 00000100:00100000:1.0:1651529344.394229:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946329728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.394229:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: --/PW res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.394234:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176538 count 1 00010000:00010000:0.0:1651529344.394241:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 2/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394244:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394245:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: --/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394245:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394246:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 4/0,1 mode: --/PW res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394250:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 2/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394253:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394253:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 3/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394254:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394255:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 4/0,1 mode: --/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394256:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 4/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.394260:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966585984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394261:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 3/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2032 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.394268:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.394273:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 4/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394277:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966586048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.394284:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.394310:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966585664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394314:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: --/PW res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.394336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.394409:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210432 00010000:00010000:1.0:1651529344.394415:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 4/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394424:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10701 00000100:00100000:1.0:1651529344.394426:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41279:x1731746396210432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.394429:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.394430:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 4/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394434:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 3/0,0 mode: PR/PR res: [0x2b194:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394440:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003081aa22/0xa29a79078f3bb2c9 lrc: 0/0,0 mode: --/PR res: [0x2b194:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49dc expref: 2033 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394443:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394444:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394445:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394448:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 4/0,1 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394458:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.394461:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394465:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394467:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396210432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.394468:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,1 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394470:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10701 00010000:00010000:0.0:1651529344.394471:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 2/0,0 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394477:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329984 00000100:00100000:1.0:1651529344.394483:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151747 00000100:00100000:1.0:1651529344.394484:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946329984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.394489:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176539 count 1 00010000:00010000:1.0:1651529344.394493:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: --/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394498:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 2/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2031 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394501:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394501:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394502:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 4/0,1 mode: --/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394508:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 3/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2031 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.394513:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946329344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 795us (886us total) trans 30064892603 rc 0/0 00010000:00010000:1.0:1651529344.394515:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 4/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2031 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.394517:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151740 00000100:00100000:1.0:1651529344.394519:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966586112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394524:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 2/0,0 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394526:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.394528:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000098da288c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.394529:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 2/0,0 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394532:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 3/0,0 mode: PW/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394539:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 1/0,0 mode: --/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394542:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098da288c/0xa29a79078f3bd162 lrc: 0/0,0 mode: --/PW res: [0x2b194:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.394682:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330304 00000100:00100000:1.0:1651529344.394689:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151748 00000100:00100000:1.0:1651529344.394691:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946330304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.394702:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176540 count 1 00010000:00010000:1.0:1651529344.394706:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: --/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394719:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 2/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2031 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394722:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394723:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394724:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 4/0,1 mode: --/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394738:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 3/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2031 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394742:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 4/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2031 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394749:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966586176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.394761:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.394800:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966585728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394848:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: --/PW res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.394863:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966585856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.394877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.394879:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: --/PW res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394888:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966585984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394890:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: --/PW res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.394917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.394927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.394927:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210496 00010000:00010000:0.0:1651529344.394932:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 4/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394938:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210624 00000100:00100000:0.0:1651529344.394938:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210560 00010000:00010000:0.0:1651529344.394940:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 4/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394944:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 5/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2034 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.394947:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210688 00010000:00010000:0.0:1651529344.394949:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 4/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2035 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.394950:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210752 00010000:00010000:1.0:1651529344.394953:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 5/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.394954:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10702 00000100:00100000:0.0:1651529344.394956:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396210496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.394958:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10703 00000100:00100000:1.0:1651529344.394959:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41278:x1731746396210560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.394959:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.394960:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 4/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394962:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.394964:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 4/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.394964:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 3/0,0 mode: PR/PR res: [0x2b196:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.394968:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 3/0,0 mode: PR/PR res: [0x2b197:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.394970:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e34c333/0xa29a79078f3bb451 lrc: 0/0,0 mode: --/PR res: [0x2b196:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5065 expref: 2036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.394973:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394974:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000388f4249/0xa29a79078f3ba6f2 lrc: 0/0,0 mode: --/PR res: [0x2b197:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b36 expref: 2035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.394974:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394975:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394978:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 4/0,1 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394985:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394985:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.394986:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394987:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394990:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 4/0,1 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394999:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41279:x1731746396210496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.395006:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395007:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10702 00000100:00100000:1.0:1651529344.395014:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41278:x1731746396210560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.395017:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10703 00000100:00100000:0.0:1651529344.395018:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10704 00000100:00100000:0.0:1651529344.395020:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396210624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.395023:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10705 00010000:00010000:0.0:1651529344.395023:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.395024:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396210688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.395025:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 5/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.395027:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395028:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 4/0,0 mode: PR/PR res: [0x2b199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.395029:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 4/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.395033:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 3/0,0 mode: PR/PR res: [0x2b198:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395034:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395034:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395035:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395038:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3b9be6 lrc: 0/0,0 mode: --/PR res: [0x2b198:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced70 expref: 2032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395038:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 4/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395041:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395042:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395048:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396210624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.395049:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395050:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395051:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10704 00010000:00010000:1.0:1651529344.395053:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 4/0,1 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395055:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10706 00000100:00100000:0.0:1651529344.395057:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41278:x1731746396210752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.395059:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.395061:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.395068:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746396210688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.395068:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 5/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2030 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.395071:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10705 00010000:00010000:0.0:1651529344.395072:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 4/0,0 mode: PR/PR res: [0x2b195:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2030 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395077:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395077:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395078:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395081:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 4/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395083:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bc24a lrc: 0/0,0 mode: --/PR res: [0x2b199:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8666 expref: 2029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395085:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.395087:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966585920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.395091:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395091:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396210752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395093:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10706 00010000:00010000:1.0:1651529344.395094:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395097:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395100:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,1 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395100:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395102:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 2/0,0 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395103:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395106:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,1 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395122:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 2/0,0 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395153:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946329664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 998us (1117us total) trans 30064892604 rc 0/0 00000100:00100000:1.0:1651529344.395156:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151744 00010000:00010000:1.0:1651529344.395164:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 2/0,0 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395167:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000013f54743 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.395167:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946329536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1045us (1138us total) trans 30064892605 rc 0/0 00010000:00010000:1.0:1651529344.395168:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 2/0,0 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395170:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151743 00010000:00010000:1.0:1651529344.395171:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 3/0,0 mode: PW/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395176:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 1/0,0 mode: --/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395178:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 2/0,0 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395179:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd17e lrc: 0/0,0 mode: --/PW res: [0x2b199:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395181:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.395183:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 2/0,0 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395186:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 3/0,0 mode: PW/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395190:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 1/0,0 mode: --/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395197:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e19e65d1/0xa29a79078f3ba865 lrc: 0/0,0 mode: --/PR res: [0x2b195:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2102 expref: 2027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.395201:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966585792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.395204:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395208:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd177 lrc: 0/0,0 mode: --/PW res: [0x2b197:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395215:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395218:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395221:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,1 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395224:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 2/0,0 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395225:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395228:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395237:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,1 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395240:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 2/0,0 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395273:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946329408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1184us (1287us total) trans 30064892606 rc 0/0 00000100:00100000:1.0:1651529344.395276:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151742 00000100:00100000:0.0:1651529344.395282:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946329472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1254us (1329us total) trans 30064892607 rc 0/0 00010000:00010000:1.0:1651529344.395283:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 2/0,0 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395285:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151741 00010000:00010000:1.0:1651529344.395287:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006cb4b8c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.395288:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 2/0,0 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395290:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 3/0,0 mode: PW/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395292:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 2/0,0 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395295:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 1/0,0 mode: --/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395296:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087cb9f01 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.395297:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 2/0,0 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395300:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 3/0,0 mode: PW/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395304:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 1/0,0 mode: --/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395306:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd170 lrc: 0/0,0 mode: --/PW res: [0x2b195:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395307:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cb9f01/0xa29a79078f3bd169 lrc: 0/0,0 mode: --/PW res: [0x2b196:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395313:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395317:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966586048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.395320:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: --/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395330:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395341:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,1 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395344:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 2/0,0 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.395381:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946329600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1161us (1328us total) trans 30064892608 rc 0/0 00000100:00100000:0.0:1651529344.395384:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151745 00000100:00100000:1.0:1651529344.395389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.395391:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 2/0,0 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395401:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.395402:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 2/0,0 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395405:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 3/0,0 mode: PW/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395406:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.395410:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 1/0,0 mode: --/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395413:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd185 lrc: 0/0,0 mode: --/PW res: [0x2b198:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395421:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210880 00010000:00010000:0.0:1651529344.395426:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 4/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395436:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211392 00010000:00010000:0.0:1651529344.395439:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 5/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2028 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395444:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211456 00010000:00010000:0.0:1651529344.395446:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 5/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2029 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395450:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10707 00000100:00100000:0.0:1651529344.395452:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746396210880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.395455:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395456:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 4/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395459:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 3/0,0 mode: PR/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395465:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3b9b92 lrc: 0/0,0 mode: --/PR res: [0x2b19a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebda expref: 2029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395468:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395470:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395475:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 4/0,1 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395483:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.395501:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10708 00000100:00100000:1.0:1651529344.395503:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746396211392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.395507:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.395509:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 5/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2028 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395510:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746396210880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.395513:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 4/0,0 mode: PR/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2028 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395513:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10707 00000100:00100000:0.0:1651529344.395518:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10709 00010000:00010000:1.0:1651529344.395519:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395520:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395520:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395520:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396211456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.395523:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 4/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395523:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395524:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 5/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395528:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 4/0,0 mode: PR/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.395534:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395534:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395535:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395537:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.395538:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 4/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395542:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.395545:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746396211392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.395547:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10708 00000100:00100000:0.0:1651529344.395548:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396211456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.395556:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395560:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395560:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10709 00010000:00010000:1.0:1651529344.395562:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,1 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395565:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 2/0,0 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395604:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946329728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1374us (1540us total) trans 30064892609 rc 0/0 00000100:00100000:1.0:1651529344.395607:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151746 00010000:00010000:1.0:1651529344.395614:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 2/0,0 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395617:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001eca5fc5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.395618:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 2/0,0 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395631:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 3/0,0 mode: PW/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395637:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 1/0,0 mode: --/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395640:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd18c lrc: 0/0,0 mode: --/PW res: [0x2b19a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395652:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb1d62ba/0xa29a79078f3ba88f lrc: 0/0,0 mode: --/PR res: [0x2b19b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21b1 expref: 2025 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.395655:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966586112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.395659:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395662:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395665:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395667:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,1 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395670:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 2/0,0 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395688:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 2/0,0 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395692:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc2c5b68 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.395693:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 2/0,0 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395696:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 3/0,0 mode: PW/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395701:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 1/0,0 mode: --/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395704:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd193 lrc: 0/0,0 mode: --/PW res: [0x2b19b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395716:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946329984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1231us (1401us total) trans 30064892610 rc 0/0 00000100:00100000:1.0:1651529344.395719:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151747 00000100:00100000:1.0:1651529344.395762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.395777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.395787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.395798:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330432 00000100:00100000:1.0:1651529344.395801:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.395820:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330496 00000100:00100000:0.0:1651529344.395824:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330560 00000100:00100000:0.0:1651529344.395831:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330688 00000100:00100000:0.0:1651529344.395838:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151749 00000100:00100000:0.0:1651529344.395839:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946330432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.395845:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176541 count 1 00010000:00010000:0.0:1651529344.395849:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: --/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395854:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 2/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.395861:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.395864:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395865:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395866:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 4/0,1 mode: --/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395873:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 3/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.395877:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 4/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395881:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966586240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.395891:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330624 00000100:00100000:0.0:1651529344.395895:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.395907:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151750 00000100:00100000:1.0:1651529344.395909:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946330496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.395912:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151751 00000100:00100000:0.0:1651529344.395914:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946330560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.395915:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176542 count 1 00002000:00080000:0.0:1651529344.395919:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176543 count 1 00010000:00010000:0.0:1651529344.395924:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: --/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395927:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: --/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395928:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 2/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.395931:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395932:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395932:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 4/0,1 mode: --/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395936:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 2/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.395939:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395940:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395941:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 4/0,1 mode: --/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395948:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 3/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.395950:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 3/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.395954:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 4/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.395958:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966586368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.395959:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 4/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.395964:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966586304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.395965:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.395972:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151752 00000100:00100000:1.0:1651529344.395974:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.395974:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946330688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.395978:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176545 count 1 00000100:00100000:1.0:1651529344.395981:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151753 00010000:00010000:0.0:1651529344.395982:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395983:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946330624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.395988:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176544 count 1 00010000:00010000:1.0:1651529344.395992:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: --/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395993:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 2/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.395996:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 2/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.395997:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395997:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395998:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 4/0,1 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395999:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396000:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396000:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 4/0,1 mode: --/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396004:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 3/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396006:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 3/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396008:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 4/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396010:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.396017:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966586432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396024:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966586496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.396025:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.396032:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.396054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.396064:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330944 00000100:00100000:1.0:1651529344.396069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.396081:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331008 00000100:00100000:0.0:1651529344.396088:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151754 00000100:00100000:0.0:1651529344.396090:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946330944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.396095:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176546 count 1 00010000:00010000:0.0:1651529344.396100:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: --/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396104:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 2/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396107:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396108:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396108:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 4/0,1 mode: --/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396115:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 3/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396118:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 4/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.396122:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966586560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396132:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151755 00000100:00100000:1.0:1651529344.396134:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946331008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.396140:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176547 count 1 00000100:00100000:0.0:1651529344.396144:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.396150:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: --/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396162:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 2/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396165:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396166:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396167:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 4/0,1 mode: --/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396174:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 3/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2024 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396177:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 4/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.396181:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966586624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396195:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.396238:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3de2a93/0xa29a79078f3bafa4 lrc: 0/0,0 mode: --/PR res: [0x2b19c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d41 expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.396243:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966586176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396247:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396250:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396253:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396256:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,1 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396258:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 2/0,0 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396270:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 2/0,0 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396274:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000390b31df already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.396275:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 2/0,0 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396278:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 3/0,0 mode: PW/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396283:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 1/0,0 mode: --/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396286:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000390b31df/0xa29a79078f3bd19a lrc: 0/0,0 mode: --/PW res: [0x2b19c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396304:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946330304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1612us (1629us total) trans 30064892611 rc 0/0 00000100:00100000:1.0:1651529344.396307:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151748 00000100:00100000:1.0:1651529344.396483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.396490:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331392 00000100:00100000:1.0:1651529344.396497:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151756 00000100:00100000:1.0:1651529344.396499:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946331392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.396513:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176548 count 1 00010000:00010000:1.0:1651529344.396518:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: --/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396524:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 2/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396527:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396527:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396528:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 4/0,1 mode: --/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396535:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 3/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2023 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396539:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 4/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2023 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.396543:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966586688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396554:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.396633:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966586240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.396638:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: --/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.396649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.396651:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966586368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.396654:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: --/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396670:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966586432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.396681:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396689:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966586560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.396692:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211584 00010000:00010000:0.0:1651529344.396692:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: --/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396698:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 4/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.396698:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211520 00010000:00010000:0.0:1651529344.396703:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 4/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2025 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.396706:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211648 00000100:00100000:0.0:1651529344.396709:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10710 00000100:00100000:0.0:1651529344.396711:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41278:x1731746396211584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.396714:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.396716:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 4/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396717:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 5/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.396723:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10711 00000100:00100000:1.0:1651529344.396725:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41279:x1731746396211520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.396728:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.396739:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 4/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.396748:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 3/0,0 mode: PR/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396749:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 3/0,0 mode: PR/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396755:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3b9dec lrc: 0/0,0 mode: --/PR res: [0x2b19d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5d5 expref: 2026 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396759:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396760:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396760:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396760:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009416f2f6/0xa29a79078f3bb5af lrc: 0/0,0 mode: --/PR res: [0x2b19f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d557b expref: 2025 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396764:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 4/0,1 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396765:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396765:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396766:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396773:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.396781:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396211520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.396783:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10711 00000100:00100000:1.0:1651529344.396788:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10712 00010000:00010000:0.0:1651529344.396792:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 4/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396797:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41279:x1731746396211648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.396799:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.396800:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.396801:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 5/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.396823:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 4/0,0 mode: PR/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.396826:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41278:x1731746396211584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 113us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.396829:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.396829:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10710 00010000:00010000:1.0:1651529344.396830:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396831:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396834:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 4/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396837:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396838:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.396840:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396843:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396845:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41279:x1731746396211648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.396846:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396847:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10712 00010000:00010000:1.0:1651529344.396863:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396867:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008de0df4c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.396868:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396871:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 3/0,0 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396883:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 1/0,0 mode: --/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396885:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd1a8 lrc: 0/0,0 mode: --/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396897:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966586496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.396900:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:39029:x1731745946330560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 985us (1112us total) trans 30064892612 rc 0/0 00010000:00010000:1.0:1651529344.396901:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: --/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396903:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151751 00010000:00010000:1.0:1651529344.396908:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bba7f lrc: 0/0,0 mode: --/PR res: [0x2b19e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67aa expref: 2021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.396910:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396912:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966586304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396914:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396914:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396917:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396920:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396922:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396924:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,1 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396927:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 2/0,0 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.396934:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 2/0,0 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396971:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946330432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1131us (1209us total) trans 30064892613 rc 0/0 00000100:00100000:0.0:1651529344.396974:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151749 00000100:00100000:1.0:1651529344.396980:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946330496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1202us total) trans 30064892614 rc 0/0 00010000:00010000:0.0:1651529344.396982:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 2/0,0 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396983:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151750 00010000:00010000:0.0:1651529344.396985:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.396986:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 2/0,0 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396989:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 3/0,0 mode: PW/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396994:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966586624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396998:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: --/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397007:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 1/0,0 mode: --/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397011:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd1a1 lrc: 0/0,0 mode: --/PW res: [0x2b19d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397015:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 2/0,0 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397018:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095181838 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.397019:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 2/0,0 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397022:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 3/0,0 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397025:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 1/0,0 mode: --/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397028:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095181838/0xa29a79078f3bd1af lrc: 0/0,0 mode: --/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.397048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.397059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.397077:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.397087:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211712 00010000:00010000:0.0:1651529344.397093:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 4/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2021 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397098:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211840 00010000:00010000:0.0:1651529344.397100:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 4/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2022 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397104:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211776 00010000:00010000:0.0:1651529344.397106:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397110:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211904 00010000:00010000:0.0:1651529344.397112:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 4/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397117:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10713 00000100:00100000:1.0:1651529344.397118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.397119:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41278:x1731746396211712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.397121:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397123:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 4/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397126:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 3/0,0 mode: PR/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397131:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000952447fe/0xa29a79078f3bc060 lrc: 0/0,0 mode: --/PR res: [0x2b1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e5c expref: 2024 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397135:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397135:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397136:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397139:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 4/0,1 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397144:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212288 00010000:00010000:0.0:1651529344.397146:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.397150:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 5/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2024 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397159:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41278:x1731746396211712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.397162:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10713 00000100:00100000:1.0:1651529344.397164:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10714 00000100:00100000:1.0:1651529344.397166:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41278:x1731746396211840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.397167:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10715 00000100:00100000:0.0:1651529344.397169:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41278:x1731746396211776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.397170:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.397171:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 4/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397172:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397173:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397177:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 3/0,0 mode: PR/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397182:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3ba3f0 lrc: 0/0,0 mode: --/PR res: [0x2b1a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dd7 expref: 2023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.397185:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 3/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2022 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397186:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397186:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397187:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397192:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fe0393/0xa29a79078f3bb538 lrc: 0/0,0 mode: --/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53f3 expref: 2022 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.397195:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397196:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397197:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397200:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 4/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397204:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 4/0,1 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397209:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397217:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396211840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.397219:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397226:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10714 00000100:00100000:0.0:1651529344.397227:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396211776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.397229:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10715 00000100:00100000:1.0:1651529344.397231:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10716 00000100:00100000:1.0:1651529344.397233:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41278:x1731746396211904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.397235:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10717 00010000:00010000:1.0:1651529344.397236:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.397236:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41279:x1731746396212288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.397237:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 4/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397239:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.397241:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 3/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397241:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 5/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2019 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397245:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 4/0,0 mode: PR/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2019 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397250:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397250:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397251:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397254:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 4/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397258:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3ba49f lrc: 0/0,0 mode: --/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10ee expref: 2019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.397258:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.397261:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397262:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.397262:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746396212288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.397263:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397266:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 4/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397272:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397278:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41278:x1731746396211904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.397278:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10717 00000100:00100000:1.0:1651529344.397281:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10716 00010000:00010000:0.0:1651529344.397285:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397288:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397291:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,1 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397293:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397294:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 2/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397297:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397300:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,1 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397303:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 2/0,0 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397360:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946330624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1376us (1499us total) trans 30064892615 rc 0/0 00000100:00100000:1.0:1651529344.397363:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151753 00000100:00100000:0.0:1651529344.397363:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946330688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1388us (1561us total) trans 30064892616 rc 0/0 00000100:00100000:0.0:1651529344.397366:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151752 00010000:00010000:1.0:1651529344.397371:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 2/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397374:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.397374:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 2/0,0 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397375:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 2/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397377:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000637c9f02 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.397378:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 3/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397379:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 2/0,0 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397381:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 3/0,0 mode: PW/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397383:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 1/0,0 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397386:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd1b6 lrc: 0/0,0 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397386:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 1/0,0 mode: --/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397389:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637c9f02/0xa29a79078f3bd1bd lrc: 0/0,0 mode: --/PW res: [0x2b1a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397392:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397394:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397395:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397398:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397398:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397401:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 2/0,0 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397401:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397404:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 2/0,0 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397448:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946331008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1313us (1379us total) trans 30064892617 rc 0/0 00000100:00100000:1.0:1651529344.397451:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151755 00000100:00100000:0.0:1651529344.397452:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946330944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1361us (1398us total) trans 30064892618 rc 0/0 00000100:00100000:0.0:1651529344.397455:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151754 00010000:00010000:1.0:1651529344.397459:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 2/0,0 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397462:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.397462:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 2/0,0 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397463:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 2/0,0 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397466:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 3/0,0 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397466:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083c4f8c3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.397467:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 2/0,0 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397470:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 1/0,0 mode: --/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397470:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 3/0,0 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397473:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd1cb lrc: 0/0,0 mode: --/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397474:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 1/0,0 mode: --/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397477:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd1c4 lrc: 0/0,0 mode: --/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.397519:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331456 00000100:00100000:1.0:1651529344.397525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.397530:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151757 00000100:00100000:0.0:1651529344.397531:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:39029:x1731745946331456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.397541:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176549 count 1 00000100:00100000:1.0:1651529344.397546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.397546:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397558:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 2/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2016 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.397562:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397562:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397563:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 4/0,1 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397570:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 3/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2016 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.397574:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 4/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2016 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397578:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966586752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.397587:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.397593:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331520 00000100:00100000:0.0:1651529344.397603:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331584 00000100:00100000:0.0:1651529344.397609:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151758 00000100:00100000:0.0:1651529344.397610:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946331520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.397615:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176550 count 1 00010000:00010000:0.0:1651529344.397619:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397630:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 2/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2016 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.397634:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397634:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397635:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 4/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397636:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151759 00000100:00100000:1.0:1651529344.397639:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946331584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.397645:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176551 count 1 00010000:00010000:1.0:1651529344.397649:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397660:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 3/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2016 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.397662:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 2/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2016 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.397665:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 4/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2016 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.397666:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397666:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397667:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 4/0,1 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397669:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966586816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.397674:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 3/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2016 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.397678:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 4/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2016 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.397684:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.397689:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966586880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.397698:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.397749:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3b9716 lrc: 0/0,0 mode: --/PR res: [0x2b1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda7d expref: 2016 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.397754:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966586688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.397758:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397764:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397766:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397769:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397772:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 2/0,0 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397784:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 2/0,0 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397788:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2b66d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.397789:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 2/0,0 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397792:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 3/0,0 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397797:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 1/0,0 mode: --/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397814:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd1d2 lrc: 0/0,0 mode: --/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397834:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946331392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1334us (1351us total) trans 30064892619 rc 0/0 00000100:00100000:1.0:1651529344.397842:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151756 00000100:00100000:0.0:1651529344.397870:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966586752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.397898:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397913:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966586816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.397916:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.397939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.397945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.397951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.397962:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331840 00000100:00100000:0.0:1651529344.397971:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331904 00000100:00100000:1.0:1651529344.397976:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331968 00000100:00100000:1.0:1651529344.397980:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332032 00000100:00100000:1.0:1651529344.397984:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151760 00000100:00100000:1.0:1651529344.397986:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946331840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.397992:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176552 count 1 00010000:00010000:1.0:1651529344.397997:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398002:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151761 00000100:00100000:0.0:1651529344.398003:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946331968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.398008:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 2/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.398009:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176554 count 1 00010000:00010000:1.0:1651529344.398011:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398011:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398012:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 4/0,1 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398019:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 3/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398020:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398023:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 4/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2015 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398027:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966586944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.398029:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 2/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2015 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398032:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398033:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398033:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 4/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398036:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.398042:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151762 00010000:00010000:0.0:1651529344.398043:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 3/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2015 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.398044:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946332032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.398047:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 4/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2015 pid: 144528 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.398049:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176555 count 1 00000100:00100000:0.0:1651529344.398051:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.398060:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.398061:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398066:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 2/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398070:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398070:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398071:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 4/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398078:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 3/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398082:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 4/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2015 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398084:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151763 00000100:00100000:1.0:1651529344.398086:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.398086:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946331904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.398091:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176553 count 1 00000100:00100000:1.0:1651529344.398093:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.398103:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398112:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 2/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398116:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398116:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398117:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 4/0,1 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398123:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 3/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2015 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398127:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2015 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398131:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966587136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.398139:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.398143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.398155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.398187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.398195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.398201:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212544 00010000:00010000:1.0:1651529344.398207:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 4/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2016 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398218:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212608 00010000:00010000:1.0:1651529344.398221:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 4/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2017 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398222:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212672 00000100:00100000:1.0:1651529344.398226:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10718 00000100:00100000:1.0:1651529344.398228:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746396212544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.398231:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.398232:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 4/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2018 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398236:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 3/0,0 mode: PR/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2018 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398242:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ccbefe2/0xa29a79078f3b7cac lrc: 0/0,0 mode: --/PR res: [0x2b1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb04 expref: 2018 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398246:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398246:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398246:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 5/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398247:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398250:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 4/0,1 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398254:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10719 00000100:00100000:0.0:1651529344.398256:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746396212608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.398259:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.398265:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.398267:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 4/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2017 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398268:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746396212544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.398271:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10718 00010000:00010000:0.0:1651529344.398271:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 3/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2017 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398276:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10720 00010000:00010000:0.0:1651529344.398277:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbe252e4/0xa29a79078f3bc124 lrc: 0/0,0 mode: --/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ce expref: 2016 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398278:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746396212672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.398280:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.398281:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398281:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398282:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 5/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2015 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.398282:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398285:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 4/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398288:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 4/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2015 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398293:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398293:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398294:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398294:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.398297:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 4/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398301:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.398301:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41279:x1731746396212608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.398304:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10719 00000100:00100000:1.0:1651529344.398306:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396212672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.398308:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10720 00010000:00010000:0.0:1651529344.398311:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398314:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398317:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398320:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e42f15/0xa29a79078f3baa25 lrc: 0/0,0 mode: --/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2722 expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.398320:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 2/0,0 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398324:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966586880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398334:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398338:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398341:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398344:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398347:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 2/0,0 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398379:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946331520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 767us (853us total) trans 30064892620 rc 0/0 00000100:00100000:0.0:1651529344.398382:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151758 00000100:00100000:0.0:1651529344.398386:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332352 00000100:00100000:0.0:1651529344.398397:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151764 00000100:00100000:0.0:1651529344.398398:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946332352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.398403:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176556 count 1 00000100:00100000:1.0:1651529344.398407:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946331584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 767us (860us total) trans 30064892621 rc 0/0 00000100:00100000:1.0:1651529344.398410:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151759 00010000:00010000:0.0:1651529344.398414:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398417:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 2/0,0 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398421:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090ee5191 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.398422:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 2/0,0 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398425:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 3/0,0 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398425:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 2/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2012 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398429:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 1/0,0 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398429:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398429:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398430:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 4/0,1 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398432:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd1e0 lrc: 0/0,0 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398437:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 2/0,0 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398437:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 3/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2012 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398440:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d288cb7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.398440:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 4/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2012 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398441:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 2/0,0 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398444:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 3/0,0 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398444:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966587200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398447:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 1/0,0 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398449:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd1e7 lrc: 0/0,0 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398453:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.398459:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398463:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398466:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,1 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398468:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 2/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398512:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946331456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1003us total) trans 30064892622 rc 0/0 00000100:00100000:0.0:1651529344.398515:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151757 00010000:00010000:0.0:1651529344.398551:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 2/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398555:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e2029 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.398556:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 2/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398559:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 3/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398565:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 1/0,0 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398567:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd1d9 lrc: 0/0,0 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.398597:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212736 00010000:00010000:1.0:1651529344.398602:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 5/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398606:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966587136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.398610:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10721 00010000:00010000:0.0:1651529344.398610:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398611:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396212736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.398614:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.398616:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 5/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398618:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398619:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 4/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.398620:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398625:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398626:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398627:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398630:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 4/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398634:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.398648:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396212736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.398651:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10721 00000100:00100000:1.0:1651529344.398661:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398665:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398672:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3ba929 lrc: 0/0,0 mode: --/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23da expref: 2012 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398676:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966586944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398679:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398682:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398687:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398690:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398693:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 2/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398751:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946331840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 763us (820us total) trans 30064892623 rc 0/0 00000100:00100000:1.0:1651529344.398754:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151760 00010000:00010000:1.0:1651529344.398762:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 2/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398765:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c14ba19b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.398766:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 2/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398769:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 3/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398773:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 1/0,0 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398776:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c14ba19b/0xa29a79078f3bd1ee lrc: 0/0,0 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398829:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.398862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.398893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.398904:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332480 00000100:00100000:1.0:1651529344.398905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.398915:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332544 00000100:00100000:1.0:1651529344.398918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.398922:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151765 00000100:00100000:0.0:1651529344.398924:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946332480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.398929:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176557 count 1 00000100:00100000:1.0:1651529344.398930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.398934:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398938:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212864 00010000:00010000:0.0:1651529344.398939:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 2/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2012 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398942:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398943:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 4/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2012 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.398943:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398943:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 4/0,1 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398954:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212800 00010000:00010000:0.0:1651529344.398956:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 3/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2012 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398957:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 4/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.398961:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212928 00010000:00010000:0.0:1651529344.398961:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 4/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2013 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.398963:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2014 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398965:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.398967:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10722 00000100:00100000:1.0:1651529344.398969:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396212864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.398972:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.398973:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 4/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2014 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.398979:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.398982:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 3/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2014 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399000:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bfc1725/0xa29a79078f3b7a9f lrc: 0/0,0 mode: --/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9de expref: 2014 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399003:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399004:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399005:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399007:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10723 00010000:00010000:1.0:1651529344.399008:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 4/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399009:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41279:x1731746396212800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.399013:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399014:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 4/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399017:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.399024:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 3/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2013 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399025:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396212864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.399027:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10722 00010000:00010000:0.0:1651529344.399030:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bb076 lrc: 0/0,0 mode: --/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40a5 expref: 2012 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399032:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10724 00000100:00100000:1.0:1651529344.399034:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396212928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.399034:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399035:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399036:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399036:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399038:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 4/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2011 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399039:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 4/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399041:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 3/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2011 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399048:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.399053:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a382b2a/0xa29a79078f3bb5e0 lrc: 0/0,0 mode: --/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5623 expref: 2011 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399056:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396212800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.399059:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10723 00010000:00010000:1.0:1651529344.399066:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399067:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399068:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399071:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 4/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399079:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399086:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41279:x1731746396212928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.399088:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10724 00010000:00010000:0.0:1651529344.399093:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399096:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399098:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399099:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399102:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399103:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399105:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 2/0,0 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399106:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 2/0,0 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399154:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946332032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1109us (1202us total) trans 30064892624 rc 0/0 00000100:00100000:1.0:1651529344.399157:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151762 00000100:00100000:1.0:1651529344.399169:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332608 00000100:00100000:1.0:1651529344.399176:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151766 00000100:00100000:0.0:1651529344.399176:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946331968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1171us (1230us total) trans 30064892625 rc 0/0 00000100:00100000:1.0:1651529344.399178:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f98687fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946332544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.399179:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151761 00002000:00080000:1.0:1651529344.399183:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176558 count 1 00000100:00100000:0.0:1651529344.399185:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151767 00000100:00100000:0.0:1651529344.399187:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946332608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.399188:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399192:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 2/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2008 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.399192:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176559 count 1 00010000:00010000:1.0:1651529344.399196:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399196:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399196:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399197:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 4/0,1 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399201:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 2/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2008 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.399204:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 3/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2008 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399204:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399205:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399205:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 4/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399207:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 4/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2008 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399212:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399212:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 3/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2008 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399219:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 4/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2008 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399220:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.399223:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.399230:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.399236:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 2/0,0 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.399239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000731b1078 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.399240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 2/0,0 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 3/0,0 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399248:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 1/0,0 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399250:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731b1078/0xa29a79078f3bd1fc lrc: 0/0,0 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399262:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 2/0,0 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399265:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059eb6c0f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.399266:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 2/0,0 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399269:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 3/0,0 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399273:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 1/0,0 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399275:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059eb6c0f/0xa29a79078f3bd1f5 lrc: 0/0,0 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399282:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399284:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399287:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399290:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 2/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399332:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946331904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1245us (1392us total) trans 30064892626 rc 0/0 00000100:00100000:0.0:1651529344.399335:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151763 00000100:00100000:0.0:1651529344.399340:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332736 00000100:00100000:0.0:1651529344.399350:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151768 00000100:00100000:0.0:1651529344.399352:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946332736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.399357:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176560 count 1 00010000:00010000:0.0:1651529344.399361:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: --/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399366:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 2/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2008 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399369:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399369:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399370:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 4/0,1 mode: --/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399376:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 3/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2008 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.399394:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 2/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399408:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bcb3d00 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.399409:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 2/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399412:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 3/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399412:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 4/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2008 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399417:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966587456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.399418:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 1/0,0 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399420:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd203 lrc: 0/0,0 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399432:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.399434:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213504 00010000:00010000:1.0:1651529344.399440:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 5/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2009 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399441:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966587200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399445:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399448:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10725 00000100:00100000:1.0:1651529344.399449:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41278:x1731746396213504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.399452:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399453:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 4/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2009 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399457:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 3/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2009 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399472:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038c33722/0xa29a79078f3b871e lrc: 0/0,0 mode: --/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc052 expref: 2009 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399477:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399480:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 4/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399489:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.399492:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399496:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399497:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396213504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.399499:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10725 00010000:00010000:0.0:1651529344.399499:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399502:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 2/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.399529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.399560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.399568:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332864 00000100:00100000:0.0:1651529344.399574:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946332352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1431us total) trans 30064892627 rc 0/0 00000100:00100000:0.0:1651529344.399577:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151764 00000100:00100000:1.0:1651529344.399579:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332800 00000100:00100000:0.0:1651529344.399583:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332928 00000100:00100000:1.0:1651529344.399584:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151769 00000100:00100000:1.0:1651529344.399585:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:39029:x1731745946332864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.399588:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151770 00000100:00100000:0.0:1651529344.399590:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:39030:x1731745946332800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.399591:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176562 count 1 00002000:00080000:0.0:1651529344.399594:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176561 count 1 00010000:00010000:1.0:1651529344.399595:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399600:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 2/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2007 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399606:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399611:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399612:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399612:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 4/0,1 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399620:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 3/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2007 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.399624:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 4/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2007 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399628:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966587520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399634:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 2/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2007 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.399637:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.399644:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151771 00000100:00100000:1.0:1651529344.399645:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:39029:x1731745946332928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.399646:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399646:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399647:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 4/0,1 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.399650:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176563 count 1 00010000:00010000:0.0:1651529344.399658:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 3/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2007 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.399661:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399662:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 4/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2007 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399666:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 2/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2007 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.399666:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966587584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.399669:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399669:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399670:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 4/0,1 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399675:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.399680:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 2/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399683:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 3/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2007 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399683:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fab6f5e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.399687:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 4/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2007 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399691:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966587648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399696:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 2/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399698:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.399700:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 3/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399705:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 1/0,0 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399708:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd20a lrc: 0/0,0 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399751:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399757:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399788:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.399791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399791:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399831:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.399841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.399855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.399857:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966587456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.399865:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213568 00010000:00010000:1.0:1651529344.399870:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 4/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2008 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399871:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: --/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399876:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213632 00010000:00010000:1.0:1651529344.399879:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 5/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399882:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213696 00010000:00010000:1.0:1651529344.399884:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 4/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2010 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399895:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213760 00000100:00100000:0.0:1651529344.399896:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10726 00010000:00010000:1.0:1651529344.399898:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 4/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2011 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399898:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396213568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.399902:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399904:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 4/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2011 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399908:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 3/0,0 mode: PR/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2011 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.399911:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10727 00000100:00100000:1.0:1651529344.399913:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396213632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.399916:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399918:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 5/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2011 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399922:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 4/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2011 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399927:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399929:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399931:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bbf74c/0xa29a79078f3b92b6 lrc: 0/0,0 mode: --/PR res: [0x2b1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc886 expref: 2011 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399932:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 4/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399937:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399943:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41279:x1731746396213632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.399943:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399944:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399945:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399946:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10727 00010000:00010000:0.0:1651529344.399948:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 4/0,1 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399950:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10728 00000100:00100000:1.0:1651529344.399952:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41279:x1731746396213696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.399954:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399956:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 4/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399956:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.399964:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41279:x1731746396213568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.399967:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 3/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399967:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10726 00010000:00010000:1.0:1651529344.399971:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000277efe06/0xa29a79078f3ba85e lrc: 0/0,0 mode: --/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20ca expref: 2008 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.399973:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10729 00000100:00100000:0.0:1651529344.399974:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396213760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.399975:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399976:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399977:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399977:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399979:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 4/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399979:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 4/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2007 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.399983:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 3/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2007 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.399988:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399994:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41279:x1731746396213696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.399997:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10728 00010000:00010000:0.0:1651529344.399997:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006df13edc/0xa29a79078f3b8c3b lrc: 0/0,0 mode: --/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f9 expref: 2007 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400001:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400002:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400003:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400006:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 4/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400009:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bbe3e lrc: 0/0,0 mode: --/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d764b expref: 2005 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400011:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.400013:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.400017:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400018:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41278:x1731746396213760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.400020:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400020:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10729 00010000:00010000:0.0:1651529344.400027:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400030:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400030:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400033:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400034:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400036:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 2/0,0 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400036:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 2/0,0 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400099:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f98687fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946332544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 920us (1205us total) trans 30064892628 rc 0/0 00000100:00100000:0.0:1651529344.400101:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946332736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 748us (862us total) trans 30064892629 rc 0/0 00000100:00100000:1.0:1651529344.400103:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151766 00000100:00100000:0.0:1651529344.400105:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151768 00010000:00010000:1.0:1651529344.400111:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 2/0,0 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400112:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 2/0,0 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400114:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006cb4b8c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.400115:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 2/0,0 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400116:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc2c5b68 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.400117:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 2/0,0 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400118:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 3/0,0 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400122:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 3/0,0 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400123:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 1/0,0 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400125:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cb4b8c/0xa29a79078f3bd218 lrc: 0/0,0 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400127:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 1/0,0 mode: --/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400130:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2c5b68/0xa29a79078f3bd226 lrc: 0/0,0 mode: --/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400136:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400139:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400142:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,1 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400144:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 2/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.400187:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946332480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1262us (1358us total) trans 30064892630 rc 0/0 00000100:00100000:0.0:1651529344.400190:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151765 00000100:00100000:0.0:1651529344.400218:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333376 00000100:00100000:1.0:1651529344.400219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.400234:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151772 00000100:00100000:0.0:1651529344.400236:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946333376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.400241:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176564 count 1 00010000:00010000:0.0:1651529344.400246:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: --/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400251:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 2/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2003 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400254:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400254:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.400255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.400255:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 4/0,1 mode: --/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400262:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 3/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2003 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400265:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.400269:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.400278:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.400283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.400283:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 2/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400286:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010c4825a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.400287:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 2/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400293:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 3/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400297:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 1/0,0 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400300:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c4825a/0xa29a79078f3bd211 lrc: 0/0,0 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400312:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213952 00010000:00010000:1.0:1651529344.400318:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 5/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2004 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.400326:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213888 00010000:00010000:1.0:1651529344.400328:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 5/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2005 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.400329:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966587584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400332:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214016 00010000:00010000:0.0:1651529344.400333:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400334:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 5/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2006 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.400339:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10730 00000100:00100000:1.0:1651529344.400340:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41279:x1731746396213952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.400343:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400344:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 4/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2006 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.400348:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 3/0,0 mode: PR/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2006 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400352:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400354:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdbbc29f/0xa29a79078f3b9a34 lrc: 0/0,0 mode: --/PR res: [0x2b1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6b6 expref: 2006 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400356:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400359:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400361:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 2/0,0 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400366:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400367:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400368:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400371:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 4/0,1 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400380:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.400389:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2005:41279:x1731746396213952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.400392:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10730 00000100:00100000:1.0:1651529344.400401:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10731 00000100:00100000:1.0:1651529344.400403:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41279:x1731746396213888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.400405:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400407:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 5/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2004 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.400409:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946332608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1221us (1490us total) trans 30064892631 rc 0/0 00010000:00010000:1.0:1651529344.400410:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 4/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2004 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.400413:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151767 00010000:00010000:1.0:1651529344.400415:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400416:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400417:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400429:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 4/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400434:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.400434:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 2/0,0 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400438:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001eca5fc5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.400439:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 2/0,0 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400440:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41279:x1731746396213888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.400442:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10731 00010000:00010000:0.0:1651529344.400442:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 3/0,0 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400446:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 1/0,0 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400447:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10732 00000100:00100000:1.0:1651529344.400448:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746396214016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.400449:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eca5fc5/0xa29a79078f3bd21f lrc: 0/0,0 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400450:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400452:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 5/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.400455:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 4/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400455:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400458:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400460:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400460:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400461:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400461:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,1 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400464:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 4/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400464:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 2/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400467:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.400479:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746396214016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.400488:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10732 00010000:00010000:1.0:1651529344.400494:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 2/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400498:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000195e0ab1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.400499:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 2/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400502:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 3/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400506:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 1/0,0 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400506:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946332800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (977us total) trans 30064892632 rc 0/0 00010000:00010000:1.0:1651529344.400509:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd234 lrc: 0/0,0 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400510:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151770 00010000:00010000:1.0:1651529344.400520:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fe1995c/0xa29a79078f3b9aea lrc: 0/0,0 mode: --/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea0c expref: 2002 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.400524:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966587648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.400527:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400530:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400541:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400544:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400547:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400560:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400563:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007de4133e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.400564:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400567:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 3/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400572:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 1/0,0 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400575:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de4133e/0xa29a79078f3bd23b lrc: 0/0,0 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400591:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946332928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (1031us total) trans 30064892633 rc 0/0 00000100:00100000:1.0:1651529344.400595:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151771 00010000:00010000:1.0:1651529344.400606:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c98522/0xa29a79078f3b96a6 lrc: 0/0,0 mode: --/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd877 expref: 2001 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.400611:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966587520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.400614:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400618:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400620:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400633:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400636:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 2/0,0 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400646:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 2/0,0 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400649:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619e83ce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.400650:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 2/0,0 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400656:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 3/0,0 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400659:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 1/0,0 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400662:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619e83ce/0xa29a79078f3bd22d lrc: 0/0,0 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400675:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946332864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1088us (1158us total) trans 30064892634 rc 0/0 00000100:00100000:1.0:1651529344.400678:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151769 00000100:00100000:1.0:1651529344.400713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.400747:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.400751:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: --/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.400769:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214464 00000100:00100000:1.0:1651529344.400772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.400774:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.400785:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10733 00000100:00100000:0.0:1651529344.400787:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41279:x1731746396214464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.400789:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.400791:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400795:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 3/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400819:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6268265/0xa29a79078f3b9dd7 lrc: 0/0,0 mode: --/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf588 expref: 2001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.400823:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400824:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400825:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400828:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 4/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400835:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.400842:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746396214464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.400845:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10733 00010000:00010000:0.0:1651529344.400852:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400855:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400858:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400861:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 2/0,0 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400872:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333632 00000100:00100000:1.0:1651529344.400886:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333568 00000100:00100000:1.0:1651529344.400893:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333696 00000100:00100000:1.0:1651529344.400900:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151773 00000100:00100000:1.0:1651529344.400901:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946333632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.400907:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176566 count 1 00010000:00010000:1.0:1651529344.400912:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400917:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 2/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400920:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400928:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400929:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 4/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400937:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 3/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400941:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 4/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.400945:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400964:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.400966:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946333376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 728us (817us total) trans 30064892635 rc 0/0 00010000:00010000:1.0:1651529344.400969:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 2/0,0 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400970:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151772 00010000:00010000:1.0:1651529344.400972:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.400973:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 2/0,0 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400975:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151774 00010000:00010000:1.0:1651529344.400976:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 3/0,0 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400976:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946333568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.400981:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 1/0,0 mode: --/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.400981:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176565 count 1 00010000:00010000:1.0:1651529344.400984:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd242 lrc: 0/0,0 mode: --/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400986:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: --/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400991:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 2/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400994:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400995:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400995:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 4/0,1 mode: --/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401002:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151775 00010000:00010000:0.0:1651529344.401002:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 3/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.401004:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946333696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.401009:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176567 count 1 00010000:00010000:1.0:1651529344.401013:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401019:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 4/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.401023:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 2/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.401023:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.401026:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401026:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401027:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 4/0,1 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401032:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.401034:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 3/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401037:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 4/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401042:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966587904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401050:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.401098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401108:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333760 00000100:00100000:0.0:1651529344.401115:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333824 00000100:00100000:0.0:1651529344.401119:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151776 00000100:00100000:0.0:1651529344.401121:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946333760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.401125:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176568 count 1 00000100:00100000:1.0:1651529344.401129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.401130:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401134:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 2/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401137:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401138:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401138:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 4/0,1 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.401145:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 3/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401148:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 4/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.401152:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.401160:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.401166:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333888 00000100:00100000:0.0:1651529344.401176:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333952 00000100:00100000:0.0:1651529344.401180:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151777 00000100:00100000:0.0:1651529344.401182:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946333824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.401193:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176569 count 1 00010000:00010000:0.0:1651529344.401202:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401205:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151778 00000100:00100000:1.0:1651529344.401207:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946333888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.401207:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 2/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401210:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401210:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401211:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 4/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.401213:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176570 count 1 00010000:00010000:0.0:1651529344.401217:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 3/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401218:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401221:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 4/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.401225:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.401230:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 2/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401233:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401234:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401234:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 4/0,1 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401241:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 3/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401251:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 4/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401256:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401265:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.401267:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401271:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151779 00000100:00100000:1.0:1651529344.401272:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946333952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.401277:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176571 count 1 00010000:00010000:1.0:1651529344.401281:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: --/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401296:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 2/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1999 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401299:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401300:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401301:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 4/0,1 mode: --/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401307:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 3/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1999 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401310:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 4/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1999 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401314:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966588160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401321:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401389:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966587840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.401394:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: --/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401411:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966587968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.401414:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401421:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966587776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.401425:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401433:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966587904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.401435:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401454:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334016 00000100:00100000:1.0:1651529344.401461:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151780 00000100:00100000:1.0:1651529344.401463:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946334016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.401468:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176572 count 1 00010000:00010000:1.0:1651529344.401472:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401476:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 2/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401479:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401480:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401481:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 4/0,1 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401487:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 3/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1999 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401491:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 4/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401495:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966588224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401505:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.401582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.401592:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.401593:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214720 00010000:00010000:0.0:1651529344.401598:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 4/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 2000 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.401609:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214848 00010000:00010000:0.0:1651529344.401612:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 4/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 2001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.401617:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214656 00010000:00010000:0.0:1651529344.401619:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 4/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 2002 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401620:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214784 00000100:00100000:0.0:1651529344.401623:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10734 00010000:00010000:1.0:1651529344.401625:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 4/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.401625:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746396214720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.401628:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.401629:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 4/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401632:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10735 00010000:00010000:0.0:1651529344.401633:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 3/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401634:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746396214848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.401637:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.401638:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 4/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.401639:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccda4844/0xa29a79078f3ba9fb lrc: 0/0,0 mode: --/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2681 expref: 2003 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.401642:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 3/0,0 mode: PR/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 2002 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.401642:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401648:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3ba1c0 lrc: 0/0,0 mode: --/PR res: [0x2b1b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04e6 expref: 2002 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.401650:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401651:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401652:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401652:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401653:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401654:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 4/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401656:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 4/0,1 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401663:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.401673:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41279:x1731746396214720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (100us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.401674:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.401676:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10734 00000100:00100000:1.0:1651529344.401682:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746396214848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.401682:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10736 00000100:00100000:0.0:1651529344.401683:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41278:x1731746396214656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.401686:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.401688:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 4/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 2000 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.401692:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 3/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 2000 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401694:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10735 00010000:00010000:0.0:1651529344.401697:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064156940/0xa29a79078f3bb9b4 lrc: 0/0,0 mode: --/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64a1 expref: 2000 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.401700:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10737 00010000:00010000:0.0:1651529344.401700:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401701:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.401702:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1998:41278:x1731746396214784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.401702:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401704:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.401706:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 4/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.401710:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 3/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.401713:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 4/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401715:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29e303b/0xa29a79078f3b9d7c lrc: 0/0,0 mode: --/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf40e expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.401719:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401719:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401720:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401723:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 4/0,1 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401737:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.401750:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41278:x1731746396214784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.401750:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.401752:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10737 00000100:00100000:0.0:1651529344.401758:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41278:x1731746396214656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 74us (165us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.401761:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401761:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10736 00010000:00010000:1.0:1651529344.401772:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401775:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401778:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 2/0,0 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401792:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401796:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401799:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401812:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 2/0,0 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401838:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946333632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 935us (1125us total) trans 30064892636 rc 0/0 00000100:00100000:1.0:1651529344.401841:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151773 00010000:00010000:1.0:1651529344.401848:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401851:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401854:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,1 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401857:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 2/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401868:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946333568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 890us (1119us total) trans 30064892637 rc 0/0 00000100:00100000:0.0:1651529344.401871:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151774 00010000:00010000:0.0:1651529344.401882:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 2/0,0 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401885:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d446ab0c already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.401892:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946333696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 887us (1120us total) trans 30064892638 rc 0/0 00010000:00010000:0.0:1651529344.401895:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 2/0,0 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401899:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 3/0,0 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401904:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 1/0,0 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401905:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151775 00010000:00010000:0.0:1651529344.401907:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d446ab0c/0xa29a79078f3bd249 lrc: 0/0,0 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401911:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 2/0,0 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401913:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 2/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401914:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.401915:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 2/0,0 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401916:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.401917:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 2/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401918:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 3/0,0 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401920:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 3/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401921:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 1/0,0 mode: --/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401923:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd250 lrc: 0/0,0 mode: --/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401925:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 1/0,0 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401928:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd257 lrc: 0/0,0 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401937:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401940:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401943:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,1 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401945:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 2/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401992:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946333760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 870us (910us total) trans 30064892639 rc 0/0 00000100:00100000:0.0:1651529344.401995:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151776 00000100:00100000:1.0:1651529344.402001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.402011:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.402016:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402022:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214976 00000100:00100000:1.0:1651529344.402023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.402027:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 4/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1996 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402037:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214912 00010000:00010000:0.0:1651529344.402040:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 5/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1997 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402047:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215040 00010000:00010000:0.0:1651529344.402049:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 5/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1998 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402053:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10738 00000100:00100000:0.0:1651529344.402055:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1998:41279:x1731746396214976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.402057:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402059:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 4/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402063:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 3/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402068:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3b8709 lrc: 0/0,0 mode: --/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc044 expref: 1998 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402072:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402072:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402073:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402076:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 4/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.402083:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.402089:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41279:x1731746396214976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.402092:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10738 00000100:00100000:0.0:1651529344.402096:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215104 00010000:00010000:0.0:1651529344.402099:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 5/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1997 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402104:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10739 00000100:00100000:0.0:1651529344.402105:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41279:x1731746396214912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.402108:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402109:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 5/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1997 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402112:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 4/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1997 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402117:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402117:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402118:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402121:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 4/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402122:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 2/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402125:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.402126:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.402127:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 2/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402140:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 3/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402145:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 1/0,0 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402147:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd25e lrc: 0/0,0 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402161:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41279:x1731746396214912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.402164:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10740 00000100:00100000:1.0:1651529344.402166:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41279:x1731746396215040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.402166:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10739 00010000:00010000:1.0:1651529344.402170:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.402171:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 5/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1996 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.402175:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 4/0,0 mode: PR/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1996 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.402180:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402180:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.402180:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10741 00010000:00010000:1.0:1651529344.402181:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402182:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746396215104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.402184:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 4/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402185:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402186:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 5/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1996 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402190:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 4/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1996 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402196:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402197:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402197:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402199:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.402200:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 4/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402205:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.402206:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746396215040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.402209:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10740 00010000:00010000:1.0:1651529344.402222:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d892a983/0xa29a79078f3baf1f lrc: 0/0,0 mode: --/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ae7 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402222:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41279:x1731746396215104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.402225:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10741 00000100:00100000:1.0:1651529344.402226:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.402230:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402232:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402233:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402236:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402236:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402239:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402239:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402241:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 2/0,0 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402242:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 2/0,0 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402286:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:39029:x1731745946333888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1078us (1156us total) trans 30064892640 rc 0/0 00000100:00100000:1.0:1651529344.402297:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151778 00010000:00010000:1.0:1651529344.402309:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e579371/0xa29a79078f3b7d70 lrc: 0/0,0 mode: --/PR res: [0x2b1bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb66 expref: 1993 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402313:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966588160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402315:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946333824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1132us (1217us total) trans 30064892641 rc 0/0 00010000:00010000:1.0:1651529344.402317:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402318:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151777 00010000:00010000:1.0:1651529344.402320:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402323:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402326:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,1 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402326:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 2/0,0 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402329:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 2/0,0 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402329:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.402330:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 2/0,0 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402333:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 3/0,0 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402338:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 1/0,0 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402341:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3bd26c lrc: 0/0,0 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402345:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 2/0,0 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402348:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000867183da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.402349:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 2/0,0 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402352:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 3/0,0 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402355:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 1/0,0 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402357:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867183da/0xa29a79078f3bd265 lrc: 0/0,0 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402361:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 2/0,0 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402363:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008de0df4c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.402364:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 2/0,0 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402366:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946333952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1222us total) trans 30064892642 rc 0/0 00010000:00010000:0.0:1651529344.402366:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 3/0,0 mode: PW/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402368:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151779 00010000:00010000:0.0:1651529344.402369:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 1/0,0 mode: --/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402372:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de0df4c/0xa29a79078f3bd273 lrc: 0/0,0 mode: --/PW res: [0x2b1bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402380:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb092992/0xa29a79078f3ba69e lrc: 0/0,0 mode: --/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19d1 expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402394:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966588224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.402398:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402401:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402404:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402407:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402409:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 2/0,0 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402444:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946334016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1107us total) trans 30064892643 rc 0/0 00000100:00100000:1.0:1651529344.402447:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151780 00010000:00010000:1.0:1651529344.402454:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 2/0,0 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402457:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000013f54743 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.402458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 2/0,0 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402463:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 3/0,0 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402468:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 1/0,0 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402470:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd27a lrc: 0/0,0 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.402519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.402530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.402541:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334592 00000100:00100000:1.0:1651529344.402545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.402559:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334656 00000100:00100000:0.0:1651529344.402566:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334720 00000100:00100000:0.0:1651529344.402570:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334784 00000100:00100000:0.0:1651529344.402576:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151781 00000100:00100000:0.0:1651529344.402577:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946334592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.402583:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176573 count 1 00010000:00010000:0.0:1651529344.402587:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402591:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 2/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402595:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402595:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402596:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 4/0,1 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402602:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 3/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402606:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 4/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1991 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.402610:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402625:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.402633:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151782 00000100:00100000:1.0:1651529344.402635:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946334656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.402636:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151783 00000100:00100000:0.0:1651529344.402638:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946334720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.402641:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176574 count 1 00002000:00080000:0.0:1651529344.402643:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176575 count 1 00010000:00010000:1.0:1651529344.402646:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402646:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402651:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 2/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402651:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 2/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402654:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402654:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402654:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402654:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402655:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 4/0,1 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402655:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 4/0,1 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402674:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 3/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402677:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 3/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402678:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 4/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1991 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402681:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 4/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1991 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402682:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402685:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966588416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402691:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.402693:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.402698:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151784 00000100:00100000:1.0:1651529344.402700:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946334784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.402705:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176576 count 1 00010000:00010000:1.0:1651529344.402708:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: --/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402713:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 2/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402716:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402716:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402717:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 4/0,1 mode: --/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402723:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 3/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402726:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 4/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1991 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402744:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966588480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402752:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.402831:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.402841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.402847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.402853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.402863:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334976 00000100:00100000:1.0:1651529344.402864:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335040 00000100:00100000:0.0:1651529344.402874:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335104 00000100:00100000:0.0:1651529344.402879:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335168 00000100:00100000:1.0:1651529344.402881:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151785 00000100:00100000:1.0:1651529344.402883:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946334976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.402884:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151786 00000100:00100000:0.0:1651529344.402886:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946335040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.402888:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176577 count 1 00010000:00010000:1.0:1651529344.402892:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: --/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.402904:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176578 count 1 00010000:00010000:1.0:1651529344.402905:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 2/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402908:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402909:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402909:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402910:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 4/0,1 mode: --/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402914:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 2/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1991 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402917:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 3/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1991 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402917:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402918:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402919:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 4/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402921:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 4/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1991 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402926:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 3/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1991 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402929:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 4/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1991 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402933:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966588544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402933:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966588608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402945:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.402945:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.402951:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151787 00000100:00100000:1.0:1651529344.402953:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946335104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.402953:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151788 00000100:00100000:0.0:1651529344.402955:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946335168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.402958:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176579 count 1 00002000:00080000:0.0:1651529344.402960:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176580 count 1 00010000:00010000:1.0:1651529344.402968:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402969:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402973:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 2/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1991 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402974:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 2/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1991 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402976:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402977:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402977:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 4/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402979:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402980:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402980:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 4/0,1 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402984:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 3/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1991 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.402987:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1991 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.402987:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 3/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1991 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402991:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 4/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1991 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.402992:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966588672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402994:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966588736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402999:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.403002:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.403063:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403068:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403130:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966588416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.403134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403134:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403150:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215680 00000100:00100000:1.0:1651529344.403151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403156:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 4/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.403159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.403169:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215744 00000100:00100000:1.0:1651529344.403171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403172:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 5/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1993 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.403176:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215872 00000100:00100000:1.0:1651529344.403178:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215808 00010000:00010000:0.0:1651529344.403178:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 5/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1994 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403183:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 4/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.403183:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10742 00000100:00100000:0.0:1651529344.403185:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41279:x1731746396215680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.403188:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403189:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 4/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.403190:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10743 00000100:00100000:1.0:1651529344.403192:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41279:x1731746396215744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.403193:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 3/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403195:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.403196:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 5/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403198:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe56698e/0xa29a79078f3ba674 lrc: 0/0,0 mode: --/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1914 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403200:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 4/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403202:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403202:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403203:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403206:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403206:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403206:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 4/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403207:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403210:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 4/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403213:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.403215:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.403222:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41279:x1731746396215744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403222:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41279:x1731746396215680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403225:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10742 00000100:00100000:1.0:1651529344.403226:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10743 00000100:00100000:0.0:1651529344.403239:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10744 00000100:00100000:1.0:1651529344.403241:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10745 00000100:00100000:0.0:1651529344.403241:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41279:x1731746396215872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.403242:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41278:x1731746396215808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.403243:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.403245:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403245:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 5/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403247:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 4/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403248:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 4/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403251:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 3/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403253:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403254:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403255:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403256:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e0e433/0xa29a79078f3bc0f3 lrc: 0/0,0 mode: --/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80ee expref: 1992 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403257:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 4/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403260:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403260:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403261:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403261:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.403264:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 4/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403266:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1991:41279:x1731746396215872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403269:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10744 00010000:00010000:1.0:1651529344.403273:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.403279:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1990:41278:x1731746396215808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.403282:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10745 00010000:00010000:0.0:1651529344.403285:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403289:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403292:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403294:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d10bbd41/0xa29a79078f3bb244 lrc: 0/0,0 mode: --/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4751 expref: 1989 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403295:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 2/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403308:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.403311:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403315:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403317:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403320:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403323:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 2/0,0 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403347:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946334592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 768us (842us total) trans 30064892644 rc 0/0 00000100:00100000:0.0:1651529344.403350:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151781 00010000:00010000:0.0:1651529344.403358:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 2/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403361:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2b66d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403362:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 2/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403365:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 3/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403370:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 1/0,0 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403373:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b66d58/0xa29a79078f3bd281 lrc: 0/0,0 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403375:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946334656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 739us (855us total) trans 30064892645 rc 0/0 00000100:00100000:1.0:1651529344.403378:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151782 00010000:00010000:1.0:1651529344.403389:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e151af9b/0xa29a79078f3b9931 lrc: 0/0,0 mode: --/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2db expref: 1988 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403391:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 2/0,0 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403393:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966588480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403394:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe83ac5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403395:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 2/0,0 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403396:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403398:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 3/0,0 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403401:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 1/0,0 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403404:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe83ac5a/0xa29a79078f3bd288 lrc: 0/0,0 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403408:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403411:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403411:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403414:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,1 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403414:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403417:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 2/0,0 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403417:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403419:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 2/0,0 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403454:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+79:39029:x1731745946334784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 754us (909us total) trans 30064892646 rc 0/0 00000100:00100000:1.0:1651529344.403457:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151784 00000100:00100000:0.0:1651529344.403457:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+79:39029:x1731745946334720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 818us (927us total) trans 30064892647 rc 0/0 00000100:00100000:0.0:1651529344.403461:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151783 00010000:00010000:1.0:1651529344.403464:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 2/0,0 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403468:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d6a0530 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403468:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 2/0,0 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403469:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 2/0,0 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403471:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 3/0,0 mode: PW/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403471:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083c4f8c3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403472:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 2/0,0 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403475:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 3/0,0 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403476:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 1/0,0 mode: --/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403479:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 1/0,0 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403482:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c4f8c3/0xa29a79078f3bd28f lrc: 0/0,0 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403486:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd296 lrc: 0/0,0 mode: --/PW res: [0x2b1c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403545:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966588608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403550:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403577:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966588544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.403588:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: --/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.403628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.403636:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216064 00010000:00010000:1.0:1651529344.403640:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 4/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1988 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.403648:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216128 00010000:00010000:1.0:1651529344.403650:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 4/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1989 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.403667:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10746 00000100:00100000:1.0:1651529344.403670:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10747 00000100:00100000:0.0:1651529344.403670:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41278:x1731746396216064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.403672:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41278:x1731746396216128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.403674:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.403675:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403676:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 4/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1989 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403677:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 4/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1989 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403680:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 3/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1989 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403680:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 3/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1989 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403686:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3ba826 lrc: 0/0,0 mode: --/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d203e expref: 1989 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.403690:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403690:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403691:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403694:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 4/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403697:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3b9311 lrc: 0/0,0 mode: --/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca0e expref: 1988 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.403701:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403704:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.403707:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403708:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403711:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 4/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403714:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41278:x1731746396216064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403717:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10746 00010000:00010000:1.0:1651529344.403725:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.403741:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41278:x1731746396216128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.403744:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10747 00010000:00010000:1.0:1651529344.403753:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403754:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403756:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403758:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403759:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403762:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 2/0,0 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403764:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403767:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403825:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946334976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (993us total) trans 30064892648 rc 0/0 00000100:00100000:1.0:1651529344.403828:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151785 00000100:00100000:1.0:1651529344.403839:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966588672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.403843:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403853:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946335040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1012us total) trans 30064892649 rc 0/0 00000100:00100000:0.0:1651529344.403864:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151786 00010000:00010000:0.0:1651529344.403874:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 2/0,0 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403877:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bcb3d00 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403878:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 2/0,0 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403881:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 3/0,0 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403886:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 1/0,0 mode: --/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403889:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcb3d00/0xa29a79078f3bd29d lrc: 0/0,0 mode: --/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403899:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403909:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e2029 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.403910:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403913:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 3/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403917:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 1/0,0 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403919:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e2029/0xa29a79078f3bd2a4 lrc: 0/0,0 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403931:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966588736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.403933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403934:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403941:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335680 00000100:00100000:0.0:1651529344.403948:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335808 00000100:00100000:0.0:1651529344.403956:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151789 00000100:00100000:0.0:1651529344.403957:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+79:39029:x1731745946335680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.403963:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176581 count 1 00000100:00100000:1.0:1651529344.403966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.403976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403978:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403983:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 2/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1985 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.403984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.403993:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216192 00010000:00010000:0.0:1651529344.403993:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403994:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403995:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 4/0,1 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403998:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1986 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.404002:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 3/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1986 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.404005:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216320 00010000:00010000:0.0:1651529344.404005:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 4/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1986 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404008:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 4/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1987 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404009:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966588800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404014:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10748 00000100:00100000:1.0:1651529344.404015:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41279:x1731746396216192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.404018:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404020:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1987 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404025:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.404030:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 3/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1987 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404031:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335744 00010000:00010000:1.0:1651529344.404036:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6d334b0/0xa29a79078f3b98dd lrc: 0/0,0 mode: --/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce168 expref: 1987 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404040:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335872 00000100:00100000:0.0:1651529344.404046:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151790 00000100:00100000:0.0:1651529344.404048:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946335808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.404049:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404049:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404050:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404053:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 4/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.404053:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176583 count 1 00010000:00010000:0.0:1651529344.404057:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,1 mode: --/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404059:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.404061:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 2/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1986 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404064:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404065:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.404067:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1986:41279:x1731746396216192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.404069:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10748 00010000:00010000:0.0:1651529344.404072:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 4/0,1 mode: --/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404074:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10749 00000100:00100000:1.0:1651529344.404075:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746396216320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.404077:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404079:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 4/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1985 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.404079:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 3/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1985 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404082:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 3/0,0 mode: PR/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1985 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.404083:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 4/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1985 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404087:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38b127d/0xa29a79078f3bc40a lrc: 0/0,0 mode: --/PR res: [0x2b1c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d2e expref: 1985 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404087:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404090:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404091:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404092:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404094:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 4/0,1 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.404095:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.404104:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.404108:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151791 00000100:00100000:1.0:1651529344.404109:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1984:41279:x1731746396216320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.404110:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946335744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.404112:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10749 00002000:00080000:0.0:1651529344.404115:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176582 count 1 00000100:00100000:1.0:1651529344.404121:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151792 00000100:00100000:1.0:1651529344.404123:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946335872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.404128:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176584 count 1 00010000:00010000:1.0:1651529344.404133:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404134:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404137:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 2/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404139:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 2/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404140:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404141:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404142:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 4/0,1 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404142:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404142:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404143:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 4/0,1 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404149:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 3/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404150:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 3/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404153:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 4/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404157:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.404164:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 4/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404165:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.404168:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966588992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404170:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404173:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404176:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.404176:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.404179:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 2/0,0 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404182:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404185:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404188:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404191:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404230:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946335104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1276us (1383us total) trans 30064892650 rc 0/0 00000100:00100000:0.0:1651529344.404231:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:39029:x1731745946335168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1378us total) trans 30064892651 rc 0/0 00000100:00100000:1.0:1651529344.404233:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151787 00000100:00100000:0.0:1651529344.404235:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151788 00010000:00010000:1.0:1651529344.404241:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 2/0,0 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404243:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404246:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fab6f5e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.404247:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d288cb7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.404247:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404248:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 2/0,0 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404251:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 3/0,0 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404255:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 1/0,0 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404258:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d288cb7/0xa29a79078f3bd2ab lrc: 0/0,0 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404258:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 3/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404263:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 1/0,0 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404266:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fab6f5e/0xa29a79078f3bd2b2 lrc: 0/0,0 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.404371:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336064 00000100:00100000:1.0:1651529344.404385:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336000 00000100:00100000:1.0:1651529344.404393:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151793 00000100:00100000:1.0:1651529344.404394:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:39029:x1731745946336064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.404396:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151794 00000100:00100000:0.0:1651529344.404399:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946336000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.404400:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176586 count 1 00010000:00010000:1.0:1651529344.404404:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.404404:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176585 count 1 00010000:00010000:0.0:1651529344.404409:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: --/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404414:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 2/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404416:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 2/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404420:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404424:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404425:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 4/0,1 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404432:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404433:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 3/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404433:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404434:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 4/0,1 mode: --/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404437:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 4/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404441:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966589056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.404452:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 3/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.404453:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.404475:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 4/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404479:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404489:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.404503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.404524:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336192 00000100:00100000:1.0:1651529344.404531:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336256 00000100:00100000:1.0:1651529344.404535:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151795 00000100:00100000:1.0:1651529344.404536:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002276da14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946336192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.404541:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176587 count 1 00010000:00010000:1.0:1651529344.404546:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: --/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404550:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 2/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404553:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404554:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404555:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 4/0,1 mode: --/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404573:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 3/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404576:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 4/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404580:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966589184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404593:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.404600:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151796 00000100:00100000:1.0:1651529344.404602:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946336256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.404607:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176588 count 1 00010000:00010000:1.0:1651529344.404611:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: --/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404615:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 2/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404627:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404627:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404628:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 4/0,1 mode: --/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404635:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 3/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1983 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.404639:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 4/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404650:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404669:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.404764:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966588928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.404769:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.404773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.404782:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.404783:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216832 00000100:00100000:0.0:1651529344.404790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.404797:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 5/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404824:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216768 00010000:00010000:1.0:1651529344.404827:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 5/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1985 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404838:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216960 00010000:00010000:1.0:1651529344.404841:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 5/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1986 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404845:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216896 00010000:00010000:1.0:1651529344.404847:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 4/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1987 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.404857:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10750 00000100:00100000:1.0:1651529344.404859:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41278:x1731746396216832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.404862:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404874:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 4/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1987 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404874:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966588864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404878:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 3/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1987 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404884:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b689354/0xa29a79078f3ba8ea lrc: 0/0,0 mode: --/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22fa expref: 1987 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404888:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404889:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404889:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404892:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 4/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404896:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 4/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404907:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.404912:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404918:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1986:41278:x1731746396216832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.404920:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: --/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404921:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10750 00010000:00010000:0.0:1651529344.404925:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404926:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10751 00000100:00100000:1.0:1651529344.404928:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746396216768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.404928:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404931:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404933:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 5/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1985 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.404942:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404945:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 2/0,0 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404946:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 4/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1985 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404951:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404952:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404952:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404955:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 4/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404960:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.404965:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746396216768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.404967:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10751 00000100:00100000:1.0:1651529344.404975:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10752 00000100:00100000:1.0:1651529344.404977:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1984:41278:x1731746396216960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.404979:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404981:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 5/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1984 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.404984:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 4/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.404986:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946335808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1054us total) trans 30064892652 rc 0/0 00010000:00010000:1.0:1651529344.404989:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404989:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.404990:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151790 00010000:00010000:1.0:1651529344.404996:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404997:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 2/0,0 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405000:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 4/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405000:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ebcde3d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.405001:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 2/0,0 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405004:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.405004:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 3/0,0 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405009:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1984:41278:x1731746396216960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.405009:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 1/0,0 mode: --/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405012:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10752 00010000:00010000:0.0:1651529344.405012:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd2c0 lrc: 0/0,0 mode: --/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405016:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10753 00000100:00100000:1.0:1651529344.405017:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41279:x1731746396216896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.405020:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.405021:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 4/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405022:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c7c98ab/0xa29a79078f3bb799 lrc: 0/0,0 mode: --/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c58 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405025:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 3/0,0 mode: PR/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405029:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45410e7/0xa29a79078f3b92af lrc: 0/0,0 mode: --/PR res: [0x2b1c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc863 expref: 1983 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405032:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405033:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405034:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405034:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966588992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.405036:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 4/0,1 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405038:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405041:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405043:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405046:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405049:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 2/0,0 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405050:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.405061:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1981:41279:x1731746396216896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.405064:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10753 00010000:00010000:1.0:1651529344.405071:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 2/0,0 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405074:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ca69b58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.405075:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 2/0,0 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405078:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 3/0,0 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405082:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 1/0,0 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405085:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd2ce lrc: 0/0,0 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405092:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405095:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405103:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946335744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1126us total) trans 30064892653 rc 0/0 00000100:00100000:0.0:1651529344.405106:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151791 00010000:00010000:1.0:1651529344.405108:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,1 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405111:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 2/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405124:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f5bb77d/0xa29a79078f3b924d lrc: 0/0,0 mode: --/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc736 expref: 1980 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.405128:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966588800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405131:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405135:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405137:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405141:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405143:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 2/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405155:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946335872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1170us total) trans 30064892654 rc 0/0 00000100:00100000:1.0:1651529344.405158:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151792 00000100:00100000:1.0:1651529344.405169:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966589184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.405173:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: --/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405180:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966589056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.405183:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405191:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946335680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1232us (1302us total) trans 30064892655 rc 0/0 00000100:00100000:0.0:1651529344.405194:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151789 00010000:00010000:0.0:1651529344.405201:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 2/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405204:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090ee5191 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.405205:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 2/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405208:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 3/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405213:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 1/0,0 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405216:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ee5191/0xa29a79078f3bd2c7 lrc: 0/0,0 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405220:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 2/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405222:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000189c34a8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.405223:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 2/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405226:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 3/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405229:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 1/0,0 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405230:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405232:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd2b9 lrc: 0/0,0 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405239:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217088 00000100:00100000:1.0:1651529344.405241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405244:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 4/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1980 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.405254:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217216 00010000:00010000:0.0:1651529344.405257:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 4/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1981 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.405264:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217024 00010000:00010000:0.0:1651529344.405266:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 4/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1982 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.405269:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217280 00010000:00010000:0.0:1651529344.405271:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 5/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.405276:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10754 00000100:00100000:0.0:1651529344.405277:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41278:x1731746396217088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.405280:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405281:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 4/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405285:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 3/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405290:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e361449/0xa29a79078f3ba620 lrc: 0/0,0 mode: --/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17b6 expref: 1983 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405293:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405294:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405295:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405298:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 4/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405305:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.405311:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41278:x1731746396217088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405314:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10754 00000100:00100000:0.0:1651529344.405318:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10755 00000100:00100000:0.0:1651529344.405320:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1981:41278:x1731746396217216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.405322:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405324:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 4/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1981 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405327:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 3/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1981 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405332:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bba5c lrc: 0/0,0 mode: --/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d673a expref: 1981 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.405335:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405336:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.405337:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10756 00010000:00010000:0.0:1651529344.405337:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405339:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1980:41279:x1731746396217024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.405339:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 4/0,1 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405343:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405347:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405359:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 4/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1980 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405363:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 3/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1980 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405369:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bb32b lrc: 0/0,0 mode: --/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bd4 expref: 1980 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405373:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.405373:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1979:41278:x1731746396217216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.405374:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405375:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405376:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10755 00010000:00010000:1.0:1651529344.405378:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 4/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405381:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10757 00000100:00100000:0.0:1651529344.405383:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41279:x1731746396217280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.405384:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.405386:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405387:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 5/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405391:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41279:x1731746396217024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.405391:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 4/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405393:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10756 00010000:00010000:0.0:1651529344.405396:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405398:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405401:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 4/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405405:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405406:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bad3c lrc: 0/0,0 mode: --/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3418 expref: 1977 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405410:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405411:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41279:x1731746396217280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.405414:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405414:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10757 00010000:00010000:0.0:1651529344.405420:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405424:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405427:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405428:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405430:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 2/0,0 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405431:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405434:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405442:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 2/0,0 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405479:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946336000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1167us total) trans 30064892656 rc 0/0 00000100:00100000:0.0:1651529344.405482:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151794 00000100:00100000:1.0:1651529344.405488:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+87:39029:x1731745946336256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 885us (984us total) trans 30064892657 rc 0/0 00000100:00100000:1.0:1651529344.405491:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151796 00010000:00010000:0.0:1651529344.405512:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 2/0,0 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405513:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 2/0,0 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405515:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.405516:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c32d2a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.405516:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 2/0,0 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405518:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 2/0,0 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405519:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 3/0,0 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405521:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 3/0,0 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405524:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 1/0,0 mode: --/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405525:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 1/0,0 mode: --/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405527:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd2dc lrc: 0/0,0 mode: --/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405535:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd2ea lrc: 0/0,0 mode: --/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405542:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405545:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405548:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.405563:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 2/0,0 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.405589:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.405599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.405611:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002276da14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946336192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1130us total) trans 30064892658 rc 0/0 00000100:00100000:1.0:1651529344.405614:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151795 00000100:00100000:1.0:1651529344.405620:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336832 00000100:00100000:1.0:1651529344.405639:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336960 00000100:00100000:1.0:1651529344.405646:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336768 00010000:00010000:0.0:1651529344.405651:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 2/0,0 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405655:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ded8c653 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.405656:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336896 00010000:00010000:0.0:1651529344.405656:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 2/0,0 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405659:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 3/0,0 mode: PW/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405660:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151797 00000100:00100000:1.0:1651529344.405662:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:39029:x1731745946336832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.405664:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 1/0,0 mode: --/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.405667:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176590 count 1 00010000:00010000:0.0:1651529344.405667:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd2e3 lrc: 0/0,0 mode: --/PW res: [0x2b1cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405671:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405675:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151798 00000100:00100000:0.0:1651529344.405677:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+89:39029:x1731745946336960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.405685:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 2/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405688:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405688:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405689:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 4/0,1 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405696:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 3/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.405696:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176592 count 1 00010000:00010000:1.0:1651529344.405700:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 4/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405704:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966589312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405712:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: --/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405717:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.405723:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 2/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.405725:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151799 00000100:00100000:1.0:1651529344.405726:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+89:39030:x1731745946336768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.405729:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405729:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.405739:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176589 count 1 00010000:00010000:0.0:1651529344.405739:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 4/0,1 mode: --/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405743:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: --/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405747:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 3/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405751:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 4/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.405754:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 2/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.405755:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966589376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.405758:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405762:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405763:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 4/0,1 mode: --/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405770:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 3/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405774:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 4/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.405777:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.405778:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966589440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405785:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151800 00000100:00100000:1.0:1651529344.405786:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.405786:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+89:39029:x1731745946336896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.405791:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176591 count 1 00010000:00010000:1.0:1651529344.405793:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405796:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405799:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405802:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 2/0,0 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405832:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: --/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405837:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 2/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405840:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405841:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405842:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 4/0,1 mode: --/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405852:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 3/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.405856:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946336064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1460us (1581us total) trans 30064892659 rc 0/0 00010000:00010000:0.0:1651529344.405856:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 4/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.405859:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151793 00000100:00100000:0.0:1651529344.405860:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405868:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.405875:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 2/0,0 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405878:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c5fd140 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.405879:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 2/0,0 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405882:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 3/0,0 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405887:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 1/0,0 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405890:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd2d5 lrc: 0/0,0 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.405936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.405944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.405966:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337088 00000100:00100000:0.0:1651529344.405968:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337152 00000100:00100000:1.0:1651529344.405973:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337216 00000100:00100000:0.0:1651529344.405978:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151801 00000100:00100000:0.0:1651529344.405980:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946337088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.405984:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151802 00000100:00100000:1.0:1651529344.405986:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946337152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.405991:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176594 count 1 00010000:00010000:1.0:1651529344.405996:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.405999:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176593 count 1 00010000:00010000:0.0:1651529344.406003:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406008:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 2/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406009:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 2/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1975 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406012:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406012:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406012:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406012:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406013:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 4/0,1 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406013:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 4/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406019:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 3/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406020:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 3/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1975 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406023:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406024:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 4/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1975 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406027:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966589568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406028:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966589632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.406043:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.406047:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.406054:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151803 00000100:00100000:1.0:1651529344.406055:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946337216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.406060:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176595 count 1 00010000:00010000:1.0:1651529344.406071:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.406076:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 2/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406079:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406080:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406080:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 4/0,1 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406086:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 3/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1975 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406090:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 4/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.406094:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966589696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406102:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.406116:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337408 00000100:00100000:1.0:1651529344.406128:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151804 00000100:00100000:1.0:1651529344.406130:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:39029:x1731745946337408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.406141:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176596 count 1 00010000:00010000:1.0:1651529344.406145:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406149:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 2/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1975 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406163:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406163:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406164:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 4/0,1 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406171:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 3/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1975 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406174:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 4/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1975 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.406178:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406191:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.406201:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966589312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.406204:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.406381:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966589440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.406384:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: --/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.406402:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217856 00010000:00010000:1.0:1651529344.406407:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 4/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1976 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.406425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.406436:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217920 00010000:00010000:1.0:1651529344.406439:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 5/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1977 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406442:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406444:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218048 00010000:00010000:1.0:1651529344.406446:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 4/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406446:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: --/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406450:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217984 00010000:00010000:1.0:1651529344.406452:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 4/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1979 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406454:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966589376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406456:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10758 00010000:00010000:0.0:1651529344.406457:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: --/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406458:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1979:41279:x1731746396217856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.406460:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.406462:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 4/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1979 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406463:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966589568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.406465:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 3/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1979 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406465:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406471:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005943f2ca/0xa29a79078f3bb412 lrc: 0/0,0 mode: --/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f85 expref: 1979 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406472:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10759 00000100:00100000:0.0:1651529344.406474:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41279:x1731746396217920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.406475:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406478:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.406479:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 4/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406482:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406483:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406483:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 3/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406486:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 4/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406489:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bbb58 lrc: 0/0,0 mode: --/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b00 expref: 1978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406493:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406494:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.406494:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406495:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406498:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 4/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406502:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1977:41279:x1731746396217856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.406504:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.406505:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10758 00000100:00100000:0.0:1651529344.406511:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41279:x1731746396217920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406513:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10759 00000100:00100000:1.0:1651529344.406515:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10760 00000100:00100000:1.0:1651529344.406517:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41279:x1731746396218048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.406519:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10761 00010000:00010000:1.0:1651529344.406520:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.406521:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 4/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406521:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41279:x1731746396217984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.406523:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.406525:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 3/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406525:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 4/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406529:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 3/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406530:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032db0d02/0xa29a79078f3ba6cf lrc: 0/0,0 mode: --/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a80 expref: 1975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406535:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406547:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 4/0,1 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406550:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009215650/0xa29a79078f3baf9d lrc: 0/0,0 mode: --/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d33 expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.406556:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.406560:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406561:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406561:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406563:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746396218048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.406565:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10760 00010000:00010000:0.0:1651529344.406567:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 4/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406576:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.406579:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406583:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406583:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746396217984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.406586:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406586:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10761 00010000:00010000:1.0:1651529344.406589:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406593:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406596:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406599:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406602:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 2/0,0 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406638:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946336832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 976us (1083us total) trans 30064892660 rc 0/0 00000100:00100000:1.0:1651529344.406642:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151797 00010000:00010000:1.0:1651529344.406649:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406653:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b5a0066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.406660:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406664:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 3/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406682:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 1/0,0 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406685:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd2f1 lrc: 0/0,0 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406690:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 2/0,0 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406692:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.406693:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 2/0,0 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406693:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946336960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1015us (1114us total) trans 30064892661 rc 0/0 00010000:00010000:1.0:1651529344.406696:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 3/0,0 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406696:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151798 00010000:00010000:1.0:1651529344.406699:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 1/0,0 mode: --/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406702:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd2f8 lrc: 0/0,0 mode: --/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406705:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406708:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406712:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,1 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406714:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 2/0,0 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406717:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406720:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406723:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406726:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 2/0,0 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406768:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946336896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1168us total) trans 30064892662 rc 0/0 00000100:00100000:0.0:1651529344.406771:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151800 00000100:00100000:1.0:1651529344.406773:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946336768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1046us (1183us total) trans 30064892663 rc 0/0 00000100:00100000:1.0:1651529344.406776:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151799 00010000:00010000:0.0:1651529344.406778:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 2/0,0 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406781:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.406783:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 2/0,0 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406785:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 3/0,0 mode: PW/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406790:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 1/0,0 mode: --/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.406793:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd306 lrc: 0/0,0 mode: --/PW res: [0x2b1cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406823:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 2/0,0 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406827:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c366db5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.406828:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 2/0,0 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406836:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 3/0,0 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406840:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 1/0,0 mode: --/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406843:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd2ff lrc: 0/0,0 mode: --/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406877:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218112 00010000:00010000:0.0:1651529344.406883:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1972 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.406886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.406898:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218368 00010000:00010000:0.0:1651529344.406901:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 5/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1973 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406909:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10762 00000100:00100000:0.0:1651529344.406911:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746396218112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.406912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.406914:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.406915:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1973 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406922:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 3/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1973 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406927:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3baff8 lrc: 0/0,0 mode: --/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ead expref: 1973 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406931:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406932:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406932:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406936:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 4/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406942:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.406943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.406950:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746396218112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406952:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10762 00000100:00100000:0.0:1651529344.406957:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218496 00010000:00010000:0.0:1651529344.406960:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 5/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1972 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406964:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218432 00010000:00010000:0.0:1651529344.406966:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 5/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1973 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.406971:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10763 00000100:00100000:0.0:1651529344.406973:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41278:x1731746396218368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.406975:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.406976:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 5/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1973 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406979:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 4/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1973 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.406985:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406985:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406986:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406989:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 4/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406993:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.407002:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41278:x1731746396218368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.407006:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10764 00000100:00100000:1.0:1651529344.407008:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41278:x1731746396218496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.407012:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.407014:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 5/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1973 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.407026:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10763 00010000:00010000:1.0:1651529344.407029:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 4/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1972 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.407031:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10765 00000100:00100000:0.0:1651529344.407033:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746396218432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.407035:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407036:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407036:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.407037:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407038:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 5/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1972 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.407040:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 4/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407042:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 4/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1972 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.407045:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.407047:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407048:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407049:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407052:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41278:x1731746396218496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.407052:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 4/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407055:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10764 00010000:00010000:0.0:1651529344.407056:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.407062:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746396218432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.407065:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10765 00010000:00010000:1.0:1651529344.407068:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ddc8e06/0xa29a79078f3bb6ea lrc: 0/0,0 mode: --/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59db expref: 1970 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407072:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966589696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407076:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407079:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407082:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407093:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407095:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 2/0,0 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407100:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407104:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407107:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407110:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 2/0,0 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407137:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946337216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1193us total) trans 30064892664 rc 0/0 00000100:00100000:1.0:1651529344.407140:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151803 00010000:00010000:1.0:1651529344.407147:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 2/0,0 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407150:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946337088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1169us (1242us total) trans 30064892665 rc 0/0 00010000:00010000:1.0:1651529344.407151:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039c01342 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.407152:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 2/0,0 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407154:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151801 00010000:00010000:1.0:1651529344.407155:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 3/0,0 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407159:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 1/0,0 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407161:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 2/0,0 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407162:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039c01342/0xa29a79078f3bd31b lrc: 0/0,0 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407165:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.407166:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 2/0,0 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407169:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 3/0,0 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407172:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d606e771/0xa29a79078f3b78a7 lrc: 0/0,0 mode: --/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb825 expref: 1969 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.407173:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 1/0,0 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407176:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd314 lrc: 0/0,0 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407183:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407187:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407190:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407193:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407196:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407198:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 2/0,0 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.407226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.407241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.407254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407265:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946337408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1135us (1194us total) trans 30064892666 rc 0/0 00000100:00100000:1.0:1651529344.407269:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151804 00000100:00100000:1.0:1651529344.407279:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337792 00010000:00010000:0.0:1651529344.407288:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 2/0,0 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407296:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337856 00010000:00010000:0.0:1651529344.407298:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022fb556b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.407299:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 2/0,0 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407301:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337920 00010000:00010000:0.0:1651529344.407302:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 3/0,0 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407305:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337984 00010000:00010000:0.0:1651529344.407307:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 1/0,0 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407309:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151805 00000100:00100000:1.0:1651529344.407310:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946337792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.407310:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022fb556b/0xa29a79078f3bd322 lrc: 0/0,0 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407318:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151806 00002000:00080000:1.0:1651529344.407324:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176597 count 1 00010000:00010000:1.0:1651529344.407329:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407334:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946337856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.407338:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 2/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.407340:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176598 count 1 00010000:00010000:1.0:1651529344.407341:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407342:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407343:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 4/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407344:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407349:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 2/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407350:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 3/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407352:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407353:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1968 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.407353:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407353:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 4/0,1 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407357:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407361:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 3/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407364:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 4/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1968 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407371:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.407378:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151807 00000100:00100000:0.0:1651529344.407379:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407380:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946337920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.407385:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176599 count 1 00010000:00010000:1.0:1651529344.407389:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: --/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407389:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407393:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 2/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.407395:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151808 00000100:00100000:0.0:1651529344.407397:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946337984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.407401:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176600 count 1 00010000:00010000:1.0:1651529344.407403:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407404:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407405:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 4/0,1 mode: --/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407412:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 3/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407414:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407415:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 4/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1968 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407419:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966589952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407419:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 2/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1968 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407422:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407422:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407423:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 4/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407427:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407438:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e2994e2/0xa29a79078f3b87f0 lrc: 0/0,0 mode: --/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0bb expref: 1968 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407442:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966589632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407445:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407449:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407451:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407452:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 3/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407456:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 4/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.407461:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407464:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,1 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407467:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 2/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407469:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.407495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.407509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407524:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946337152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1537us (1588us total) trans 30064892667 rc 0/0 00000100:00100000:1.0:1651529344.407527:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151802 00000100:00100000:0.0:1651529344.407529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407538:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338240 00000100:00100000:1.0:1651529344.407544:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338304 00000100:00100000:1.0:1651529344.407547:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338368 00000100:00100000:1.0:1651529344.407561:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151809 00000100:00100000:1.0:1651529344.407562:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946338240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.407569:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151810 00000100:00100000:0.0:1651529344.407572:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+100:39030:x1731745946338304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.407573:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176601 count 1 00002000:00080000:0.0:1651529344.407577:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176602 count 1 00010000:00010000:1.0:1651529344.407578:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: --/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407583:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 2/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407586:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407586:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407587:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 4/0,1 mode: --/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407590:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: --/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407594:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 3/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407595:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 2/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1967 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407598:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407599:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407600:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 4/0,1 mode: --/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407605:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 4/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.407607:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 3/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1967 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.407610:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966590080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407611:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 4/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1967 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.407615:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966590144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407623:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407628:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 2/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407632:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000143ae2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.407633:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 2/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407636:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 3/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407641:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 1/0,0 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407643:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000143ae2/0xa29a79078f3bd30d lrc: 0/0,0 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407644:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.407652:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151811 00000100:00100000:1.0:1651529344.407654:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946338368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.407658:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176603 count 1 00010000:00010000:1.0:1651529344.407662:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407674:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 2/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1967 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407677:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407677:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407678:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 4/0,1 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407694:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 3/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1967 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407697:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 4/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1967 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407701:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407709:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.407714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407727:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338624 00000100:00100000:1.0:1651529344.407753:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151812 00000100:00100000:1.0:1651529344.407754:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946338624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.407759:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176604 count 1 00010000:00010000:1.0:1651529344.407763:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407768:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 2/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407786:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407787:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407788:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 4/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407795:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 3/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407798:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 4/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.407817:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966590272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407826:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.407837:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966589824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407841:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407926:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966589952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407930:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: --/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407943:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966590080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407946:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: --/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407959:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966589888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407964:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407971:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.407972:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407974:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407975:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407981:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966590144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407983:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: --/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.408315:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218880 00000100:00100000:0.0:1651529344.408316:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.408320:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1968 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.408321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.408326:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219008 00000100:00100000:0.0:1651529344.408326:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.408328:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 4/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1969 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.408338:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219136 00000100:00100000:0.0:1651529344.408339:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219264 00010000:00010000:1.0:1651529344.408341:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 4/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1971 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408345:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 4/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1971 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.408346:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218944 00010000:00010000:1.0:1651529344.408348:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 4/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1972 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.408351:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219072 00000100:00100000:1.0:1651529344.408352:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219200 00010000:00010000:0.0:1651529344.408354:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 4/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408355:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 4/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1974 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.408359:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10766 00000100:00100000:1.0:1651529344.408361:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10767 00000100:00100000:0.0:1651529344.408361:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41278:x1731746396218880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.408363:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41278:x1731746396219008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.408364:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408366:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408370:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 3/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408373:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.408375:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 4/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408376:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425aeb0f/0xa29a79078f3b9c80 lrc: 0/0,0 mode: --/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf048 expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408379:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 3/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408380:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408380:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408381:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408384:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 4/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408385:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335f36c7/0xa29a79078f3bb42e lrc: 0/0,0 mode: --/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fee expref: 1973 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408388:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408389:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408390:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408393:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.408399:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 4/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408403:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41278:x1731746396218880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.408405:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408406:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10766 00000100:00100000:0.0:1651529344.408411:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10768 00000100:00100000:1.0:1651529344.408413:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41278:x1731746396219008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408413:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41278:x1731746396219136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.408416:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10767 00000100:00100000:1.0:1651529344.408421:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10769 00000100:00100000:1.0:1651529344.408423:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1970:41278:x1731746396219264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.408426:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.408427:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 4/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1970 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408431:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408433:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 4/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1970 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408440:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 3/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1970 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408441:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 3/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1970 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408445:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d82112/0xa29a79078f3ba1ea lrc: 0/0,0 mode: --/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0556 expref: 1970 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408447:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3b937a lrc: 0/0,0 mode: --/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbb9 expref: 1970 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408448:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408449:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408450:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408450:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408451:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408451:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408453:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 4/0,1 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408454:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 4/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408462:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.408467:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408469:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1968:41278:x1731746396219136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408472:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10768 00000100:00100000:1.0:1651529344.408474:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1968:41278:x1731746396219264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.408477:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10769 00000100:00100000:0.0:1651529344.408478:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10770 00000100:00100000:0.0:1651529344.408480:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1966:41279:x1731746396218944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.408482:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10771 00010000:00010000:0.0:1651529344.408482:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.408483:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1966:41279:x1731746396219072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.408484:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 4/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408486:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.408487:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 4/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408487:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 3/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408491:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 3/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408492:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3bafe3 lrc: 0/0,0 mode: --/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e4b expref: 1966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408496:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408496:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408497:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408500:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 4/0,1 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408504:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bb4cf lrc: 0/0,0 mode: --/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d521e expref: 1965 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408506:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.408507:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408508:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408509:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408511:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 4/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408511:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746396218944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408514:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10770 00000100:00100000:0.0:1651529344.408518:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10772 00010000:00010000:1.0:1651529344.408520:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.408527:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746396219072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408527:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746396219200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.408529:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.408530:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10771 00010000:00010000:0.0:1651529344.408531:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 4/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1963 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.408535:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 3/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1962 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408539:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408540:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416a2d2b/0xa29a79078f3b8f7c lrc: 0/0,0 mode: --/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4b2 expref: 1962 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.408542:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408545:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408545:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408546:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408547:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408548:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 2/0,0 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408549:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 4/0,1 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408555:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408560:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41279:x1731746396219200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408569:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10772 00010000:00010000:0.0:1651529344.408579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 2/0,0 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408582:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000013f54743 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.408583:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 2/0,0 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408586:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 3/0,0 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408590:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 1/0,0 mode: --/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408593:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f54743/0xa29a79078f3bd337 lrc: 0/0,0 mode: --/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408598:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946337920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1217us (1356us total) trans 30064892668 rc 0/0 00000100:00100000:1.0:1651529344.408601:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151807 00010000:00010000:0.0:1651529344.408601:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408604:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408607:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,1 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408608:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408610:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 2/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408612:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408615:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408617:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 2/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408652:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+103:39029:x1731745946337856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1317us (1426us total) trans 30064892669 rc 0/0 00000100:00100000:0.0:1651529344.408655:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151806 00010000:00010000:0.0:1651529344.408662:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 2/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408663:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946338368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1008us (1133us total) trans 30064892670 rc 0/0 00000100:00100000:1.0:1651529344.408665:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151811 00010000:00010000:0.0:1651529344.408665:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.408666:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 2/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408669:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 3/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408673:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 2/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408673:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 1/0,0 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408676:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.408676:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd330 lrc: 0/0,0 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408677:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 2/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408680:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 3/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408682:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408685:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408688:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408691:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 2/0,0 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408693:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 1/0,0 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408696:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd353 lrc: 0/0,0 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408700:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 2/0,0 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408703:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.408703:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 2/0,0 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408706:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 3/0,0 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408710:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 1/0,0 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408712:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd33e lrc: 0/0,0 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408718:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408721:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408724:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946337984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1326us (1470us total) trans 30064892671 rc 0/0 00000100:00100000:0.0:1651529344.408726:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151808 00010000:00010000:1.0:1651529344.408729:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408740:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408752:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408756:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d6a0530 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.408757:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408760:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 3/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408765:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 1/0,0 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408768:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6a0530/0xa29a79078f3bd329 lrc: 0/0,0 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408775:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408778:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408780:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946337792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1469us (1576us total) trans 30064892672 rc 0/0 00010000:00010000:0.0:1651529344.408781:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,1 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408783:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151805 00010000:00010000:0.0:1651529344.408784:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 2/0,0 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408817:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966590272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.408821:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408828:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 2/0,0 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408831:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.408832:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 2/0,0 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408835:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 3/0,0 mode: PW/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408839:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 1/0,0 mode: --/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408840:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946338304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1267us (1330us total) trans 30064892673 rc 0/0 00000100:00100000:0.0:1651529344.408843:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151810 00010000:00010000:1.0:1651529344.408852:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd34c lrc: 0/0,0 mode: --/PW res: [0x2b1da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408858:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408861:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.408864:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,1 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408867:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 2/0,0 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408918:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946338240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1342us (1411us total) trans 30064892674 rc 0/0 00000100:00100000:1.0:1651529344.408921:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151809 00010000:00010000:0.0:1651529344.408943:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 2/0,0 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408947:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.408949:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 2/0,0 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408952:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 3/0,0 mode: PW/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408956:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 1/0,0 mode: --/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408959:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3bd345 lrc: 0/0,0 mode: --/PW res: [0x2b1d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408967:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219392 00010000:00010000:0.0:1651529344.408972:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 4/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1961 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409005:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10773 00000100:00100000:0.0:1651529344.409007:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41279:x1731746396219392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.409011:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.409012:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 4/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1961 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409017:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 3/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1961 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409022:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bb50e lrc: 0/0,0 mode: --/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52fe expref: 1961 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409028:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409029:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409030:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409033:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 4/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409043:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.409050:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409053:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41279:x1731746396219392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.409055:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409056:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10773 00010000:00010000:1.0:1651529344.409058:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409070:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 2/0,0 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409121:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946338624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1365us (1407us total) trans 30064892675 rc 0/0 00000100:00100000:1.0:1651529344.409131:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151812 00000100:00100000:1.0:1651529344.409136:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338880 00000100:00100000:1.0:1651529344.409152:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151813 00000100:00100000:0.0:1651529344.409152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409153:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946338880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.409163:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176606 count 1 00000100:00100000:0.0:1651529344.409164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.409168:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409169:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 2/0,0 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409173:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 2/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1959 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409173:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.409174:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 2/0,0 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409176:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409177:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409177:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 4/0,1 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409177:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 3/0,0 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409182:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 1/0,0 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409184:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 3/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1959 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409187:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd35a lrc: 0/0,0 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409188:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 4/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1959 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409195:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338816 00000100:00100000:0.0:1651529344.409204:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338944 00000100:00100000:1.0:1651529344.409208:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966590336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.409209:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151814 00000100:00100000:0.0:1651529344.409210:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+104:39029:x1731745946338816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.409216:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176605 count 1 00010000:00010000:0.0:1651529344.409220:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409223:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409230:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151815 00000100:00100000:1.0:1651529344.409232:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:39029:x1731745946338944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.409237:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176607 count 1 00010000:00010000:0.0:1651529344.409238:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 2/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409241:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409242:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409243:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409243:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 4/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409245:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 2/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409248:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409249:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409249:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 4/0,1 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409251:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 3/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409255:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 4/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409256:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 3/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409259:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 4/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409259:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409263:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.409269:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409270:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.409341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409350:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339008 00000100:00100000:0.0:1651529344.409363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409378:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339136 00000100:00100000:0.0:1651529344.409382:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409393:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339200 00000100:00100000:0.0:1651529344.409397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409398:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151816 00000100:00100000:1.0:1651529344.409400:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+107:39029:x1731745946339008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.409408:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.409409:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176608 count 1 00010000:00010000:1.0:1651529344.409414:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: --/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409414:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339264 00010000:00010000:1.0:1651529344.409418:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 2/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1959 pid: 127523 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.409420:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339584 00010000:00010000:1.0:1651529344.409421:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409422:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409422:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 4/0,1 mode: --/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409423:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151817 00000100:00100000:0.0:1651529344.409425:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946339136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.409428:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 3/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1959 pid: 127523 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.409430:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176609 count 1 00010000:00010000:1.0:1651529344.409432:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 4/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1959 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409435:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409436:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966590528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409439:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 2/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409442:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409443:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409444:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 4/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409450:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409457:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151818 00010000:00010000:0.0:1651529344.409458:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 3/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.409459:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946339200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.409462:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 4/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.409464:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176610 count 1 00000100:00100000:0.0:1651529344.409469:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966590592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409474:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409478:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 2/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.409478:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.409481:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409482:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409483:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 4/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409485:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151819 00000100:00100000:0.0:1651529344.409487:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946339264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.409489:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 3/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.409491:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176611 count 1 00010000:00010000:1.0:1651529344.409493:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.409497:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966590656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409503:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: --/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409504:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.409508:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 2/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1959 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.409511:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151820 00000100:00100000:1.0:1651529344.409513:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946339584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.409517:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176612 count 1 00010000:00010000:1.0:1651529344.409521:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: --/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409525:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 2/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409526:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409527:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409528:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 4/0,1 mode: --/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409538:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409538:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409539:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 4/0,1 mode: --/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409545:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 3/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1959 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409546:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 3/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409549:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 4/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1959 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409550:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 4/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409553:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966590720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409554:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966590784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.409562:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409563:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409603:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966590336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409607:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.409621:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409624:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.409652:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219968 00010000:00010000:1.0:1651529344.409657:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 5/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1960 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.409677:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409682:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409687:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219904 00000100:00100000:0.0:1651529344.409689:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220032 00010000:00010000:1.0:1651529344.409690:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 4/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1962 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.409695:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10774 00000100:00100000:1.0:1651529344.409697:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1962:41279:x1731746396219968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.409699:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.409701:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 4/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1962 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409704:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 3/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1962 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409709:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 4/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1962 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409710:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000083988d6/0xa29a79078f3bc251 lrc: 0/0,0 mode: --/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8682 expref: 1962 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409713:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409714:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409715:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409716:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10775 00010000:00010000:1.0:1651529344.409718:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 4/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409718:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41278:x1731746396219904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.409720:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.409722:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 4/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1961 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409728:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.409741:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 3/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1961 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.409748:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41279:x1731746396219968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (127us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.409752:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d5e03e/0xa29a79078f3b97a9 lrc: 0/0,0 mode: --/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc98 expref: 1961 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409756:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409756:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.409757:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10774 00010000:00010000:0.0:1651529344.409757:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409762:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10776 00010000:00010000:0.0:1651529344.409763:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 4/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409764:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41278:x1731746396220032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.409767:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.409769:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 4/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.409772:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.409780:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 3/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.409780:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41278:x1731746396219904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.409783:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10775 00010000:00010000:1.0:1651529344.409785:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3ba4c2 lrc: 0/0,0 mode: --/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ce expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.409789:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409789:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409790:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409791:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409793:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 4/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409794:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409797:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409799:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.409800:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 2/0,0 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409817:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41278:x1731746396220032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.409820:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10776 00010000:00010000:1.0:1651529344.409828:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409844:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409847:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409850:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 2/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409891:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946338816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 679us (739us total) trans 30064892676 rc 0/0 00000100:00100000:0.0:1651529344.409894:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151814 00000100:00100000:1.0:1651529344.409895:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946338944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 662us (731us total) trans 30064892677 rc 0/0 00000100:00100000:1.0:1651529344.409898:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151815 00010000:00010000:0.0:1651529344.409902:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 2/0,0 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409906:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 2/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409910:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c32d2a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.409911:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 2/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409914:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 3/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409918:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 1/0,0 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409920:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.409921:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c32d2a2/0xa29a79078f3bd36f lrc: 0/0,0 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409921:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 2/0,0 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409924:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 3/0,0 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409929:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 1/0,0 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409935:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409938:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409940:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd368 lrc: 0/0,0 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409941:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409944:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 2/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410006:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946338880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 851us (888us total) trans 30064892678 rc 0/0 00000100:00100000:1.0:1651529344.410009:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151813 00000100:00100000:1.0:1651529344.410026:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966590656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410035:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410040:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 2/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410044:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.410045:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 2/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410048:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 3/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410049:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966590784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410052:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: --/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410053:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 1/0,0 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410056:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd361 lrc: 0/0,0 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410059:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966590528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.410068:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966590592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410071:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: --/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410073:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410079:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966590720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.410082:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: --/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.410254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.410264:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339904 00000100:00100000:1.0:1651529344.410275:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339840 00000100:00100000:1.0:1651529344.410280:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151821 00000100:00100000:0.0:1651529344.410280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.410282:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946339904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.410292:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176614 count 1 00000100:00100000:0.0:1651529344.410293:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.410301:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410306:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 2/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1956 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.410309:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410310:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410311:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 4/0,1 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410317:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 3/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1956 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.410322:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.410332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.410334:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 4/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1956 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.410343:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.410348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.410358:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.410361:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339968 00000100:00100000:0.0:1651529344.410369:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151822 00000100:00100000:0.0:1651529344.410370:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946339840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.410371:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220096 00010000:00010000:1.0:1651529344.410376:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 4/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1957 pid: 127523 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.410376:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176613 count 1 00010000:00010000:0.0:1651529344.410381:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410382:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220160 00010000:00010000:1.0:1651529344.410384:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 4/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.410386:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 2/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1958 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.410388:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220416 00010000:00010000:1.0:1651529344.410390:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 4/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.410391:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410392:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410393:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 4/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410394:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220224 00010000:00010000:1.0:1651529344.410396:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1960 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.410400:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220352 00010000:00010000:0.0:1651529344.410400:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 3/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1960 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.410402:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 4/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1961 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.410403:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 4/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1961 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.410406:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10777 00000100:00100000:1.0:1651529344.410408:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41279:x1731746396220096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.410408:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410411:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410412:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 4/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1961 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410415:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 3/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1961 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410417:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.410423:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151823 00000100:00100000:0.0:1651529344.410425:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946339968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.410429:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176615 count 1 00010000:00010000:1.0:1651529344.410430:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3b7dee lrc: 0/0,0 mode: --/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbac expref: 1961 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410434:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410434:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410435:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410438:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 4/0,1 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410442:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410445:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.410447:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 2/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1960 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.410450:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410450:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410451:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 4/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410452:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41279:x1731746396220096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410455:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10777 00000100:00100000:1.0:1651529344.410460:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10778 00010000:00010000:0.0:1651529344.410460:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 3/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1959 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.410461:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41279:x1731746396220160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410464:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410464:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 4/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410465:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 4/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410468:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966590976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410469:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 3/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410476:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.410480:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0e2077d/0xa29a79078f3ba6ac lrc: 0/0,0 mode: --/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a02 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410482:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10779 00000100:00100000:0.0:1651529344.410484:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41278:x1731746396220416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.410487:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410489:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 4/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410490:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410491:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410491:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410492:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 3/0,0 mode: PR/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410494:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 4/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410498:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbd033f2/0xa29a79078f3ba21b lrc: 0/0,0 mode: --/PR res: [0x2b1e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05f7 expref: 1958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410503:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.410509:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41279:x1731746396220160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.410509:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410509:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410510:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410512:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10778 00000100:00100000:1.0:1651529344.410516:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10780 00010000:00010000:0.0:1651529344.410516:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 4/0,1 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410518:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41279:x1731746396220224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410520:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410522:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1956 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.410525:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.410532:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 3/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1956 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.410532:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41278:x1731746396220416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.410535:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10779 00010000:00010000:1.0:1651529344.410538:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bb00d lrc: 0/0,0 mode: --/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ee5 expref: 1956 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410541:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.410545:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10781 00000100:00100000:0.0:1651529344.410547:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396220352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410548:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410549:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410549:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410551:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 4/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1954 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410552:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 4/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410554:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 3/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1954 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.410558:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.410560:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d8efc1/0xa29a79078f3b8a7b lrc: 0/0,0 mode: --/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc212 expref: 1954 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.410563:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410563:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410564:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410565:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1953:41279:x1731746396220224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410567:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10780 00010000:00010000:0.0:1651529344.410567:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 4/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410574:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.410575:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410579:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410579:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1952:41279:x1731746396220352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (231us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.410582:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410582:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10781 00010000:00010000:1.0:1651529344.410585:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 2/0,0 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410588:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410591:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410594:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410597:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 2/0,0 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410623:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946339200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1163us (1240us total) trans 30064892679 rc 0/0 00000100:00100000:1.0:1651529344.410626:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151818 00010000:00010000:1.0:1651529344.410633:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 2/0,0 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410637:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946339136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1212us (1275us total) trans 30064892680 rc 0/0 00010000:00010000:1.0:1651529344.410639:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ebcde3d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.410640:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 2/0,0 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410640:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151817 00010000:00010000:1.0:1651529344.410643:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 3/0,0 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410648:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 1/0,0 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410648:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 2/0,0 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410651:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd384 lrc: 0/0,0 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410651:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ded8c653 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.410652:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 2/0,0 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410656:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410657:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 3/0,0 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410659:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410662:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,1 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410662:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 1/0,0 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410665:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 2/0,0 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410665:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded8c653/0xa29a79078f3bd37d lrc: 0/0,0 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410669:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,0 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410680:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ca69b58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.410681:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 2/0,0 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410684:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 3/0,0 mode: PW/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410687:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 1/0,0 mode: --/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410690:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd392 lrc: 0/0,0 mode: --/PW res: [0x2b1e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410697:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410706:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:39029:x1731745946339584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1298us total) trans 30064892681 rc 0/0 00010000:00010000:0.0:1651529344.410708:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410709:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151820 00010000:00010000:0.0:1651529344.410711:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410714:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 2/0,0 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410718:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410728:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410741:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,1 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410744:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 2/0,0 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410774:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946339264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1286us (1375us total) trans 30064892682 rc 0/0 00000100:00100000:0.0:1651529344.410777:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151819 00000100:00100000:1.0:1651529344.410784:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+113:39029:x1731745946339008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1384us (1457us total) trans 30064892683 rc 0/0 00010000:00010000:0.0:1651529344.410784:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 2/0,0 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410787:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151816 00010000:00010000:0.0:1651529344.410788:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070dc9a1a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.410789:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 2/0,0 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410792:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 3/0,0 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410795:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 2/0,0 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410796:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 1/0,0 mode: --/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410798:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000189c34a8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.410799:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 2/0,0 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410799:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070dc9a1a/0xa29a79078f3bd38b lrc: 0/0,0 mode: --/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410817:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 3/0,0 mode: PW/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410822:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 1/0,0 mode: --/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410826:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd376 lrc: 0/0,0 mode: --/PW res: [0x2b1e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.411097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.411102:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340032 00000100:00100000:0.0:1651529344.411107:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340096 00000100:00100000:1.0:1651529344.411110:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151824 00000100:00100000:1.0:1651529344.411112:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d259f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946340032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.411119:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151825 00000100:00100000:0.0:1651529344.411120:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946340096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.411123:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176616 count 1 00010000:00010000:1.0:1651529344.411127:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411132:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 2/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411135:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411136:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411137:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 4/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.411139:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176617 count 1 00010000:00010000:1.0:1651529344.411144:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 3/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411144:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: --/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411147:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411149:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 2/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1951 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.411151:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966591040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411153:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411153:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411154:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 4/0,1 mode: --/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411166:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.411179:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 3/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1951 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411191:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 4/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1951 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411196:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411206:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.411228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.411244:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340160 00000100:00100000:1.0:1651529344.411251:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151826 00000100:00100000:1.0:1651529344.411253:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+115:39029:x1731745946340160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.411258:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176618 count 1 00010000:00010000:1.0:1651529344.411272:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: --/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411277:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 2/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1951 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.411281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.411290:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411291:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411292:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 4/0,1 mode: --/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.411299:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 3/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1951 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411308:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 4/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1951 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.411312:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966591168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.411325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.411331:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411337:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220928 00010000:00010000:1.0:1651529344.411341:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 5/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1952 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411351:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966590912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411355:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220992 00010000:00010000:0.0:1651529344.411355:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411363:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966590976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411365:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411367:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 4/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1953 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411372:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221056 00000100:00100000:1.0:1651529344.411373:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10782 00000100:00100000:1.0:1651529344.411374:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396220928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.411377:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.411377:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 4/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1954 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411379:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 5/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1954 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411382:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 4/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1954 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411383:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10783 00000100:00100000:0.0:1651529344.411385:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396220992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.411388:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411388:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411388:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.411389:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411389:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 4/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1954 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411392:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 4/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411393:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 3/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1954 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411397:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.411409:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396220928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.411412:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10782 00000100:00100000:1.0:1651529344.411417:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10784 00000100:00100000:1.0:1651529344.411418:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1953:41278:x1731746396221056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.411421:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.411429:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 4/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1953 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411433:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 3/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1953 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411437:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bab05 lrc: 0/0,0 mode: --/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b0b expref: 1953 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411438:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3b9f35 lrc: 0/0,0 mode: --/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb23 expref: 1953 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411441:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411442:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411442:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411442:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411443:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411443:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411446:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 4/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411446:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 4/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411454:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.411458:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.411460:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41278:x1731746396221056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.411463:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10784 00000100:00100000:0.0:1651529344.411466:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41279:x1731746396220992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.411469:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10783 00000100:00100000:1.0:1651529344.411472:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340288 00010000:00010000:0.0:1651529344.411476:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411481:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340224 00000100:00100000:1.0:1651529344.411485:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151827 00000100:00100000:1.0:1651529344.411487:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946340288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.411491:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176620 count 1 00010000:00010000:1.0:1651529344.411496:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411498:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411508:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411510:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 2/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1949 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411511:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 2/0,0 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411513:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411513:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411514:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 4/0,1 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411521:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 3/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1949 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411525:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 4/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1949 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.411529:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966591232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411537:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411543:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151828 00000100:00100000:1.0:1651529344.411545:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946340224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.411556:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176619 count 1 00010000:00010000:1.0:1651529344.411559:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411564:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 2/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1949 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411566:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411573:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411574:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 4/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411575:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946339840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1203us (1320us total) trans 30064892684 rc 0/0 00000100:00100000:0.0:1651529344.411578:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151822 00010000:00010000:1.0:1651529344.411581:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 3/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1949 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411584:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411586:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 2/0,0 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411588:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411589:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c366db5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.411590:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 2/0,0 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411593:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 3/0,0 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411596:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.411598:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 1/0,0 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411601:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c366db5/0xa29a79078f3bd3a0 lrc: 0/0,0 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411605:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1be1a8/0xa29a79078f3b9ed3 lrc: 0/0,0 mode: --/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf92b expref: 1949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411608:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411609:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966590848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411611:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411612:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411614:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411616:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411618:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411621:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411629:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411633:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 2/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411668:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946339968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1242us (1407us total) trans 30064892685 rc 0/0 00000100:00100000:0.0:1651529344.411671:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151823 00000100:00100000:1.0:1651529344.411676:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+118:39029:x1731745946339904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1393us (1431us total) trans 30064892686 rc 0/0 00010000:00010000:0.0:1651529344.411678:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411679:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151821 00010000:00010000:0.0:1651529344.411681:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.411682:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411685:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 3/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411686:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 2/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411689:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000195e0ab1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.411689:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 1/0,0 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411690:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 2/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411692:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd3a7 lrc: 0/0,0 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411693:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 3/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411698:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 1/0,0 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411701:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd399 lrc: 0/0,0 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411744:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966591040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.411749:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.411764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.411775:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221120 00010000:00010000:1.0:1651529344.411785:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1949 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.411786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.411799:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221184 00010000:00010000:1.0:1651529344.411823:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 5/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1950 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.411830:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221248 00010000:00010000:1.0:1651529344.411833:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 5/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1951 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.411838:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10785 00000100:00100000:0.0:1651529344.411849:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411857:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41279:x1731746396221120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.411860:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.411866:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411870:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 3/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411875:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d62fbc6c/0xa29a79078f3bad74 lrc: 0/0,0 mode: --/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3506 expref: 1951 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411876:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: --/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411879:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.411885:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10786 00010000:00010000:1.0:1651529344.411886:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411887:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411887:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41279:x1731746396221184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.411890:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 4/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411891:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.411893:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 4/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1950 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411896:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 3/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1950 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411898:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.411902:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec15f669/0xa29a79078f3bb6ff lrc: 0/0,0 mode: --/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a59 expref: 1950 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411905:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411906:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.411910:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1949:41279:x1731746396221120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.411913:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10785 00010000:00010000:0.0:1651529344.411914:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411918:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10787 00000100:00100000:1.0:1651529344.411920:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1948:41279:x1731746396221248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.411923:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.411924:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 5/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1948 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.411928:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 4/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1948 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.411929:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 4/0,1 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411933:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411934:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411935:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411936:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.411937:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 4/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411941:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.411944:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1948:41279:x1731746396221184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.411946:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10786 00000100:00100000:1.0:1651529344.411954:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1947:41279:x1731746396221248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.411957:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10787 00010000:00010000:0.0:1651529344.411959:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411963:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411966:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,1 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411968:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 2/0,0 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411969:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c6e9b23/0xa29a79078f3b96b4 lrc: 0/0,0 mode: --/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8a1 expref: 1946 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.411973:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966591168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.411976:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411980:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411982:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411985:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411988:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 2/0,0 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412030:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946340096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (933us total) trans 30064892687 rc 0/0 00000100:00100000:1.0:1651529344.412033:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+119:39029:x1731745946340160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 778us (805us total) trans 30064892688 rc 0/0 00000100:00100000:0.0:1651529344.412034:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151825 00000100:00100000:1.0:1651529344.412035:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151826 00010000:00010000:0.0:1651529344.412041:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 2/0,0 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412043:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412044:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.412045:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 2/0,0 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412048:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 3/0,0 mode: PW/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412052:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 1/0,0 mode: --/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412056:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412058:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd3b5 lrc: 0/0,0 mode: --/PW res: [0x2b1e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412060:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412062:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412062:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 2/0,0 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412064:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa20b79a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.412065:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 2/0,0 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412068:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 3/0,0 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412071:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 1/0,0 mode: --/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412074:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa20b79a/0xa29a79078f3bd3bc lrc: 0/0,0 mode: --/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412077:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412080:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b5a0066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.412081:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412086:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 3/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412089:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 1/0,0 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412092:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5a0066/0xa29a79078f3bd3ae lrc: 0/0,0 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412097:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d259f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39029:x1731745946340032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 984us (1016us total) trans 30064892689 rc 0/0 00000100:00100000:1.0:1651529344.412100:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151824 00000100:00100000:0.0:1651529344.412128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.412139:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340864 00000100:00100000:0.0:1651529344.412145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.412146:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151829 00000100:00100000:1.0:1651529344.412147:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946340864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.412152:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176621 count 1 00000100:00100000:0.0:1651529344.412157:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.412167:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: --/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412173:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 2/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412176:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412176:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412177:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 4/0,1 mode: --/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412192:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340928 00010000:00010000:1.0:1651529344.412203:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 3/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412207:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 4/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412210:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966591360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412225:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.412231:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340992 00000100:00100000:1.0:1651529344.412232:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151830 00000100:00100000:1.0:1651529344.412234:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+120:39029:x1731745946340928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.412238:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176622 count 1 00010000:00010000:1.0:1651529344.412242:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: --/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412247:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151831 00000100:00100000:0.0:1651529344.412249:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946340992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.412254:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 2/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.412255:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176623 count 1 00010000:00010000:1.0:1651529344.412257:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412258:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412259:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 4/0,1 mode: --/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412260:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412264:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 2/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412265:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 3/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412268:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 4/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.412268:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412268:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412269:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 4/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412277:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966591424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.412279:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 3/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.412283:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 4/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412285:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.412287:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.412296:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.412343:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966591232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412347:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412355:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412357:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.412372:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221824 00010000:00010000:1.0:1651529344.412377:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 4/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412389:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10788 00000100:00100000:1.0:1651529344.412391:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1946:41279:x1731746396221824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.412394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.412400:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412401:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 4/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.412403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.412405:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 3/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.412413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.412421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.412430:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341056 00010000:00010000:1.0:1651529344.412432:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca14551/0xa29a79078f3bba6a lrc: 0/0,0 mode: --/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6772 expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412436:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.412436:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341120 00010000:00010000:1.0:1651529344.412437:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412438:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412442:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341184 00010000:00010000:1.0:1651529344.412445:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 4/0,1 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412447:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151832 00000100:00100000:0.0:1651529344.412448:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946341056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.412452:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1651529344.412454:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176624 count 1 00010000:00010000:0.0:1651529344.412458:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412465:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41279:x1731746396221824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 73us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412467:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10788 00000100:00100000:1.0:1651529344.412473:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221888 00010000:00010000:1.0:1651529344.412476:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412485:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10789 00000100:00100000:1.0:1651529344.412486:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41278:x1731746396221888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.412488:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 2/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412489:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412490:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.412491:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412494:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 3/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.412500:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412500:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 4/0,1 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412506:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bb665 lrc: 0/0,0 mode: --/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57ab expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412509:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412510:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412511:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412514:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 4/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412518:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 3/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1944 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.412520:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.412522:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 4/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1944 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.412526:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966591552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412527:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1944:41278:x1731746396221888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412529:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10789 00000100:00100000:0.0:1651529344.412535:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.412536:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412539:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412542:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412543:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151833 00000100:00100000:0.0:1651529344.412544:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946341120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.412545:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 2/0,0 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.412549:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176625 count 1 00010000:00010000:0.0:1651529344.412553:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: --/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412558:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 2/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.412569:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412569:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412570:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 4/0,1 mode: --/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412577:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 3/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.412590:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.412594:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966591616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412598:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946340224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1052us (1301us total) trans 30064892690 rc 0/0 00000100:00100000:1.0:1651529344.412601:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151828 00000100:00100000:1.0:1651529344.412606:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151834 00000100:00100000:1.0:1651529344.412608:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946341184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.412613:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176626 count 1 00000100:00100000:0.0:1651529344.412614:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.412617:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: --/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412620:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 2/0,0 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412622:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 2/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.412623:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ca694ba already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.412624:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 2/0,0 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412625:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412625:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412626:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 4/0,1 mode: --/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412627:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 3/0,0 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412632:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 1/0,0 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412633:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 3/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.412635:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca694ba/0xa29a79078f3bd3ca lrc: 0/0,0 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412636:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 4/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412640:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412648:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.412684:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412688:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412691:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,1 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412693:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 2/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.412726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.412758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.412769:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946340288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1280us (1487us total) trans 30064892691 rc 0/0 00000100:00100000:1.0:1651529344.412772:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151827 00000100:00100000:1.0:1651529344.412786:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221952 00010000:00010000:0.0:1651529344.412791:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 2/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412796:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 5/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1944 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412820:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222080 00010000:00010000:1.0:1651529344.412824:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 5/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412829:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222016 00010000:00010000:1.0:1651529344.412832:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 5/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.412835:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ee7027c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.412836:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 2/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412837:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10790 00010000:00010000:0.0:1651529344.412839:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 3/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412844:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 1/0,0 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412845:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1946:41279:x1731746396221952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.412847:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ee7027c/0xa29a79078f3bd3c3 lrc: 0/0,0 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412848:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412849:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 5/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412853:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 4/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412859:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412860:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412861:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412864:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 4/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412869:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412876:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1946:41279:x1731746396221952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412878:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10790 00000100:00100000:1.0:1651529344.412882:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10791 00000100:00100000:1.0:1651529344.412884:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41279:x1731746396222080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.412885:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412886:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412887:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 4/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.412889:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412891:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 3/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412896:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a9d484/0xa29a79078f3baf26 lrc: 0/0,0 mode: --/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b11 expref: 1945 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412900:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412900:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412901:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412901:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10792 00000100:00100000:0.0:1651529344.412903:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1944:41279:x1731746396222016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.412904:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 4/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412906:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.412908:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 5/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1944 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412913:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412918:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1944:41279:x1731746396222080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.412919:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 4/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1944 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412921:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10791 00000100:00100000:1.0:1651529344.412933:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966591424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412943:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: --/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412946:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3ba07e lrc: 0/0,0 mode: --/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc2 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.412952:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3ba54e lrc: 0/0,0 mode: --/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d143d expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.412956:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966591360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412959:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412959:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412960:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412960:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412964:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412964:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 4/0,1 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412967:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412970:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412974:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.412979:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412982:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1941:41279:x1731746396222016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.412985:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10792 00010000:00010000:0.0:1651529344.412994:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412997:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413000:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413003:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413018:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946340864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 870us (890us total) trans 30064892692 rc 0/0 00000100:00100000:1.0:1651529344.413021:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151829 00010000:00010000:1.0:1651529344.413028:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413032:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb910b6e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.413033:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413035:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 3/0,0 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413040:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 1/0,0 mode: --/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413043:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd3d1 lrc: 0/0,0 mode: --/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413047:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413050:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6372cd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.413051:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413054:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 3/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413057:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 1/0,0 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413059:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd3df lrc: 0/0,0 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413064:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413067:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413070:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413070:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946340992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 820us (913us total) trans 30064892693 rc 0/0 00010000:00010000:1.0:1651529344.413073:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413073:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151831 00010000:00010000:0.0:1651529344.413089:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413093:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b899a19 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.413094:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413097:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 3/0,0 mode: PW/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413102:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 1/0,0 mode: --/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413105:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd3d8 lrc: 0/0,0 mode: --/PW res: [0x2b1ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413115:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946340928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (970us total) trans 30064892694 rc 0/0 00000100:00100000:1.0:1651529344.413118:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151830 00000100:00100000:0.0:1651529344.413153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413163:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341248 00000100:00100000:1.0:1651529344.413173:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151835 00000100:00100000:1.0:1651529344.413175:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946341248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.413180:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176627 count 1 00000100:00100000:0.0:1651529344.413183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.413184:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413194:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 2/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1940 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413202:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413203:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413203:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 4/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413211:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 3/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1940 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413220:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1940 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.413227:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.413234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.413243:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966591744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.413244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.413258:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966591616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413262:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.413269:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222208 00010000:00010000:0.0:1651529344.413269:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: --/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413273:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413280:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222144 00010000:00010000:1.0:1651529344.413283:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 5/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1942 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413287:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222272 00010000:00010000:1.0:1651529344.413289:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 5/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.413291:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966591552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413293:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10793 00000100:00100000:1.0:1651529344.413295:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1943:41279:x1731746396222208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.413295:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413297:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.413299:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413302:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 3/0,0 mode: PR/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.413302:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341312 00010000:00010000:1.0:1651529344.413307:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000886360db/0xa29a79078f3ba8f8 lrc: 0/0,0 mode: --/PR res: [0x2b1f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d235c expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.413314:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151836 00000100:00100000:0.0:1651529344.413316:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+125:39029:x1731745946341312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.413321:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176628 count 1 00010000:00010000:1.0:1651529344.413327:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413328:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413328:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413331:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 4/0,1 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413333:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: --/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413337:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 2/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1942 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413340:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.413347:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1942:41279:x1731746396222208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.413347:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413347:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413348:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 4/0,1 mode: --/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413350:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10793 00010000:00010000:0.0:1651529344.413356:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 3/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1941 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413359:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10794 00010000:00010000:0.0:1651529344.413360:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 4/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413361:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1941:41278:x1731746396222144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.413363:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.413364:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.413365:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 4/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413369:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 3/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413373:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3ba460 lrc: 0/0,0 mode: --/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f9e expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413377:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413384:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413385:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413387:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.413388:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 4/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413393:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413396:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.413401:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413403:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41278:x1731746396222144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.413405:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10794 00010000:00010000:0.0:1651529344.413405:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,1 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413407:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 2/0,0 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413409:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10795 00000100:00100000:1.0:1651529344.413411:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1939:41278:x1731746396222272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.413414:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.413422:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 5/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1939 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413426:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 4/0,0 mode: PR/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1939 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.413430:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413431:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413432:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413435:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 4/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413439:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.413454:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1939:41278:x1731746396222272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.413454:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946341120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (1041us total) trans 30064892695 rc 0/0 00000100:00100000:1.0:1651529344.413457:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10795 00000100:00100000:0.0:1651529344.413458:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151833 00010000:00010000:1.0:1651529344.413463:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 2/0,0 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413465:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413467:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e17f64ce already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.413468:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 2/0,0 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413469:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413471:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 3/0,0 mode: PW/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413472:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413475:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 1/0,0 mode: --/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413475:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 2/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413477:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd3ed lrc: 0/0,0 mode: --/PW res: [0x2b1f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413481:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413484:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c5fd140 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.413485:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 2/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413488:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 3/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413493:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 1/0,0 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413496:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c5fd140/0xa29a79078f3bd3e6 lrc: 0/0,0 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413506:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a81e729/0xa29a79078f3bb267 lrc: 0/0,0 mode: --/PR res: [0x2b1f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47f9 expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413510:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.413512:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946341056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1062us (1117us total) trans 30064892696 rc 0/0 00010000:00010000:1.0:1651529344.413513:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413515:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151832 00010000:00010000:1.0:1651529344.413516:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413519:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413522:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413524:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413547:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.413561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.413572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413584:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946341184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1155us total) trans 30064892697 rc 0/0 00000100:00100000:1.0:1651529344.413587:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151834 00000100:00100000:1.0:1651529344.413593:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341888 00000100:00100000:1.0:1651529344.413598:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341952 00000100:00100000:1.0:1651529344.413609:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342016 00010000:00010000:0.0:1651529344.413621:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413626:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4c6bb8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.413627:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413630:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 3/0,0 mode: PW/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413635:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 1/0,0 mode: --/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413637:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd3f4 lrc: 0/0,0 mode: --/PW res: [0x2b1f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413640:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151837 00000100:00100000:1.0:1651529344.413642:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946341888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.413646:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151838 00002000:00080000:1.0:1651529344.413647:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176629 count 1 00010000:00010000:1.0:1651529344.413652:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: --/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413664:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 2/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.413665:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946341952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.413668:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413669:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413669:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 4/0,1 mode: --/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.413670:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176630 count 1 00010000:00010000:0.0:1651529344.413675:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413676:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 3/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413680:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 4/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1937 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.413680:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 2/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413683:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413683:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.413684:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.413684:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 4/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413691:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 3/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413695:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 4/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1937 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413698:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.413705:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151839 00000100:00100000:0.0:1651529344.413706:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966591936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413707:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946342016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.413712:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176631 count 1 00010000:00010000:1.0:1651529344.413716:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413716:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.413720:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 2/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1937 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413723:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413724:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413724:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 4/0,1 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413739:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 3/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1937 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413742:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 4/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1937 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413746:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966592000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413767:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.413794:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413816:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342080 00000100:00100000:1.0:1651529344.413825:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151840 00000100:00100000:1.0:1651529344.413826:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946342080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.413831:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176632 count 1 00000100:00100000:0.0:1651529344.413838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.413849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.413855:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413868:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 2/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413871:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413872:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413872:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 4/0,1 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413879:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 3/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413883:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 4/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1937 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413887:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413910:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.413917:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342144 00000100:00100000:1.0:1651529344.413925:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342208 00000100:00100000:1.0:1651529344.413932:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151841 00000100:00100000:1.0:1651529344.413934:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946342144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.413939:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176633 count 1 00000100:00100000:0.0:1651529344.413950:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151842 00000100:00100000:0.0:1651529344.413952:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946342208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.413956:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: --/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.413958:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176634 count 1 00010000:00010000:1.0:1651529344.413961:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 2/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413962:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: --/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413970:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 2/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1937 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413973:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413973:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413973:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413974:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 4/0,1 mode: --/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413974:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413974:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 4/0,1 mode: --/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413981:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 3/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1937 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413982:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 3/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1937 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413985:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 4/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1937 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.413989:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966592128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.414002:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.414019:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 4/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1937 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414024:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966592192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.414034:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.414057:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966591744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.414062:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414086:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222784 00010000:00010000:0.0:1651529344.414093:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414104:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10796 00000100:00100000:0.0:1651529344.414106:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1938:41278:x1731746396222784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.414109:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414110:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414114:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 3/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414120:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381db1d3/0xa29a79078f3bbd1f lrc: 0/0,0 mode: --/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d719e expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414124:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414124:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414125:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414128:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 4/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414136:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.414138:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414142:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414145:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414145:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1937:41278:x1731746396222784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.414148:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10796 00010000:00010000:1.0:1651529344.414157:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414212:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+132:39029:x1731745946341248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1036us (1059us total) trans 30064892698 rc 0/0 00000100:00100000:1.0:1651529344.414215:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151835 00010000:00010000:1.0:1651529344.414223:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414226:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab014776 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.414227:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414238:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 3/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414243:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 1/0,0 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414246:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd3fb lrc: 0/0,0 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.414387:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342272 00000100:00100000:1.0:1651529344.414396:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151843 00000100:00100000:1.0:1651529344.414398:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+132:39029:x1731745946342272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.414403:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176635 count 1 00010000:00010000:1.0:1651529344.414417:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: --/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414422:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 2/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1936 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.414425:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414426:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414426:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 4/0,1 mode: --/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414433:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 3/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1936 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.414437:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 4/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1936 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414441:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.414455:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.414502:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966591872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.414506:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: --/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.414535:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966592000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.414539:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414548:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414566:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.414568:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222976 00010000:00010000:1.0:1651529344.414578:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 5/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1937 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.414585:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222912 00010000:00010000:1.0:1651529344.414588:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 5/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.414592:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223104 00010000:00010000:1.0:1651529344.414594:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 4/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1939 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414596:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966591936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.414598:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223040 00010000:00010000:1.0:1651529344.414600:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 4/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1940 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414601:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414604:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223168 00010000:00010000:1.0:1651529344.414606:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 5/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1941 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414609:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966592192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.414610:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223232 00010000:00010000:0.0:1651529344.414611:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: --/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414612:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 5/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1942 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414616:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223296 00010000:00010000:1.0:1651529344.414618:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 4/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1943 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414618:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966591808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.414620:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: --/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414627:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10797 00000100:00100000:0.0:1651529344.414629:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1943:41279:x1731746396222976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414632:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.414633:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10798 00000100:00100000:1.0:1651529344.414634:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1943:41278:x1731746396222912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414634:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 4/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414637:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414638:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 3/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414639:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 4/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414643:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 3/0,0 mode: PR/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414643:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049a5b7e/0xa29a79078f3bbd6c lrc: 0/0,0 mode: --/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72e0 expref: 1943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414647:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414648:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc633e91/0xa29a79078f3bbb9e lrc: 0/0,0 mode: --/PR res: [0x2b1f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c50 expref: 1942 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414648:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414652:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414652:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414653:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414656:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 4/0,1 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414657:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414665:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.414673:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1941:41278:x1731746396222912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.414676:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10798 00000100:00100000:1.0:1651529344.414680:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10799 00010000:00010000:0.0:1651529344.414684:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 4/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414688:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41279:x1731746396223104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.414691:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.414692:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 4/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1940 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414692:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.414696:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 3/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1940 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414700:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41279:x1731746396222976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414701:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d643a637/0xa29a79078f3b88ad lrc: 0/0,0 mode: --/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc124 expref: 1940 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.414703:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10797 00010000:00010000:1.0:1651529344.414704:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414705:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414706:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414709:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 4/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414710:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10800 00000100:00100000:0.0:1651529344.414711:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1938:41278:x1731746396223040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.414714:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.414715:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.414716:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 4/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414720:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 3/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414721:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1938:41279:x1731746396223104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.414724:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10799 00010000:00010000:0.0:1651529344.414725:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b716ce5/0xa29a79078f3bb1fe lrc: 0/0,0 mode: --/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46a9 expref: 1938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414728:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10801 00010000:00010000:0.0:1651529344.414729:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414730:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.414739:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41278:x1731746396223168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.414742:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414742:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414743:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 5/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1936 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414745:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 4/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414753:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 4/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1936 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414758:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414758:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414761:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.414765:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414768:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41278:x1731746396223040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414769:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 4/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414771:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10800 00010000:00010000:1.0:1651529344.414773:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.414780:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41278:x1731746396223168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.414781:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10802 00000100:00100000:1.0:1651529344.414782:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10801 00000100:00100000:0.0:1651529344.414782:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41279:x1731746396223232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414785:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.414787:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10803 00010000:00010000:0.0:1651529344.414787:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 5/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1934 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414789:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41279:x1731746396223296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.414791:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414791:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 4/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1934 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414793:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 4/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1934 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.414796:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 3/0,0 mode: PR/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1934 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414796:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414797:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414798:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414801:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d25a4f8/0xa29a79078f3b98cf lrc: 0/0,0 mode: --/PR res: [0x2b1fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce13e expref: 1934 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.414801:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 4/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414826:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.414833:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41279:x1731746396223232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414835:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414836:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.414836:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10802 00010000:00010000:1.0:1651529344.414837:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414840:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 4/0,1 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414843:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414848:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.414855:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1932:41279:x1731746396223296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 66us (267us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.414857:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414858:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10803 00010000:00010000:0.0:1651529344.414861:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414864:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414867:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414870:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414873:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414876:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 2/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414912:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+134:39029:x1731745946341952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1246us (1350us total) trans 30064892699 rc 0/0 00000100:00100000:0.0:1651529344.414915:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151838 00000100:00100000:1.0:1651529344.414919:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+133:39030:x1731745946342016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1211us (1347us total) trans 30064892700 rc 0/0 00010000:00010000:0.0:1651529344.414922:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414923:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151839 00010000:00010000:0.0:1651529344.414926:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ddda7a96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.414927:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414930:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 3/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414934:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 1/0,0 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414937:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd410 lrc: 0/0,0 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414943:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f831a6a3/0xa29a79078f3ba90d lrc: 0/0,0 mode: --/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2394 expref: 1931 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.414947:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966592128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.414951:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414951:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 2/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414954:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414954:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.414955:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 2/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414957:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414957:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 3/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414960:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414961:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 1/0,0 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414962:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 2/0,0 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414963:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd417 lrc: 0/0,0 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414967:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,0 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414969:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.414970:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 2/0,0 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414973:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 3/0,0 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414983:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 1/0,0 mode: --/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414986:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd425 lrc: 0/0,0 mode: --/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414993:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414996:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414999:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,1 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415000:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+133:39030:x1731745946342144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1065us (1161us total) trans 30064892701 rc 0/0 00010000:00010000:0.0:1651529344.415001:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 2/0,0 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415002:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151841 00010000:00010000:1.0:1651529344.415009:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 2/0,0 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415012:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a5ade66 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.415013:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 2/0,0 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415024:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 3/0,0 mode: PW/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415029:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 1/0,0 mode: --/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415032:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd42c lrc: 0/0,0 mode: --/PW res: [0x2b1fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415038:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415040:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+133:39029:x1731745946342208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1191us total) trans 30064892702 rc 0/0 00010000:00010000:1.0:1651529344.415041:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415043:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151842 00010000:00010000:1.0:1651529344.415044:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415047:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 2/0,0 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415060:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 2/0,0 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415063:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cadf91e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.415064:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 2/0,0 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415075:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 3/0,0 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415080:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 1/0,0 mode: --/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415082:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd409 lrc: 0/0,0 mode: --/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415085:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+133:39030:x1731745946341888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1442us (1538us total) trans 30064892703 rc 0/0 00000100:00100000:1.0:1651529344.415088:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151837 00010000:00010000:0.0:1651529344.415090:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415092:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415096:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,1 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415098:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c43cbd/0xa29a79078f3b9977 lrc: 0/0,0 mode: --/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3ad expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.415098:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 2/0,0 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415116:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.415120:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415123:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415126:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415129:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415131:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 2/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415137:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+133:39029:x1731745946341312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1820us (1953us total) trans 30064892704 rc 0/0 00000100:00100000:0.0:1651529344.415147:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151836 00010000:00010000:0.0:1651529344.415154:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 2/0,0 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415167:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fbd3940 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.415168:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 2/0,0 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415171:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 3/0,0 mode: PW/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415172:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+133:39029:x1731745946342080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1345us (1378us total) trans 30064892705 rc 0/0 00000100:00100000:1.0:1651529344.415175:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151840 00010000:00010000:0.0:1651529344.415175:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 1/0,0 mode: --/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415178:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd402 lrc: 0/0,0 mode: --/PW res: [0x2b1f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415182:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 2/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415185:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.415186:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 2/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415204:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 3/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415209:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 1/0,0 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.415211:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd41e lrc: 0/0,0 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415225:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223360 00010000:00010000:1.0:1651529344.415229:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 5/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415237:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10804 00000100:00100000:1.0:1651529344.415238:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746396223360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.415247:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.415248:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 5/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.415252:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 4/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.415269:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415270:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415271:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415287:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 4/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415292:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.415305:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746396223360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.415308:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10804 00010000:00010000:1.0:1651529344.415320:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089959694/0xa29a79078f3bb2d0 lrc: 0/0,0 mode: --/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a14 expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415324:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.415328:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415331:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415334:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415337:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415339:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 2/0,0 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415367:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 2/0,0 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415371:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.415372:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 2/0,0 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415375:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 3/0,0 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415380:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 1/0,0 mode: --/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415393:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd433 lrc: 0/0,0 mode: --/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415402:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+133:39029:x1731745946342272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1025us total) trans 30064892706 rc 0/0 00000100:00100000:1.0:1651529344.415405:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151843 00000100:00100000:0.0:1651529344.415459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415469:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342912 00000100:00100000:0.0:1651529344.415471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415484:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342848 00000100:00100000:1.0:1651529344.415490:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151844 00000100:00100000:1.0:1651529344.415491:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+134:39030:x1731745946342912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.415496:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176637 count 1 00010000:00010000:1.0:1651529344.415501:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415506:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 2/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415509:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415509:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415510:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 4/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415521:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151845 00010000:00010000:1.0:1651529344.415523:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 3/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.415523:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+134:39029:x1731745946342848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.415527:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 4/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415531:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592320:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.415539:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176636 count 1 00010000:00010000:0.0:1651529344.415544:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415549:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 2/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.415552:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.415559:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415559:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415560:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 4/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415568:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 3/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415572:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.415576:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966592384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.415586:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.415607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415622:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342976 00000100:00100000:0.0:1651529344.415626:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415640:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343104 00000100:00100000:1.0:1651529344.415645:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151846 00000100:00100000:1.0:1651529344.415646:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946342976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.415651:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176638 count 1 00000100:00100000:0.0:1651529344.415656:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.415665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.415666:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415671:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 2/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.415671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.415674:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415675:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415676:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 4/0,1 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.415687:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 3/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.415687:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343040 00010000:00010000:1.0:1651529344.415691:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 4/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.415696:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343232 00000100:00100000:0.0:1651529344.415699:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343168 00000100:00100000:1.0:1651529344.415700:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.415701:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343296 00000100:00100000:0.0:1651529344.415704:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151847 00000100:00100000:0.0:1651529344.415705:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+140:39029:x1731745946343104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.415711:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176640 count 1 00000100:00100000:1.0:1651529344.415714:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.415720:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151848 00010000:00010000:0.0:1651529344.415721:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415722:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+140:39030:x1731745946343040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.415726:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 2/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415729:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415739:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415740:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 4/0,1 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.415742:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176639 count 1 00010000:00010000:1.0:1651529344.415746:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415749:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 3/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415750:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 2/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415752:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 4/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.415753:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415754:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415755:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 4/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415757:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966592512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.415761:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 3/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415765:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415769:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966592576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415776:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.415781:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.415783:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151849 00000100:00100000:1.0:1651529344.415785:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+140:39029:x1731745946343232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.415788:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151850 00002000:00080000:1.0:1651529344.415789:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176642 count 1 00000100:00100000:0.0:1651529344.415790:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+140:39030:x1731745946343168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.415792:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,1 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.415795:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176641 count 1 00010000:00010000:1.0:1651529344.415796:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 2/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415799:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: --/PW res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415817:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 2/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1928 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415822:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415823:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415824:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 4/0,1 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415825:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415825:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415826:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 4/0,1 mode: --/PW res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415831:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 3/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415835:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 4/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415838:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966592640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415846:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.415846:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 3/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1928 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415850:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 4/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1928 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415853:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151851 00000100:00100000:1.0:1651529344.415854:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+140:39030:x1731745946343296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.415854:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966592704:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.415859:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176643 count 1 00000100:00100000:0.0:1651529344.415863:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.415870:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: --/PW res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415875:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 2/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415878:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415878:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415879:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 4/0,1 mode: --/PW res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415898:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 3/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1928 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415902:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 4/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.415906:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966592768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415914:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.415932:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.415944:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966592384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.415949:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415955:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416028:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223872 00000100:00100000:0.0:1651529344.416031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.416039:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 4/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416046:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224000 00010000:00010000:1.0:1651529344.416049:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416058:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10805 00000100:00100000:1.0:1651529344.416060:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746396223872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.416062:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10806 00010000:00010000:1.0:1651529344.416063:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.416064:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746396224000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.416065:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 4/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416068:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.416070:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416074:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 3/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416076:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 3/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416080:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3ba1a4 lrc: 0/0,0 mode: --/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0476 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416082:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3ba0bd lrc: 0/0,0 mode: --/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00b0 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416084:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416084:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416085:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416086:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416086:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416087:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416088:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 4/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416090:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 4/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416095:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.416097:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.416102:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41279:x1731746396224000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.416105:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41279:x1731746396223872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.416105:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10806 00000100:00100000:1.0:1651529344.416108:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10805 00010000:00010000:0.0:1651529344.416113:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416116:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416116:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416119:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416119:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416122:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416122:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 2/0,0 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416134:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 2/0,0 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416162:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+142:39029:x1731745946342848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 638us (691us total) trans 30064892707 rc 0/0 00000100:00100000:0.0:1651529344.416165:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151845 00010000:00010000:0.0:1651529344.416172:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 2/0,0 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416175:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087bc911b already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.416176:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+141:39030:x1731745946342912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 684us (717us total) trans 30064892708 rc 0/0 00010000:00010000:0.0:1651529344.416176:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 2/0,0 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416178:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 3/0,0 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416179:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151844 00010000:00010000:0.0:1651529344.416183:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 1/0,0 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416186:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 2/0,0 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416186:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd441 lrc: 0/0,0 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416190:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000465e6a7b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.416191:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 2/0,0 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416193:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 3/0,0 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416198:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 1/0,0 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416201:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd43a lrc: 0/0,0 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416268:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966592576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416272:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416302:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416305:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416325:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224128 00000100:00100000:0.0:1651529344.416327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.416335:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 4/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1927 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.416335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416352:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224064 00010000:00010000:1.0:1651529344.416356:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416360:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224192 00010000:00010000:1.0:1651529344.416362:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 5/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416367:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10807 00000100:00100000:0.0:1651529344.416367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416368:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41279:x1731746396224128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.416377:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966592512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416379:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.416380:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 4/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416382:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416384:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 3/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.416389:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224256 00010000:00010000:0.0:1651529344.416394:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 5/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416399:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710ace10/0xa29a79078f3bb6c7 lrc: 0/0,0 mode: --/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5941 expref: 1930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.416400:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10808 00000100:00100000:0.0:1651529344.416401:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746396224064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.416402:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416403:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416404:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416405:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.416406:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1929 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416407:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 4/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416414:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.416426:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41279:x1731746396224128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.416429:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10807 00010000:00010000:0.0:1651529344.416433:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 3/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416439:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10809 00000100:00100000:1.0:1651529344.416441:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41279:x1731746396224192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.416443:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.416445:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 4/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416449:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 3/0,0 mode: PR/PR res: [0x2b200:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416449:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000246de058/0xa29a79078f3b9aff lrc: 0/0,0 mode: --/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea44 expref: 1928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416453:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416454:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3baa80 lrc: 0/0,0 mode: --/PR res: [0x2b200:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d289c expref: 1927 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416454:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416454:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416457:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 4/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416467:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.416473:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416474:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416475:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416476:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1926:41279:x1731746396224064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 73us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.416478:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 4/0,1 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416478:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10808 00000100:00100000:0.0:1651529344.416484:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10810 00010000:00010000:1.0:1651529344.416486:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.416492:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1925:41278:x1731746396224256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.416493:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1925:41279:x1731746396224192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.416495:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.416496:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10809 00010000:00010000:0.0:1651529344.416497:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 5/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416501:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 4/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416506:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416506:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416507:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416508:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3baabf lrc: 0/0,0 mode: --/PR res: [0x2b202:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29d0 expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416512:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966592640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416512:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 4/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416516:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 4/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416517:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.416519:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416522:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416522:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1923:41278:x1731746396224256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.416525:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416525:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10810 00010000:00010000:0.0:1651529344.416531:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416535:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 2/0,0 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416535:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416538:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,1 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416540:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 2/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416578:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+142:39029:x1731745946343232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 792us (912us total) trans 30064892709 rc 0/0 00000100:00100000:1.0:1651529344.416581:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151849 00000100:00100000:0.0:1651529344.416587:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+141:39029:x1731745946343104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (961us total) trans 30064892710 rc 0/0 00010000:00010000:1.0:1651529344.416588:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416591:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151847 00010000:00010000:1.0:1651529344.416592:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416595:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416598:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416598:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 2/0,0 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416601:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000195e0ab1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.416603:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 2/0,0 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416606:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 3/0,0 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416610:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 1/0,0 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416613:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000195e0ab1/0xa29a79078f3bd45d lrc: 0/0,0 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416617:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 2/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416620:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e77a8a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.416621:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 2/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416624:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 3/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416627:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 1/0,0 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416629:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd44f lrc: 0/0,0 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416631:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+141:39030:x1731745946343040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (975us total) trans 30064892711 rc 0/0 00000100:00100000:1.0:1651529344.416634:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151848 00010000:00010000:0.0:1651529344.416635:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416638:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.416638:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416641:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416641:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 3/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416644:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 1/0,0 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416645:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416646:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd456 lrc: 0/0,0 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416657:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416660:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 2/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.416704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.416713:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+141:39029:x1731745946342976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1065us (1105us total) trans 30064892712 rc 0/0 00000100:00100000:1.0:1651529344.416722:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151846 00000100:00100000:1.0:1651529344.416727:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343616 00000100:00100000:0.0:1651529344.416727:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416743:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343552 00000100:00100000:1.0:1651529344.416747:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151852 00000100:00100000:1.0:1651529344.416749:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+142:39029:x1731745946343616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.416754:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176645 count 1 00000100:00100000:0.0:1651529344.416758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.416771:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416775:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 2/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1922 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.416783:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416784:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416785:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 4/0,1 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416791:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966592704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416795:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: --/PW res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416798:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 3/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1922 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.416821:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151853 00000100:00100000:0.0:1651529344.416823:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f2dbe31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+142:39030:x1731745946343552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.416826:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 4/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.416829:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176644 count 1 00000100:00100000:1.0:1651529344.416831:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416834:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416845:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.416850:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 2/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416854:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.416855:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 2/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416858:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 3/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416862:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 1/0,0 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416866:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd448 lrc: 0/0,0 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416867:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 2/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1922 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416870:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416871:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416872:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 4/0,1 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416873:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224384 00010000:00010000:1.0:1651529344.416878:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 5/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1923 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416879:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 3/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1923 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416883:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 4/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1923 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416884:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224320 00000100:00100000:0.0:1651529344.416887:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966592896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416895:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 4/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1924 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.416897:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.416902:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10811 00000100:00100000:1.0:1651529344.416903:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41279:x1731746396224384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.416904:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10812 00010000:00010000:1.0:1651529344.416906:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.416906:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746396224320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.416908:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 5/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416909:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.416911:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 4/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416911:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 4/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1924 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416915:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 3/0,0 mode: PR/PR res: [0x2b201:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1924 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.416916:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416917:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416918:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416920:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 4/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416920:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8fc1cf/0xa29a79078f3b77ab lrc: 0/0,0 mode: --/PR res: [0x2b201:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb412 expref: 1924 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.416924:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416925:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.416925:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416925:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416928:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 4/0,1 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416932:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1923:41279:x1731746396224384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.416935:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10811 00010000:00010000:0.0:1651529344.416935:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.416946:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3ba98b lrc: 0/0,0 mode: --/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2515 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.416950:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966592768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.416955:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41278:x1731746396224320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.416958:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10812 00010000:00010000:1.0:1651529344.416961:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416964:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416967:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416967:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416970:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416970:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416973:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 2/0,0 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416973:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,1 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416976:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 2/0,0 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417013:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946343296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1158us (1335us total) trans 30064892713 rc 0/0 00000100:00100000:1.0:1651529344.417017:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151851 00000100:00100000:0.0:1651529344.417026:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946343168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1235us (1354us total) trans 30064892714 rc 0/0 00000100:00100000:0.0:1651529344.417029:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151850 00010000:00010000:0.0:1651529344.417037:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 2/0,0 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417040:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000189c34a8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.417041:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 2/0,0 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417044:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 3/0,0 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417049:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 1/0,0 mode: --/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417052:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd46b lrc: 0/0,0 mode: --/PW res: [0x2b203:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417056:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 2/0,0 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417059:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a742b1a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.417059:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 2/0,0 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417065:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 3/0,0 mode: PW/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417068:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 1/0,0 mode: --/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417070:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd464 lrc: 0/0,0 mode: --/PW res: [0x2b201:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.417122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417131:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344000 00000100:00100000:0.0:1651529344.417136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417144:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344128 00000100:00100000:1.0:1651529344.417148:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344064 00000100:00100000:0.0:1651529344.417148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417153:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344192 00000100:00100000:1.0:1651529344.417157:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151854 00000100:00100000:1.0:1651529344.417158:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946344000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.417163:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176646 count 1 00010000:00010000:1.0:1651529344.417173:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417181:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151855 00000100:00100000:0.0:1651529344.417183:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946344128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.417189:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176648 count 1 00010000:00010000:1.0:1651529344.417191:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 2/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1920 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417193:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417194:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417194:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417195:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 4/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417198:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 2/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417202:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 3/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1920 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417202:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417203:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 4/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417206:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 4/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1920 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.417210:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417220:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 3/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.417225:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.417232:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151856 00000100:00100000:1.0:1651529344.417234:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946344064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.417239:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176647 count 1 00010000:00010000:1.0:1651529344.417242:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: --/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417246:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 4/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.417247:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 2/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417250:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.417251:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966593024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417257:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417258:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 4/0,1 mode: --/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417261:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.417265:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 3/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.417268:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151857 00010000:00010000:1.0:1651529344.417269:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 4/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.417270:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946344192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.417273:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966593088:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.417275:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176649 count 1 00000100:00100000:1.0:1651529344.417281:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.417287:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: --/PW res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417307:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 2/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417310:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417310:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417311:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 4/0,1 mode: --/PW res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417319:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 3/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417322:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 4/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.417334:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966593152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.417343:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.417356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417366:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344256 00000100:00100000:1.0:1651529344.417374:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151858 00000100:00100000:0.0:1651529344.417374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417375:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946344256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.417385:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176650 count 1 00010000:00010000:1.0:1651529344.417389:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: --/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417408:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 2/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417411:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417412:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417412:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 4/0,1 mode: --/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417419:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 3/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417429:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 4/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.417433:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966593216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.417447:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.417453:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344320 00000100:00100000:1.0:1651529344.417460:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151859 00000100:00100000:1.0:1651529344.417462:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+148:39030:x1731745946344320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.417466:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176651 count 1 00010000:00010000:1.0:1651529344.417470:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417483:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 2/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417486:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417487:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417487:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 4/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417494:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 3/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417497:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 4/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.417516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.417521:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966593280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.417524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.417540:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.417547:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224896 00010000:00010000:1.0:1651529344.417551:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 5/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1921 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.417565:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966592896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.417566:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224960 00010000:00010000:1.0:1651529344.417569:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 4/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.417570:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417576:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10813 00000100:00100000:1.0:1651529344.417577:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41279:x1731746396224896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.417578:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10814 00010000:00010000:1.0:1651529344.417580:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.417580:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41279:x1731746396224960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.417581:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 5/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.417583:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.417585:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 4/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.417585:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 4/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.417588:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 3/0,0 mode: PR/PR res: [0x2b204:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.417591:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417591:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417592:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417594:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bc09f lrc: 0/0,0 mode: --/PR res: [0x2b204:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f97 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.417595:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 4/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417598:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417598:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417607:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.417607:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417610:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 4/0,1 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417619:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41279:x1731746396224896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.417622:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10813 00010000:00010000:0.0:1651529344.417624:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.417635:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3b9fe4 lrc: 0/0,0 mode: --/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd84 expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.417639:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966592832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417643:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417646:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417646:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41279:x1731746396224960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 65us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.417649:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417649:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10814 00010000:00010000:1.0:1651529344.417652:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417654:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 2/0,0 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417683:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417687:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417690:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,1 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417693:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+149:39029:x1731745946343616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 943us (1032us total) trans 30064892715 rc 0/0 00010000:00010000:0.0:1651529344.417693:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 2/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417705:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151852 00010000:00010000:1.0:1651529344.417713:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 2/0,0 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417716:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ca69b58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.417717:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 2/0,0 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417720:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 3/0,0 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417725:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 1/0,0 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417728:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd472 lrc: 0/0,0 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417742:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 2/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417745:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e17f64ce already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.417745:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f2dbe31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+149:39030:x1731745946343552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 920us (1041us total) trans 30064892716 rc 0/0 00010000:00010000:1.0:1651529344.417746:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 2/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417748:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151853 00010000:00010000:1.0:1651529344.417749:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 3/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417760:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 1/0,0 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417763:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd479 lrc: 0/0,0 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417819:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966592960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417823:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417839:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966593088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417842:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: --/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417876:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966593216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417879:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: --/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417881:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966593024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417886:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417905:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966593152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417908:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: --/PW res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418038:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966593280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.418042:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418043:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.418050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.418065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.418074:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344768 00000100:00100000:0.0:1651529344.418075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.418084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.418085:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344704 00000100:00100000:0.0:1651529344.418092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.418097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.418099:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151860 00000100:00100000:1.0:1651529344.418101:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:39029:x1731745946344768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.418102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.418106:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176653 count 1 00000100:00100000:0.0:1651529344.418109:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151861 00010000:00010000:1.0:1651529344.418110:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418111:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946344704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.418115:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 2/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1918 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.418117:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176652 count 1 00010000:00010000:1.0:1651529344.418118:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418118:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418119:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 4/0,1 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418122:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418126:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 3/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418126:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 2/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.418129:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 4/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1918 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418129:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418130:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418131:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 4/0,1 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418133:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966593344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.418149:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.418154:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 3/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1918 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.418155:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225152 00010000:00010000:0.0:1651529344.418158:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 4/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418160:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 4/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1919 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418163:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966593408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.418166:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225280 00010000:00010000:1.0:1651529344.418168:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 4/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418172:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.418178:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225088 00000100:00100000:1.0:1651529344.418180:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225408 00010000:00010000:1.0:1651529344.418183:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 4/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418183:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 4/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1922 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.418187:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225216 00010000:00010000:1.0:1651529344.418189:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 4/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1923 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418189:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225344 00010000:00010000:0.0:1651529344.418191:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 4/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.418194:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10815 00000100:00100000:1.0:1651529344.418195:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41279:x1731746396225152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.418197:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10816 00010000:00010000:1.0:1651529344.418198:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.418198:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41279:x1731746396225280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.418199:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 4/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418201:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418203:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 3/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418203:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 4/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418206:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 3/0,0 mode: PR/PR res: [0x2b209:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418208:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3ba563 lrc: 0/0,0 mode: --/PR res: [0x2b208:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d146e expref: 1924 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418212:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418212:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418213:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418216:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 4/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418227:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bbea7 lrc: 0/0,0 mode: --/PR res: [0x2b209:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77be expref: 1923 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418231:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.418238:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41279:x1731746396225152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.418238:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418238:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418239:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418241:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10815 00010000:00010000:0.0:1651529344.418242:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 4/0,1 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418246:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10817 00000100:00100000:1.0:1651529344.418247:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41279:x1731746396225408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.418249:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.418250:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418252:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 4/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1921 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418255:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 3/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1921 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418256:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41279:x1731746396225280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.418259:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10816 00010000:00010000:1.0:1651529344.418260:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3b9f82 lrc: 0/0,0 mode: --/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbf5 expref: 1921 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418264:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.418264:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10818 00010000:00010000:1.0:1651529344.418265:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418265:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418266:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41278:x1731746396225088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.418268:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 4/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418268:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.418270:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 4/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1919 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418273:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 3/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1919 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418274:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.418278:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a581648b/0xa29a79078f3b96d0 lrc: 0/0,0 mode: --/PR res: [0x2b206:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd903 expref: 1919 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.418280:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41279:x1731746396225408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.418289:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10817 00010000:00010000:0.0:1651529344.418293:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418293:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.418294:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10819 00010000:00010000:0.0:1651529344.418294:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418295:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1917:41278:x1731746396225216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.418297:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 4/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418298:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418299:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 4/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1917 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418303:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 3/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1917 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418305:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.418312:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1917:41278:x1731746396225088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.418315:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd50c64a/0xa29a79078f3bb24b lrc: 0/0,0 mode: --/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d475f expref: 1917 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418315:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10818 00010000:00010000:1.0:1651529344.418318:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418319:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418320:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418320:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10820 00000100:00100000:0.0:1651529344.418321:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41278:x1731746396225344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.418323:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 4/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418324:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.418325:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 4/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1915 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.418328:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.418329:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 3/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1915 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.418334:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de942c8/0xa29a79078f3ba5cc lrc: 0/0,0 mode: --/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d166d expref: 1915 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.418335:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41278:x1731746396225216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.418337:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10819 00010000:00010000:0.0:1651529344.418337:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418344:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418344:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418346:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418348:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 4/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418356:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.418362:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418363:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1913:41278:x1731746396225344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.418365:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418365:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10820 00010000:00010000:1.0:1651529344.418367:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 2/0,0 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418372:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418382:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418385:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418388:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 2/0,0 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418417:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946344064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1182us (1281us total) trans 30064892717 rc 0/0 00000100:00100000:1.0:1651529344.418421:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151856 00010000:00010000:1.0:1651529344.418427:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 2/0,0 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418431:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ebcde3d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.418432:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 2/0,0 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418433:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946344128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1311us total) trans 30064892718 rc 0/0 00010000:00010000:1.0:1651529344.418435:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 3/0,0 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418436:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151855 00010000:00010000:1.0:1651529344.418439:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 1/0,0 mode: --/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418442:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebcde3d/0xa29a79078f3bd48e lrc: 0/0,0 mode: --/PW res: [0x2b207:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418444:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 2/0,0 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418457:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000551753c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.418458:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418458:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 2/0,0 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418461:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418461:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 3/0,0 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418464:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418466:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 1/0,0 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418467:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 2/0,0 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418469:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd487 lrc: 0/0,0 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418480:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 2/0,0 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418483:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3a2643a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.418484:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 2/0,0 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418487:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 3/0,0 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418490:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 1/0,0 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418500:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd4a3 lrc: 0/0,0 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418507:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946344320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1044us (1132us total) trans 30064892719 rc 0/0 00010000:00010000:0.0:1651529344.418507:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418509:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151859 00010000:00010000:0.0:1651529344.418510:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418513:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,1 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418516:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418516:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 2/0,0 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418519:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418529:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418532:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 2/0,0 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418563:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946344192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1292us (1414us total) trans 30064892720 rc 0/0 00000100:00100000:0.0:1651529344.418566:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151857 00010000:00010000:0.0:1651529344.418573:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 2/0,0 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418576:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4c6bb8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.418577:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 2/0,0 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418579:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946344256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1203us (1223us total) trans 30064892721 rc 0/0 00010000:00010000:0.0:1651529344.418580:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 3/0,0 mode: PW/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418582:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151858 00010000:00010000:1.0:1651529344.418589:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 2/0,0 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418593:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6372cd9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.418593:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 1/0,0 mode: --/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418594:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 2/0,0 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418596:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd495 lrc: 0/0,0 mode: --/PW res: [0x2b209:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418597:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 3/0,0 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418601:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 1/0,0 mode: --/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418604:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6372cd9/0xa29a79078f3bd49c lrc: 0/0,0 mode: --/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418609:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418612:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418615:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418626:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418682:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418686:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b9cb94 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.418687:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418690:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 3/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418696:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946344000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1536us (1589us total) trans 30064892722 rc 0/0 00000100:00100000:1.0:1651529344.418698:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151854 00010000:00010000:0.0:1651529344.418699:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 1/0,0 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418719:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b9cb94/0xa29a79078f3bd480 lrc: 0/0,0 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418876:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966593344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.418880:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.418904:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345152 00000100:00100000:1.0:1651529344.418912:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151862 00000100:00100000:1.0:1651529344.418913:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946345152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.418916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.418918:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176654 count 1 00010000:00010000:1.0:1651529344.418922:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418927:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 2/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1912 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.418930:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418931:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418931:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 4/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.418944:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 3/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1912 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.418950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.418961:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 4/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.418962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.418965:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966593472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.418980:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.418984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.418991:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225856 00010000:00010000:1.0:1651529344.418996:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 4/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1913 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419004:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225920 00000100:00100000:0.0:1651529344.419010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.419014:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 5/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1914 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419020:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10821 00000100:00100000:1.0:1651529344.419026:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41279:x1731746396225856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.419028:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345280 00010000:00010000:1.0:1651529344.419029:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.419030:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 4/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1914 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419037:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345408 00010000:00010000:1.0:1651529344.419039:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 3/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1914 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419041:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345216 00000100:00100000:0.0:1651529344.419043:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345344 00000100:00100000:0.0:1651529344.419045:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345472 00000100:00100000:0.0:1651529344.419048:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151863 00000100:00100000:0.0:1651529344.419050:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946345280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.419051:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001782bea0/0xa29a79078f3bbb7b lrc: 0/0,0 mode: --/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bb6 expref: 1914 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.419056:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176656 count 1 00010000:00010000:0.0:1651529344.419060:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: --/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419062:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419063:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419064:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419065:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 2/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1913 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419067:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 4/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419068:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419069:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419070:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 4/0,1 mode: --/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419073:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.419077:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 3/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1913 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419081:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 4/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1913 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419085:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1913:41279:x1731746396225856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.419088:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10821 00000100:00100000:0.0:1651529344.419093:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966593536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419098:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10822 00000100:00100000:1.0:1651529344.419099:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41279:x1731746396225920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.419102:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.419104:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 5/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.419107:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 4/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419110:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.419112:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419113:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419114:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419117:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151864 00000100:00100000:0.0:1651529344.419119:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946345408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.419124:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176658 count 1 00010000:00010000:1.0:1651529344.419126:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 4/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419127:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419130:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.419132:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 2/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1912 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419135:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419135:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419136:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 4/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419137:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41279:x1731746396225920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.419139:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10822 00010000:00010000:0.0:1651529344.419142:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 3/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1911 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419145:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419148:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151865 00000100:00100000:0.0:1651529344.419149:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966593600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419150:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946345216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.419155:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176655 count 1 00000100:00100000:0.0:1651529344.419156:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.419164:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830406f3/0xa29a79078f3baecb lrc: 0/0,0 mode: --/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d399e expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.419165:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: --/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419168:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966593408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.419170:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 2/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419173:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419174:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419174:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 4/0,1 mode: --/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419179:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419181:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 3/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419183:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419185:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 4/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1910 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419185:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419188:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419191:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 2/0,0 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419197:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966593664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419205:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.419212:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151866 00000100:00100000:1.0:1651529344.419214:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946345344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.419218:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176657 count 1 00010000:00010000:1.0:1651529344.419228:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: --/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419237:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 2/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419240:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419241:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419241:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 4/0,1 mode: --/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419248:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 3/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.419250:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946344704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1138us (1184us total) trans 30064892723 rc 0/0 00010000:00010000:1.0:1651529344.419251:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 4/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419253:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151861 00000100:00100000:1.0:1651529344.419255:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966593728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419258:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151867 00000100:00100000:0.0:1651529344.419260:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946345472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.419262:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.419264:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176659 count 1 00010000:00010000:0.0:1651529344.419268:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419269:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419273:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 2/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419279:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419282:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419284:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 2/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419287:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419288:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419289:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 4/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419296:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 3/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1910 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419300:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 4/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419304:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966593792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419313:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.419318:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 2/0,0 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419322:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb910b6e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.419323:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 2/0,0 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419324:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+157:39029:x1731745946344768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1281us total) trans 30064892724 rc 0/0 00010000:00010000:0.0:1651529344.419326:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 3/0,0 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419327:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151860 00010000:00010000:0.0:1651529344.419330:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 1/0,0 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419334:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 2/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419337:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.419339:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 2/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419341:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 3/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419342:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd4b1 lrc: 0/0,0 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419346:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 1/0,0 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419349:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd4aa lrc: 0/0,0 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419373:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966593472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.419377:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419420:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226048 00010000:00010000:0.0:1651529344.419426:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 4/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419437:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10823 00000100:00100000:0.0:1651529344.419439:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41279:x1731746396226048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.419442:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419443:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 4/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419447:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 3/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419453:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bbc70 lrc: 0/0,0 mode: --/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fa6 expref: 1911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419456:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419457:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419458:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419476:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 4/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419487:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.419488:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419492:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419496:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419497:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1910:41279:x1731746396226048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.419498:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419500:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10823 00000100:00100000:1.0:1651529344.419540:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+157:39029:x1731745946345152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 626us (657us total) trans 30064892725 rc 0/0 00000100:00100000:0.0:1651529344.419549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419552:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151862 00000100:00100000:1.0:1651529344.419558:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345792 00000100:00100000:1.0:1651529344.419565:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151868 00000100:00100000:1.0:1651529344.419566:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+157:39029:x1731745946345792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.419571:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176660 count 1 00010000:00010000:1.0:1651529344.419591:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: --/PW res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.419607:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419608:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 2/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1909 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419611:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419611:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.419612:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419612:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 4/0,1 mode: --/PW res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419612:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419615:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 3/0,0 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419620:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 3/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1909 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419620:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 1/0,0 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419623:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 4/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1909 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419623:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd4b8 lrc: 0/0,0 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419627:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966593856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419631:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345856 00000100:00100000:1.0:1651529344.419646:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.419646:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151869 00000100:00100000:0.0:1651529344.419648:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+158:39029:x1731745946345856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.419653:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176661 count 1 00010000:00010000:0.0:1651529344.419657:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419662:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 2/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1909 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419666:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 4/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419673:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 3/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1909 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419677:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1909 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419681:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966593920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419690:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.419771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419781:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345984 00000100:00100000:0.0:1651529344.419792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.419795:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151870 00000100:00100000:1.0:1651529344.419797:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946345984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.419798:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.419817:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.419821:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176662 count 1 00010000:00010000:1.0:1651529344.419830:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419840:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 2/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1909 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419853:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419853:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419854:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 4/0,1 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419858:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966593600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.419861:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 3/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1909 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419863:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419865:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 4/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1909 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419869:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966593984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419878:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.419884:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226304 00000100:00100000:0.0:1651529344.419885:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966593536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.419888:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: --/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419889:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419896:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226432 00000100:00100000:0.0:1651529344.419897:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226368 00010000:00010000:1.0:1651529344.419899:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 5/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419902:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 4/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1912 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419904:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10824 00000100:00100000:1.0:1651529344.419905:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41279:x1731746396226304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.419908:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.419908:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10825 00010000:00010000:1.0:1651529344.419909:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.419910:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41279:x1731746396226432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.419913:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419914:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 5/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419918:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 4/0,0 mode: PR/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.419920:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 3/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419924:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419924:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419925:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419926:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3bb08b lrc: 0/0,0 mode: --/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40f9 expref: 1912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419928:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 4/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419930:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419930:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419931:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419933:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.419934:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 4/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419940:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41279:x1731746396226432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.419943:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.419950:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41279:x1731746396226304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.419952:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10825 00000100:00100000:1.0:1651529344.419954:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10824 00000100:00100000:0.0:1651529344.419957:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10826 00010000:00010000:1.0:1651529344.419966:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b113ff71/0xa29a79078f3bbd88 lrc: 0/0,0 mode: --/PR res: [0x2b20f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7334 expref: 1909 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.419970:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966593664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419970:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41279:x1731746396226368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.419974:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419974:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419975:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 4/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1908 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.419977:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419980:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 3/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1908 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.419985:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda04b65/0xa29a79078f3b9326 lrc: 0/0,0 mode: --/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca5b expref: 1908 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.419987:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419988:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419989:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419990:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,1 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419990:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419992:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 2/0,0 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419993:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 4/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420007:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420013:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41279:x1731746396226368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.420016:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10826 00010000:00010000:0.0:1651529344.420023:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 2/0,0 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420026:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.420027:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 2/0,0 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420030:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 3/0,0 mode: PW/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420034:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946345216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 883us (1049us total) trans 30064892726 rc 0/0 00010000:00010000:0.0:1651529344.420034:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 1/0,0 mode: --/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420037:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151865 00010000:00010000:0.0:1651529344.420037:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd4cd lrc: 0/0,0 mode: --/PW res: [0x2b20f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420043:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420046:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420047:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966593728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.420049:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420051:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: --/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420052:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 2/0,0 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420069:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 2/0,0 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420072:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b899a19 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.420073:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 2/0,0 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420076:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 3/0,0 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420091:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 1/0,0 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420094:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b899a19/0xa29a79078f3bd4c6 lrc: 0/0,0 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420098:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946345408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 978us (1148us total) trans 30064892727 rc 0/0 00000100:00100000:0.0:1651529344.420102:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151864 00010000:00010000:0.0:1651529344.420109:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420113:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420116:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420118:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 2/0,0 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420151:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946345280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1100us (1236us total) trans 30064892728 rc 0/0 00000100:00100000:0.0:1651529344.420154:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151863 00010000:00010000:0.0:1651529344.420160:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 2/0,0 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420164:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cadf91e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.420165:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 2/0,0 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420167:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 3/0,0 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420172:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 1/0,0 mode: --/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420175:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cadf91e/0xa29a79078f3bd4bf lrc: 0/0,0 mode: --/PW res: [0x2b210:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420239:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226496 00010000:00010000:1.0:1651529344.420244:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 4/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1907 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420253:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226560 00010000:00010000:1.0:1651529344.420255:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 5/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.420267:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10827 00000100:00100000:1.0:1651529344.420268:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41279:x1731746396226496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.420271:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.420273:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 4/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.420276:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 3/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.420282:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f100e67/0xa29a79078f3bae7e lrc: 0/0,0 mode: --/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3878 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420293:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.420302:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420302:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420303:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420306:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 4/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420312:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966593792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.420317:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420318:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420324:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966593920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.420327:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420331:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41279:x1731746396226496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.420334:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10827 00000100:00100000:1.0:1651529344.420339:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226688 00010000:00010000:1.0:1651529344.420342:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 5/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1907 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.420347:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226816 00010000:00010000:1.0:1651529344.420349:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.420354:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10828 00000100:00100000:1.0:1651529344.420355:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41278:x1731746396226560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.420356:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10829 00010000:00010000:1.0:1651529344.420357:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.420358:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41279:x1731746396226688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.420359:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 4/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420361:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420363:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 5/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1908 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420367:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 4/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1908 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.420371:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 3/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420375:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420376:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420377:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edcb935/0xa29a79078f3ba9d1 lrc: 0/0,0 mode: --/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e7 expref: 1908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420377:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420380:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420380:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 4/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420381:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420382:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420385:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 4/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420385:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.420393:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420399:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41279:x1731746396226688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.420400:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41278:x1731746396226560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.420402:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10829 00000100:00100000:1.0:1651529344.420404:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10828 00000100:00100000:0.0:1651529344.420408:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10830 00000100:00100000:0.0:1651529344.420410:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41279:x1731746396226816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.420412:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420414:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1905 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.420416:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420417:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 3/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1905 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.420420:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420423:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420423:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bb037 lrc: 0/0,0 mode: --/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f7f expref: 1905 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420426:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420427:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420428:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420431:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 4/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420435:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 2/0,0 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420454:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420461:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746396226816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.420464:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10830 00010000:00010000:0.0:1651529344.420470:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 2/0,0 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420473:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.420475:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 2/0,0 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420477:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946345344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1262us (1466us total) trans 30064892729 rc 0/0 00010000:00010000:0.0:1651529344.420477:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 3/0,0 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420480:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151866 00010000:00010000:0.0:1651529344.420482:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 1/0,0 mode: --/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420484:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd4d4 lrc: 0/0,0 mode: --/PW res: [0x2b211:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420490:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3b842a lrc: 0/0,0 mode: --/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbed1 expref: 1903 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420490:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420495:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966593856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.420495:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420498:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420498:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420501:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420502:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420504:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420507:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420518:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 2/0,0 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420564:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+161:39029:x1731745946345472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1303us (1545us total) trans 30064892730 rc 0/0 00000100:00100000:0.0:1651529344.420567:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151867 00000100:00100000:1.0:1651529344.420569:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+161:39029:x1731745946345792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1020us total) trans 30064892731 rc 0/0 00000100:00100000:1.0:1651529344.420572:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151868 00010000:00010000:0.0:1651529344.420574:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420577:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab014776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.420578:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420580:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 2/0,0 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420581:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 3/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420583:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.420584:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 2/0,0 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420586:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 1/0,0 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420587:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 3/0,0 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420588:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab014776/0xa29a79078f3bd4db lrc: 0/0,0 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420592:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 1/0,0 mode: --/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420595:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd4e2 lrc: 0/0,0 mode: --/PW res: [0x2b214:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420595:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420598:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420601:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420603:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 2/0,0 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420638:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946345856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 989us (1041us total) trans 30064892732 rc 0/0 00000100:00100000:0.0:1651529344.420641:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151869 00010000:00010000:0.0:1651529344.420647:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 2/0,0 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420650:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4a435ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.420651:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 2/0,0 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420654:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 3/0,0 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420658:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 1/0,0 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420661:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a435ef/0xa29a79078f3bd4e9 lrc: 0/0,0 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420689:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.420714:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966593984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.420716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.420717:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420728:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420739:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346240 00000100:00100000:1.0:1651529344.420748:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346304 00000100:00100000:1.0:1651529344.420753:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151871 00000100:00100000:0.0:1651529344.420754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.420761:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946346240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.420767:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176663 count 1 00010000:00010000:1.0:1651529344.420771:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420776:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 2/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420785:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420786:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420786:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 4/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420795:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346368 00010000:00010000:1.0:1651529344.420800:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 3/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420821:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1902 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420822:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151872 00000100:00100000:0.0:1651529344.420824:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+162:39029:x1731745946346304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.420825:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966594048:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.420830:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176664 count 1 00010000:00010000:0.0:1651529344.420834:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420839:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.420845:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 2/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.420846:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151873 00000100:00100000:1.0:1651529344.420848:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+162:39030:x1731745946346368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.420848:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420849:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420850:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 4/0,1 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.420853:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176665 count 1 00010000:00010000:0.0:1651529344.420857:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 3/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.420861:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 4/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1902 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.420864:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: --/PW res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420875:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 2/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420878:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420879:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420879:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 4/0,1 mode: --/PW res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420883:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966594112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420886:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 3/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1902 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420890:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 4/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1902 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420893:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.420894:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966594176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.420902:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.420902:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227200 00010000:00010000:0.0:1651529344.420908:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 4/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.420920:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10831 00000100:00100000:0.0:1651529344.420922:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1903:41279:x1731746396227200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.420925:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420926:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 4/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420930:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 3/0,0 mode: PR/PR res: [0x2b216:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420936:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027078626/0xa29a79078f3ba9e6 lrc: 0/0,0 mode: --/PR res: [0x2b216:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d262d expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.420939:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420940:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420941:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420944:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 4/0,1 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420954:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.420956:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420960:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420961:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41279:x1731746396227200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (233us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.420963:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,1 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420964:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10831 00010000:00010000:1.0:1651529344.420965:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 2/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421006:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 2/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421010:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.421011:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 2/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421014:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 3/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421019:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 1/0,0 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421022:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd4f0 lrc: 0/0,0 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421028:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:39029:x1731745946345984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1229us (1256us total) trans 30064892733 rc 0/0 00000100:00100000:1.0:1651529344.421031:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151870 00000100:00100000:0.0:1651529344.421087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421097:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346560 00000100:00100000:0.0:1651529344.421097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421106:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346624 00000100:00100000:1.0:1651529344.421110:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151874 00000100:00100000:1.0:1651529344.421112:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946346560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.421117:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176666 count 1 00010000:00010000:1.0:1651529344.421128:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.421133:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 2/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1901 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421142:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421147:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421148:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 4/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421156:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 3/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1901 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.421158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.421160:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 4/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1901 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.421169:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966594240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421184:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346688 00000100:00100000:0.0:1651529344.421193:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346752 00000100:00100000:1.0:1651529344.421200:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.421206:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151875 00000100:00100000:0.0:1651529344.421208:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946346624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.421211:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151876 00000100:00100000:1.0:1651529344.421213:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+166:39029:x1731745946346688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.421218:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176668 count 1 00010000:00010000:1.0:1651529344.421221:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: --/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.421225:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176667 count 1 00010000:00010000:1.0:1651529344.421226:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 2/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421228:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421229:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421230:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 4/0,1 mode: --/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421230:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421235:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 2/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421236:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 3/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421238:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421239:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 4/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1901 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421239:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421240:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 4/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421243:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.421247:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 3/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.421250:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.421250:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 4/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1901 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.421255:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966594368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421256:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151877 00000100:00100000:1.0:1651529344.421257:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946346752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.421262:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176669 count 1 00010000:00010000:1.0:1651529344.421274:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421279:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 2/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421282:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.421282:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.421283:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421283:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 4/0,1 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421289:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 3/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1901 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.421291:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966594112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421293:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 4/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1901 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421295:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421297:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966594432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421304:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421314:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966594048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421317:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421336:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347008 00000100:00100000:1.0:1651529344.421343:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151878 00000100:00100000:1.0:1651529344.421345:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946347008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.421349:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176670 count 1 00000100:00100000:0.0:1651529344.421367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.421375:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421384:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 2/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1901 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.421389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.421397:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421398:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421399:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 4/0,1 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.421408:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227328 00010000:00010000:1.0:1651529344.421411:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 3/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1902 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421413:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1902 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.421414:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 4/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1902 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.421419:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966594496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421423:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227392 00010000:00010000:0.0:1651529344.421426:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 4/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.421437:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421443:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227456 00010000:00010000:1.0:1651529344.421448:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 5/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1904 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.421452:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10832 00000100:00100000:0.0:1651529344.421454:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746396227328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.421456:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10833 00000100:00100000:1.0:1651529344.421457:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746396227392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.421457:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.421459:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1904 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.421460:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.421461:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 4/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1904 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421463:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 3/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1904 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421469:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bc19b lrc: 0/0,0 mode: --/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8356 expref: 1904 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421473:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421474:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421474:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421475:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 3/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.421481:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1bbc3d/0xa29a79078f3bbd57 lrc: 0/0,0 mode: --/PR res: [0x2b218:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d728c expref: 1903 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.421484:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421485:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421486:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421488:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 4/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421489:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 4/0,1 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421502:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.421502:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.421509:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41279:x1731746396227392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.421511:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41279:x1731746396227328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.421512:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10833 00000100:00100000:0.0:1651529344.421514:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10832 00000100:00100000:1.0:1651529344.421517:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10834 00000100:00100000:1.0:1651529344.421519:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41278:x1731746396227456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.421522:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.421522:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421523:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 5/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421525:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421527:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 4/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421528:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,1 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421531:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 2/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421545:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421546:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421546:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421550:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 4/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421554:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.421560:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41278:x1731746396227456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.421563:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10834 00010000:00010000:1.0:1651529344.421569:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 2/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421572:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074c2362e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.421573:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 2/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421574:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+168:39029:x1731745946346304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 749us (859us total) trans 30064892734 rc 0/0 00010000:00010000:1.0:1651529344.421576:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 3/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421578:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151872 00010000:00010000:1.0:1651529344.421580:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 1/0,0 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421583:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c2362e/0xa29a79078f3bd4fe lrc: 0/0,0 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421596:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3b9ef6 lrc: 0/0,0 mode: --/PR res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9a9 expref: 1899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.421600:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966594176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421603:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421606:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421615:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421619:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421622:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 2/0,0 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421641:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 2/0,0 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421645:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.421653:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 2/0,0 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421656:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 3/0,0 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421662:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 1/0,0 mode: --/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421664:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd505 lrc: 0/0,0 mode: --/PW res: [0x2b219:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421673:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946346368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 824us (918us total) trans 30064892735 rc 0/0 00000100:00100000:1.0:1651529344.421676:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151873 00010000:00010000:1.0:1651529344.421684:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421699:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421702:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421705:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421746:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421750:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.421751:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421756:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946346240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 993us (1067us total) trans 30064892736 rc 0/0 00000100:00100000:1.0:1651529344.421759:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151871 00010000:00010000:0.0:1651529344.421768:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 3/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421773:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 1/0,0 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421776:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd4f7 lrc: 0/0,0 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421844:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966594240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421848:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421869:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347264 00000100:00100000:0.0:1651529344.421871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.421880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421888:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347328 00000100:00100000:1.0:1651529344.421895:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151879 00000100:00100000:1.0:1651529344.421897:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+169:39029:x1731745946347264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.421912:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151880 00000100:00100000:0.0:1651529344.421914:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:39029:x1731745946347328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.421915:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176671 count 1 00010000:00010000:1.0:1651529344.421919:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.421920:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176672 count 1 00010000:00010000:1.0:1651529344.421924:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 2/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1898 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421925:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: --/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421927:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421928:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421929:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 4/0,1 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421930:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 2/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1898 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421933:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421933:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421934:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 4/0,1 mode: --/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421935:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 3/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1898 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421939:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 4/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.421941:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 3/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1898 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.421943:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966594560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.421945:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 4/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.421949:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966594624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421957:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421966:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421966:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.421969:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: --/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421977:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227776 00010000:00010000:1.0:1651529344.421982:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 4/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1899 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.421989:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10835 00000100:00100000:1.0:1651529344.421991:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41278:x1731746396227776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.421993:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.421995:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 4/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1899 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.421998:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 3/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1899 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422003:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ab2c7d/0xa29a79078f3b9350 lrc: 0/0,0 mode: --/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaf5 expref: 1899 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422007:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422007:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422008:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422011:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 4/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422017:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.422030:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41278:x1731746396227776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422033:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10835 00000100:00100000:0.0:1651529344.422039:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.422048:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227968 00010000:00010000:1.0:1651529344.422051:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 4/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422068:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10836 00000100:00100000:1.0:1651529344.422070:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41279:x1731746396227968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.422073:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422082:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 4/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422086:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 3/0,0 mode: PR/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422092:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c2551de/0xa29a79078f3ba67b lrc: 0/0,0 mode: --/PR res: [0x2b21c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1930 expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422095:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422096:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422097:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422099:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 4/0,1 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422106:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.422117:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746396227968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422119:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10836 00010000:00010000:1.0:1651529344.422128:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422131:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422134:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,1 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422151:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 2/0,0 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422203:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:39029:x1731745946346688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 989us (1073us total) trans 30064892737 rc 0/0 00000100:00100000:1.0:1651529344.422206:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151876 00000100:00100000:1.0:1651529344.422211:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347392 00000100:00100000:1.0:1651529344.422219:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151881 00000100:00100000:1.0:1651529344.422221:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:39029:x1731745946347392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.422226:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176673 count 1 00010000:00010000:1.0:1651529344.422230:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422253:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 2/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1896 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.422253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422261:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422261:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422262:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 4/0,1 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422273:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966594368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422274:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 3/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1896 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422277:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422278:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 4/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1896 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422293:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.422306:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.422312:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 2/0,0 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422315:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ca69b58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.422316:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 2/0,0 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422319:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 3/0,0 mode: PW/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422324:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 1/0,0 mode: --/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422327:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca69b58/0xa29a79078f3bd513 lrc: 0/0,0 mode: --/PW res: [0x2b21c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422343:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228160 00010000:00010000:1.0:1651529344.422348:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 5/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1897 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422361:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228224 00010000:00010000:1.0:1651529344.422364:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 4/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.422379:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228288 00010000:00010000:1.0:1651529344.422383:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 5/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1899 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.422387:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10837 00000100:00100000:1.0:1651529344.422389:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41279:x1731746396228160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.422392:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422393:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 5/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1899 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422402:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 4/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422404:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422408:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422408:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422409:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422412:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 4/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422417:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.422417:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966594624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422421:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: --/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422429:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41279:x1731746396228160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422432:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10837 00000100:00100000:0.0:1651529344.422435:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347456 00000100:00100000:1.0:1651529344.422437:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228352 00010000:00010000:1.0:1651529344.422447:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 5/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422452:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228416 00010000:00010000:1.0:1651529344.422454:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 4/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422456:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151882 00000100:00100000:0.0:1651529344.422458:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+171:39029:x1731745946347456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.422459:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10838 00000100:00100000:1.0:1651529344.422460:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41278:x1731746396228224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.422463:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1651529344.422463:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176674 count 1 00010000:00010000:1.0:1651529344.422464:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 4/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422468:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 3/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422468:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: --/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422472:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 2/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1900 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.422473:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b99c661a/0xa29a79078f3bb634 lrc: 0/0,0 mode: --/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d573b expref: 1900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422475:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422476:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422477:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422477:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422480:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 4/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422489:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.422500:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41278:x1731746396228224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422503:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10838 00010000:00010000:0.0:1651529344.422504:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 4/0,1 mode: --/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422507:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10839 00000100:00100000:1.0:1651529344.422509:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41278:x1731746396228288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.422511:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422513:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 5/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1898 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422513:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 3/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1898 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.422516:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 4/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1898 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422517:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 4/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422521:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.422521:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966594752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422522:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422522:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422526:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 4/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422530:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.422530:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.422534:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41278:x1731746396228288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.422535:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422537:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10839 00010000:00010000:0.0:1651529344.422538:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422540:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10840 00010000:00010000:0.0:1651529344.422541:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422542:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746396228352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.422544:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.422544:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 2/0,0 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422551:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 5/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1897 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422555:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 4/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1897 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422560:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422561:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422563:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 4/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422568:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.422573:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746396228352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422575:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10840 00000100:00100000:1.0:1651529344.422578:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10841 00000100:00100000:1.0:1651529344.422580:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1896:41278:x1731746396228416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.422582:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422584:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 4/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1896 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422585:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+172:39030:x1731745946346624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1376us (1487us total) trans 30064892738 rc 0/0 00010000:00010000:1.0:1651529344.422587:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 3/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1896 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.422588:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151875 00010000:00010000:1.0:1651529344.422591:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9354f41/0xa29a79078f3ba317 lrc: 0/0,0 mode: --/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a81 expref: 1896 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422595:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 2/0,0 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422601:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422601:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422602:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422605:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 4/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422610:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f620f630 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.422613:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.422617:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 2/0,0 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422619:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1895:41278:x1731746396228416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.422620:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 3/0,0 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422621:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10841 00010000:00010000:0.0:1651529344.422625:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 1/0,0 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422628:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f620f630/0xa29a79078f3bd51a lrc: 0/0,0 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422633:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000628b05c5/0xa29a79078f3bb435 lrc: 0/0,0 mode: --/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ffc expref: 1894 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.422635:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422637:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966594432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422638:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422641:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422641:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422644:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422644:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 2/0,0 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422647:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422650:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422659:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 2/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422689:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946347328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 773us (808us total) trans 30064892739 rc 0/0 00000100:00100000:0.0:1651529344.422698:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151880 00000100:00100000:1.0:1651529344.422700:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946346752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1441us (1541us total) trans 30064892740 rc 0/0 00000100:00100000:1.0:1651529344.422703:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151877 00010000:00010000:0.0:1651529344.422706:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 2/0,0 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422709:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000465e6a7b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.422710:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 2/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422710:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 2/0,0 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422713:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 3/0,0 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422714:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a742b1a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.422715:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 2/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422718:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 3/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422718:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 1/0,0 mode: --/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422721:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000465e6a7b/0xa29a79078f3bd536 lrc: 0/0,0 mode: --/PW res: [0x2b220:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422722:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 1/0,0 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422725:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd521 lrc: 0/0,0 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422747:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f192d0cc/0xa29a79078f3b9541 lrc: 0/0,0 mode: --/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd288 expref: 1893 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422757:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966594496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422768:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422771:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.422787:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422790:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422793:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 2/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422843:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 2/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422848:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e17f64ce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.422849:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 2/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422852:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 3/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422881:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 1/0,0 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422885:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946347008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1539us (1559us total) trans 30064892741 rc 0/0 00000100:00100000:1.0:1651529344.422888:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151878 00010000:00010000:0.0:1651529344.422890:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd528 lrc: 0/0,0 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422899:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422903:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422910:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228480 00010000:00010000:1.0:1651529344.422914:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 4/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.422933:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10842 00000100:00100000:1.0:1651529344.422942:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41279:x1731746396228480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.422945:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422946:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 4/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422950:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 3/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422956:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fcf3c1/0xa29a79078f3bb802 lrc: 0/0,0 mode: --/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e03 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.422960:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422960:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422961:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422964:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 4/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422971:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.422982:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746396228480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422985:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10842 00010000:00010000:1.0:1651529344.422996:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423000:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423012:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423014:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 2/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.423062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.423083:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.423092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.423098:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 2/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423102:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087bc911b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.423103:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 2/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423108:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946347392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 886us (1068us total) trans 30064892742 rc 0/0 00000100:00100000:1.0:1651529344.423111:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151881 00010000:00010000:0.0:1651529344.423111:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 3/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423116:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347968 00010000:00010000:0.0:1651529344.423116:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 1/0,0 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423119:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd53d lrc: 0/0,0 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423124:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348096 00000100:00100000:1.0:1651529344.423128:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348032 00000100:00100000:1.0:1651529344.423133:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348224 00000100:00100000:1.0:1651529344.423137:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151883 00000100:00100000:1.0:1651529344.423138:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+175:39029:x1731745946347968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.423143:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176675 count 1 00010000:00010000:1.0:1651529344.423147:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423152:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 2/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.423154:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151884 00010000:00010000:1.0:1651529344.423155:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423156:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423157:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 4/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423164:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+175:39029:x1731745946348096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.423171:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176677 count 1 00010000:00010000:1.0:1651529344.423173:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 3/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423175:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423177:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 4/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423180:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 2/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.423181:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423183:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423183:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423184:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 4/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423190:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.423191:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 3/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423195:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 4/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.423197:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151885 00000100:00100000:1.0:1651529344.423198:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+175:39030:x1731745946348032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.423199:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966594880:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.423203:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176676 count 1 00010000:00010000:1.0:1651529344.423206:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: --/PW res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423209:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.423211:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 2/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.423214:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423214:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423215:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 4/0,1 mode: --/PW res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423216:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151886 00000100:00100000:0.0:1651529344.423218:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+175:39029:x1731745946348224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.423221:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 3/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1891 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.423222:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176678 count 1 00010000:00010000:1.0:1651529344.423224:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 4/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423225:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: --/PW res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423236:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966594944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.423243:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.423244:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 2/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1891 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423247:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423248:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423248:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 4/0,1 mode: --/PW res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423254:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003543a2d9/0xa29a79078f3baa10 lrc: 0/0,0 mode: --/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26b2 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423255:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 3/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1891 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.423258:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966594560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423259:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 4/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1890 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423261:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423263:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423264:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423267:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423270:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423271:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.423273:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 2/0,0 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423321:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+176:39029:x1731745946347264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1422us (1461us total) trans 30064892743 rc 0/0 00000100:00100000:1.0:1651529344.423329:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151879 00010000:00010000:1.0:1651529344.423336:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 2/0,0 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423347:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e77a8a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.423348:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 2/0,0 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.423351:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 3/0,0 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423361:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 1/0,0 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423364:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd52f lrc: 0/0,0 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423372:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228736 00010000:00010000:1.0:1651529344.423377:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 5/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.423393:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10843 00000100:00100000:1.0:1651529344.423395:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41279:x1731746396228736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.423398:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.423398:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966594752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423400:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 4/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423403:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 3/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423403:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: --/PW res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423418:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3ba046 lrc: 0/0,0 mode: --/PR res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff0c expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423422:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423422:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423423:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423426:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 4/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423435:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.423445:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1890:41279:x1731746396228736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.423448:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10843 00010000:00010000:1.0:1651529344.423455:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423456:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423459:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423460:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423462:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423464:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 2/0,0 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423473:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423476:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 2/0,0 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423514:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+177:39029:x1731745946346560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2401us (2427us total) trans 30064892744 rc 0/0 00000100:00100000:1.0:1651529344.423517:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151874 00000100:00100000:0.0:1651529344.423547:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+176:39029:x1731745946347456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1160us total) trans 30064892745 rc 0/0 00000100:00100000:0.0:1651529344.423550:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151882 00010000:00010000:0.0:1651529344.423580:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 2/0,0 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423584:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000189c34a8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.423585:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 2/0,0 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423599:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 3/0,0 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423604:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 1/0,0 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423607:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189c34a8/0xa29a79078f3bd50c lrc: 0/0,0 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423611:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 2/0,0 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423621:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b147f5d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.423622:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 2/0,0 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423625:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 3/0,0 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423629:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 1/0,0 mode: --/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423631:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd544 lrc: 0/0,0 mode: --/PW res: [0x2b222:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.423703:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966594816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423707:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.423720:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348288 00000100:00100000:1.0:1651529344.423725:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348352 00000100:00100000:1.0:1651529344.423749:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151887 00000100:00100000:0.0:1651529344.423750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.423751:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+177:39029:x1731745946348288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.423760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.423761:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176679 count 1 00010000:00010000:1.0:1651529344.423765:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423775:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 2/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1889 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.423777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.423778:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423779:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423780:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 4/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.423796:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 3/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1889 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.423799:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966594880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423815:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423823:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1889 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.423827:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966595072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.423831:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423834:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: --/PW res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423840:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.423847:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229056 00010000:00010000:1.0:1651529344.423851:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 4/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1890 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.423852:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151888 00000100:00100000:0.0:1651529344.423854:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+177:39030:x1731745946348352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.423857:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229120 00010000:00010000:1.0:1651529344.423859:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 4/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.423860:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176680 count 1 00000100:00100000:1.0:1651529344.423863:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229248 00010000:00010000:1.0:1651529344.423866:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 4/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1892 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.423870:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229184 00010000:00010000:0.0:1651529344.423871:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: --/PW res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423872:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 5/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.423876:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10844 00010000:00010000:0.0:1651529344.423876:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 2/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1893 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.423877:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41279:x1731746396229056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.423879:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423880:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423880:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423880:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 4/0,1 mode: --/PW res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423881:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 4/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423887:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 3/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1893 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423891:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 4/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423892:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 3/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.423895:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966595136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423898:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3ba937 lrc: 0/0,0 mode: --/PR res: [0x2b223:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2419 expref: 1893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423902:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423902:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423903:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423905:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.423906:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 4/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423913:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.423920:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746396229056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.423922:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10844 00000100:00100000:1.0:1651529344.423927:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10845 00000100:00100000:1.0:1651529344.423929:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41278:x1731746396229120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.423931:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.423931:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10846 00010000:00010000:1.0:1651529344.423933:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 4/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.423933:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41279:x1731746396229248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.423936:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 3/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423937:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423947:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 4/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1891 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423948:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3b9f7b lrc: 0/0,0 mode: --/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbe7 expref: 1891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423951:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423951:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 3/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1891 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.423952:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423953:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423956:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 4/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423957:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3b97d3 lrc: 0/0,0 mode: --/PR res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd78 expref: 1890 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.423961:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423961:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423964:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.423967:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423970:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1889:41278:x1731746396229120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.423971:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 4/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423973:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10845 00000100:00100000:1.0:1651529344.423977:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10847 00010000:00010000:0.0:1651529344.423977:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.423979:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1888:41278:x1731746396229184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.423981:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.423983:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 5/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1888 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.423985:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1888:41279:x1731746396229248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.423986:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 4/0,0 mode: PR/PR res: [0x2b224:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1888 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.423988:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10846 00010000:00010000:1.0:1651529344.423991:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423996:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423998:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423999:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423999:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424002:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 4/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424002:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424006:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.424012:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41278:x1731746396229184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (225us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.424013:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 2/0,0 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424015:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10847 00010000:00010000:1.0:1651529344.424030:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 2/0,0 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424034:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002fb79765 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.424035:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 2/0,0 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424038:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 3/0,0 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424042:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 1/0,0 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424045:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb79765/0xa29a79078f3bd552 lrc: 0/0,0 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424055:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034bd60ce/0xa29a79078f3bbd26 lrc: 0/0,0 mode: --/PR res: [0x2b224:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71ba expref: 1886 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.424056:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946348096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 891us (993us total) trans 30064892746 rc 0/0 00000100:00100000:0.0:1651529344.424059:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151884 00010000:00010000:0.0:1651529344.424066:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424068:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966594944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.424069:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424072:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424072:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424075:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424075:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 2/0,0 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424078:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424081:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,1 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424083:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 2/0,0 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424116:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946348224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 897us (1023us total) trans 30064892747 rc 0/0 00000100:00100000:0.0:1651529344.424119:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151886 00010000:00010000:0.0:1651529344.424125:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 2/0,0 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424128:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3a2643a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.424129:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 2/0,0 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424130:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946348032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 931us (1046us total) trans 30064892748 rc 0/0 00000100:00100000:1.0:1651529344.424133:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151885 00010000:00010000:1.0:1651529344.424141:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424141:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 3/0,0 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424144:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424146:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 1/0,0 mode: --/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424148:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a2643a/0xa29a79078f3bd560 lrc: 0/0,0 mode: --/PW res: [0x2b226:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424153:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 2/0,0 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424156:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424156:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ddda7a96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.424157:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 2/0,0 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424159:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 2/0,0 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424159:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 3/0,0 mode: PW/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424162:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 1/0,0 mode: --/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424165:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd559 lrc: 0/0,0 mode: --/PW res: [0x2b224:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424168:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 2/0,0 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424172:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fbd3940 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.424172:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 2/0,0 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424175:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 3/0,0 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424178:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 1/0,0 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424181:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd54b lrc: 0/0,0 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424196:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946347968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1057us (1144us total) trans 30064892749 rc 0/0 00000100:00100000:0.0:1651529344.424196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424199:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151883 00000100:00100000:1.0:1651529344.424211:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348480 00000100:00100000:0.0:1651529344.424215:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424227:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348544 00000100:00100000:1.0:1651529344.424234:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151889 00000100:00100000:1.0:1651529344.424235:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946348480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.424240:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176681 count 1 00010000:00010000:1.0:1651529344.424245:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: --/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424256:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 2/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424259:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424260:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424266:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 4/0,1 mode: --/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424283:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151890 00000100:00100000:0.0:1651529344.424285:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946348544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.424291:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176682 count 1 00010000:00010000:1.0:1651529344.424294:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 3/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424295:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424300:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 2/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424303:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424303:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424304:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 4/0,1 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424309:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 4/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.424313:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424328:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.424346:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 3/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424350:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 4/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.424354:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424363:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.424500:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424519:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966595072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424524:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.424572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424581:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349056 00000100:00100000:0.0:1651529344.424582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.424587:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349120 00000100:00100000:1.0:1651529344.424591:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349184 00000100:00100000:1.0:1651529344.424600:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151891 00000100:00100000:1.0:1651529344.424602:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946349056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.424604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.424611:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176683 count 1 00000100:00100000:0.0:1651529344.424617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.424626:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424640:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 2/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1885 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424644:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424645:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424645:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 4/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424659:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424662:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 3/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1885 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424664:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424666:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 4/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.424670:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966595328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424672:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349248 00000100:00100000:0.0:1651529344.424678:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151892 00000100:00100000:0.0:1651529344.424680:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946349120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.424684:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.424691:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229440 00002000:00080000:0.0:1651529344.424691:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176684 count 1 00010000:00010000:1.0:1651529344.424695:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1886 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424696:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424703:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229504 00010000:00010000:0.0:1651529344.424703:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 2/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1886 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424705:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 5/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424706:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424706:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424707:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 4/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424714:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10848 00000100:00100000:1.0:1651529344.424715:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41278:x1731746396229440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.424718:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.424719:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424719:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 3/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1887 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424723:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 3/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424723:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 4/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1887 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.424727:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424740:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221330c9/0xa29a79078f3ba8dc lrc: 0/0,0 mode: --/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22de expref: 1887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.424744:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424744:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424745:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424745:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.424748:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 4/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424753:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966595136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424755:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.424757:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: --/PW res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424762:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1886:41278:x1731746396229440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.424764:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10848 00000100:00100000:0.0:1651529344.424764:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151893 00000100:00100000:0.0:1651529344.424766:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946349184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.424769:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10849 00000100:00100000:1.0:1651529344.424770:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41278:x1731746396229504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00002000:00080000:0.0:1651529344.424770:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176685 count 1 00010000:00010000:1.0:1651529344.424773:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.424774:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 4/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424774:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: --/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424778:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 3/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424781:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 2/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1885 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424783:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008404d1f1/0xa29a79078f3bb58c lrc: 0/0,0 mode: --/PR res: [0x2b228:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5519 expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.424784:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424785:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424785:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 4/0,1 mode: --/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424788:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424789:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424790:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424791:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 3/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1884 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424792:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 4/0,1 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424795:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 4/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1884 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.424801:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.424823:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1884:41278:x1731746396229504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.424825:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966595456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424826:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10849 00000100:00100000:0.0:1651529344.424834:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.424839:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424840:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151894 00000100:00100000:1.0:1651529344.424842:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946349248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.424842:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424845:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,1 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.424847:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176686 count 1 00010000:00010000:0.0:1651529344.424848:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 2/0,0 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424851:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424855:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 2/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1883 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424858:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424859:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424859:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 4/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424866:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 3/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1883 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424870:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1883 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.424874:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966595520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424881:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.424889:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946348352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1034us (1182us total) trans 30064892750 rc 0/0 00000100:00100000:1.0:1651529344.424892:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424892:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151888 00010000:00010000:1.0:1651529344.424895:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: --/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424900:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424900:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 2/0,0 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424903:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424903:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb910b6e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.424904:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 2/0,0 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424907:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424907:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 3/0,0 mode: PW/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424909:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424912:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 1/0,0 mode: --/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424915:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb910b6e/0xa29a79078f3bd56e lrc: 0/0,0 mode: --/PW res: [0x2b228:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424927:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424930:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a5ade66 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.424931:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424936:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 3/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424940:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 1/0,0 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424942:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd567 lrc: 0/0,0 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424955:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946348288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1202us (1297us total) trans 30064892751 rc 0/0 00000100:00100000:1.0:1651529344.424957:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151887 00000100:00100000:0.0:1651529344.424987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.425002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425013:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229632 00010000:00010000:1.0:1651529344.425018:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 4/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1884 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425025:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229760 00010000:00010000:1.0:1651529344.425034:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 4/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425060:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10850 00000100:00100000:1.0:1651529344.425062:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396229632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.425063:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10851 00000100:00100000:0.0:1651529344.425065:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396229760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.425069:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425070:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.425071:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 4/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425072:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 4/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.425075:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 3/0,0 mode: PR/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425076:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 3/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.425080:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095fc5b88/0xa29a79078f3ba325 lrc: 0/0,0 mode: --/PR res: [0x2b22a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aab expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425082:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021dc431f/0xa29a79078f3b85ff lrc: 0/0,0 mode: --/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfbf expref: 1885 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.425084:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425085:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425086:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425086:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425087:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425088:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425089:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 4/0,1 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425091:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 4/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425096:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.425098:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.425120:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41279:x1731746396229760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425121:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41279:x1731746396229632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.425123:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10851 00000100:00100000:1.0:1651529344.425125:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10850 00010000:00010000:0.0:1651529344.425130:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425133:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425134:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425137:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425137:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,1 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425140:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425140:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 2/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425142:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 2/0,0 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425180:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+185:39029:x1731745946348480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 944us (984us total) trans 30064892752 rc 0/0 00000100:00100000:1.0:1651529344.425184:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151889 00010000:00010000:1.0:1651529344.425190:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 2/0,0 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425193:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.425194:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 2/0,0 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425197:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 3/0,0 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425204:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 1/0,0 mode: --/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425207:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd575 lrc: 0/0,0 mode: --/PW res: [0x2b229:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425208:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946348544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 922us (992us total) trans 30064892753 rc 0/0 00010000:00010000:1.0:1651529344.425211:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 2/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425211:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151890 00010000:00010000:1.0:1651529344.425214:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4c6bb8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.425215:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 2/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425218:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 3/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425221:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 1/0,0 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425223:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c6bb8a/0xa29a79078f3bd57c lrc: 0/0,0 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.425254:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.425264:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349376 00000100:00100000:1.0:1651529344.425270:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349440 00000100:00100000:1.0:1651529344.425290:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151895 00000100:00100000:1.0:1651529344.425292:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+185:39029:x1731745946349376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.425303:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176687 count 1 00010000:00010000:1.0:1651529344.425307:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: --/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425310:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151896 00000100:00100000:0.0:1651529344.425313:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946349440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.425319:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 2/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1881 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.425319:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176688 count 1 00010000:00010000:1.0:1651529344.425323:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425323:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425324:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 4/0,1 mode: --/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425324:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: --/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425329:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 2/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1881 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.425331:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 3/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1881 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.425334:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 4/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1881 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425338:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.425345:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425345:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425346:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 4/0,1 mode: --/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425347:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.425355:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 3/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1881 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.425358:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 4/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1881 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.425362:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.425372:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.425413:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966595328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.425417:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425448:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.425462:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966595520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.425463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.425465:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.425481:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.425489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425496:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230272 00000100:00100000:0.0:1651529344.425499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.425501:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 5/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1882 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425507:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230208 00000100:00100000:0.0:1651529344.425508:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.425509:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 4/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1883 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425513:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230336 00010000:00010000:1.0:1651529344.425515:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 5/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1884 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425519:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230400 00010000:00010000:0.0:1651529344.425520:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425521:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1885 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425525:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10852 00000100:00100000:1.0:1651529344.425527:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396230272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.425529:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425530:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 4/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1885 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425534:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 3/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1885 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425540:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b419d0f5/0xa29a79078f3b79aa lrc: 0/0,0 mode: --/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb960 expref: 1885 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425551:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425551:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425552:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425553:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349504 00010000:00010000:1.0:1651529344.425555:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 4/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425564:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349568 00010000:00010000:1.0:1651529344.425570:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.425576:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151897 00000100:00100000:0.0:1651529344.425578:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946349504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.425583:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1884:41279:x1731746396230272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (110us total) trans 0 rc 0/0 00002000:00080000:0.0:1651529344.425583:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176689 count 1 00000100:00100000:1.0:1651529344.425585:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10852 00010000:00010000:0.0:1651529344.425588:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425590:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10853 00000100:00100000:1.0:1651529344.425592:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41279:x1731746396230208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.425595:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425596:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 4/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1883 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425600:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 3/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1883 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.425603:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 2/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1883 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.425605:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c62ac1da/0xa29a79078f3ba643 lrc: 0/0,0 mode: --/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1842 expref: 1883 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.425606:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425607:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425608:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425608:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 4/0,1 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425615:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 3/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1882 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.425616:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425617:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425620:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 4/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425626:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425630:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 4/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1882 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.425632:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1882:41279:x1731746396230208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.425634:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966595712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.425635:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10853 00000100:00100000:1.0:1651529344.425639:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10854 00000100:00100000:1.0:1651529344.425641:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41278:x1731746396230336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.425643:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.425643:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.425645:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 5/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1881 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425649:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 4/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1881 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425654:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425655:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425657:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425658:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 4/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425660:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425661:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425663:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425666:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 2/0,0 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425673:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41278:x1731746396230336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425676:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10854 00000100:00100000:1.0:1651529344.425680:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10855 00000100:00100000:1.0:1651529344.425681:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1880:41278:x1731746396230400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.425684:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425685:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1880 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425689:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 3/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1880 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425694:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3b9b30 lrc: 0/0,0 mode: --/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceafa expref: 1880 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.425697:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425698:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425701:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 4/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425706:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946349120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1025us (1156us total) trans 30064892754 rc 0/0 00010000:00010000:1.0:1651529344.425707:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.425709:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151892 00000100:00100000:1.0:1651529344.425711:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41278:x1731746396230400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425714:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10855 00000100:00100000:0.0:1651529344.425715:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151898 00000100:00100000:0.0:1651529344.425716:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+187:39030:x1731745946349568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.425721:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176690 count 1 00010000:00010000:0.0:1651529344.425725:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425727:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425738:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 2/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1878 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.425739:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425742:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425743:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425743:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425743:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 4/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425746:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 2/0,0 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425767:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 3/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1878 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.425771:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 4/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.425775:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.425783:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.425788:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946349248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (1184us total) trans 30064892755 rc 0/0 00010000:00010000:0.0:1651529344.425789:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 2/0,0 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425791:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151894 00010000:00010000:0.0:1651529344.425792:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000551753c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.425793:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 2/0,0 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425796:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 3/0,0 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425800:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425801:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 1/0,0 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425819:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425820:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551753c5/0xa29a79078f3bd58a lrc: 0/0,0 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425823:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425825:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 2/0,0 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425826:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 2/0,0 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425837:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.425838:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 2/0,0 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425841:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 3/0,0 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425845:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 1/0,0 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425847:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd598 lrc: 0/0,0 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425851:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 2/0,0 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425854:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.425855:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 2/0,0 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425858:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 3/0,0 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425860:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946349056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1257us (1383us total) trans 30064892756 rc 0/0 00010000:00010000:0.0:1651529344.425861:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 1/0,0 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425871:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151891 00010000:00010000:0.0:1651529344.425871:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd583 lrc: 0/0,0 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425885:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b91b403b/0xa29a79078f3b9dc9 lrc: 0/0,0 mode: --/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf55e expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.425888:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966595456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.425891:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425895:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425897:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425900:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425903:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 2/0,0 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425942:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946349184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1176us (1370us total) trans 30064892757 rc 0/0 00000100:00100000:0.0:1651529344.425945:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151893 00010000:00010000:0.0:1651529344.425961:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 2/0,0 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425965:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdab2c09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.425966:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 2/0,0 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425968:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 3/0,0 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425973:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 1/0,0 mode: --/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425976:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdab2c09/0xa29a79078f3bd591 lrc: 0/0,0 mode: --/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426019:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426024:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: --/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.426045:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.426054:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230464 00010000:00010000:1.0:1651529344.426059:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 4/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426066:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230528 00010000:00010000:1.0:1651529344.426068:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 5/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426081:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10856 00000100:00100000:1.0:1651529344.426083:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41279:x1731746396230464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.426094:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426098:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: --/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426105:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.426106:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10857 00000100:00100000:0.0:1651529344.426108:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41278:x1731746396230528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.426112:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 4/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426112:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.426113:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 4/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426116:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 3/0,0 mode: PR/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426122:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000358a1d0c/0xa29a79078f3bbc15 lrc: 0/0,0 mode: --/PR res: [0x2b22f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6de6 expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426141:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426141:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426142:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426142:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 3/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426145:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 4/0,1 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426149:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a170fe1/0xa29a79078f3bbf64 lrc: 0/0,0 mode: --/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a5e expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426152:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426153:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.426153:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426154:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426157:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 4/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426165:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41279:x1731746396230464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.426167:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10856 00010000:00010000:0.0:1651529344.426171:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.426180:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426180:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41278:x1731746396230528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.426183:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10857 00010000:00010000:1.0:1651529344.426184:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426187:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,1 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426190:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 2/0,0 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426191:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426195:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426198:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426211:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426228:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946349376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 935us (987us total) trans 30064892758 rc 0/0 00000100:00100000:1.0:1651529344.426230:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151895 00010000:00010000:1.0:1651529344.426246:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 2/0,0 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426250:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.426251:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 2/0,0 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426253:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 3/0,0 mode: PW/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426258:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 1/0,0 mode: --/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426261:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd59f lrc: 0/0,0 mode: --/PW res: [0x2b22f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426265:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426268:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fe86dd8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.426269:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426272:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 3/0,0 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426275:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 1/0,0 mode: --/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426276:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946349440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 962us (1021us total) trans 30064892759 rc 0/0 00000100:00100000:0.0:1651529344.426279:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151896 00010000:00010000:1.0:1651529344.426285:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd5a6 lrc: 0/0,0 mode: --/PW res: [0x2b230:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426309:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.426332:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350144 00000100:00100000:0.0:1651529344.426337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.426350:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350272 00000100:00100000:1.0:1651529344.426355:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350208 00000100:00100000:1.0:1651529344.426358:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151899 00000100:00100000:1.0:1651529344.426360:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946350144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.426365:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176691 count 1 00010000:00010000:1.0:1651529344.426382:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426382:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.426393:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 2/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1875 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426397:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426397:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426398:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 4/0,1 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426409:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 3/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1875 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426413:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 4/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1875 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426424:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.426425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.426431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.426441:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350336 00000100:00100000:1.0:1651529344.426456:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426456:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151900 00000100:00100000:0.0:1651529344.426458:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946350272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.426463:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151901 00000100:00100000:1.0:1651529344.426464:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+191:39030:x1731745946350208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.426464:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176693 count 1 00002000:00080000:1.0:1651529344.426469:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176692 count 1 00010000:00010000:0.0:1651529344.426469:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426473:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426474:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 2/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1875 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426477:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426478:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 2/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1875 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426478:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426478:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 4/0,1 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426481:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426481:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426482:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 4/0,1 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426488:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 3/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1875 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426491:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 4/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1875 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426495:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966595904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426497:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 3/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1875 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426501:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 4/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1875 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426502:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426505:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.426508:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151902 00000100:00100000:1.0:1651529344.426510:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+191:39030:x1731745946350336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.426514:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176694 count 1 00000100:00100000:0.0:1651529344.426514:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426522:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966595776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426525:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426526:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426530:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 2/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1875 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426533:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.426533:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966595712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426534:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426534:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 4/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426540:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 3/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1875 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426544:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.426548:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966596032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426551:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426555:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426561:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230592 00000100:00100000:1.0:1651529344.426562:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230656 00010000:00010000:0.0:1651529344.426565:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 4/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426566:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 4/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.426578:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10858 00000100:00100000:0.0:1651529344.426580:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41279:x1731746396230592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.426583:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.426585:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10859 00000100:00100000:1.0:1651529344.426587:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41278:x1731746396230656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.426590:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.426591:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 4/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426591:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 4/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426595:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 3/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426601:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c4b9eb1/0xa29a79078f3bc0a6 lrc: 0/0,0 mode: --/PR res: [0x2b231:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fa5 expref: 1877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426604:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426605:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 3/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1876 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.426605:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426606:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426609:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 4/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426611:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bb959 lrc: 0/0,0 mode: --/PR res: [0x2b232:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d637b expref: 1876 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.426614:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426615:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426616:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426616:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.426619:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 4/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426623:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41279:x1731746396230592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.426628:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.426632:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10858 00000100:00100000:1.0:1651529344.426635:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1874:41278:x1731746396230656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.426638:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10859 00010000:00010000:0.0:1651529344.426639:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426643:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426646:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426656:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 2/0,0 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426698:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946349568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 981us (1234us total) trans 30064892760 rc 0/0 00000100:00100000:0.0:1651529344.426701:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151898 00010000:00010000:0.0:1651529344.426708:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 2/0,0 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426711:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.426713:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 2/0,0 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426715:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 3/0,0 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426720:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 1/0,0 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426722:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd5b4 lrc: 0/0,0 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426728:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426741:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426750:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426753:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 2/0,0 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426791:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946349504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1212us (1343us total) trans 30064892761 rc 0/0 00000100:00100000:0.0:1651529344.426794:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151897 00010000:00010000:0.0:1651529344.426801:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 2/0,0 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426822:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.426823:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 2/0,0 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426831:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 3/0,0 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426836:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 1/0,0 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426839:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd5ad lrc: 0/0,0 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426855:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350400 00000100:00100000:1.0:1651529344.426858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426876:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350464 00000100:00100000:0.0:1651529344.426883:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151903 00000100:00100000:0.0:1651529344.426885:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+193:39029:x1731745946350400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.426890:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176695 count 1 00010000:00010000:0.0:1651529344.426894:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: --/PW res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426898:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 2/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426901:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426902:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426903:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 4/0,1 mode: --/PW res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426909:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 3/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426913:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 4/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.426917:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966596096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.426926:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426933:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151904 00000100:00100000:0.0:1651529344.426935:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+193:39030:x1731745946350464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.426939:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176696 count 1 00010000:00010000:0.0:1651529344.426943:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: --/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426969:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 2/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426972:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426972:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426973:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 4/0,1 mode: --/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426980:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 3/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426984:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 4/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.426988:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966596160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427003:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.427090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.427100:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350528 00000100:00100000:0.0:1651529344.427102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.427113:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350592 00000100:00100000:1.0:1651529344.427122:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151905 00000100:00100000:1.0:1651529344.427123:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946350528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.427125:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151906 00000100:00100000:0.0:1651529344.427128:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946350592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.427129:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176697 count 1 00010000:00010000:1.0:1651529344.427133:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.427133:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176698 count 1 00010000:00010000:1.0:1651529344.427145:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 2/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1873 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427148:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427149:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427149:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 4/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427153:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: --/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427159:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 2/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427163:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 3/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1873 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427166:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 4/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1873 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.427171:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966596224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.427171:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427172:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427172:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 4/0,1 mode: --/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427181:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 3/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1873 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.427185:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.427191:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 4/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427196:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966596288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427205:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.427222:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966595840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.427226:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427241:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966595968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.427244:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966595904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.427246:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427247:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427253:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966596032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.427264:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427359:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.427369:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231296 00000100:00100000:0.0:1651529344.427370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.427379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.427380:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 4/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1874 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.427399:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231424 00010000:00010000:1.0:1651529344.427403:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.427407:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231552 00010000:00010000:1.0:1651529344.427409:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 5/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1876 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.427413:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231232 00010000:00010000:1.0:1651529344.427415:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 4/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1877 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.427419:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231360 00000100:00100000:0.0:1651529344.427419:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.427421:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 4/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1878 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.427425:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231488 00010000:00010000:1.0:1651529344.427426:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 5/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427427:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966596160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.427431:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10860 00010000:00010000:0.0:1651529344.427432:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: --/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427440:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41279:x1731746396231296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.427443:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427445:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 4/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1879 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427446:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966596096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.427448:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 3/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1879 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427449:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: --/PW res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427454:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c8a5c80/0xa29a79078f3b8072 lrc: 0/0,0 mode: --/PR res: [0x2b235:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcfc expref: 1879 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427456:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10861 00010000:00010000:1.0:1651529344.427458:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427458:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.427458:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41279:x1731746396231424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.427459:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427461:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427462:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 4/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427463:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427467:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 3/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427471:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.427479:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b5137f/0xa29a79078f3bc1b0 lrc: 0/0,0 mode: --/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83c6 expref: 1878 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.427481:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41279:x1731746396231296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (122us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.427483:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.427484:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10860 00010000:00010000:0.0:1651529344.427484:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427485:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427488:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 4/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427489:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10862 00000100:00100000:1.0:1651529344.427490:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41279:x1731746396231552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.427493:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427495:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 4/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1876 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427497:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.427505:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41279:x1731746396231424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.427508:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10861 00010000:00010000:1.0:1651529344.427510:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 3/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1876 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427515:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf679708/0xa29a79078f3ba89d lrc: 0/0,0 mode: --/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d221a expref: 1875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.427515:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10863 00000100:00100000:0.0:1651529344.427516:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41279:x1731746396231232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.427519:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427519:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427520:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427520:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427521:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 4/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1874 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427523:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 4/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427533:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.427539:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1874:41279:x1731746396231552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.427542:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10862 00000100:00100000:1.0:1651529344.427547:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10864 00000100:00100000:1.0:1651529344.427549:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746396231360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.427552:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427555:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 3/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1873 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427561:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caf72e13/0xa29a79078f3b95fe lrc: 0/0,0 mode: --/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd639 expref: 1873 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427562:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 4/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1873 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427565:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427566:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 3/0,0 mode: PR/PR res: [0x2b234:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1872 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427566:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427567:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427570:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 4/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427583:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e73cb8d/0xa29a79078f3b9285 lrc: 0/0,0 mode: --/PR res: [0x2b234:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7d7 expref: 1872 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427587:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427587:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427587:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.427588:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427591:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 4/0,1 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427595:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41279:x1731746396231232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 78us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.427596:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.427598:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10863 00000100:00100000:1.0:1651529344.427603:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41279:x1731746396231360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.427606:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10864 00000100:00100000:0.0:1651529344.427608:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10865 00000100:00100000:0.0:1651529344.427610:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41279:x1731746396231488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.427612:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427613:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427614:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 4/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427617:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427618:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 3/0,0 mode: PR/PR res: [0x2b237:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.427620:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,1 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427622:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 2/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427623:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032b90108/0xa29a79078f3bbfe2 lrc: 0/0,0 mode: --/PR res: [0x2b237:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c6b expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.427627:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427627:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427628:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427631:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 4/0,1 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427638:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.427643:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41279:x1731746396231488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.427646:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10865 00010000:00010000:0.0:1651529344.427666:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427671:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427673:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+196:39030:x1731745946350208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1336us total) trans 30064892762 rc 0/0 00010000:00010000:0.0:1651529344.427674:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427677:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151901 00010000:00010000:0.0:1651529344.427677:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 2/0,0 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427684:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 2/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427688:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.427689:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 2/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427692:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 3/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427696:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 1/0,0 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427699:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd5c9 lrc: 0/0,0 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427703:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 2/0,0 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427706:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.427707:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 2/0,0 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427720:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 3/0,0 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427724:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 1/0,0 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427726:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd5c2 lrc: 0/0,0 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427728:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+196:39029:x1731745946350272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1269us (1405us total) trans 30064892763 rc 0/0 00000100:00100000:0.0:1651529344.427739:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151900 00010000:00010000:1.0:1651529344.427741:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427744:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427747:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427748:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427750:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 2/0,0 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427751:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427755:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427763:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 2/0,0 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427823:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946350336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1312us (1441us total) trans 30064892764 rc 0/0 00000100:00100000:1.0:1651529344.427827:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151902 00010000:00010000:1.0:1651529344.427834:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 2/0,0 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427836:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+196:39030:x1731745946350464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 900us (977us total) trans 30064892765 rc 0/0 00000100:00100000:0.0:1651529344.427839:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151904 00010000:00010000:1.0:1651529344.427846:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.427847:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 2/0,0 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427847:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 2/0,0 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427850:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 3/0,0 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427853:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b147f5d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.427854:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 2/0,0 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427855:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 1/0,0 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427857:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 3/0,0 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427858:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd5d0 lrc: 0/0,0 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427861:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 1/0,0 mode: --/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427864:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b147f5d3/0xa29a79078f3bd5de lrc: 0/0,0 mode: --/PW res: [0x2b238:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427865:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427868:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427870:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427871:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427873:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 2/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427873:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427877:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427885:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 2/0,0 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427920:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946350144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1559us (1611us total) trans 30064892766 rc 0/0 00000100:00100000:0.0:1651529344.427927:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946350400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1087us total) trans 30064892767 rc 0/0 00000100:00100000:0.0:1651529344.427930:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151903 00000100:00100000:1.0:1651529344.427932:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151899 00010000:00010000:0.0:1651529344.427937:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 2/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427940:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 2/0,0 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427941:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.427942:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 2/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427944:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.427945:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 2/0,0 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427945:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 3/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427948:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 3/0,0 mode: PW/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427949:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 1/0,0 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427952:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 1/0,0 mode: --/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427952:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd5bb lrc: 0/0,0 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427955:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd5d7 lrc: 0/0,0 mode: --/PW res: [0x2b237:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428003:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966596224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428007:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.428071:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966596288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428075:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: --/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428080:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.428085:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231616 00000100:00100000:1.0:1651529344.428086:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231680 00010000:00010000:1.0:1651529344.428091:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 4/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1868 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.428108:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 4/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1869 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.428110:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10866 00000100:00100000:1.0:1651529344.428112:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41279:x1731746396231680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.428115:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.428120:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10867 00010000:00010000:1.0:1651529344.428122:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 4/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.428122:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41279:x1731746396231616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.428126:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 3/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.428126:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.428127:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 4/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1869 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.428131:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aaedf37/0xa29a79078f3b9dbb lrc: 0/0,0 mode: --/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf534 expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.428131:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 3/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1869 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.428135:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428135:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428136:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428137:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083b74eb3/0xa29a79078f3b7dfc lrc: 0/0,0 mode: --/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbba expref: 1868 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.428139:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 4/0,1 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428141:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428141:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428142:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428145:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 4/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428149:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.428163:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.428164:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41279:x1731746396231680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.428167:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10866 00000100:00100000:0.0:1651529344.428171:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41279:x1731746396231616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.428174:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10867 00010000:00010000:1.0:1651529344.428175:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428182:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428185:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428186:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428189:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428191:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,1 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428192:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 2/0,0 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428194:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 2/0,0 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428246:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946350528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1156us total) trans 30064892768 rc 0/0 00000100:00100000:1.0:1651529344.428249:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151905 00000100:00100000:0.0:1651529344.428277:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+196:39030:x1731745946350592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1174us total) trans 30064892769 rc 0/0 00000100:00100000:0.0:1651529344.428280:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151906 00000100:00100000:1.0:1651529344.428287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428287:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 2/0,0 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428291:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.428298:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 2/0,0 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428301:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 3/0,0 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428306:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 1/0,0 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428309:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd5e5 lrc: 0/0,0 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428313:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 2/0,0 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428316:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e77a8a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.428317:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 2/0,0 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428320:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 3/0,0 mode: PW/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428323:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 1/0,0 mode: --/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428325:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd5ec lrc: 0/0,0 mode: --/PW res: [0x2b23a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428333:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351104 00000100:00100000:0.0:1651529344.428339:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351232 00000100:00100000:0.0:1651529344.428342:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351168 00000100:00100000:1.0:1651529344.428343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.428366:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351296 00000100:00100000:0.0:1651529344.428375:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151907 00000100:00100000:0.0:1651529344.428376:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946351104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.428382:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176699 count 1 00010000:00010000:0.0:1651529344.428386:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: --/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428390:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 2/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428393:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.428397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428401:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428402:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 4/0,1 mode: --/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428404:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351616 00000100:00100000:1.0:1651529344.428410:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351552 00010000:00010000:0.0:1651529344.428410:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 3/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.428414:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151908 00010000:00010000:0.0:1651529344.428414:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 4/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.428415:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946351232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.428418:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966596352:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.428421:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176701 count 1 00010000:00010000:1.0:1651529344.428425:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428432:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.428439:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151909 00000100:00100000:0.0:1651529344.428441:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946351168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.428446:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 2/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1865 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.428446:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176700 count 1 00010000:00010000:1.0:1651529344.428449:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428449:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428450:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 4/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428456:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428458:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 3/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1865 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428461:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 4/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1865 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.428461:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 2/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428464:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428464:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.428465:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966596416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428465:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 4/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428471:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 3/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.428475:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.428482:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151910 00010000:00010000:0.0:1651529344.428482:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 4/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.428484:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946351296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.428487:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966596480:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.428489:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176702 count 1 00010000:00010000:1.0:1651529344.428493:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: --/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428494:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.428497:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 2/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428500:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.428501:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151911 00000100:00100000:0.0:1651529344.428502:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946351616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.428507:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176704 count 1 00010000:00010000:1.0:1651529344.428509:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428509:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 4/0,1 mode: --/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428517:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 3/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428521:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 4/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.428524:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966596544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.428533:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.428537:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428542:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 2/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428545:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428546:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428547:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 4/0,1 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428550:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151912 00000100:00100000:1.0:1651529344.428552:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946351552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.428554:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 3/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.428556:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176703 count 1 00010000:00010000:0.0:1651529344.428557:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 4/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.428560:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428564:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 2/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428567:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428568:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428568:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 4/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428572:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966596608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428575:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 3/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.428580:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.428589:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 4/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.428593:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966596672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.428595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.428602:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.428608:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351744 00000100:00100000:0.0:1651529344.428610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.428614:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351680 00000100:00100000:1.0:1651529344.428618:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151913 00000100:00100000:1.0:1651529344.428619:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+203:39030:x1731745946351744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.428623:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176706 count 1 00010000:00010000:1.0:1651529344.428627:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: --/PW res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428632:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 2/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.428640:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151914 00000100:00100000:0.0:1651529344.428642:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+203:39030:x1731745946351680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.428648:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176705 count 1 00010000:00010000:0.0:1651529344.428652:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428656:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 2/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428661:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428662:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428663:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 4/0,1 mode: --/PW res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428670:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 3/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428674:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 4/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.428676:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428677:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428677:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 4/0,1 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428685:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 3/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1865 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.428688:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966596736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428689:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 4/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.428693:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966596800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.428702:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.428714:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.428845:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966596352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428849:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: --/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428897:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966596416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428907:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428916:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966596544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428919:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: --/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428939:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966596480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428943:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428951:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966596672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.428952:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966596608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428955:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428955:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.429288:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966596736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.429288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.429297:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: --/PW res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.429310:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232192 00000100:00100000:0.0:1651529344.429313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.429315:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 4/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1866 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429322:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.429326:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232256 00000100:00100000:0.0:1651529344.429327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.429332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.429337:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 4/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1867 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.429342:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232320 00010000:00010000:1.0:1651529344.429344:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 4/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1868 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429345:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966596800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.429348:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232448 00010000:00010000:0.0:1651529344.429349:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429350:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 4/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429355:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232576 00010000:00010000:1.0:1651529344.429356:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 4/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1870 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429356:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232704 00000100:00100000:1.0:1651529344.429361:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232832 00010000:00010000:0.0:1651529344.429362:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 4/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1872 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429363:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 4/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1872 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429367:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232384 00000100:00100000:0.0:1651529344.429369:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10868 00010000:00010000:1.0:1651529344.429370:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 4/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429371:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746396232192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.429374:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10869 00010000:00010000:0.0:1651529344.429374:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429375:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 4/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429376:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746396232256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.429379:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429379:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 3/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429380:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 4/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1873 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429385:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbfb65e2/0xa29a79078f3baf65 lrc: 0/0,0 mode: --/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c1b expref: 1873 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429389:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429390:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429390:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429392:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 3/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1872 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429393:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 4/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429399:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f41f20/0xa29a79078f3b97fd lrc: 0/0,0 mode: --/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde3c expref: 1872 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429400:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.429403:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429403:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429404:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429407:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 4/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429412:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41279:x1731746396232192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.429415:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10868 00010000:00010000:1.0:1651529344.429419:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.429421:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10870 00000100:00100000:0.0:1651529344.429423:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41279:x1731746396232320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.429426:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429427:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 4/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1870 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429428:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41279:x1731746396232256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429430:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10869 00010000:00010000:0.0:1651529344.429431:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 3/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1870 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429436:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10871 00010000:00010000:0.0:1651529344.429436:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9403fe7/0xa29a79078f3b9a73 lrc: 0/0,0 mode: --/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce788 expref: 1869 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429438:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41279:x1731746396232448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.429439:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429440:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429440:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429441:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429442:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 4/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1868 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429444:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 4/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429445:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 3/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1868 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429449:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.429455:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41279:x1731746396232320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.429457:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10870 00010000:00010000:1.0:1651529344.429459:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ffc74f0/0xa29a79078f3ba8d5 lrc: 0/0,0 mode: --/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22b4 expref: 1868 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429462:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429463:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429464:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429466:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 4/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429467:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10872 00000100:00100000:0.0:1651529344.429469:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41279:x1731746396232576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.429471:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429472:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 4/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1866 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429473:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.429476:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 3/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1866 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429479:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41279:x1731746396232448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.429481:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a565bb/0xa29a79078f3bbd18 lrc: 0/0,0 mode: --/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7190 expref: 1866 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.429482:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10871 00010000:00010000:0.0:1651529344.429484:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429485:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429485:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429487:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10873 00000100:00100000:1.0:1651529344.429488:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1864:41279:x1731746396232704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.429488:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 4/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429491:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.429492:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 4/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1864 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429497:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.429503:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 3/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1864 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429503:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1864:41279:x1731746396232576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.429505:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10872 00010000:00010000:1.0:1651529344.429508:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110bb075/0xa29a79078f3bbdb2 lrc: 0/0,0 mode: --/PR res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73c0 expref: 1863 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.429510:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10874 00000100:00100000:0.0:1651529344.429511:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1863:41279:x1731746396232832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.429514:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429515:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 4/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1863 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429519:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 3/0,0 mode: PR/PR res: [0x2b241:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1863 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429520:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429521:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429522:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429523:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3275310/0xa29a79078f3bab98 lrc: 0/0,0 mode: --/PR res: [0x2b241:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ce7 expref: 1862 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429525:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 4/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429528:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429531:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.429531:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 4/0,1 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429537:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41279:x1731746396232704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.429537:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.429540:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10873 00000100:00100000:0.0:1651529344.429542:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41279:x1731746396232832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.429544:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10874 00000100:00100000:1.0:1651529344.429546:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10875 00000100:00100000:1.0:1651529344.429547:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41278:x1731746396232384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.429550:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429550:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429551:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 4/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429553:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429555:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 3/0,0 mode: PR/PR res: [0x2b240:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.429556:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429559:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429560:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bb991 lrc: 0/0,0 mode: --/PR res: [0x2b240:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6431 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.429563:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429570:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429571:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429574:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 4/0,1 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429589:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.429596:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41278:x1731746396232384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429599:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10875 00010000:00010000:1.0:1651529344.429606:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429609:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fbd3940 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.429610:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429613:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 3/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429617:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 1/0,0 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429620:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd601 lrc: 0/0,0 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429623:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946351168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1182us (1307us total) trans 30064892770 rc 0/0 00010000:00010000:1.0:1651529344.429626:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429626:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151909 00010000:00010000:0.0:1651529344.429633:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429637:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429638:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429640:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,1 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429641:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429643:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 2/0,0 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429643:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 2/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429684:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946351616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1180us (1295us total) trans 30064892771 rc 0/0 00000100:00100000:0.0:1651529344.429687:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151911 00000100:00100000:1.0:1651529344.429689:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946351296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1204us (1345us total) trans 30064892772 rc 0/0 00000100:00100000:1.0:1651529344.429692:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151910 00010000:00010000:0.0:1651529344.429694:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 2/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429697:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ddda7a96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.429698:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 2/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429701:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429701:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 3/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429704:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429707:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429710:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 2/0,0 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429719:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 1/0,0 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429722:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd60f lrc: 0/0,0 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429726:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 2/0,0 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429729:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.429730:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 2/0,0 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429742:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 3/0,0 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429745:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 1/0,0 mode: --/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429748:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd608 lrc: 0/0,0 mode: --/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429751:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 2/0,0 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429754:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.429755:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946351232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1338us (1450us total) trans 30064892773 rc 0/0 00010000:00010000:0.0:1651529344.429759:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 2/0,0 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429762:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 3/0,0 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429766:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 1/0,0 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429767:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151908 00010000:00010000:0.0:1651529344.429768:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd5fa lrc: 0/0,0 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429775:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429776:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429778:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429779:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429781:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,1 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429782:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429784:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 2/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429785:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 2/0,0 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429839:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946351552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1286us (1441us total) trans 30064892774 rc 0/0 00000100:00100000:1.0:1651529344.429842:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151912 00000100:00100000:0.0:1651529344.429845:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946351680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1202us (1234us total) trans 30064892775 rc 0/0 00000100:00100000:0.0:1651529344.429848:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151914 00010000:00010000:1.0:1651529344.429849:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 2/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429852:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a742b1a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.429854:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 2/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429856:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 3/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429856:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 2/0,0 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429861:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 1/0,0 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429867:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.429868:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 2/0,0 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429871:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd624 lrc: 0/0,0 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429871:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 3/0,0 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429876:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 1/0,0 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429878:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd616 lrc: 0/0,0 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429879:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429882:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429885:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429885:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429888:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 2/0,0 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429888:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429891:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429893:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 2/0,0 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429934:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946351744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1313us (1338us total) trans 30064892776 rc 0/0 00000100:00100000:1.0:1651529344.429937:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151913 00000100:00100000:0.0:1651529344.429940:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946351104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1563us (1653us total) trans 30064892777 rc 0/0 00010000:00010000:1.0:1651529344.429944:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 2/0,0 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429947:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e08cf94 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.429948:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 2/0,0 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429951:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 3/0,0 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429951:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151907 00010000:00010000:1.0:1651529344.429965:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 1/0,0 mode: --/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429967:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd61d lrc: 0/0,0 mode: --/PW res: [0x2b242:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429971:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 2/0,0 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429975:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a5ade66 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.429976:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 2/0,0 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429979:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 3/0,0 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429984:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 1/0,0 mode: --/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429986:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd5f3 lrc: 0/0,0 mode: --/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.430291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430308:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352384 00000100:00100000:0.0:1651529344.430313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430341:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352512 00000100:00100000:1.0:1651529344.430345:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352640 00000100:00100000:1.0:1651529344.430350:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151915 00000100:00100000:1.0:1651529344.430351:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946352384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.430356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.430364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.430370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.430371:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176708 count 1 00000100:00100000:0.0:1651529344.430379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.430381:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: --/PW res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.430394:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 2/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.430397:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352768 00010000:00010000:1.0:1651529344.430398:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430399:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430399:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 4/0,1 mode: --/PW res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430403:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352320 00010000:00010000:1.0:1651529344.430408:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 3/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430412:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 4/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.430413:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352448 00000100:00100000:0.0:1651529344.430415:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352576 00000100:00100000:0.0:1651529344.430417:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352704 00000100:00100000:0.0:1651529344.430420:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151916 00000100:00100000:1.0:1651529344.430422:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966596864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.430422:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.430428:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176710 count 1 00010000:00010000:0.0:1651529344.430432:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430435:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.430437:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 2/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430440:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430441:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.430442:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151917 00010000:00010000:0.0:1651529344.430442:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 4/0,1 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430444:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.430448:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176712 count 1 00010000:00010000:0.0:1651529344.430449:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 3/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430452:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430453:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 4/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.430457:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 2/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.430457:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966596928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430460:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430460:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430461:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 4/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430467:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 3/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.430467:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.430471:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 4/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.430474:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151918 00000100:00100000:1.0:1651529344.430475:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966596992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.430476:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.430480:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176714 count 1 00000100:00100000:1.0:1651529344.430482:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.430488:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151919 00010000:00010000:0.0:1651529344.430491:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430496:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 2/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.430498:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.430499:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430500:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430500:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 4/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.430503:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176707 count 1 00010000:00010000:1.0:1651529344.430506:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430507:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 3/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430510:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 4/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.430511:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 2/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430514:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430514:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.430514:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430515:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 4/0,1 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430521:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 3/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.430522:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.430525:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 4/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.430528:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151920 00000100:00100000:1.0:1651529344.430529:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.430530:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.430535:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176709 count 1 00000100:00100000:1.0:1651529344.430536:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.430538:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430542:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 2/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.430543:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151921 00000100:00100000:1.0:1651529344.430545:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.430548:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.430549:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176711 count 1 00010000:00010000:0.0:1651529344.430549:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430549:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 4/0,1 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430552:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430555:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 3/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430558:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 4/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.430562:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966597184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430566:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 2/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.430568:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.430569:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430570:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430571:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 4/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430574:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151922 00000100:00100000:0.0:1651529344.430576:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946352704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.430577:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 3/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.430580:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176713 count 1 00010000:00010000:1.0:1651529344.430581:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 4/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.430583:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430585:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966597248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430587:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 2/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430590:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430590:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430591:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 4/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430592:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.430600:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 3/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430603:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 4/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.430607:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966597312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.430613:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.430904:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966596864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.430907:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966596928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430909:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: --/PW res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430912:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430918:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966596992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430920:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.431153:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431157:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431165:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966597184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431168:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431176:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233472 00010000:00010000:1.0:1651529344.431182:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 4/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.431193:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233408 00010000:00010000:1.0:1651529344.431196:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 4/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.431196:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233536 00000100:00100000:1.0:1651529344.431201:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10876 00010000:00010000:0.0:1651529344.431201:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 4/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1860 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.431202:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41279:x1731746396233472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.431205:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431207:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 4/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1860 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431210:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 3/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1860 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.431211:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10877 00000100:00100000:0.0:1651529344.431213:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41278:x1731746396233408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.431216:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fb91198/0xa29a79078f3baa33 lrc: 0/0,0 mode: --/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d274c expref: 1860 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431216:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.431217:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 4/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1860 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431220:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431220:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431221:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431221:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 3/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431225:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 4/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431227:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3b9bd1 lrc: 0/0,0 mode: --/PR res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced00 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431231:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431232:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431233:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431236:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 4/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431241:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.431256:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431258:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41279:x1731746396233472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431261:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10876 00000100:00100000:0.0:1651529344.431264:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41278:x1731746396233408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431266:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10878 00000100:00100000:1.0:1651529344.431268:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41278:x1731746396233536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.431268:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10877 00010000:00010000:1.0:1651529344.431271:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431273:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 4/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1856 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431277:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 3/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1856 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431280:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431282:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eebaf1f/0xa29a79078f3bb3fd lrc: 0/0,0 mode: --/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f2a expref: 1856 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431284:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431285:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431286:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431287:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431287:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431289:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 2/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431290:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 4/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431296:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431302:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41278:x1731746396233536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431312:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10878 00010000:00010000:1.0:1651529344.431319:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431323:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431326:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431328:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431338:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 915us (1046us total) trans 30064892778 rc 0/0 00000100:00100000:0.0:1651529344.431341:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151916 00010000:00010000:0.0:1651529344.431349:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 2/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431352:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087bc911b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.431353:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 2/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431356:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 3/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431375:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1061us total) trans 30064892779 rc 0/0 00000100:00100000:1.0:1651529344.431378:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151917 00010000:00010000:0.0:1651529344.431382:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 1/0,0 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431385:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431386:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bc911b/0xa29a79078f3bd632 lrc: 0/0,0 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431389:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fe86dd8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.431390:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431393:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 3/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431397:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 1/0,0 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431409:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd639 lrc: 0/0,0 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431430:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.431434:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431449:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966597248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.431451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.431452:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431465:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233664 00010000:00010000:1.0:1651529344.431470:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 4/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.431475:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234112 00010000:00010000:1.0:1651529344.431477:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 5/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1856 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.431483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431490:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233792 00010000:00010000:1.0:1651529344.431493:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 4/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.431497:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233920 00000100:00100000:0.0:1651529344.431499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.431505:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 4/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.431508:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966597312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431513:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431517:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234048 00010000:00010000:1.0:1651529344.431520:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 4/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.431520:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10879 00000100:00100000:0.0:1651529344.431522:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41278:x1731746396233664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.431525:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10880 00000100:00100000:1.0:1651529344.431526:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41279:x1731746396234112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.431526:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.431527:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 4/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431529:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431531:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 4/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431531:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 3/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431534:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 3/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431537:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029db8597/0xa29a79078f3b9e24 lrc: 0/0,0 mode: --/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6f4 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431539:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030c6d9d1/0xa29a79078f3ba5ef lrc: 0/0,0 mode: --/PR res: [0x2b249:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1707 expref: 1859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431541:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431541:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431542:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431543:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431544:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431544:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431547:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 4/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431547:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 4/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431554:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.431557:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431567:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41279:x1731746396234112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.431572:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41278:x1731746396233664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.431575:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10879 00000100:00100000:1.0:1651529344.431577:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10880 00000100:00100000:0.0:1651529344.431581:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10881 00000100:00100000:1.0:1651529344.431583:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10882 00000100:00100000:0.0:1651529344.431583:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41278:x1731746396233792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.431585:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41278:x1731746396233920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.431586:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431587:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.431587:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 4/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431589:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 4/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431591:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 3/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431593:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 3/0,0 mode: PR/PR res: [0x2b245:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431596:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089cb8ce4/0xa29a79078f3bbc38 lrc: 0/0,0 mode: --/PR res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e48 expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431598:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3bafab lrc: 0/0,0 mode: --/PR res: [0x2b245:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d4f expref: 1855 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431600:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431601:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431601:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431602:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431602:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431603:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431604:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 4/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431606:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 4/0,1 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431620:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431627:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396233920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431630:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10882 00000100:00100000:1.0:1651529344.431634:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10883 00010000:00010000:0.0:1651529344.431634:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.431642:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41278:x1731746396233792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431643:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41278:x1731746396234048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.431645:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.431645:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10881 00010000:00010000:1.0:1651529344.431647:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 4/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1852 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.431651:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 3/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431653:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431655:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3ba9c3 lrc: 0/0,0 mode: --/PR res: [0x2b247:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25c4 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.431656:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431659:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431659:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431660:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431660:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431662:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 2/0,0 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431663:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 4/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431670:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431676:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41278:x1731746396234048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431678:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10883 00010000:00010000:1.0:1651529344.431685:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431689:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431701:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431704:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431722:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1245us (1365us total) trans 30064892780 rc 0/0 00000100:00100000:0.0:1651529344.431725:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151918 00010000:00010000:0.0:1651529344.431742:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 2/0,0 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431746:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e17f64ce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.431747:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 2/0,0 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431753:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 3/0,0 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431756:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1258us (1392us total) trans 30064892781 rc 0/0 00010000:00010000:0.0:1651529344.431757:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 1/0,0 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431760:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151919 00010000:00010000:0.0:1651529344.431760:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17f64ce/0xa29a79078f3bd640 lrc: 0/0,0 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431765:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431767:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431767:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.431768:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431771:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431771:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 3/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431774:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431774:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 1/0,0 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431777:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 2/0,0 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431777:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd647 lrc: 0/0,0 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431782:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 2/0,0 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431785:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfab8781 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.431786:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 2/0,0 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431789:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 3/0,0 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431792:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 1/0,0 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431795:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd655 lrc: 0/0,0 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431800:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431818:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431821:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,1 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431824:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 2/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431831:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1451us total) trans 30064892782 rc 0/0 00000100:00100000:1.0:1651529344.431834:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151921 00010000:00010000:1.0:1651529344.431841:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 2/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431855:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.431856:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 2/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431859:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 3/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431863:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946352448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1332us (1492us total) trans 30064892783 rc 0/0 00010000:00010000:1.0:1651529344.431864:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 1/0,0 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431866:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151920 00010000:00010000:1.0:1651529344.431867:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd64e lrc: 0/0,0 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431873:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431874:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431876:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431878:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431879:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431881:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431882:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 2/0,0 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431884:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 2/0,0 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431929:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946352384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1576us (1646us total) trans 30064892784 rc 0/0 00000100:00100000:0.0:1651529344.431932:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946352704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1355us (1543us total) trans 30064892785 rc 0/0 00000100:00100000:0.0:1651529344.431935:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151922 00000100:00100000:1.0:1651529344.431940:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151915 00010000:00010000:0.0:1651529344.431942:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 2/0,0 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431945:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acf2ca80 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.431946:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 2/0,0 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431948:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 2/0,0 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431949:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 3/0,0 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431952:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.431953:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 2/0,0 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431953:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 1/0,0 mode: --/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431956:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 3/0,0 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431956:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd62b lrc: 0/0,0 mode: --/PW res: [0x2b244:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431961:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 1/0,0 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431964:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd65c lrc: 0/0,0 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.431999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.432012:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353408 00000100:00100000:1.0:1651529344.432021:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353344 00000100:00100000:1.0:1651529344.432038:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151923 00000100:00100000:1.0:1651529344.432040:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946353408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.432051:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176716 count 1 00010000:00010000:1.0:1651529344.432055:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: --/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432060:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151924 00000100:00100000:0.0:1651529344.432062:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946353344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.432066:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 2/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.432068:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176715 count 1 00010000:00010000:0.0:1651529344.432072:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: --/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432077:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432077:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432077:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 2/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432078:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 4/0,1 mode: --/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432080:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432081:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432082:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 4/0,1 mode: --/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432086:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 3/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432089:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 3/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432090:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 4/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432095:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966597376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432109:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.432117:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 4/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.432122:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966597440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432131:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432180:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353536 00000100:00100000:1.0:1651529344.432195:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151925 00000100:00100000:1.0:1651529344.432197:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+214:39030:x1731745946353536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.432203:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176718 count 1 00010000:00010000:1.0:1651529344.432207:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432211:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 2/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1849 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432215:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432215:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432216:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 4/0,1 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432234:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 3/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1849 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432238:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 4/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1849 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432242:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966597504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432253:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.432310:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966597376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.432319:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: --/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432325:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353472 00000100:00100000:1.0:1651529344.432327:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353920 00000100:00100000:1.0:1651529344.432343:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354048 00000100:00100000:1.0:1651529344.432348:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151926 00000100:00100000:1.0:1651529344.432350:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946353472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.432355:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176717 count 1 00010000:00010000:1.0:1651529344.432371:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432377:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 2/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432380:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432380:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.432384:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151927 00000100:00100000:0.0:1651529344.432387:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946353920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.432391:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 4/0,1 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.432393:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176719 count 1 00010000:00010000:1.0:1651529344.432399:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 3/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432403:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 4/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432407:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432407:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: --/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432412:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 2/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432415:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.432416:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.432416:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432416:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 4/0,1 mode: --/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432423:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151928 00010000:00010000:0.0:1651529344.432424:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 3/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.432425:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946354048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.432427:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 4/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.432430:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176721 count 1 00000100:00100000:0.0:1651529344.432431:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.432433:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432438:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 2/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1849 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.432440:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.432441:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432441:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432442:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 4/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432448:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 3/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1849 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432455:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 4/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1849 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432459:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966597696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432465:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432473:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966597440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432477:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: --/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432484:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353984 00000100:00100000:0.0:1651529344.432492:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151929 00000100:00100000:1.0:1651529344.432493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.432494:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+218:39030:x1731745946353984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.432498:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176720 count 1 00010000:00010000:0.0:1651529344.432502:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432507:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 2/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432510:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432510:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432511:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 4/0,1 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432517:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 3/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432521:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 4/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.432525:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966597760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432533:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.432545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.432549:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354112 00000100:00100000:0.0:1651529344.432559:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151930 00000100:00100000:0.0:1651529344.432561:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+219:39030:x1731745946354112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.432566:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176722 count 1 00010000:00010000:0.0:1651529344.432569:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432580:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 2/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.432584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.432584:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432584:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432585:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 4/0,1 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432591:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234496 00010000:00010000:0.0:1651529344.432591:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 3/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1849 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432597:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 4/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1850 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432609:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234432 00010000:00010000:1.0:1651529344.432612:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 4/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.432615:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 4/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432616:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234560 00010000:00010000:1.0:1651529344.432618:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 5/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1852 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.432620:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966597824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432623:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10884 00000100:00100000:1.0:1651529344.432624:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41279:x1731746396234496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.432628:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.432629:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 4/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1852 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.432635:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.432639:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 3/0,0 mode: PR/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1852 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.432642:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10885 00000100:00100000:0.0:1651529344.432644:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41278:x1731746396234432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.432645:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bc18d lrc: 0/0,0 mode: --/PR res: [0x2b24b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8341 expref: 1852 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.432647:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.432649:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432649:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 4/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.432650:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432650:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432653:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 4/0,1 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432660:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 3/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.432663:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.432670:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1851:41279:x1731746396234496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.432672:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eadf901f/0xa29a79078f3baee0 lrc: 0/0,0 mode: --/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f9 expref: 1851 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432673:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10884 00000100:00100000:1.0:1651529344.432683:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10886 00000100:00100000:1.0:1651529344.432685:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41278:x1731746396234560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.432687:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.432688:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432689:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 5/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1849 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.432689:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432689:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432693:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 4/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432695:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 4/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1849 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.432700:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432703:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.432707:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432708:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432710:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41278:x1731746396234432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.432711:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 4/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432713:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10885 00010000:00010000:1.0:1651529344.432716:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.432721:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432722:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1848:41278:x1731746396234560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.432724:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10886 00010000:00010000:0.0:1651529344.432725:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432746:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000330a08f2/0xa29a79078f3b77e3 lrc: 0/0,0 mode: --/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb51c expref: 1847 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.432750:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966597504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432750:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,1 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432754:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432757:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432760:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432762:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 2/0,0 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432763:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432766:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 2/0,0 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432838:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+221:39030:x1731745946353536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 639us (664us total) trans 30064892786 rc 0/0 00000100:00100000:1.0:1651529344.432841:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151925 00010000:00010000:1.0:1651529344.432850:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432853:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432853:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946353344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 791us (854us total) trans 30064892787 rc 0/0 00010000:00010000:1.0:1651529344.432856:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432857:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151924 00010000:00010000:1.0:1651529344.432859:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 2/0,0 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432865:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 2/0,0 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432869:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.432870:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 2/0,0 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432873:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 3/0,0 mode: PW/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432878:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 1/0,0 mode: --/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432881:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd66a lrc: 0/0,0 mode: --/PW res: [0x2b24b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432885:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 2/0,0 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432888:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027416bb5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.432889:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 2/0,0 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432892:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 3/0,0 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432895:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946353408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 853us (924us total) trans 30064892788 rc 0/0 00010000:00010000:0.0:1651529344.432895:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 1/0,0 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432897:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151923 00010000:00010000:0.0:1651529344.432897:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd671 lrc: 0/0,0 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432901:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 2/0,0 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432903:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006e1d96e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.432904:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 2/0,0 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432907:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 3/0,0 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432910:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 1/0,0 mode: --/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432912:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd663 lrc: 0/0,0 mode: --/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432954:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966597696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.432972:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432981:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432987:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.432991:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432992:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: --/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432999:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966597760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433001:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433168:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234752 00010000:00010000:1.0:1651529344.433174:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 4/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1847 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433193:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234816 00000100:00100000:0.0:1651529344.433195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.433196:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 4/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1848 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433208:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234880 00010000:00010000:1.0:1651529344.433211:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 4/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433211:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.433219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433221:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10887 00000100:00100000:1.0:1651529344.433223:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396234752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.433226:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.433226:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234944 00010000:00010000:1.0:1651529344.433228:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 4/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1850 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433231:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 4/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1850 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.433232:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 3/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1850 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.433245:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bb340 lrc: 0/0,0 mode: --/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bfe expref: 1850 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.433249:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433250:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433250:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433254:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 4/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433260:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433263:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10888 00000100:00100000:0.0:1651529344.433265:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396234816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.433268:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.433270:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 4/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.433275:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396234752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.433277:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 3/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1849 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.433278:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10887 00000100:00100000:1.0:1651529344.433283:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10889 00000100:00100000:1.0:1651529344.433285:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1848:41279:x1731746396234880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.433288:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.433289:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 4/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1848 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.433293:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 3/0,0 mode: PR/PR res: [0x2b250:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1848 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433293:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3b9feb lrc: 0/0,0 mode: --/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd92 expref: 1848 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433297:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433298:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433299:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433302:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 4/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433306:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3ba7cb lrc: 0/0,0 mode: --/PR res: [0x2b250:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eee expref: 1847 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433309:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.433316:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433317:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.433317:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1846:41279:x1731746396234816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.433318:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433319:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10888 00010000:00010000:1.0:1651529344.433321:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 4/0,1 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433325:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10890 00000100:00100000:0.0:1651529344.433326:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1845:41278:x1731746396234944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.433330:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.433336:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.433337:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1845:41279:x1731746396234880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.433338:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 4/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1845 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.433339:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10889 00010000:00010000:0.0:1651529344.433342:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 3/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1844 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433347:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3b9659 lrc: 0/0,0 mode: --/PR res: [0x2b251:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd75f expref: 1844 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.433348:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433351:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433351:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433351:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433352:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433354:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433355:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 4/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433357:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 2/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433364:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433370:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41278:x1731746396234944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.433373:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10890 00010000:00010000:0.0:1651529344.433380:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433383:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433386:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433389:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 2/0,0 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433400:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946353472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1049us (1106us total) trans 30064892789 rc 0/0 00000100:00100000:1.0:1651529344.433403:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151926 00000100:00100000:1.0:1651529344.433417:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354368 00000100:00100000:1.0:1651529344.433423:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354496 00000100:00100000:1.0:1651529344.433431:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151931 00000100:00100000:1.0:1651529344.433432:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946354368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.433438:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176723 count 1 00010000:00010000:1.0:1651529344.433442:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: --/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433447:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 2/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.433447:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946353920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1139us total) trans 30064892790 rc 0/0 00010000:00010000:1.0:1651529344.433450:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.433450:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151927 00010000:00010000:1.0:1651529344.433451:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433451:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 4/0,1 mode: --/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433456:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151932 00010000:00010000:1.0:1651529344.433458:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 3/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.433458:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+221:39030:x1731745946354496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.433462:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 4/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.433462:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176724 count 1 00000100:00100000:1.0:1651529344.433466:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433466:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433471:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 2/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433474:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.433475:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.433475:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433475:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 4/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433480:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 2/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433482:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 3/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.433483:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade9dc56 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.433486:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433490:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.433492:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 2/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433495:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 3/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433498:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.433500:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 1/0,0 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433503:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd678 lrc: 0/0,0 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433503:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 2/0,0 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433507:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.433508:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 2/0,0 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433509:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433511:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 3/0,0 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433512:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433515:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433515:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 1/0,0 mode: --/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433518:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 2/0,0 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433518:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd67f lrc: 0/0,0 mode: --/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433522:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,0 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433533:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f28f648 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.433534:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 2/0,0 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433537:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 3/0,0 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433540:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 1/0,0 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433545:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd686 lrc: 0/0,0 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433553:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433555:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433559:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,1 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433560:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946354048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1134us (1241us total) trans 30064892791 rc 0/0 00010000:00010000:0.0:1651529344.433561:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 2/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433563:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151928 00010000:00010000:1.0:1651529344.433579:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 2/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433590:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e77a8a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.433591:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 2/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433594:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 3/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433599:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 1/0,0 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433602:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e77a8a4/0xa29a79078f3bd68d lrc: 0/0,0 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433603:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946353984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1108us (1124us total) trans 30064892792 rc 0/0 00000100:00100000:0.0:1651529344.433606:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151929 00000100:00100000:1.0:1651529344.433620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.433640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.433670:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966597824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433674:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433682:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354624 00000100:00100000:0.0:1651529344.433688:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151933 00000100:00100000:0.0:1651529344.433690:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946354624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.433696:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176725 count 1 00010000:00010000:0.0:1651529344.433700:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433704:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 2/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433707:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433708:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433708:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 4/0,1 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433715:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 3/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433718:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 4/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433722:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.433764:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.433772:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235392 00010000:00010000:0.0:1651529344.433777:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 4/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1843 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.433787:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10891 00000100:00100000:0.0:1651529344.433789:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41279:x1731746396235392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.433792:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.433793:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 4/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433797:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 3/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433821:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da0523b/0xa29a79078f3b99e0 lrc: 0/0,0 mode: --/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce543 expref: 1843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.433824:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433825:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433826:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433829:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 4/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433836:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433844:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41279:x1731746396235392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.433864:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10891 00000100:00100000:1.0:1651529344.433872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.433876:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433880:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433883:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433886:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 2/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.433927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.433934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.433941:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354688 00000100:00100000:1.0:1651529344.433952:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354816 00000100:00100000:1.0:1651529344.433962:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354752 00000100:00100000:0.0:1651529344.433962:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946354112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1400us (1458us total) trans 30064892793 rc 0/0 00000100:00100000:0.0:1651529344.433965:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151930 00000100:00100000:1.0:1651529344.433966:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354880 00000100:00100000:1.0:1651529344.433969:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151934 00000100:00100000:1.0:1651529344.433971:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946354688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.433971:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151935 00000100:00100000:0.0:1651529344.433973:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946354816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.433976:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176726 count 1 00002000:00080000:0.0:1651529344.433978:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176728 count 1 00010000:00010000:1.0:1651529344.433989:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433990:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: --/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433994:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 2/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433995:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 2/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.433997:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433998:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433998:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 4/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433998:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434006:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 3/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434009:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434013:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966598080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434014:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434015:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 4/0,1 mode: --/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434023:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.434023:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 3/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434028:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 4/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434030:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151936 00000100:00100000:1.0:1651529344.434031:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946354752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.434035:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966598144:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.434037:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176727 count 1 00010000:00010000:1.0:1651529344.434040:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434044:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 2/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.434044:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.434050:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 2/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434053:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.434054:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 2/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434057:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434057:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 3/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434058:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434059:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 4/0,1 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434065:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 3/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434069:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 4/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434073:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966598208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434075:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 1/0,0 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434079:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd694 lrc: 0/0,0 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434080:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.434087:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151937 00000100:00100000:1.0:1651529344.434088:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946354880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.434093:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176729 count 1 00010000:00010000:1.0:1651529344.434097:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434101:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 2/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434104:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434104:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434105:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 4/0,1 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434135:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 3/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1841 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434139:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 4/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.434144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.434149:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.434158:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.434166:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966597888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.434170:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: --/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434189:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966597952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434194:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434201:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434203:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434209:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235456 00010000:00010000:0.0:1651529344.434214:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 4/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.434225:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10892 00000100:00100000:0.0:1651529344.434227:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41278:x1731746396235456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.434244:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434246:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 4/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434268:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 3/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434269:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434274:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3b86b5 lrc: 0/0,0 mode: --/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc01a expref: 1842 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.434278:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434278:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434279:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434282:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 4/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434291:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.434297:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235648 00000100:00100000:0.0:1651529344.434302:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41278:x1731746396235456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.434307:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.434312:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10892 00000100:00100000:1.0:1651529344.434314:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235776 00010000:00010000:1.0:1651529344.434317:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 4/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.434319:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10893 00000100:00100000:0.0:1651529344.434320:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41279:x1731746396235648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.434322:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10894 00010000:00010000:0.0:1651529344.434323:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.434324:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41279:x1731746396235776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.434325:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434329:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 3/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434333:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3ba539 lrc: 0/0,0 mode: --/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13f0 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434334:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.434336:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 4/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434337:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434337:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434338:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434340:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 3/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434341:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 4/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434345:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731d9780/0xa29a79078f3bab28 lrc: 0/0,0 mode: --/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bac expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434347:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.434349:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434350:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434351:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434353:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1840:41279:x1731746396235648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (84us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.434354:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 4/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434356:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10893 00010000:00010000:1.0:1651529344.434363:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.434371:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41279:x1731746396235776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.434374:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10894 00010000:00010000:1.0:1651529344.434382:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434385:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434391:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434403:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434406:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 2/0,0 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434410:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434420:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434422:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 2/0,0 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434455:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946354368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1260us total) trans 30064892794 rc 0/0 00000100:00100000:1.0:1651529344.434458:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151931 00000100:00100000:1.0:1651529344.434463:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355328 00000100:00100000:1.0:1651529344.434470:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151938 00000100:00100000:1.0:1651529344.434472:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946355328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.434476:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176730 count 1 00010000:00010000:1.0:1651529344.434481:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434481:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946354496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1269us total) trans 30064892795 rc 0/0 00000100:00100000:0.0:1651529344.434484:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151932 00010000:00010000:1.0:1651529344.434485:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 2/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1838 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434488:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434489:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434490:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 4/0,1 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434492:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 2/0,0 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434495:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae6e66f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.434496:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 3/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1838 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434496:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 2/0,0 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434499:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 3/0,0 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434504:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 1/0,0 mode: --/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434507:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd69b lrc: 0/0,0 mode: --/PW res: [0x2b253:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434512:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 4/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1838 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434516:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966598336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434520:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 2/0,0 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434523:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.434524:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.434524:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 2/0,0 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434527:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 3/0,0 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434530:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 1/0,0 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434533:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd6a2 lrc: 0/0,0 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434538:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434541:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434544:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434546:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 2/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434598:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946354624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 907us (978us total) trans 30064892796 rc 0/0 00000100:00100000:0.0:1651529344.434602:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151933 00010000:00010000:0.0:1651529344.434609:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 2/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434612:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.434613:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 2/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434616:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 3/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434620:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 1/0,0 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434623:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd6a9 lrc: 0/0,0 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434633:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966598144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434636:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: --/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434645:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966598080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.434650:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434658:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966598208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.434661:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.434726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.434743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.434747:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235904 00010000:00010000:0.0:1651529344.434753:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1839 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.434762:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236032 00010000:00010000:0.0:1651529344.434765:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 4/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1840 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434766:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236160 00000100:00100000:0.0:1651529344.434769:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10895 00000100:00100000:0.0:1651529344.434771:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746396235904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.434772:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 4/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434774:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434775:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434778:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236352 00010000:00010000:0.0:1651529344.434779:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 3/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434780:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 5/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434784:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3ba0a1 lrc: 0/0,0 mode: --/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0024 expref: 1842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434788:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434788:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434789:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434792:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 4/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434793:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10896 00000100:00100000:1.0:1651529344.434795:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746396236032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.434798:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434801:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.434821:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 4/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434826:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 3/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.434827:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746396235904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.434832:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bb92f lrc: 0/0,0 mode: --/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62f6 expref: 1841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434836:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434836:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434837:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434841:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 4/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434846:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10895 00010000:00010000:1.0:1651529344.434854:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.434862:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41279:x1731746396236032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.434865:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10897 00000100:00100000:1.0:1651529344.434867:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10896 00000100:00100000:0.0:1651529344.434867:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41279:x1731746396236160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.434870:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434872:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 4/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1838 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434873:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10898 00010000:00010000:0.0:1651529344.434876:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 3/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1838 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.434881:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1838:41278:x1731746396236352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.434881:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bbf3a lrc: 0/0,0 mode: --/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79e0 expref: 1838 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434884:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434884:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434885:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434886:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 5/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1837 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.434886:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434889:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 4/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434890:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 4/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1837 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.434895:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434896:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434902:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434906:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 4/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434907:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.434910:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.434914:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41279:x1731746396236160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.434916:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41278:x1731746396236352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.434917:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10897 00000100:00100000:1.0:1651529344.434919:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10898 00010000:00010000:0.0:1651529344.434927:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434930:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434930:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434933:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434934:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434936:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 2/0,0 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434937:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434952:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434985:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+229:39030:x1731745946354816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1011us (1078us total) trans 30064892797 rc 0/0 00000100:00100000:0.0:1651529344.434988:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151935 00010000:00010000:0.0:1651529344.434995:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 2/0,0 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434997:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946354688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1025us (1125us total) trans 30064892798 rc 0/0 00010000:00010000:0.0:1651529344.434998:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.434999:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 2/0,0 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435000:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151934 00010000:00010000:0.0:1651529344.435002:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 3/0,0 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435006:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 1/0,0 mode: --/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435008:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435009:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd6b7 lrc: 0/0,0 mode: --/PW res: [0x2b258:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435011:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944b24dc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.435012:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435015:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 3/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435019:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 1/0,0 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435022:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd6b0 lrc: 0/0,0 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435038:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435041:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435044:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435047:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 2/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435052:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.435082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.435096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435111:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946354752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1078us (1189us total) trans 30064892799 rc 0/0 00000100:00100000:0.0:1651529344.435119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435121:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151936 00000100:00100000:1.0:1651529344.435127:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355648 00000100:00100000:1.0:1651529344.435133:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355584 00000100:00100000:1.0:1651529344.435141:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355712 00010000:00010000:0.0:1651529344.435154:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 2/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435156:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151939 00000100:00100000:1.0:1651529344.435157:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+230:39029:x1731745946355648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.435158:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba67ad12 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.435159:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 2/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435162:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 3/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.435163:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176732 count 1 00010000:00010000:1.0:1651529344.435167:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435167:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 1/0,0 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435171:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 2/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435174:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435175:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435176:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 4/0,1 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435182:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 3/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435183:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd6be lrc: 0/0,0 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435186:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 4/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435191:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966598400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435193:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151940 00000100:00100000:0.0:1651529344.435195:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+230:39029:x1731745946355584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.435200:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176731 count 1 00000100:00100000:1.0:1651529344.435205:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.435210:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: --/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435212:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236416 00010000:00010000:1.0:1651529344.435217:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 5/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1836 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435224:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10899 00000100:00100000:1.0:1651529344.435226:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41278:x1731746396236416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.435226:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 2/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1836 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435229:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.435229:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435229:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435230:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 5/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.435230:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 4/0,1 mode: --/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435234:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 4/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.435237:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 3/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1836 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435239:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435240:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435240:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435241:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 4/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.435243:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 4/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435245:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966598464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435250:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.435255:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.435256:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41278:x1731746396236416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.435259:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10899 00000100:00100000:0.0:1651529344.435261:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151941 00000100:00100000:0.0:1651529344.435263:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+230:39029:x1731745946355712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.435268:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176733 count 1 00010000:00010000:1.0:1651529344.435270:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42051c3/0xa29a79078f3ba9ed lrc: 0/0,0 mode: --/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2649 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.435272:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435274:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966598336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435276:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 2/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1834 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435278:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435279:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435281:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435284:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435286:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435287:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435287:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 4/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435290:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 2/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435294:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 3/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1834 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435304:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1834 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.435308:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966598528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435329:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.435332:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+231:39030:x1731745946355328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 859us (1053us total) trans 30064892800 rc 0/0 00000100:00100000:1.0:1651529344.435337:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151938 00010000:00010000:0.0:1651529344.435347:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 2/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435348:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bb1a3 lrc: 0/0,0 mode: --/PR res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4505 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.435350:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a5ade66 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.435351:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 2/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435352:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435354:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 3/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435355:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435358:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435359:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 1/0,0 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435361:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435362:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5ade66/0xa29a79078f3bd6cc lrc: 0/0,0 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435364:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435367:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 2/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435376:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 2/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435379:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e08cf94 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.435380:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 2/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435382:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 3/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435386:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 1/0,0 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435388:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd6c5 lrc: 0/0,0 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435400:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+231:39030:x1731745946354880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1311us (1465us total) trans 30064892801 rc 0/0 00000100:00100000:1.0:1651529344.435403:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151937 00000100:00100000:0.0:1651529344.435416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.435435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.435467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435489:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355904 00000100:00100000:1.0:1651529344.435499:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355840 00000100:00100000:0.0:1651529344.435502:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355968 00000100:00100000:1.0:1651529344.435504:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151942 00000100:00100000:1.0:1651529344.435506:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946355904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.435516:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176735 count 1 00010000:00010000:1.0:1651529344.435521:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: --/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435525:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 2/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.435526:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151943 00010000:00010000:1.0:1651529344.435528:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.435528:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946355840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.435529:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435530:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 4/0,1 mode: --/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.435533:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176734 count 1 00010000:00010000:1.0:1651529344.435536:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 3/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435537:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435540:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 4/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435544:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435553:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 2/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.435559:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.435562:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435563:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435563:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 4/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435566:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151944 00000100:00100000:1.0:1651529344.435568:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946355968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.435571:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 3/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.435572:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176736 count 1 00010000:00010000:0.0:1651529344.435575:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1833 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.435576:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435583:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 2/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435586:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435586:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435587:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 4/0,1 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435597:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435599:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 3/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435603:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 4/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435607:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966598720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435607:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.435614:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.435654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435668:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966598400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435673:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435697:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356288 00000100:00100000:1.0:1651529344.435704:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356224 00000100:00100000:1.0:1651529344.435708:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151945 00000100:00100000:1.0:1651529344.435710:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+235:39029:x1731745946356288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.435714:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176738 count 1 00010000:00010000:1.0:1651529344.435718:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435723:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 2/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435726:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435726:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435727:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 4/0,1 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435745:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 3/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435749:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 4/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435753:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966598784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.435767:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.435774:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151946 00000100:00100000:1.0:1651529344.435775:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+235:39029:x1731745946356224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.435780:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176737 count 1 00010000:00010000:1.0:1651529344.435797:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435822:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 2/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435829:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435829:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435830:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 4/0,1 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435837:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 3/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1833 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435841:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 4/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.435845:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966598848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.435858:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.435904:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966598464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435908:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: --/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.436210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.436221:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236672 00000100:00100000:0.0:1651529344.436223:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966598528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.436227:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 4/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436235:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236736 00010000:00010000:1.0:1651529344.436237:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 4/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436250:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10900 00000100:00100000:1.0:1651529344.436252:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746396236672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.436255:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436256:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 4/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436262:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436268:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 3/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.436271:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10901 00000100:00100000:0.0:1651529344.436273:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41278:x1731746396236736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.436274:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd9ba53f/0xa29a79078f3ba71c lrc: 0/0,0 mode: --/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c08 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436277:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436278:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436278:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436279:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436279:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 4/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436282:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 4/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436282:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 3/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436288:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c00f8a/0xa29a79078f3bbeae lrc: 0/0,0 mode: --/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77d3 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436289:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.436291:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436292:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436293:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436296:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 4/0,1 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436301:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746396236672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.436304:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10900 00010000:00010000:0.0:1651529344.436309:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.436312:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436315:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436316:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1832:41278:x1731746396236736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.436318:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436319:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10901 00010000:00010000:1.0:1651529344.436330:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 2/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436335:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436344:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436347:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,1 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436350:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 2/0,0 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436373:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+237:39029:x1731745946355648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1215us (1321us total) trans 30064892802 rc 0/0 00000100:00100000:1.0:1651529344.436376:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151939 00000100:00100000:0.0:1651529344.436391:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+236:39029:x1731745946355584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1196us (1295us total) trans 30064892803 rc 0/0 00000100:00100000:0.0:1651529344.436395:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151940 00000100:00100000:1.0:1651529344.436402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.436416:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 2/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436420:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ddda7a96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.436421:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 2/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436424:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 3/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436429:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 1/0,0 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436446:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddda7a96/0xa29a79078f3bd6d3 lrc: 0/0,0 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436450:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 2/0,0 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436453:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.436454:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 2/0,0 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436457:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 3/0,0 mode: PW/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436460:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 1/0,0 mode: --/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436463:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd6da lrc: 0/0,0 mode: --/PW res: [0x2b25b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436473:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436476:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.436503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.436510:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236864 00000100:00100000:1.0:1651529344.436511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.436516:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1832 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436517:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.436526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.436532:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237056 00000100:00100000:0.0:1651529344.436533:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236992 00010000:00010000:0.0:1651529344.436536:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 5/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436537:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.436540:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237120 00010000:00010000:0.0:1651529344.436542:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 5/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436543:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237184 00010000:00010000:1.0:1651529344.436546:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 5/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1836 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.436547:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237312 00010000:00010000:0.0:1651529344.436549:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 5/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1837 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436551:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10902 00000100:00100000:1.0:1651529344.436552:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41278:x1731746396236864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.436554:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10903 00010000:00010000:1.0:1651529344.436555:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.436556:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41279:x1731746396236992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.436557:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1837 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436559:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.436560:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 5/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1837 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436563:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 4/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1837 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436570:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436571:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 3/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1837 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436576:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 4/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436577:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc414ead/0xa29a79078f3b98ac lrc: 0/0,0 mode: --/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b9 expref: 1837 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436581:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436581:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.436582:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436582:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436586:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 4/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436590:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41279:x1731746396236992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.436595:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.436599:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10903 00000100:00100000:1.0:1651529344.436603:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41278:x1731746396236864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.436606:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10902 00000100:00100000:1.0:1651529344.436611:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10904 00000100:00100000:1.0:1651529344.436612:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746396237056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.436615:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436616:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.436625:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10905 00000100:00100000:0.0:1651529344.436627:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746396237120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.436628:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 3/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436630:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.436632:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 5/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436636:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 4/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436640:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094993538/0xa29a79078f3bbeed lrc: 0/0,0 mode: --/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ba expref: 1834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436641:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436642:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436642:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436643:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436644:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436645:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436645:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 4/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436647:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 4/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436649:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.436656:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.436662:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746396237056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.436663:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746396237120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.436665:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10904 00000100:00100000:0.0:1651529344.436667:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10905 00000100:00100000:1.0:1651529344.436670:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10906 00000100:00100000:1.0:1651529344.436672:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746396237184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.436675:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436676:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 5/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1831 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.436676:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10907 00000100:00100000:0.0:1651529344.436678:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41278:x1731746396237312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.436680:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 4/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436680:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.436682:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 5/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436684:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436685:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436686:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436686:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 4/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.436689:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 4/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436692:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436693:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.436695:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 4/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436697:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746396237184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.436699:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10906 00010000:00010000:0.0:1651529344.436699:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.436704:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1830:41278:x1731746396237312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.436707:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10907 00010000:00010000:1.0:1651529344.436709:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb2b1dd8/0xa29a79078f3bc219 lrc: 0/0,0 mode: --/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85a2 expref: 1829 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.436713:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966598720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436713:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436716:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436717:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436720:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436720:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436723:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436723:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 2/0,0 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436726:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436728:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 2/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436782:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+237:39029:x1731745946355712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1517us (1662us total) trans 30064892804 rc 0/0 00000100:00100000:0.0:1651529344.436785:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151941 00000100:00100000:1.0:1651529344.436787:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+237:39029:x1731745946355968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1219us (1320us total) trans 30064892805 rc 0/0 00000100:00100000:1.0:1651529344.436790:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151944 00010000:00010000:0.0:1651529344.436792:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 2/0,0 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436796:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.436797:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 2/0,0 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436798:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 2/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436799:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 3/0,0 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436802:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fbd3940 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.436818:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 2/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436821:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 1/0,0 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436822:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 3/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436824:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd6e1 lrc: 0/0,0 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436827:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 1/0,0 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436830:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbd3940/0xa29a79078f3bd6f6 lrc: 0/0,0 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436833:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436836:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436839:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436842:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3b9f51 lrc: 0/0,0 mode: --/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb93 expref: 1828 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436842:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 2/0,0 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436846:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966598848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.436849:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436855:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436858:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436861:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,1 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436863:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 2/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436885:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+237:39029:x1731745946355840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1357us (1449us total) trans 30064892806 rc 0/0 00000100:00100000:0.0:1651529344.436888:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151943 00010000:00010000:0.0:1651529344.436895:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 2/0,0 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436898:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.436899:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 2/0,0 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436902:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 3/0,0 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436906:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+236:39029:x1731745946356224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1130us (1224us total) trans 30064892807 rc 0/0 00010000:00010000:0.0:1651529344.436906:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 1/0,0 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436909:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd6ef lrc: 0/0,0 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436910:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151946 00010000:00010000:0.0:1651529344.436914:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 2/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363745b8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.436917:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 2/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436920:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d58c761e/0xa29a79078f3bc02f lrc: 0/0,0 mode: --/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d91 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.436920:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 3/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436923:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 1/0,0 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436924:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436926:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363745b8/0xa29a79078f3bd704 lrc: 0/0,0 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436927:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436930:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436936:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436939:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,1 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.436941:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 2/0,0 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.436983:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+236:39029:x1731745946355904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1477us (1568us total) trans 30064892808 rc 0/0 00000100:00100000:1.0:1651529344.436986:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151942 00000100:00100000:1.0:1651529344.437000:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356736 00000100:00100000:0.0:1651529344.437013:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356800 00000100:00100000:0.0:1651529344.437021:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151947 00000100:00100000:0.0:1651529344.437022:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946356736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.437028:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176739 count 1 00000100:00100000:1.0:1651529344.437036:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151948 00000100:00100000:1.0:1651529344.437038:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946356800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.437040:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: --/PW res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.437043:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176740 count 1 00010000:00010000:1.0:1651529344.437047:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437052:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 2/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437055:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437056:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437056:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 4/0,1 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437073:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 2/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437075:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 3/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437077:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437078:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437078:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 4/0,1 mode: --/PW res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437079:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 4/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.437084:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437086:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 3/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437090:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 4/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437094:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.437098:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.437103:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 2/0,0 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437107:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a742b1a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.437108:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 2/0,0 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437111:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 3/0,0 mode: PW/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437111:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.437116:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 1/0,0 mode: --/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437118:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a742b1a/0xa29a79078f3bd6e8 lrc: 0/0,0 mode: --/PW res: [0x2b25f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437130:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3baaaa lrc: 0/0,0 mode: --/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2952 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.437151:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966598784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.437155:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437158:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437161:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437164:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437167:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 2/0,0 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437199:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 2/0,0 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437203:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085334b47 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.437204:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 2/0,0 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437209:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+238:39029:x1731745946356288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1498us (1555us total) trans 30064892809 rc 0/0 00000100:00100000:1.0:1651529344.437212:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151945 00010000:00010000:0.0:1651529344.437219:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 3/0,0 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437224:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 1/0,0 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437229:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd6fd lrc: 0/0,0 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.437260:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356992 00000100:00100000:1.0:1651529344.437266:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151949 00000100:00100000:1.0:1651529344.437279:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+238:39030:x1731745946356992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.437285:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176741 count 1 00010000:00010000:1.0:1651529344.437289:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437302:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 2/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437305:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437306:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437306:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 4/0,1 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437314:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 3/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437317:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 4/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.437322:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966599040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.437338:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.437352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437406:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.437409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.437414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.437416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.437424:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357120 00000100:00100000:1.0:1651529344.437428:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237888 00000100:00100000:0.0:1651529344.437434:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357248 00000100:00100000:0.0:1651529344.437440:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357056 00010000:00010000:1.0:1651529344.437443:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 5/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437443:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357184 00000100:00100000:0.0:1651529344.437446:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357312 00000100:00100000:0.0:1651529344.437449:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151950 00000100:00100000:1.0:1651529344.437454:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237952 00000100:00100000:0.0:1651529344.437455:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946357120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.437457:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 5/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.437473:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10908 00000100:00100000:1.0:1651529344.437475:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396237888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00002000:00080000:0.0:1651529344.437475:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176743 count 1 00010000:00010000:1.0:1651529344.437478:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.437480:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 5/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.437480:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437483:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 4/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.437485:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 2/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1827 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437488:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437489:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437489:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437489:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 4/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437490:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437491:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437494:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 4/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437497:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 3/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1827 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437499:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.437501:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437505:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966599104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.437507:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396237888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.437510:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10908 00000100:00100000:1.0:1651529344.437514:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10909 00000100:00100000:0.0:1651529344.437514:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.437516:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746396237952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.437519:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.437520:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 5/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.437531:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 4/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.437536:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437536:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.437536:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151951 00010000:00010000:1.0:1651529344.437537:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437538:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946357248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.437540:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 4/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.437543:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176745 count 1 00010000:00010000:1.0:1651529344.437544:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.437547:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: --/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437550:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746396237952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.437552:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10909 00010000:00010000:0.0:1651529344.437552:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 2/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437555:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437555:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437556:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 4/0,1 mode: --/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437560:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151952 00000100:00100000:1.0:1651529344.437562:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946357056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.437562:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 3/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437565:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 4/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.437567:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176742 count 1 00010000:00010000:1.0:1651529344.437571:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437575:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 2/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437578:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437579:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.437582:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966599168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.437586:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 4/0,1 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437590:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.437594:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 3/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437597:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 4/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437598:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151953 00000100:00100000:0.0:1651529344.437599:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946357184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.437602:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966599232:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.437604:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176744 count 1 00010000:00010000:0.0:1651529344.437607:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: --/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437609:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.437612:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 2/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437614:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437615:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437616:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 4/0,1 mode: --/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437618:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151954 00000100:00100000:1.0:1651529344.437619:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946357312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.437622:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 3/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.437624:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176746 count 1 00010000:00010000:0.0:1651529344.437626:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 4/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.437628:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: --/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437630:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966599296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.437632:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 2/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437635:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437636:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.437636:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.437637:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 4/0,1 mode: --/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437643:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 3/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437644:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052546546/0xa29a79078f3ba245 lrc: 0/0,0 mode: --/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06e5 expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.437656:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 4/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437656:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966598976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437660:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437661:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966599360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437663:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437666:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437668:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.437669:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437671:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 2/0,0 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437678:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bb960 lrc: 0/0,0 mode: --/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6389 expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.437682:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966598912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.437686:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437689:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437692:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437695:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437698:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 2/0,0 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437714:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946356736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 691us (774us total) trans 30064892810 rc 0/0 00000100:00100000:0.0:1651529344.437717:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151947 00010000:00010000:0.0:1651529344.437725:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 2/0,0 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437728:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.437729:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 2/0,0 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437747:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946356800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 708us (787us total) trans 30064892811 rc 0/0 00010000:00010000:0.0:1651529344.437751:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 3/0,0 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437757:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 1/0,0 mode: --/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437758:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151948 00010000:00010000:0.0:1651529344.437759:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd70b lrc: 0/0,0 mode: --/PW res: [0x2b263:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437764:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 2/0,0 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437766:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003610de67 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.437767:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 2/0,0 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437770:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 3/0,0 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437773:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 1/0,0 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437776:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003610de67/0xa29a79078f3bd712 lrc: 0/0,0 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.437838:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238016 00010000:00010000:0.0:1651529344.437851:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 5/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.437862:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10910 00000100:00100000:0.0:1651529344.437864:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41278:x1731746396238016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.437867:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.437868:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966599040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437869:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 4/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.437873:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 3/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.437878:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437882:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097dae111/0xa29a79078f3b9c1e lrc: 0/0,0 mode: --/PR res: [0x2b265:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee6c expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.437885:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437886:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437887:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437890:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 4/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437900:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.437908:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41278:x1731746396238016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (83us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.437910:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437911:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10910 00010000:00010000:1.0:1651529344.437914:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437917:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437920:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 2/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437966:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 2/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437977:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000927716a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.437978:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 2/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437982:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946356992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 713us (731us total) trans 30064892812 rc 0/0 00010000:00010000:0.0:1651529344.437982:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 3/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437985:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151949 00010000:00010000:0.0:1651529344.437986:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 1/0,0 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437989:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927716a4/0xa29a79078f3bd719 lrc: 0/0,0 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.438066:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357824 00000100:00100000:0.0:1651529344.438071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.438088:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357888 00000100:00100000:1.0:1651529344.438096:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151955 00000100:00100000:1.0:1651529344.438098:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+245:39030:x1731745946357824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.438100:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151956 00000100:00100000:0.0:1651529344.438102:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946357888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.438103:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176747 count 1 00002000:00080000:0.0:1651529344.438108:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176748 count 1 00010000:00010000:0.0:1651529344.438113:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438115:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: --/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438117:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 2/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438120:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 2/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.438120:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438121:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438123:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438124:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438125:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 4/0,1 mode: --/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438132:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 3/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438135:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 4/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.438140:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966599424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438145:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 4/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438155:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 3/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.438160:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.438165:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 4/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438169:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966599488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.438179:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.438211:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357952 00000100:00100000:1.0:1651529344.438220:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151957 00000100:00100000:1.0:1651529344.438222:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+246:39029:x1731745946357952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.438227:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176749 count 1 00010000:00010000:1.0:1651529344.438231:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: --/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438235:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 2/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438247:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438248:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438248:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 4/0,1 mode: --/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438256:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 3/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1822 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438260:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 4/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.438264:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966599552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438280:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.438357:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966599104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438366:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438370:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966599232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438374:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438374:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966599168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438377:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: --/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438384:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966599296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438386:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: --/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438453:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966599360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438456:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: --/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.438483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.438492:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238208 00000100:00100000:0.0:1651529344.438493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.438497:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 4/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.438524:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238336 00010000:00010000:1.0:1651529344.438528:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 4/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1824 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.438532:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238144 00010000:00010000:1.0:1651529344.438534:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1825 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.438538:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238272 00000100:00100000:0.0:1651529344.438541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.438548:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 4/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.438558:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238400 00010000:00010000:1.0:1651529344.438566:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 4/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438568:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966599488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438571:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10911 00010000:00010000:0.0:1651529344.438572:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438573:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396238208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.438576:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.438577:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 4/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438580:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10912 00010000:00010000:1.0:1651529344.438581:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 3/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438582:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396238336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.438585:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.438586:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bbdd5 lrc: 0/0,0 mode: --/PR res: [0x2b266:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7422 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.438587:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 4/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.438591:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 3/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.438597:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3ba05b lrc: 0/0,0 mode: --/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff60 expref: 1826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.438600:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438600:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438601:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438601:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438601:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438602:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438604:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 4/0,1 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438605:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 4/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438611:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.438611:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.438620:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1825:41279:x1731746396238208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.438623:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10911 00000100:00100000:0.0:1651529344.438627:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41279:x1731746396238336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.438628:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10913 00000100:00100000:1.0:1651529344.438629:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41278:x1731746396238144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.438630:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10912 00010000:00010000:1.0:1651529344.438632:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.438633:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1823 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.438637:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 3/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438641:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10914 00010000:00010000:1.0:1651529344.438642:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fce09f6/0xa29a79078f3bbee6 lrc: 0/0,0 mode: --/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78ac expref: 1823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438643:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41278:x1731746396238272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.438645:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.438646:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438647:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 4/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.438651:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 3/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.438653:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438654:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438656:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7684b6/0xa29a79078f3bc38c lrc: 0/0,0 mode: --/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b36 expref: 1822 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.438657:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 4/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438659:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438660:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438661:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438666:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.438671:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 4/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438673:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1821:41278:x1731746396238144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.438675:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10913 00010000:00010000:0.0:1651529344.438678:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.438680:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10915 00000100:00100000:1.0:1651529344.438681:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41278:x1731746396238400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.438684:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.438684:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41278:x1731746396238272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.438685:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 4/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.438687:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10914 00010000:00010000:1.0:1651529344.438689:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 3/0,0 mode: PR/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.438694:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bb91a lrc: 0/0,0 mode: --/PR res: [0x2b26a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62c5 expref: 1819 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.438694:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438697:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438698:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438698:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438699:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438700:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438703:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 2/0,0 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438716:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 4/0,1 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438722:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.438729:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41278:x1731746396238400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.438741:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10915 00010000:00010000:1.0:1651529344.438749:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 2/0,0 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438752:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006e1d96e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.438753:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 2/0,0 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438756:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 3/0,0 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438761:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 1/0,0 mode: --/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438763:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd727 lrc: 0/0,0 mode: --/PW res: [0x2b269:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438771:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438774:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438776:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946357248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1408us total) trans 30064892813 rc 0/0 00000100:00100000:0.0:1651529344.438779:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151951 00010000:00010000:1.0:1651529344.438784:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,1 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438786:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 2/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438786:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438789:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438799:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438802:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438845:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946357056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1282us (1453us total) trans 30064892814 rc 0/0 00000100:00100000:1.0:1651529344.438849:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151952 00000100:00100000:0.0:1651529344.438855:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946357120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1404us (1503us total) trans 30064892815 rc 0/0 00010000:00010000:1.0:1651529344.438857:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438859:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151950 00010000:00010000:1.0:1651529344.438861:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438864:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,1 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438866:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 2/0,0 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438866:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 2/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438870:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069245c18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.438871:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 2/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438874:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 3/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438879:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 1/0,0 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438882:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069245c18/0xa29a79078f3bd72e lrc: 0/0,0 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438886:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438889:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acf2ca80 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.438890:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438892:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 3/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438898:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 1/0,0 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438901:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd720 lrc: 0/0,0 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438902:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946357312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1282us (1488us total) trans 30064892816 rc 0/0 00010000:00010000:0.0:1651529344.438904:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 2/0,0 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438905:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151954 00010000:00010000:0.0:1651529344.438907:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9d48418 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.438907:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 2/0,0 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438910:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 3/0,0 mode: PW/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438913:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 1/0,0 mode: --/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438916:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966599424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438916:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d48418/0xa29a79078f3bd73c lrc: 0/0,0 mode: --/PW res: [0x2b26a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438924:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438926:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438929:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: --/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438930:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438932:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 2/0,0 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438938:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966599552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438946:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: --/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438952:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 2/0,0 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438955:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027416bb5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.438956:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 2/0,0 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438959:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 3/0,0 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438964:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 1/0,0 mode: --/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438966:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd735 lrc: 0/0,0 mode: --/PW res: [0x2b268:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438974:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946357184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1374us (1567us total) trans 30064892817 rc 0/0 00000100:00100000:0.0:1651529344.438977:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151953 00000100:00100000:1.0:1651529344.438981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.439002:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238528 00000100:00100000:0.0:1651529344.439004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.439014:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 4/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1818 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.439017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.439036:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238656 00000100:00100000:0.0:1651529344.439049:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238848 00010000:00010000:0.0:1651529344.439055:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 4/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.439058:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 4/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1819 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.439062:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10916 00000100:00100000:0.0:1651529344.439063:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41278:x1731746396238528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.439066:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.439068:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 4/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.439070:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10917 00000100:00100000:1.0:1651529344.439071:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41279:x1731746396238848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.439072:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 3/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.439075:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.439077:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 4/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.439077:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270d15f3/0xa29a79078f3bae00 lrc: 0/0,0 mode: --/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36b8 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.439080:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 3/0,0 mode: PR/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.439082:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439082:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439083:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439086:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9f5d61/0xa29a79078f3bb3a2 lrc: 0/0,0 mode: --/PR res: [0x2b26d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d4e expref: 1819 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.439086:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 4/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439090:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439091:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439092:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439097:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.439101:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 4/0,1 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439108:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.439119:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41278:x1731746396238528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.439120:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41279:x1731746396238848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.439123:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10916 00000100:00100000:0.0:1651529344.439128:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10918 00000100:00100000:0.0:1651529344.439130:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41278:x1731746396238656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.439131:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10917 00010000:00010000:0.0:1651529344.439133:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.439134:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 4/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1816 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.439138:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 3/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1816 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.439140:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439143:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ad7479f/0xa29a79078f3bab91 lrc: 0/0,0 mode: --/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cd9 expref: 1816 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.439144:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439147:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439147:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439148:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439148:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439150:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 2/0,0 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439151:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 4/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439166:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.439172:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746396238656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.439175:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10918 00010000:00010000:0.0:1651529344.439182:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 2/0,0 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439185:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae6e66f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.439186:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 2/0,0 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439189:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 3/0,0 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439195:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946357824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1096us (1148us total) trans 30064892818 rc 0/0 00000100:00100000:1.0:1651529344.439198:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151955 00010000:00010000:0.0:1651529344.439200:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 1/0,0 mode: --/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439203:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae6e66f1/0xa29a79078f3bd74a lrc: 0/0,0 mode: --/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439205:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439209:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439209:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439212:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,1 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439214:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 2/0,0 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439214:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439242:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439246:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439273:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+248:39029:x1731745946357952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1050us (1096us total) trans 30064892819 rc 0/0 00000100:00100000:1.0:1651529344.439276:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151957 00010000:00010000:1.0:1651529344.439283:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 2/0,0 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439287:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000078dae39a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.439288:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 2/0,0 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439290:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+247:39029:x1731745946357888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1186us (1218us total) trans 30064892820 rc 0/0 00010000:00010000:1.0:1651529344.439291:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 3/0,0 mode: PW/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439293:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151956 00010000:00010000:1.0:1651529344.439295:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 1/0,0 mode: --/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439298:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078dae39a/0xa29a79078f3bd751 lrc: 0/0,0 mode: --/PW res: [0x2b26d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439301:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439304:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f28f648 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.439305:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439308:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 3/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439312:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 1/0,0 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439315:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd743 lrc: 0/0,0 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439378:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358080 00000100:00100000:0.0:1651529344.439389:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151958 00000100:00100000:0.0:1651529344.439390:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+247:39029:x1731745946358080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.439396:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176750 count 1 00010000:00010000:0.0:1651529344.439400:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439406:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.439419:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 2/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1814 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.439423:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.439431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439437:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358208 00010000:00010000:0.0:1651529344.439439:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439440:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 4/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439446:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358336 00010000:00010000:0.0:1651529344.439453:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 3/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1814 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439458:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358144 00010000:00010000:0.0:1651529344.439458:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1814 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.439464:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358272 00000100:00100000:0.0:1651529344.439467:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966599616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439468:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151959 00000100:00100000:1.0:1651529344.439470:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946358208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.439475:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176752 count 1 00000100:00100000:0.0:1651529344.439479:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.439480:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439485:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 2/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.439485:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151960 00000100:00100000:0.0:1651529344.439487:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946358336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.439488:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439488:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439489:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 4/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439496:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 3/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439500:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1814 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.439502:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176754 count 1 00000100:00100000:1.0:1651529344.439504:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966599680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.439506:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439511:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 2/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439513:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.439514:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439514:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439515:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 4/0,1 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439520:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151961 00000100:00100000:1.0:1651529344.439521:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946358144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.439522:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 3/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439525:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 4/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1814 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.439526:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176751 count 1 00010000:00010000:1.0:1651529344.439537:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439541:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 2/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.439548:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966599744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.439551:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439552:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439552:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 4/0,1 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439557:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.439559:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 3/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439563:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 4/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1814 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.439564:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151962 00000100:00100000:0.0:1651529344.439566:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946358272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.439567:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966599808:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.439571:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176753 count 1 00010000:00010000:0.0:1651529344.439574:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439575:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.439579:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 2/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439590:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.439611:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439611:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439612:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 4/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439620:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 3/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.439624:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1814 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.439628:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966599872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439636:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.439643:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358400 00000100:00100000:0.0:1651529344.439653:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358528 00000100:00100000:0.0:1651529344.439659:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358656 00000100:00100000:0.0:1651529344.439663:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151963 00000100:00100000:0.0:1651529344.439664:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+254:39029:x1731745946358400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.439669:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176755 count 1 00010000:00010000:0.0:1651529344.439673:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439677:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 2/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1814 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439680:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439688:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439689:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 4/0,1 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439696:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 3/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1814 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439697:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151964 00000100:00100000:1.0:1651529344.439699:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946358528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.439699:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 4/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1814 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.439703:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966599936:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.439704:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176756 count 1 00010000:00010000:1.0:1651529344.439708:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439726:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 2/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1814 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439729:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.439729:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.439738:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439739:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 4/0,1 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439747:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 3/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1814 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439751:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 4/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1814 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.439755:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439776:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.439783:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151965 00000100:00100000:1.0:1651529344.439785:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946358656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.439790:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176757 count 1 00010000:00010000:1.0:1651529344.439794:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439798:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 2/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439801:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439825:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439826:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 4/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439834:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 3/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439838:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1814 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.439842:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966600064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439862:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.439888:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966599616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.439893:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439911:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966599680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.439915:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439923:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966599744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.439943:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439965:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966599808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.439966:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966599872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.439969:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439969:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440019:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.440020:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966599936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.440022:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440025:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.440309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440309:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239296 00010000:00010000:0.0:1651529344.440316:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 4/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1815 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440327:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239360 00000100:00100000:1.0:1651529344.440329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440330:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 4/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1816 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440334:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239424 00000100:00100000:1.0:1651529344.440336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440336:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1817 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440340:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239616 00000100:00100000:1.0:1651529344.440341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440342:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 4/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1818 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.440345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440346:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239168 00010000:00010000:0.0:1651529344.440348:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1819 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.440350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440352:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239232 00010000:00010000:0.0:1651529344.440354:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440358:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239488 00010000:00010000:0.0:1651529344.440360:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 4/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1821 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.440361:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10919 00000100:00100000:1.0:1651529344.440363:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1821:41279:x1731746396239296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.440367:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440369:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 4/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440373:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 3/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1821 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440375:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10920 00000100:00100000:0.0:1651529344.440377:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1821:41279:x1731746396239360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.440379:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f39a3c/0xa29a79078f3bc1d3 lrc: 0/0,0 mode: --/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8452 expref: 1821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440380:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440381:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 4/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440383:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440384:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440385:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440385:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 3/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440388:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 4/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440391:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e60ec5/0xa29a79078f3bb1d4 lrc: 0/0,0 mode: --/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45f3 expref: 1820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440395:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440395:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440398:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.440403:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440406:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 4/0,1 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440408:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41279:x1731746396239296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.440420:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.440425:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10919 00000100:00100000:0.0:1651529344.440428:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41279:x1731746396239360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440431:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10920 00000100:00100000:0.0:1651529344.440436:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10921 00000100:00100000:0.0:1651529344.440444:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41279:x1731746396239424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.440445:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10922 00000100:00100000:1.0:1651529344.440447:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41279:x1731746396239616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.440447:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440449:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440450:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440451:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 4/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1817 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440453:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 3/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440455:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 3/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1817 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440458:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3ba992 lrc: 0/0,0 mode: --/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d253f expref: 1817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440461:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000046bec24/0xa29a79078f3b7829 lrc: 0/0,0 mode: --/PR res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb650 expref: 1816 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440461:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440462:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440463:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440464:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440465:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440466:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440466:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 4/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440469:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 4/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440472:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.440475:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.440478:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41279:x1731746396239424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440481:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10921 00000100:00100000:1.0:1651529344.440482:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41279:x1731746396239616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.440484:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10922 00000100:00100000:0.0:1651529344.440486:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10923 00000100:00100000:0.0:1651529344.440488:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1813:41279:x1731746396239168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.440490:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10924 00010000:00010000:0.0:1651529344.440490:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.440491:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1813:41279:x1731746396239232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.440492:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1813 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440494:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440495:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1813 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440499:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 3/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1813 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440504:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3ba3e2 lrc: 0/0,0 mode: --/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d83 expref: 1813 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440508:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440511:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 4/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440519:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 3/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1812 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.440523:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.440525:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a3a1348/0xa29a79078f3b9587 lrc: 0/0,0 mode: --/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd41e expref: 1812 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.440528:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1811:41279:x1731746396239232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.440529:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440529:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440530:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440531:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10924 00010000:00010000:0.0:1651529344.440533:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 4/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440535:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10925 00000100:00100000:1.0:1651529344.440536:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1810:41279:x1731746396239488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.440538:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440540:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 4/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1810 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.440540:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.440544:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 3/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1810 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440547:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1810:41279:x1731746396239168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.440548:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626b7092/0xa29a79078f3b7ba9 lrc: 0/0,0 mode: --/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba78 expref: 1810 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.440549:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10923 00010000:00010000:1.0:1651529344.440551:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440552:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440553:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440556:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 4/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440557:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440560:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440565:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.440569:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440571:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41279:x1731746396239488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.440574:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10925 00010000:00010000:1.0:1651529344.440580:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440581:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 2/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440584:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440587:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,1 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440592:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 2/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440624:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+256:39029:x1731745946358336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1211us total) trans 30064892821 rc 0/0 00000100:00100000:0.0:1651529344.440627:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151960 00000100:00100000:1.0:1651529344.440633:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+255:39029:x1731745946358144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1110us (1212us total) trans 30064892822 rc 0/0 00010000:00010000:0.0:1651529344.440635:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 2/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440636:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151961 00010000:00010000:0.0:1651529344.440638:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade9dc56 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440639:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 2/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440642:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 3/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440643:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 2/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440647:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440647:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 1/0,0 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440648:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 2/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440650:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd766 lrc: 0/0,0 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440651:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 3/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440655:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 1/0,0 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440656:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440658:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd76d lrc: 0/0,0 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440659:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440662:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440665:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440665:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440668:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440671:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440674:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 2/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440709:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+256:39029:x1731745946358272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1277us total) trans 30064892823 rc 0/0 00000100:00100000:0.0:1651529344.440712:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151962 00000100:00100000:1.0:1651529344.440715:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946358528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1015us (1091us total) trans 30064892824 rc 0/0 00000100:00100000:1.0:1651529344.440718:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151964 00010000:00010000:0.0:1651529344.440719:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440722:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440723:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440726:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 3/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440729:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966600064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.440742:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 1/0,0 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440744:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440745:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd774 lrc: 0/0,0 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440749:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 2/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440751:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440752:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440753:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 2/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440754:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440755:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 3/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440757:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440759:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 2/0,0 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440759:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 1/0,0 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440761:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd782 lrc: 0/0,0 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440765:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,0 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440767:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440768:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 2/0,0 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440771:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 3/0,0 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440774:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 1/0,0 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440779:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd75f lrc: 0/0,0 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440785:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440788:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440792:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440794:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 2/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440822:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+255:39029:x1731745946358208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1351us (1416us total) trans 30064892825 rc 0/0 00000100:00100000:1.0:1651529344.440831:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151959 00010000:00010000:1.0:1651529344.440839:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 2/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440843:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000016e6613 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.440844:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 2/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440847:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 3/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440851:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 1/0,0 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440854:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd77b lrc: 0/0,0 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440858:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+255:39029:x1731745946358400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1267us total) trans 30064892826 rc 0/0 00000100:00100000:0.0:1651529344.440861:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151963 00000100:00100000:1.0:1651529344.440871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440872:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440875:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440879:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440884:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 2/0,0 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440918:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+255:39029:x1731745946358080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1527us (1576us total) trans 30064892827 rc 0/0 00000100:00100000:0.0:1651529344.440921:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151958 00010000:00010000:0.0:1651529344.440927:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 2/0,0 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440931:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfab8781 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.440932:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 2/0,0 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440934:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 3/0,0 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440939:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 1/0,0 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440941:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd758 lrc: 0/0,0 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440983:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239744 00010000:00010000:1.0:1651529344.440993:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441002:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10926 00000100:00100000:1.0:1651529344.441003:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41279:x1731746396239744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.441006:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.441008:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441020:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 3/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441025:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000558a7a31/0xa29a79078f3bb52a lrc: 0/0,0 mode: --/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5398 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441029:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441030:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441031:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441034:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 4/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441040:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.441051:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41279:x1731746396239744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.441054:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10926 00010000:00010000:1.0:1651529344.441066:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441070:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441081:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441093:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441135:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946358656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1349us (1498us total) trans 30064892828 rc 0/0 00000100:00100000:1.0:1651529344.441138:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151965 00010000:00010000:1.0:1651529344.441144:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441148:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.441149:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441152:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 3/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441156:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 1/0,0 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441159:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd789 lrc: 0/0,0 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441212:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441218:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359168 00000100:00100000:0.0:1651529344.441221:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359296 00000100:00100000:1.0:1651529344.441229:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151966 00000100:00100000:1.0:1651529344.441231:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+256:39030:x1731745946359168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.441237:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176758 count 1 00010000:00010000:1.0:1651529344.441248:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441268:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 2/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.441268:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151967 00000100:00100000:0.0:1651529344.441270:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+256:39030:x1731745946359296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.441272:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441273:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441274:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 4/0,1 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.441276:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176760 count 1 00010000:00010000:0.0:1651529344.441280:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441281:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 3/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441285:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 4/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.441285:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 2/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441288:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.441289:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966600128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441289:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441290:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 4/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441297:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 3/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441301:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441304:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.441312:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966600192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.441322:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.441326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441362:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441376:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359424 00000100:00100000:1.0:1651529344.441378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441384:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359232 00000100:00100000:1.0:1651529344.441386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441396:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359360 00000100:00100000:0.0:1651529344.441402:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151968 00000100:00100000:0.0:1651529344.441404:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946359424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.441408:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359488 00002000:00080000:0.0:1651529344.441409:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176762 count 1 00000100:00100000:1.0:1651529344.441414:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359552 00010000:00010000:0.0:1651529344.441414:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441416:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359680 00010000:00010000:0.0:1651529344.441418:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 2/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1806 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.441419:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151969 00010000:00010000:0.0:1651529344.441422:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441422:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441423:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 4/0,1 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441428:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+262:39030:x1731745946359232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.441429:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 3/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1806 pid: 127525 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.441433:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176759 count 1 00010000:00010000:0.0:1651529344.441433:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 4/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1806 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.441437:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.441438:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441443:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 2/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441446:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441446:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441447:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 4/0,1 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441448:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.441454:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 3/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.441454:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151970 00000100:00100000:0.0:1651529344.441456:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+262:39030:x1731745946359360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.441458:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 4/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.441460:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176761 count 1 00000100:00100000:1.0:1651529344.441462:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966600320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441463:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441467:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 2/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.441471:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.441473:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441473:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441474:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 4/0,1 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441478:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151971 00000100:00100000:1.0:1651529344.441480:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+262:39030:x1731745946359488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.441480:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 3/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441483:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 4/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.441484:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176763 count 1 00000100:00100000:0.0:1651529344.441487:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966600384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.441488:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: --/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441494:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.441499:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151972 00000100:00100000:0.0:1651529344.441501:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946359552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.441502:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 2/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441505:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441505:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.441505:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176764 count 1 00010000:00010000:1.0:1651529344.441506:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 4/0,1 mode: --/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441508:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441512:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 2/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1806 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441513:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 3/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441515:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441516:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 4/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.441516:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441516:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 4/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441520:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441525:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 3/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1806 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.441527:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.441528:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1806 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441534:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151973 00000100:00100000:1.0:1651529344.441535:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946359680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.441540:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176765 count 1 00010000:00010000:1.0:1651529344.441543:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: --/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441554:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 2/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.441554:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966600512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.441558:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.441563:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.441565:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441566:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 4/0,1 mode: --/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441573:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 3/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441577:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 4/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441581:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966600576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.441588:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.441668:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966600128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.441672:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.441684:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240256 00000100:00100000:0.0:1651529344.441684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.441694:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 4/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1807 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.441695:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966600192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441700:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441702:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240320 00010000:00010000:1.0:1651529344.441704:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441714:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10927 00000100:00100000:1.0:1651529344.441715:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41279:x1731746396240256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.441718:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.441718:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10928 00000100:00100000:0.0:1651529344.441720:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41278:x1731746396240320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.441724:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.441725:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441726:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 4/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.441729:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 3/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441738:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 3/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441744:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ed2232/0xa29a79078f3bb11e lrc: 0/0,0 mode: --/PR res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4314 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.441744:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3ba2d8 lrc: 0/0,0 mode: --/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0977 expref: 1808 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.441748:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441748:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441749:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441750:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441750:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441753:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 4/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441753:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 4/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441759:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.441760:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.441767:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1806:41278:x1731746396240320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.441769:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1806:41279:x1731746396240256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.441770:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10928 00000100:00100000:1.0:1651529344.441772:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10927 00010000:00010000:0.0:1651529344.441777:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441780:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441781:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441783:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441784:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441786:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441786:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441797:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 2/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441855:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+264:39030:x1731745946359296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 585us (643us total) trans 30064892829 rc 0/0 00000100:00100000:1.0:1651529344.441857:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+264:39030:x1731745946359168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 625us (660us total) trans 30064892830 rc 0/0 00000100:00100000:0.0:1651529344.441859:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151967 00000100:00100000:1.0:1651529344.441861:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151966 00010000:00010000:0.0:1651529344.441866:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441869:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e08cf94 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.441870:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441873:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 3/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441878:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 1/0,0 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441881:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd797 lrc: 0/0,0 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441921:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 2/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441924:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000569a40ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.441925:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 2/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441928:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 3/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441932:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 1/0,0 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441937:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd790 lrc: 0/0,0 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441952:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441962:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.441970:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.441970:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966600384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.441972:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.441983:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240384 00010000:00010000:1.0:1651529344.441988:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 4/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1805 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.441998:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240512 00010000:00010000:1.0:1651529344.442001:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 4/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442001:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240448 00000100:00100000:1.0:1651529344.442006:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10929 00000100:00100000:1.0:1651529344.442007:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41279:x1731746396240384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.442007:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 5/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1807 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442010:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442012:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 4/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1807 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442013:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10930 00000100:00100000:0.0:1651529344.442015:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41279:x1731746396240512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.442016:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 3/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1807 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442017:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.442019:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 4/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1807 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442023:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 3/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1807 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442032:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cd1fd0/0xa29a79078f3b8e4f lrc: 0/0,0 mode: --/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc40a expref: 1807 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442035:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442037:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442040:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 4/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442049:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.442057:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002067ec37/0xa29a79078f3b9b99 lrc: 0/0,0 mode: --/PR res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebfd expref: 1806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.442058:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1806:41279:x1731746396240384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.442061:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10929 00010000:00010000:0.0:1651529344.442062:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442062:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442063:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442066:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10931 00010000:00010000:0.0:1651529344.442066:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 4/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442068:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41278:x1731746396240448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.442071:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442072:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 5/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442072:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.442076:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 4/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1804 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442080:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41279:x1731746396240512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (110us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.442081:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.442083:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10930 00010000:00010000:1.0:1651529344.442088:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442089:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442090:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442092:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 4/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442094:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442096:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.442096:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442099:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 2/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442103:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746396240448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.442106:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10931 00010000:00010000:1.0:1651529344.442117:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc372821/0xa29a79078f3bb1b8 lrc: 0/0,0 mode: --/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4598 expref: 1802 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.442128:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966600320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442132:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442135:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442138:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442141:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442143:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 2/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442165:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946359360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 701us (801us total) trans 30064892831 rc 0/0 00000100:00100000:0.0:1651529344.442168:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151970 00010000:00010000:0.0:1651529344.442176:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 2/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442179:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba67ad12 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.442180:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 2/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442183:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 3/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442192:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946359232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 763us (844us total) trans 30064892832 rc 0/0 00000100:00100000:1.0:1651529344.442196:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151969 00010000:00010000:0.0:1651529344.442200:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 1/0,0 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442203:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 2/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442203:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba67ad12/0xa29a79078f3bd7ac lrc: 0/0,0 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442207:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000eae6198 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.442208:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 2/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442211:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 3/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442211:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442213:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442215:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 1/0,0 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442217:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442218:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd7a5 lrc: 0/0,0 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442220:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.442256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.442293:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946359424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 888us (967us total) trans 30064892833 rc 0/0 00000100:00100000:0.0:1651529344.442297:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151968 00000100:00100000:0.0:1651529344.442315:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360256 00000100:00100000:0.0:1651529344.442325:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360192 00000100:00100000:0.0:1651529344.442330:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151974 00000100:00100000:0.0:1651529344.442332:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+264:39029:x1731745946360256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.442337:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176767 count 1 00010000:00010000:0.0:1651529344.442342:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: --/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442346:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 2/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1801 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442349:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442350:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442351:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 4/0,1 mode: --/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442357:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151975 00010000:00010000:0.0:1651529344.442357:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 3/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1801 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.442360:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+264:39029:x1731745946360192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.442361:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 4/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1801 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.442365:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176766 count 1 00000100:00100000:0.0:1651529344.442365:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442370:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442378:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.442386:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 2/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1801 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442389:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442390:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442390:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 4/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442398:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 3/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1801 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442398:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442402:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 4/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1801 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442402:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944b24dc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.442403:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442405:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 3/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442406:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966600704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.442410:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 1/0,0 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442413:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944b24dc/0xa29a79078f3bd79e lrc: 0/0,0 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442415:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.442423:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.442424:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966600512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442427:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: --/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442428:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442434:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966600576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442437:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: --/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.442512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.442513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.442531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442545:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240768 00010000:00010000:1.0:1651529344.442551:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 4/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1802 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442559:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241024 00010000:00010000:1.0:1651529344.442562:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 4/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1803 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442564:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360384 00000100:00100000:1.0:1651529344.442566:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240960 00010000:00010000:1.0:1651529344.442568:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1804 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442574:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360320 00000100:00100000:0.0:1651529344.442579:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360448 00000100:00100000:0.0:1651529344.442586:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151976 00000100:00100000:0.0:1651529344.442587:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+267:39029:x1731745946360384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.442588:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10932 00000100:00100000:1.0:1651529344.442589:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41279:x1731746396240768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.442592:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1651529344.442592:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176769 count 1 00010000:00010000:1.0:1651529344.442594:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 4/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442597:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: --/PW res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442598:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 3/0,0 mode: PR/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442602:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 2/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1804 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442603:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b327103b/0xa29a79078f3ba34f lrc: 0/0,0 mode: --/PR res: [0x2b27b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b6f expref: 1804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442605:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442605:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442606:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 4/0,1 mode: --/PW res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442607:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442613:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 3/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1803 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442615:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442616:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442616:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 4/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1803 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442619:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 4/0,1 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442620:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966600768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442626:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.442634:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.442639:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41279:x1731746396240768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.442641:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151977 00000100:00100000:1.0:1651529344.442643:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10932 00000100:00100000:0.0:1651529344.442643:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+267:39029:x1731745946360320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.442648:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10933 00002000:00080000:0.0:1651529344.442648:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176768 count 1 00000100:00100000:1.0:1651529344.442649:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41279:x1731746396241024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.442652:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.442652:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442653:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 4/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442656:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 2/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442657:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 3/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442659:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442660:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442660:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 4/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442662:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008936eb13/0xa29a79078f3bc243 lrc: 0/0,0 mode: --/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d863c expref: 1802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442665:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442666:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442666:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 3/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1801 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442667:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442670:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 4/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1801 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.442673:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966600832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442679:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 4/0,1 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442680:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.442686:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.442686:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10934 00000100:00100000:1.0:1651529344.442692:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1801:41279:x1731746396241024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.442695:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10933 00000100:00100000:0.0:1651529344.442706:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1800:41278:x1731746396240960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.442707:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442709:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442710:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442711:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1800 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442713:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,1 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442715:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 3/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1800 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.442716:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 2/0,0 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442721:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cb80fbd/0xa29a79078f3b8d53 lrc: 0/0,0 mode: --/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc370 expref: 1800 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442740:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442741:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442742:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442745:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 4/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442751:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.442758:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41278:x1731746396240960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.442761:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10934 00000100:00100000:1.0:1651529344.442767:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+268:39030:x1731745946359488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1286us (1404us total) trans 30064892834 rc 0/0 00010000:00010000:0.0:1651529344.442769:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 2/0,0 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442770:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151971 00010000:00010000:0.0:1651529344.442772:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f202d8f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.442773:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 2/0,0 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442775:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151978 00010000:00010000:0.0:1651529344.442776:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 3/0,0 mode: PW/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442777:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+267:39030:x1731745946360448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.442780:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 1/0,0 mode: --/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.442781:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176770 count 1 00010000:00010000:0.0:1651529344.442785:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd7b3 lrc: 0/0,0 mode: --/PW res: [0x2b27b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442791:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442794:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: --/PW res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442794:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442797:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442798:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 2/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442800:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 2/0,0 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442802:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442818:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442823:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 4/0,1 mode: --/PW res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442831:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 3/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442835:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 4/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.442839:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.442847:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.442853:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 2/0,0 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442856:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.442857:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 2/0,0 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442857:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946359552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1355us (1478us total) trans 30064892835 rc 0/0 00010000:00010000:1.0:1651529344.442860:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 3/0,0 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442860:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151972 00010000:00010000:1.0:1651529344.442868:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 1/0,0 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442871:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd7ba lrc: 0/0,0 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442878:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442881:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442884:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,1 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442886:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 2/0,0 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.442933:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442949:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946359680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1412us (1562us total) trans 30064892836 rc 0/0 00000100:00100000:1.0:1651529344.442952:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151973 00000100:00100000:1.0:1651529344.442972:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241280 00010000:00010000:0.0:1651529344.442981:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 2/0,0 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442985:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fe86dd8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.442986:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 2/0,0 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442991:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 3/0,0 mode: PW/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442994:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 5/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1799 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.442996:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 1/0,0 mode: --/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442999:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd7c1 lrc: 0/0,0 mode: --/PW res: [0x2b27d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443008:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241344 00000100:00100000:0.0:1651529344.443009:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443012:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 5/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443013:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: --/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443017:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10935 00000100:00100000:1.0:1651529344.443019:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1800:41279:x1731746396241280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.443020:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10936 00010000:00010000:1.0:1651529344.443021:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443023:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 4/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443027:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 3/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443033:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3635659/0xa29a79078f3bbf8e lrc: 0/0,0 mode: --/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b37 expref: 1800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443037:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443038:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443040:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41279:x1731746396241344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.443041:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 4/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443044:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.443046:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 5/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1799 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443051:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.443056:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 4/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1799 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443061:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41279:x1731746396241280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443064:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10935 00000100:00100000:1.0:1651529344.443075:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966600704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.443076:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097781278/0xa29a79078f3bb54d lrc: 0/0,0 mode: --/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5440 expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443079:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443082:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443083:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443084:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443087:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 4/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443103:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 4/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443106:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443106:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.443109:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443112:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443114:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1797:41279:x1731746396241344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.443117:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10936 00010000:00010000:0.0:1651529344.443144:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443148:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006e1d96e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.443149:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443151:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 3/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443154:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946360192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 793us (898us total) trans 30064892837 rc 0/0 00010000:00010000:0.0:1651529344.443156:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 1/0,0 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443157:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151975 00010000:00010000:0.0:1651529344.443159:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd7cf lrc: 0/0,0 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443188:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966600768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.443192:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: --/PW res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443197:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.443224:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443228:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443243:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 2/0,0 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443272:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.443284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.443291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.443301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.443307:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946360256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 974us (1074us total) trans 30064892838 rc 0/0 00000100:00100000:1.0:1651529344.443310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.443311:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151974 00000100:00100000:0.0:1651529344.443316:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360832 00000100:00100000:0.0:1651529344.443326:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360960 00000100:00100000:0.0:1651529344.443332:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360896 00010000:00010000:1.0:1651529344.443348:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 2/0,0 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443352:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151979 00000100:00100000:0.0:1651529344.443354:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+270:39029:x1731745946360832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.443357:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.443358:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 2/0,0 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.443359:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176771 count 1 00010000:00010000:1.0:1651529344.443361:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 3/0,0 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443364:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443366:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 1/0,0 mode: --/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443369:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd7c8 lrc: 0/0,0 mode: --/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443369:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 2/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1796 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443372:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443372:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443373:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 4/0,1 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443377:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241472 00010000:00010000:0.0:1651529344.443380:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 3/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1797 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443382:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 4/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1797 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443383:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 4/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1797 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.443387:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.443389:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241536 00010000:00010000:1.0:1651529344.443391:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 5/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443395:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241600 00000100:00100000:0.0:1651529344.443396:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.443397:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 5/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1799 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443402:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10937 00000100:00100000:1.0:1651529344.443404:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41278:x1731746396241472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.443405:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966600832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443407:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443408:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 4/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1799 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443408:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443412:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 3/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1799 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443416:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057968885/0xa29a79078f3b96fa lrc: 0/0,0 mode: --/PR res: [0x2b281:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd973 expref: 1799 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.443416:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10938 00000100:00100000:0.0:1651529344.443418:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41279:x1731746396241536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.443420:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443420:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443420:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443421:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443422:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 4/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443424:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 4/0,1 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443426:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 3/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443431:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3ba1c7 lrc: 0/0,0 mode: --/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04f4 expref: 1798 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443435:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.443442:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1798:41278:x1731746396241472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443445:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10937 00000100:00100000:1.0:1651529344.443450:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10939 00000100:00100000:1.0:1651529344.443451:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1797:41278:x1731746396241600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.443454:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443455:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 5/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1797 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.443459:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 4/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443459:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443460:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443461:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443464:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443464:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443464:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 4/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443465:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443468:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 4/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443471:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.443472:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.443479:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41278:x1731746396241600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.443479:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746396241536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443481:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10939 00000100:00100000:0.0:1651529344.443483:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10938 00000100:00100000:1.0:1651529344.443489:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151980 00010000:00010000:0.0:1651529344.443490:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443491:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+270:39030:x1731745946360960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.443494:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.443496:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176773 count 1 00010000:00010000:0.0:1651529344.443497:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,1 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443500:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443502:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 2/0,0 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443505:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 2/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1794 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443508:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443508:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443509:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 4/0,1 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443516:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 3/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1794 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443520:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 4/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1794 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443524:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966601024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.443531:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.443537:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151981 00000100:00100000:1.0:1651529344.443539:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+271:39030:x1731745946360896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.443543:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176772 count 1 00010000:00010000:1.0:1651529344.443546:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443550:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 2/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1794 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443553:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.443553:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+271:39029:x1731745946360384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 965us (1082us total) trans 30064892839 rc 0/0 00010000:00010000:1.0:1651529344.443554:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443554:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 4/0,1 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443556:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151976 00010000:00010000:1.0:1651529344.443560:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 3/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1794 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443563:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 2/0,0 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443564:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 4/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1794 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.443567:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.443568:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 2/0,0 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443571:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 3/0,0 mode: PW/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443575:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 1/0,0 mode: --/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443578:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd7d6 lrc: 0/0,0 mode: --/PW res: [0x2b281:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443580:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966601088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.443584:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443587:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.443587:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443590:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443593:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 2/0,0 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443595:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000462cdb2e/0xa29a79078f3bae3f lrc: 0/0,0 mode: --/PR res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d377c expref: 1794 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443599:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966600896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443603:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443606:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443609:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443612:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443614:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 2/0,0 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443626:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+271:39029:x1731745946360320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 983us (1114us total) trans 30064892840 rc 0/0 00000100:00100000:0.0:1651529344.443629:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151977 00010000:00010000:0.0:1651529344.443635:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 2/0,0 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443639:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.443640:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 2/0,0 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443642:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 3/0,0 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443647:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 1/0,0 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443649:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd7dd lrc: 0/0,0 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443653:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 2/0,0 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443655:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+271:39030:x1731745946360448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 877us (1125us total) trans 30064892841 rc 0/0 00010000:00010000:0.0:1651529344.443656:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c7a918e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.443657:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 2/0,0 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443658:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151978 00010000:00010000:0.0:1651529344.443660:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 3/0,0 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443663:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 1/0,0 mode: --/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443665:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd7e4 lrc: 0/0,0 mode: --/PW res: [0x2b282:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443702:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.443725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.443780:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361024 00000100:00100000:1.0:1651529344.443787:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361216 00000100:00100000:1.0:1651529344.443791:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151982 00000100:00100000:1.0:1651529344.443793:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946361024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.443798:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176774 count 1 00010000:00010000:1.0:1651529344.443826:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443831:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 2/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443835:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443835:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443836:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 4/0,1 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443843:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 3/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443846:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 4/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1793 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.443851:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966601152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.443858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.443870:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.443881:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361472 00000100:00100000:1.0:1651529344.443896:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151983 00000100:00100000:1.0:1651529344.443898:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+273:39029:x1731745946361216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.443907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.443915:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361408 00002000:00080000:1.0:1651529344.443916:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176775 count 1 00010000:00010000:1.0:1651529344.443920:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: --/PW res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443925:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 2/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443928:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443929:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443929:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 4/0,1 mode: --/PW res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443936:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 3/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.443938:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151984 00010000:00010000:1.0:1651529344.443939:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 4/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1793 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.443940:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+274:39030:x1731745946361472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.443943:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966601216:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.443945:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176777 count 1 00010000:00010000:0.0:1651529344.443950:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443951:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.443955:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 2/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.443958:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151985 00000100:00100000:1.0:1651529344.443960:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+274:39030:x1731745946361408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.443960:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443961:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443962:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 4/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.443965:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176776 count 1 00010000:00010000:1.0:1651529344.443968:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443969:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 3/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443972:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 2/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443972:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1793 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.443976:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966601280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443983:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443984:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443984:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 4/0,1 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443985:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.443992:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 3/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1793 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443996:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 4/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1793 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444000:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966601344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.444007:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.444032:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.444067:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966600960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.444075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.444082:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.444100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.444108:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241984 00010000:00010000:1.0:1651529344.444119:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 5/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1794 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444126:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241920 00010000:00010000:1.0:1651529344.444129:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 4/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1795 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444135:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242048 00010000:00010000:0.0:1651529344.444141:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 5/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1796 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444142:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10940 00000100:00100000:1.0:1651529344.444144:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41278:x1731746396241984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.444148:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10941 00000100:00100000:0.0:1651529344.444150:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41278:x1731746396241920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.444153:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444154:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444154:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 4/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444155:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 5/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444158:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 3/0,0 mode: PR/PR res: [0x2b283:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444159:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 4/0,0 mode: PR/PR res: [0x2b285:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444163:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb08d578/0xa29a79078f3bc34d lrc: 0/0,0 mode: --/PR res: [0x2b283:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a79 expref: 1796 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444165:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444166:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444167:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444167:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444168:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444169:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444170:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 4/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444172:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 4/0,1 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444175:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.444178:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.444186:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1795:41278:x1731746396241984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444189:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10940 00000100:00100000:0.0:1651529344.444192:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1794:41278:x1731746396241920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444195:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10941 00000100:00100000:1.0:1651529344.444199:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10942 00000100:00100000:1.0:1651529344.444201:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41278:x1731746396242048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.444204:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444204:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444205:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 5/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1793 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444207:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444209:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 4/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1793 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444210:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,1 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444213:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 2/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444227:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444228:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444229:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444232:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 4/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444236:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.444242:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41278:x1731746396242048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444245:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10942 00000100:00100000:0.0:1651529344.444252:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+275:39029:x1731745946360832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 897us (1054us total) trans 30064892842 rc 0/0 00000100:00100000:0.0:1651529344.444255:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151979 00010000:00010000:1.0:1651529344.444256:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3babfa lrc: 0/0,0 mode: --/PR res: [0x2b285:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e6f expref: 1792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444260:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966601024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444260:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361536 00010000:00010000:1.0:1651529344.444264:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444275:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444277:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444281:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,1 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444287:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151986 00000100:00100000:0.0:1651529344.444289:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+275:39029:x1731745946361536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.444290:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 2/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.444294:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176778 count 1 00010000:00010000:0.0:1651529344.444298:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: --/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444303:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 2/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1791 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444306:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444306:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444307:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 4/0,1 mode: --/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444314:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 3/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1791 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444318:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 4/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444324:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966601408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.444332:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946360960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 840us (1060us total) trans 30064892843 rc 0/0 00000100:00100000:0.0:1651529344.444334:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.444335:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151980 00010000:00010000:0.0:1651529344.444339:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 2/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444343:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 2/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444343:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.444344:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 2/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444346:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.444346:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 3/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444347:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 2/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444351:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 3/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444351:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 1/0,0 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444355:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 1/0,0 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444358:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd7f2 lrc: 0/0,0 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444368:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bdbcb4/0xa29a79078f3b9897 lrc: 0/0,0 mode: --/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce05e expref: 1791 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444368:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd7eb lrc: 0/0,0 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444371:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966601088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444383:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444386:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444388:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444391:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444394:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 2/0,0 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444434:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 2/0,0 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444438:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acf2ca80 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.444439:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 2/0,0 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444442:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 3/0,0 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444447:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 1/0,0 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444450:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd7f9 lrc: 0/0,0 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444455:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946360896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 915us (1170us total) trans 30064892844 rc 0/0 00000100:00100000:1.0:1651529344.444458:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151981 00000100:00100000:1.0:1651529344.444489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.444510:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966601280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.444513:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242112 00010000:00010000:0.0:1651529344.444514:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444518:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 5/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444525:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10943 00000100:00100000:1.0:1651529344.444527:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1791:41279:x1731746396242112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.444529:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444531:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 5/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444535:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 4/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444541:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444541:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444542:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444545:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 4/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444550:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.444554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.444558:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1791:41279:x1731746396242112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444567:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10943 00000100:00100000:1.0:1651529344.444577:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966601344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.444593:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444600:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361856 00000100:00100000:1.0:1651529344.444606:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361920 00000100:00100000:1.0:1651529344.444610:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151987 00000100:00100000:1.0:1651529344.444611:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+277:39029:x1731745946361856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.444616:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176779 count 1 00010000:00010000:1.0:1651529344.444628:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: --/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444631:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.444635:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 2/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444638:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444639:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444639:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 4/0,1 mode: --/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.444652:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 3/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444655:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 4/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444659:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966601472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444664:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361984 00000100:00100000:1.0:1651529344.444669:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.444672:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151988 00000100:00100000:0.0:1651529344.444673:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+278:39030:x1731745946361920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.444674:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242368 00010000:00010000:1.0:1651529344.444678:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 5/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.444678:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176780 count 1 00010000:00010000:0.0:1651529344.444683:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444686:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10944 00000100:00100000:1.0:1651529344.444687:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1791:41279:x1731746396242368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.444688:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 2/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1791 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444690:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444691:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 5/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444691:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444692:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444692:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 4/0,1 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444698:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 4/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444699:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 3/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1791 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444703:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444703:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 4/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444704:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444704:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444707:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 4/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444707:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966601536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444712:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.444738:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.444740:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1791:41279:x1731746396242368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444742:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10944 00000100:00100000:0.0:1651529344.444746:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151989 00000100:00100000:0.0:1651529344.444748:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+278:39029:x1731745946361984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.444753:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176781 count 1 00010000:00010000:1.0:1651529344.444755:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bc155 lrc: 0/0,0 mode: --/PR res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82bc expref: 1790 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444757:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444759:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966601216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444762:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444762:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 2/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1789 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444765:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444765:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444766:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444766:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 4/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444768:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444772:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444772:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 3/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1789 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444774:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 2/0,0 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444779:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 4/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1789 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444782:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966601600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444790:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.444837:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+279:39029:x1731745946361216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 938us (1112us total) trans 30064892845 rc 0/0 00000100:00100000:0.0:1651529344.444839:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.444840:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151983 00010000:00010000:1.0:1651529344.444852:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 2/0,0 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444856:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8ffaa05 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.444857:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 2/0,0 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.444860:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 3/0,0 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444869:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 1/0,0 mode: --/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444872:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ffaa05/0xa29a79078f3bd807 lrc: 0/0,0 mode: --/PW res: [0x2b287:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444887:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242432 00010000:00010000:1.0:1651529344.444891:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.444897:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242560 00010000:00010000:1.0:1651529344.444899:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 4/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444903:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242752 00010000:00010000:1.0:1651529344.444905:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 5/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.444910:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10945 00000100:00100000:1.0:1651529344.444911:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1792:41279:x1731746396242432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.444918:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966601408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444921:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444922:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1792 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444922:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: --/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444926:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 3/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444930:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10946 00010000:00010000:1.0:1651529344.444932:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db927966/0xa29a79078f3ba18f lrc: 0/0,0 mode: --/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0430 expref: 1792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.444932:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1792:41279:x1731746396242560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.444935:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444935:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444936:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444937:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444937:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 4/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444941:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 3/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444942:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 4/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444947:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3ba7b6 lrc: 0/0,0 mode: --/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e8c expref: 1791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444952:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.444962:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1791:41279:x1731746396242432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444964:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10945 00000100:00100000:1.0:1651529344.444969:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10947 00000100:00100000:1.0:1651529344.444971:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1790:41279:x1731746396242752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.444973:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444975:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 4/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1790 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444978:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444978:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444979:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 3/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.444979:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444982:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 4/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444983:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3ba1ab lrc: 0/0,0 mode: --/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d047d expref: 1789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.444987:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444988:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444988:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444992:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.444998:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 4/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445000:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1788:41279:x1731746396242560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.445003:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10946 00010000:00010000:1.0:1651529344.445007:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.445013:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1787:41279:x1731746396242752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.445016:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10947 00010000:00010000:1.0:1651529344.445028:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445030:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445031:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445034:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445034:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445037:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 2/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445037:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445053:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 2/0,0 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445077:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946361408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1116us (1169us total) trans 30064892846 rc 0/0 00000100:00100000:1.0:1651529344.445080:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151985 00010000:00010000:1.0:1651529344.445090:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3ba3db lrc: 0/0,0 mode: --/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d59 expref: 1786 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445094:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966601152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445096:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+279:39030:x1731745946361472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1155us (1238us total) trans 30064892847 rc 0/0 00010000:00010000:1.0:1651529344.445097:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445099:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151984 00010000:00010000:1.0:1651529344.445103:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445105:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445107:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 2/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445108:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445110:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.445111:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 2/0,0 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445111:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 2/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445114:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 3/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445119:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 1/0,0 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445122:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd815 lrc: 0/0,0 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445126:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 2/0,0 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445129:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.445130:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 2/0,0 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445133:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 3/0,0 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445136:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 1/0,0 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445141:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd80e lrc: 0/0,0 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445144:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+279:39030:x1731745946361024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1350us (1442us total) trans 30064892848 rc 0/0 00010000:00010000:0.0:1651529344.445144:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 2/0,0 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445147:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151982 00010000:00010000:0.0:1651529344.445147:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085334b47 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.445147:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 2/0,0 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445150:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 3/0,0 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445153:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 1/0,0 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445156:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085334b47/0xa29a79078f3bd800 lrc: 0/0,0 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445161:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445164:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445167:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445170:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 2/0,0 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445219:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+279:39029:x1731745946361536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (1179us total) trans 30064892849 rc 0/0 00000100:00100000:0.0:1651529344.445222:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151986 00000100:00100000:0.0:1651529344.445227:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362240 00000100:00100000:0.0:1651529344.445251:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151990 00000100:00100000:0.0:1651529344.445252:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+279:39030:x1731745946362240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.445258:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176782 count 1 00010000:00010000:0.0:1651529344.445263:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445267:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 2/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1785 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445271:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445271:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445272:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 4/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445279:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 3/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1785 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445289:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 4/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1785 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.445296:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966601664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445310:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.445316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.445318:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966601600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445322:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445329:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966601536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445331:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.445353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.445359:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 2/0,0 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445363:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.445364:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 2/0,0 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445377:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 3/0,0 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445382:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 1/0,0 mode: --/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445385:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd81c lrc: 0/0,0 mode: --/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445393:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242880 00010000:00010000:1.0:1651529344.445398:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 5/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1786 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445408:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243008 00010000:00010000:1.0:1651529344.445411:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 4/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1787 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445415:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242944 00010000:00010000:1.0:1651529344.445417:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 4/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.445423:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10948 00000100:00100000:1.0:1651529344.445425:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10949 00000100:00100000:0.0:1651529344.445425:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1788:41278:x1731746396242880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.445426:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1788:41278:x1731746396243008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.445429:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.445431:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 4/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.445438:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.445440:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 5/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.445443:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 3/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.445444:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 4/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.445448:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001592a495/0xa29a79078f3bbbc8 lrc: 0/0,0 mode: --/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d06 expref: 1788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.445450:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445451:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445451:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445452:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445453:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445453:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445456:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 4/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445457:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 4/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445461:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.445465:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.445490:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1787:41278:x1731746396242880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.445493:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10948 00000100:00100000:1.0:1651529344.445494:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1787:41278:x1731746396243008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.445497:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10949 00000100:00100000:0.0:1651529344.445499:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10950 00000100:00100000:0.0:1651529344.445501:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41279:x1731746396242944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.445504:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.445505:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 4/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.445509:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bab8a lrc: 0/0,0 mode: --/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ccb expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.445509:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 3/0,0 mode: PR/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445513:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966601472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445514:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67d1b17/0xa29a79078f3b9dde lrc: 0/0,0 mode: --/PR res: [0x2b28c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf596 expref: 1784 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.445517:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445518:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445519:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445519:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445520:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445522:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 4/0,1 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445529:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.445531:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445534:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,1 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445535:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1783:41279:x1731746396242944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.445537:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 2/0,0 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445554:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10950 00010000:00010000:0.0:1651529344.445562:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 2/0,0 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445565:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.445566:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 2/0,0 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445569:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 3/0,0 mode: PW/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445573:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 1/0,0 mode: --/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445576:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd823 lrc: 0/0,0 mode: --/PW res: [0x2b28b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445578:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+280:39029:x1731745946361856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 966us (1024us total) trans 30064892850 rc 0/0 00000100:00100000:1.0:1651529344.445581:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151987 00010000:00010000:0.0:1651529344.445582:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445585:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445590:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445593:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445632:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+280:39029:x1731745946361984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 883us (1001us total) trans 30064892851 rc 0/0 00000100:00100000:0.0:1651529344.445643:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151989 00000100:00100000:1.0:1651529344.445647:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445648:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362432 00000100:00100000:0.0:1651529344.445657:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362560 00000100:00100000:0.0:1651529344.445663:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151991 00000100:00100000:1.0:1651529344.445664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.445665:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+281:39029:x1731745946362432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.445674:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176783 count 1 00010000:00010000:0.0:1651529344.445679:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445683:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 2/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1782 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445686:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445687:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445688:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 4/0,1 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445694:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 3/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1782 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445698:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 4/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1782 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.445702:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966601728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445711:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.445716:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445719:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.445720:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445723:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 3/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445728:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 1/0,0 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445740:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd831 lrc: 0/0,0 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445751:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362496 00000100:00100000:1.0:1651529344.445755:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362624 00000100:00100000:0.0:1651529344.445761:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151992 00000100:00100000:0.0:1651529344.445763:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+283:39029:x1731745946362560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.445767:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151993 00002000:00080000:0.0:1651529344.445768:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176785 count 1 00000100:00100000:1.0:1651529344.445769:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+283:39029:x1731745946362496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.445771:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: --/PW res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.445774:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176784 count 1 00010000:00010000:0.0:1651529344.445776:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 2/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.445779:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: --/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445779:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445779:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445780:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 4/0,1 mode: --/PW res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445784:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 2/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445786:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 3/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445790:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 4/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.445794:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966601792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.445798:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445798:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445799:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 4/0,1 mode: --/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445828:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 3/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.445832:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 4/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445836:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966601856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445840:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.445849:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966601664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.445851:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.445853:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445858:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151994 00010000:00010000:0.0:1651529344.445859:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445860:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946362624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.445862:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.445865:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176786 count 1 00010000:00010000:0.0:1651529344.445868:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,1 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445869:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445871:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 2/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445873:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 2/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1782 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.445883:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445884:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445885:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 4/0,1 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445894:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 3/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1782 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.445897:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 4/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1782 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.445901:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966601920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.445908:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.445913:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 2/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445916:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.445917:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 2/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445920:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 3/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445925:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 1/0,0 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445937:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd82a lrc: 0/0,0 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445962:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+284:39030:x1731745946361920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1287us (1378us total) trans 30064892852 rc 0/0 00000100:00100000:0.0:1651529344.445965:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151988 00000100:00100000:0.0:1651529344.445970:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362880 00000100:00100000:0.0:1651529344.445987:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151995 00000100:00100000:0.0:1651529344.445989:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+284:39030:x1731745946362880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.445994:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176787 count 1 00010000:00010000:0.0:1651529344.445998:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: --/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446003:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 2/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.446006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.446006:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446007:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446007:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 4/0,1 mode: --/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446014:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 3/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1782 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.446018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.446020:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 4/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446024:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966601984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446032:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.446040:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966601728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446044:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446050:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243264 00010000:00010000:0.0:1651529344.446055:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 4/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1783 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446066:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243456 00010000:00010000:0.0:1651529344.446069:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 4/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1784 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.446071:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10951 00000100:00100000:1.0:1651529344.446073:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1784:41278:x1731746396243264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.446077:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10952 00000100:00100000:0.0:1651529344.446079:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1784:41278:x1731746396243456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.446081:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446082:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.446083:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 4/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1784 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446083:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 4/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1784 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446088:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 3/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1784 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446093:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3b86d8 lrc: 0/0,0 mode: --/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc021 expref: 1784 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446097:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446098:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446099:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446102:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 4/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446103:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 3/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1783 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446109:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000657ecf1e/0xa29a79078f3b7ef8 lrc: 0/0,0 mode: --/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc46 expref: 1783 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446111:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.446119:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446120:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.446121:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1782:41278:x1731746396243264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (457us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.446121:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446123:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10951 00010000:00010000:0.0:1651529344.446124:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 4/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446133:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362944 00000100:00100000:1.0:1651529344.446139:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151996 00000100:00100000:1.0:1651529344.446141:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946362944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.446141:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529344.446146:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176788 count 1 00000100:00100000:0.0:1651529344.446149:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1781:41278:x1731746396243456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.446150:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446152:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10952 00010000:00010000:1.0:1651529344.446154:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 2/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1781 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446157:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446158:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446158:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 4/0,1 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446159:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446162:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446165:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 3/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1780 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446165:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446168:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 4/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1780 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446168:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 2/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446172:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966602048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446180:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.446195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.446221:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946362432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 555us (603us total) trans 30064892853 rc 0/0 00000100:00100000:0.0:1651529344.446224:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151991 00000100:00100000:0.0:1651529344.446229:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363072 00000100:00100000:0.0:1651529344.446238:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151997 00000100:00100000:0.0:1651529344.446240:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946363072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.446245:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176789 count 1 00010000:00010000:0.0:1651529344.446249:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446254:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 2/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1780 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446257:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446258:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446258:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 4/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446265:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 3/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1780 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446268:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1780 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446272:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966602112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446296:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.446313:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 2/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446317:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002818ea2d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.446318:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 2/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446321:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 3/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446326:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 1/0,0 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446328:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd83f lrc: 0/0,0 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446335:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446339:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446347:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446350:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446366:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966601920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446376:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446384:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966601856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446387:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: --/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.446406:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363200 00000100:00100000:1.0:1651529344.446413:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151998 00000100:00100000:1.0:1651529344.446415:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946363200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.446420:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176790 count 1 00000100:00100000:0.0:1651529344.446426:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946362240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1249us total) trans 30064892854 rc 0/0 00000100:00100000:0.0:1651529344.446429:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151990 00010000:00010000:1.0:1651529344.446431:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446435:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 2/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1780 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446437:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446439:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446439:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446440:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 4/0,1 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446440:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af9cd173 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.446441:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446444:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 3/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446446:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 3/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1780 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446449:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 1/0,0 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446450:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 4/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1780 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446452:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd838 lrc: 0/0,0 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446454:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966602176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446462:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966601792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446463:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.446465:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: --/PW res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446472:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966601984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446475:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: --/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.446568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.446584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.446593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.446600:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243584 00000100:00100000:0.0:1651529344.446607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.446610:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 4/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1781 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.446625:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243712 00010000:00010000:1.0:1651529344.446628:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 4/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.446638:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243648 00000100:00100000:0.0:1651529344.446638:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966602112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446641:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 4/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446642:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446645:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243776 00010000:00010000:1.0:1651529344.446647:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 4/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1784 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446650:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243840 00000100:00100000:1.0:1651529344.446651:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10953 00000100:00100000:1.0:1651529344.446653:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41279:x1731746396243584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.446655:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446655:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 5/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446657:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 4/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446660:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 3/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446661:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10954 00000100:00100000:0.0:1651529344.446663:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41279:x1731746396243712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.446666:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001af373a2/0xa29a79078f3bbb04 lrc: 0/0,0 mode: --/PR res: [0x2b291:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d697f expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446666:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446668:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 4/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1785 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446669:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446671:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 3/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1784 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446677:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446677:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bc307 lrc: 0/0,0 mode: --/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8968 expref: 1784 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446678:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446681:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 4/0,1 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446690:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.446698:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.446701:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1783:41279:x1731746396243584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.446703:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.446704:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10953 00010000:00010000:0.0:1651529344.446704:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446707:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 4/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446709:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10955 00000100:00100000:1.0:1651529344.446711:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1782:41279:x1731746396243648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.446713:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446713:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.446715:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 4/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446719:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 3/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446721:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1782:41279:x1731746396243712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.446724:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1803263/0xa29a79078f3bc1e1 lrc: 0/0,0 mode: --/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8498 expref: 1782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.446724:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10954 00010000:00010000:1.0:1651529344.446727:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446728:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446729:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446744:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10956 00000100:00100000:0.0:1651529344.446746:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1780:41279:x1731746396243776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.446748:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 4/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446749:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446750:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 4/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1780 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446754:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 3/0,0 mode: PR/PR res: [0x2b292:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1780 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446756:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.446759:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a02d239/0xa29a79078f3b780d lrc: 0/0,0 mode: --/PR res: [0x2b292:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5c4 expref: 1780 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.446763:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1779:41279:x1731746396243648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.446763:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.446765:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10955 00000100:00100000:1.0:1651529344.446770:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10957 00010000:00010000:0.0:1651529344.446770:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446771:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446772:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1778:41279:x1731746396243840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.446774:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.446774:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 4/0,1 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446776:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 5/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1778 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.446779:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 4/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1778 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446783:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.446791:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1778:41279:x1731746396243776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.446792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446793:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446793:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10956 00010000:00010000:1.0:1651529344.446796:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 4/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446800:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.446821:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1778:41279:x1731746396243840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.446831:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10957 00010000:00010000:0.0:1651529344.446844:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446848:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446849:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446852:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446852:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,1 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446854:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 2/0,0 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446856:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,1 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446858:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 2/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446905:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946362560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1258us total) trans 30064892855 rc 0/0 00000100:00100000:1.0:1651529344.446908:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+289:39030:x1731745946362624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1161us total) trans 30064892856 rc 0/0 00000100:00100000:0.0:1651529344.446909:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151992 00000100:00100000:1.0:1651529344.446911:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151994 00010000:00010000:0.0:1651529344.446916:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 2/0,0 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446919:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 2/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446923:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.446924:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 2/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446927:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 3/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446931:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 1/0,0 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446931:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2f53f23 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.446932:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 2/0,0 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446935:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 3/0,0 mode: PW/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446940:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 1/0,0 mode: --/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446942:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd854 lrc: 0/0,0 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446943:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f53f23/0xa29a79078f3bd846 lrc: 0/0,0 mode: --/PW res: [0x2b291:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446950:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446953:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446955:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8d1f14e/0xa29a79078f3bc16a lrc: 0/0,0 mode: --/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82e6 expref: 1776 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.446956:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446958:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966602048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446958:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 2/0,0 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446962:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446965:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446968:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446970:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446973:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446996:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+289:39030:x1731745946362880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1006us (1040us total) trans 30064892857 rc 0/0 00000100:00100000:0.0:1651529344.447006:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151995 00000100:00100000:1.0:1651529344.447011:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946362944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 869us (1005us total) trans 30064892858 rc 0/0 00000100:00100000:1.0:1651529344.447014:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151996 00010000:00010000:0.0:1651529344.447014:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 2/0,0 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447018:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebfd9f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.447019:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 2/0,0 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447021:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 3/0,0 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447026:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 1/0,0 mode: --/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447029:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eebfd9f3/0xa29a79078f3bd85b lrc: 0/0,0 mode: --/PW res: [0x2b293:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447030:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447033:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000eae6198 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.447034:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447037:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 3/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447041:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 1/0,0 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447044:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eae6198/0xa29a79078f3bd862 lrc: 0/0,0 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447045:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.447058:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447061:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447064:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.447071:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 2/0,0 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.447121:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+288:39029:x1731745946362496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1351us (1427us total) trans 30064892859 rc 0/0 00000100:00100000:1.0:1651529344.447134:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151993 00010000:00010000:0.0:1651529344.447143:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 2/0,0 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447147:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.447148:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 2/0,0 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447153:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 3/0,0 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447157:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 1/0,0 mode: --/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447159:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363328 00010000:00010000:0.0:1651529344.447160:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd84d lrc: 0/0,0 mode: --/PW res: [0x2b290:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447175:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 151999 00000100:00100000:1.0:1651529344.447176:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+288:39029:x1731745946363328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.447182:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176791 count 1 00010000:00010000:1.0:1651529344.447186:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: --/PW res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447191:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 2/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1775 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447194:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447194:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447195:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 4/0,1 mode: --/PW res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447202:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 3/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1775 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447205:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 4/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1775 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.447210:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966602240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447224:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.447230:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244032 00010000:00010000:1.0:1651529344.447235:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1776 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.447263:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244160 00010000:00010000:1.0:1651529344.447266:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 5/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1777 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.447266:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10958 00000100:00100000:0.0:1651529344.447269:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1777:41279:x1731746396244032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.447272:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.447273:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10959 00000100:00100000:1.0:1651529344.447275:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1777:41279:x1731746396244160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.447275:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1777 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.447277:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.447279:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 5/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1777 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.447279:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 3/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1777 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.447283:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 4/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1777 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.447285:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf87103d/0xa29a79078f3b9804 lrc: 0/0,0 mode: --/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde4a expref: 1777 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.447288:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447288:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447289:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447289:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447290:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447290:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447293:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 4/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447297:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.447305:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1776:41279:x1731746396244160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.447308:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10959 00010000:00010000:0.0:1651529344.447311:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 4/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447317:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.447320:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101e9263/0xa29a79078f3ba4f3 lrc: 0/0,0 mode: --/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12a0 expref: 1775 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.447324:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966602176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.447325:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1774:41279:x1731746396244032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (261us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.447328:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447328:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10958 00010000:00010000:1.0:1651529344.447331:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447334:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447335:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447336:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447339:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447356:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447359:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447362:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 2/0,0 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447390:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+290:39030:x1731745946363200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 974us (990us total) trans 30064892860 rc 0/0 00000100:00100000:1.0:1651529344.447393:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151998 00010000:00010000:1.0:1651529344.447401:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447404:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000016e6613 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.447405:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447410:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 3/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447415:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 1/0,0 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447417:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016e6613/0xa29a79078f3bd870 lrc: 0/0,0 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447422:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 2/0,0 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447425:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006841b2da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.447425:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 2/0,0 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447428:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 3/0,0 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447431:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 1/0,0 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447434:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006841b2da/0xa29a79078f3bd869 lrc: 0/0,0 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447450:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946363072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1254us total) trans 30064892861 rc 0/0 00000100:00100000:0.0:1651529344.447453:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151997 00000100:00100000:1.0:1651529344.447469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.447501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.447520:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.447530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.447539:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363584 00000100:00100000:0.0:1651529344.447551:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363712 00000100:00100000:1.0:1651529344.447556:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363648 00000100:00100000:0.0:1651529344.447560:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152000 00000100:00100000:0.0:1651529344.447562:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946363584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.447567:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176792 count 1 00000100:00100000:1.0:1651529344.447572:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152001 00000100:00100000:1.0:1651529344.447574:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+291:39029:x1731745946363712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.447577:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: --/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.447579:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176794 count 1 00010000:00010000:0.0:1651529344.447582:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 2/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1773 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447584:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: --/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447585:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447586:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447586:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 4/0,1 mode: --/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447588:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 2/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1773 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447591:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447592:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447593:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 4/0,1 mode: --/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447593:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 3/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1773 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447597:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 4/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1773 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.447600:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 3/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1773 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.447601:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966602304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.447603:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 4/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.447608:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966602368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.447615:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.447622:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152002 00000100:00100000:1.0:1651529344.447624:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.447624:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+291:39029:x1731745946363648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.447629:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176793 count 1 00000100:00100000:1.0:1651529344.447633:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966602240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.447633:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447637:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: --/PW res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447639:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 2/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1773 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447643:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447643:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447644:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 4/0,1 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447650:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 3/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1773 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447653:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 4/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.447657:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966602432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.447665:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.447671:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244480 00010000:00010000:0.0:1651529344.447676:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 4/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.447687:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10960 00000100:00100000:0.0:1651529344.447689:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1774:41279:x1731746396244480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.447691:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.447693:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 4/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.447717:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 3/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.447723:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3bb0bc lrc: 0/0,0 mode: --/PR res: [0x2b297:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41a8 expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.447727:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447728:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447728:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447748:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 4/0,1 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447760:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.447771:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41279:x1731746396244480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.447774:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10960 00010000:00010000:1.0:1651529344.447775:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447779:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447783:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,1 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447785:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 2/0,0 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.447852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.447862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.447871:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+292:39029:x1731745946363328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 693us (826us total) trans 30064892862 rc 0/0 00000100:00100000:0.0:1651529344.447871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.447879:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 151999 00000100:00100000:1.0:1651529344.447884:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363904 00000100:00100000:1.0:1651529344.447898:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363968 00000100:00100000:1.0:1651529344.447903:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364160 00000100:00100000:1.0:1651529344.447906:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364224 00000100:00100000:1.0:1651529344.447909:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152003 00000100:00100000:1.0:1651529344.447911:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946363904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.447911:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 2/0,0 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447915:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfab8781 already unused, calling callback (00000000109466a4) 00002000:00080000:1.0:1651529344.447916:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176795 count 1 00010000:00010000:0.0:1651529344.447916:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 2/0,0 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447919:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 3/0,0 mode: PW/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447920:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: --/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447925:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 2/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1772 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447935:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 1/0,0 mode: --/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447937:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447937:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447938:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 4/0,1 mode: --/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447938:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd877 lrc: 0/0,0 mode: --/PW res: [0x2b297:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447946:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 3/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1772 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.447947:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152004 00000100:00100000:0.0:1651529344.447949:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946363968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.447950:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 4/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.447954:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966602496:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.447954:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176796 count 1 00010000:00010000:0.0:1651529344.447958:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: --/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447963:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.447963:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 2/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447966:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447966:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447967:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 4/0,1 mode: --/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447970:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152005 00000100:00100000:1.0:1651529344.447972:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+295:39029:x1731745946364160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.447976:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176797 count 1 00010000:00010000:1.0:1651529344.447979:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447984:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 2/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1772 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447987:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447987:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447987:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 3/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447988:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 4/0,1 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447994:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 4/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.447998:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966602560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.448005:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 3/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1772 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.448007:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.448008:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 4/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1772 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448012:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966602624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.448014:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152006 00000100:00100000:0.0:1651529344.448015:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946364224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.448019:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.448020:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176798 count 1 00010000:00010000:0.0:1651529344.448023:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448028:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 2/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1772 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448031:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448031:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448032:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 4/0,1 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448061:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 3/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1772 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448065:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 4/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1772 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.448073:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966602688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.448080:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.448088:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966602304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.448092:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: --/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.448113:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966602368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.448117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.448118:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: --/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448131:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.448138:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244672 00010000:00010000:1.0:1651529344.448143:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 4/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1773 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448150:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244800 00010000:00010000:1.0:1651529344.448153:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 5/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.448156:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966602432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448157:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244736 00010000:00010000:1.0:1651529344.448159:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 4/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1775 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448160:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448167:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10961 00000100:00100000:0.0:1651529344.448169:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1775:41279:x1731746396244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.448172:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.448174:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 4/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1775 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448175:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10962 00000100:00100000:1.0:1651529344.448177:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1775:41278:x1731746396244800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.448178:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 3/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1775 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.448180:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448181:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 4/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1775 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448183:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c052b66/0xa29a79078f3b98c8 lrc: 0/0,0 mode: --/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce122 expref: 1775 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.448185:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 3/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1775 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448187:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448188:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448189:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448191:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d31b34/0xa29a79078f3bbaef lrc: 0/0,0 mode: --/PR res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ec expref: 1774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448192:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 4/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448194:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448195:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448196:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448198:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.448199:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 4/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448214:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448214:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41279:x1731746396244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.448217:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10961 00000100:00100000:1.0:1651529344.448222:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41278:x1731746396244800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448225:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10962 00000100:00100000:0.0:1651529344.448228:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10963 00000100:00100000:0.0:1651529344.448229:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1771:41279:x1731746396244736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.448232:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.448234:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364288 00010000:00010000:0.0:1651529344.448234:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 4/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448238:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 3/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448243:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3ba1ce lrc: 0/0,0 mode: --/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0502 expref: 1771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448246:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448247:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448247:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448249:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152007 00010000:00010000:0.0:1651529344.448250:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 4/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448251:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+296:39030:x1731745946364288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.448256:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176799 count 1 00010000:00010000:0.0:1651529344.448260:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.448265:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448266:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1770:41279:x1731746396244736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.448269:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10963 00010000:00010000:1.0:1651529344.448270:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 2/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1770 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448273:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448274:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448274:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 4/0,1 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448276:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448280:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448281:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 3/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1769 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448283:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448285:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 4/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448285:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 2/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448289:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966602752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448303:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.448309:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 2/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448312:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000569a40ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.448313:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 2/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448326:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 3/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448331:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 1/0,0 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448331:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+297:39029:x1731745946363648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 706us (811us total) trans 30064892863 rc 0/0 00010000:00010000:1.0:1651529344.448334:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569a40ae/0xa29a79078f3bd88c lrc: 0/0,0 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448335:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152002 00010000:00010000:1.0:1651529344.448341:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448341:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448343:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448347:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448347:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448349:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 2/0,0 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448350:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448352:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 2/0,0 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448393:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+298:39029:x1731745946363712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 818us (892us total) trans 30064892864 rc 0/0 00000100:00100000:0.0:1651529344.448395:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+298:39029:x1731745946363584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 831us (925us total) trans 30064892865 rc 0/0 00000100:00100000:1.0:1651529344.448396:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152001 00000100:00100000:0.0:1651529344.448398:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152000 00010000:00010000:0.0:1651529344.448405:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 2/0,0 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448408:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade9dc56 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.448409:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 2/0,0 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448412:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 3/0,0 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448416:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 1/0,0 mode: --/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448419:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd885 lrc: 0/0,0 mode: --/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448423:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 2/0,0 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448426:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f202d8f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.448427:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 2/0,0 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448430:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 3/0,0 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448433:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 1/0,0 mode: --/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448435:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f202d8f/0xa29a79078f3bd87e lrc: 0/0,0 mode: --/PW res: [0x2b298:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448504:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966602560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448507:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.448516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.448524:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: --/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.448533:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245056 00010000:00010000:0.0:1651529344.448538:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 5/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1770 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.448549:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245184 00010000:00010000:0.0:1651529344.448557:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 4/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1771 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.448562:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245248 00010000:00010000:0.0:1651529344.448564:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 5/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1772 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448569:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966602624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.448573:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448581:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10964 00000100:00100000:1.0:1651529344.448583:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41278:x1731746396245056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.448583:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10965 00000100:00100000:0.0:1651529344.448585:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41278:x1731746396245184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.448586:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448588:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 5/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.448592:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 4/0,0 mode: PR/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448597:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448598:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448598:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448599:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448599:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 4/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.448602:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 4/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448603:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 3/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.448606:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.448609:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3b82be lrc: 0/0,0 mode: --/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe3e expref: 1772 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448612:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448613:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448614:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448615:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1771:41278:x1731746396245056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.448617:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 4/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448618:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10964 00000100:00100000:1.0:1651529344.448623:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10966 00010000:00010000:0.0:1651529344.448623:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448631:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1770:41278:x1731746396245184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448634:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1770:41278:x1731746396245248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.448634:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10965 00010000:00010000:1.0:1651529344.448637:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448639:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 4/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1769 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448641:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448643:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 3/0,0 mode: PR/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1769 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448644:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448647:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448648:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f82e0b/0xa29a79078f3b94d1 lrc: 0/0,0 mode: --/PR res: [0x2b29d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ba expref: 1769 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448650:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 2/0,0 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448652:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448652:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448653:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448656:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 4/0,1 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448668:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.448675:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1768:41278:x1731746396245248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448677:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10966 00010000:00010000:1.0:1651529344.448685:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 2/0,0 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448688:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acf2ca80 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.448693:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+297:39030:x1731745946363968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 743us (840us total) trans 30064892866 rc 0/0 00010000:00010000:1.0:1651529344.448697:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 2/0,0 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448700:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 3/0,0 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448705:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 1/0,0 mode: --/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448707:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2ca80/0xa29a79078f3bd89a lrc: 0/0,0 mode: --/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448709:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152004 00010000:00010000:1.0:1651529344.448714:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448717:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448720:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,1 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448720:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966602688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.448722:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 2/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448724:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.448790:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+297:39029:x1731745946364160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 817us (927us total) trans 30064892867 rc 0/0 00000100:00100000:1.0:1651529344.448793:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152005 00000100:00100000:1.0:1651529344.448798:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364672 00000100:00100000:0.0:1651529344.448815:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.448835:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.448839:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364608 00000100:00100000:1.0:1651529344.448850:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152008 00000100:00100000:1.0:1651529344.448852:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946364672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.448857:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176801 count 1 00000100:00100000:0.0:1651529344.448864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.448868:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448873:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 2/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1767 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448876:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448877:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448877:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 4/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.448895:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 3/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1767 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448899:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 4/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1767 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448903:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966602816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.448909:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 2/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448913:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027416bb5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.448914:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 2/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448917:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.448924:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245312 00010000:00010000:1.0:1651529344.448929:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 4/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1768 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448931:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 3/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448938:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245568 00010000:00010000:0.0:1651529344.448942:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 1/0,0 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448945:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd8a1 lrc: 0/0,0 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448948:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 5/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.448953:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10967 00000100:00100000:1.0:1651529344.448955:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1769:41279:x1731746396245312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.448955:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364736 00010000:00010000:1.0:1651529344.448958:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448959:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 4/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.448967:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152009 00000100:00100000:0.0:1651529344.448968:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946364608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.448970:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 3/0,0 mode: PR/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.448974:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176800 count 1 00010000:00010000:1.0:1651529344.448976:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d526b07b/0xa29a79078f3ba17a lrc: 0/0,0 mode: --/PR res: [0x2b29e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03b2 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.448978:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448980:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448981:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448982:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448982:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 2/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1768 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448985:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 4/0,1 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448985:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448986:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448987:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 4/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448994:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.449001:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1768:41279:x1731746396245312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.449003:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10967 00000100:00100000:1.0:1651529344.449008:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10968 00000100:00100000:1.0:1651529344.449016:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41278:x1731746396245568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.449019:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449020:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 5/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1767 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449023:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 3/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1767 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449027:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1767 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449031:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966602880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.449033:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 4/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1767 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449038:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449038:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449039:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449041:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.449042:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 4/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449046:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.449048:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152010 00000100:00100000:0.0:1651529344.449050:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946364736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.449053:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41278:x1731746396245568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (167us total) trans 0 rc 0/0 00002000:00080000:0.0:1651529344.449054:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176802 count 1 00000100:00100000:1.0:1651529344.449055:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10968 00010000:00010000:0.0:1651529344.449058:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449062:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 2/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1766 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449065:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449066:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449066:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 4/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449072:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 3/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1766 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449073:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003456b473/0xa29a79078f3b7aa6 lrc: 0/0,0 mode: --/PR res: [0x2b29b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9ec expref: 1766 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449076:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 4/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1766 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449077:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966602496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.449081:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449089:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966602944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.449095:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449097:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.449098:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449101:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,1 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449103:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449104:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 2/0,0 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449106:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449110:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,1 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449119:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 2/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449153:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946363904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1241us (1327us total) trans 30064892868 rc 0/0 00000100:00100000:1.0:1651529344.449156:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152003 00010000:00010000:1.0:1651529344.449164:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 2/0,0 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449167:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f28f648 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.449168:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 2/0,0 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449168:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+300:39030:x1731745946364224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1151us (1296us total) trans 30064892869 rc 0/0 00010000:00010000:1.0:1651529344.449171:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 3/0,0 mode: PW/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449171:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152006 00010000:00010000:1.0:1651529344.449175:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 1/0,0 mode: --/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449179:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 2/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449183:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c7a918e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.449184:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 2/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449187:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd893 lrc: 0/0,0 mode: --/PW res: [0x2b29b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449187:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 3/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449198:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c2f1abf/0xa29a79078f3ba4c9 lrc: 0/0,0 mode: --/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11f8 expref: 1765 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449201:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966602752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449201:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 1/0,0 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449203:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7a918e/0xa29a79078f3bd8a8 lrc: 0/0,0 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449205:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449208:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449211:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449213:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449216:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 2/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.449263:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+300:39030:x1731745946364288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1010us (1192us total) trans 30064892870 rc 0/0 00000100:00100000:1.0:1651529344.449266:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152007 00010000:00010000:0.0:1651529344.449291:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 2/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449296:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006e1d96e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.449297:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 2/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449300:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 3/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449304:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 1/0,0 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449307:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd8af lrc: 0/0,0 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449309:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364928 00000100:00100000:1.0:1651529344.449319:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152011 00000100:00100000:1.0:1651529344.449321:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+300:39029:x1731745946364928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.449326:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176803 count 1 00010000:00010000:1.0:1651529344.449337:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449337:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364992 00010000:00010000:1.0:1651529344.449342:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 2/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.449349:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152012 00010000:00010000:1.0:1651529344.449351:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.449351:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946364992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.449352:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449353:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 4/0,1 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449360:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 3/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.449363:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176804 count 1 00010000:00010000:1.0:1651529344.449364:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 4/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449368:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966603008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449368:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: --/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449372:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 2/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449376:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449376:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449377:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 4/0,1 mode: --/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449382:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.449403:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 3/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449407:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 4/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449411:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966603072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.449421:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.449425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449457:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365312 00000100:00100000:1.0:1651529344.449471:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152013 00000100:00100000:1.0:1651529344.449473:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+302:39030:x1731745946365312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.449479:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176805 count 1 00010000:00010000:1.0:1651529344.449501:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449506:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 2/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449509:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449510:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449511:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 4/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449518:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 3/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449521:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 4/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449525:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449540:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.449560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.449584:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365440 00000100:00100000:0.0:1651529344.449593:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365376 00000100:00100000:1.0:1651529344.449597:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152014 00000100:00100000:1.0:1651529344.449599:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+304:39030:x1731745946365440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.449604:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176807 count 1 00010000:00010000:1.0:1651529344.449608:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449615:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152015 00000100:00100000:0.0:1651529344.449617:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+304:39029:x1731745946365376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.449618:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 2/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.449622:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176806 count 1 00010000:00010000:1.0:1651529344.449631:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449632:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449632:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 4/0,1 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449634:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: --/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449638:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 2/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449639:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 3/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449642:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449642:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449643:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 4/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449643:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 4/0,1 mode: --/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449647:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966603200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449650:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 3/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1764 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.449660:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.449672:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 4/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449676:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966603264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.449686:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.449710:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966602816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.449715:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449747:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966602880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.449757:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.449770:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966602944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.449773:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449789:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.449797:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.449829:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966603072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449833:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: --/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449840:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245824 00000100:00100000:1.0:1651529344.449845:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245952 00010000:00010000:0.0:1651529344.449845:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 4/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1765 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449851:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245888 00010000:00010000:1.0:1651529344.449852:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 4/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1766 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449853:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1767 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449857:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246016 00010000:00010000:0.0:1651529344.449859:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 5/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1768 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449861:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246080 00010000:00010000:1.0:1651529344.449863:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 4/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449864:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10969 00000100:00100000:0.0:1651529344.449865:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1769:41279:x1731746396245824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.449868:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10970 00010000:00010000:0.0:1651529344.449868:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.449869:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 4/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.449870:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1769:41279:x1731746396245888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.449873:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.449873:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 3/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449874:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449878:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 3/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449884:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b1673b/0xa29a79078f3ba111 lrc: 0/0,0 mode: --/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0223 expref: 1769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449888:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449888:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449889:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449889:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3babd7 lrc: 0/0,0 mode: --/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dc7 expref: 1768 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449892:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 4/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449894:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449895:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449898:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 4/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449903:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.449916:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.449920:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41279:x1731746396245888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.449923:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10970 00000100:00100000:0.0:1651529344.449925:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41279:x1731746396245824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.449928:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10969 00000100:00100000:1.0:1651529344.449929:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10971 00000100:00100000:1.0:1651529344.449931:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41278:x1731746396245952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.449933:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10972 00010000:00010000:1.0:1651529344.449934:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449935:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 4/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1765 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449935:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41279:x1731746396246016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.449937:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449939:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 3/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1765 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449939:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 5/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1765 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449943:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 4/0,0 mode: PR/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1765 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449944:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008847a44b/0xa29a79078f3b93ce lrc: 0/0,0 mode: --/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccced expref: 1765 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.449948:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449948:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449948:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449949:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449952:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 4/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449956:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449957:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449961:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.449965:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 4/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449967:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1764:41278:x1731746396245952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.449970:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10971 00010000:00010000:0.0:1651529344.449971:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.449974:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10973 00000100:00100000:1.0:1651529344.449976:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1763:41279:x1731746396246080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.449977:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1763:41279:x1731746396246016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.449978:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449980:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 4/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.449980:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10972 00010000:00010000:1.0:1651529344.449983:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 3/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449987:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449988:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d4f4f6/0xa29a79078f3bb66c lrc: 0/0,0 mode: --/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d580d expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.449990:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449992:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449992:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449993:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449993:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449996:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 4/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449996:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 2/0,0 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450008:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450015:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41279:x1731746396246080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.450017:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10973 00010000:00010000:1.0:1651529344.450024:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 2/0,0 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450027:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085cc183a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.450029:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 2/0,0 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450032:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 3/0,0 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450036:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 1/0,0 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450039:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085cc183a/0xa29a79078f3bd8bd lrc: 0/0,0 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450044:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450048:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450051:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450053:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 2/0,0 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450074:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946364608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1104us (1270us total) trans 30064892871 rc 0/0 00000100:00100000:0.0:1651529344.450077:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152009 00010000:00010000:0.0:1651529344.450085:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 2/0,0 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450099:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.450100:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 2/0,0 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450103:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 3/0,0 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450108:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 1/0,0 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450109:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946364672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1257us (1347us total) trans 30064892872 rc 0/0 00010000:00010000:0.0:1651529344.450110:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bd8b6 lrc: 0/0,0 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450112:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152008 00010000:00010000:0.0:1651529344.450117:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450120:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450123:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450125:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.450125:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450137:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450146:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bc2c8 lrc: 0/0,0 mode: --/PR res: [0x2b2a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d887a expref: 1760 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450150:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966603008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450152:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450155:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450158:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450161:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,1 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450164:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 2/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450164:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946364736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1114us (1300us total) trans 30064892873 rc 0/0 00000100:00100000:0.0:1651529344.450175:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152010 00010000:00010000:0.0:1651529344.450183:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450186:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fe86dd8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.450188:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450190:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 3/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450195:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 1/0,0 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450198:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe86dd8/0xa29a79078f3bd8c4 lrc: 0/0,0 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450202:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 2/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450203:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946364928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (983us total) trans 30064892874 rc 0/0 00010000:00010000:0.0:1651529344.450205:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.450206:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152011 00010000:00010000:0.0:1651529344.450206:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 2/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450208:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 3/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450220:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 1/0,0 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450223:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd8cb lrc: 0/0,0 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450228:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450231:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450234:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450237:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 2/0,0 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.450278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.450280:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946364992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 928us (1039us total) trans 30064892875 rc 0/0 00000100:00100000:0.0:1651529344.450283:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152012 00010000:00010000:0.0:1651529344.450290:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 2/0,0 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450294:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e08cf94 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.450295:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 2/0,0 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.450305:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 3/0,0 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450310:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 1/0,0 mode: --/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450313:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd8d2 lrc: 0/0,0 mode: --/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450323:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966603264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.450327:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: --/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450351:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246144 00010000:00010000:1.0:1651529344.450364:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 4/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1760 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450375:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246336 00010000:00010000:1.0:1651529344.450378:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 5/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1761 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450382:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246464 00010000:00010000:1.0:1651529344.450384:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 4/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450389:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10974 00000100:00100000:1.0:1651529344.450391:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1762:41278:x1731746396246144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.450393:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450395:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 4/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.450397:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10975 00010000:00010000:1.0:1651529344.450398:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 3/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.450400:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1762:41279:x1731746396246336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.450404:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fbf54c/0xa29a79078f3bb46d lrc: 0/0,0 mode: --/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50c0 expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.450404:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.450406:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 5/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450408:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450408:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450409:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450410:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 4/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1761 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.450416:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450416:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450417:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450419:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 4/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450427:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.450428:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 4/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450434:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450436:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41278:x1731746396246144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.450439:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10974 00000100:00100000:0.0:1651529344.450441:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1760:41279:x1731746396246336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.450444:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10976 00000100:00100000:1.0:1651529344.450446:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1760:41279:x1731746396246464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.450446:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10975 00010000:00010000:1.0:1651529344.450448:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450450:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 4/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450453:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 3/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450458:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051e4f0f4/0xa29a79078f3bbe68 lrc: 0/0,0 mode: --/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76ec expref: 1759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450462:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450463:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450463:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450466:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 4/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450481:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.450486:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450488:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1758:41279:x1731746396246464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.450490:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450491:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10976 00010000:00010000:0.0:1651529344.450493:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450495:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 2/0,0 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450509:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e8c101/0xa29a79078f3ba2fb lrc: 0/0,0 mode: --/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a26 expref: 1757 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450513:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966603200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450517:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450520:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450523:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450526:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450528:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 2/0,0 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450570:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+306:39029:x1731745946365376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 952us (999us total) trans 30064892876 rc 0/0 00000100:00100000:1.0:1651529344.450572:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+306:39030:x1731745946365440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 972us (1021us total) trans 30064892877 rc 0/0 00000100:00100000:0.0:1651529344.450573:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152015 00010000:00010000:0.0:1651529344.450580:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 2/0,0 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450584:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152014 00010000:00010000:0.0:1651529344.450584:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.450592:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 2/0,0 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450594:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 2/0,0 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450595:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.450596:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 2/0,0 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450597:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 3/0,0 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450599:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 3/0,0 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450603:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 1/0,0 mode: --/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450604:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 1/0,0 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450605:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd8e7 lrc: 0/0,0 mode: --/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450607:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd8e0 lrc: 0/0,0 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450613:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450616:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450619:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450621:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450632:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450656:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.450687:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946365312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1206us (1255us total) trans 30064892878 rc 0/0 00000100:00100000:1.0:1651529344.450691:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152013 00000100:00100000:0.0:1651529344.450691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.450696:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365824 00000100:00100000:1.0:1651529344.450702:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365888 00000100:00100000:1.0:1651529344.450715:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365952 00000100:00100000:1.0:1651529344.450720:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366016 00000100:00100000:1.0:1651529344.450724:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366080 00010000:00010000:0.0:1651529344.450726:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450737:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.450738:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450742:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 3/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450743:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152016 00000100:00100000:1.0:1651529344.450745:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+309:39030:x1731745946365824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.450746:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 1/0,0 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.450750:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176808 count 1 00010000:00010000:1.0:1651529344.450755:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: --/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450756:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd8d9 lrc: 0/0,0 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450759:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 2/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1756 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450763:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450763:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450764:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 4/0,1 mode: --/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450765:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152017 00000100:00100000:0.0:1651529344.450767:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+309:39029:x1731745946365888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.450771:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 3/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1756 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.450772:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176809 count 1 00010000:00010000:1.0:1651529344.450775:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 4/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1756 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.450776:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450780:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 2/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.450784:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450784:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450785:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 4/0,1 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450791:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.450818:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.450825:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152018 00000100:00100000:1.0:1651529344.450827:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+309:39030:x1731745946365952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.450831:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 3/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.450832:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176810 count 1 00010000:00010000:0.0:1651529344.450835:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 4/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450836:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: --/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450840:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 2/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1756 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.450840:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966603392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450843:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450844:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450844:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 4/0,1 mode: --/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450849:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.450851:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 3/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1756 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450854:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 4/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1756 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450858:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966603456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.450858:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152019 00000100:00100000:1.0:1651529344.450866:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.450869:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+309:39029:x1731745946366016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.450872:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152020 00002000:00080000:0.0:1651529344.450874:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176811 count 1 00000100:00100000:1.0:1651529344.450881:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+309:39030:x1731745946366080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.450883:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: --/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.450886:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176812 count 1 00010000:00010000:0.0:1651529344.450888:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 2/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1756 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450890:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450891:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450891:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450892:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 4/0,1 mode: --/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450894:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 2/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450897:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450898:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450898:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 3/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1756 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450899:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 4/0,1 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450902:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 4/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1756 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.450905:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 3/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.450906:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966603520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450908:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 4/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.450912:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966603584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.450913:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.450920:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.450955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.450986:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366144 00000100:00100000:1.0:1651529344.450995:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366336 00000100:00100000:1.0:1651529344.451002:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366464 00000100:00100000:0.0:1651529344.451011:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152021 00000100:00100000:1.0:1651529344.451014:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152022 00000100:00100000:0.0:1651529344.451014:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+312:39029:x1731745946366144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.451016:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+312:39030:x1731745946366336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.451020:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176813 count 1 00002000:00080000:1.0:1651529344.451021:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176814 count 1 00010000:00010000:0.0:1651529344.451031:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: --/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451032:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451036:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 2/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.451037:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 2/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451039:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451040:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451040:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451041:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451041:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 4/0,1 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451041:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 4/0,1 mode: --/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451048:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 3/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451048:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 3/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451051:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 4/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.451052:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 4/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.451055:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966603648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.451056:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966603712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451070:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.451075:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.451077:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152023 00000100:00100000:0.0:1651529344.451078:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+312:39030:x1731745946366464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.451083:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176815 count 1 00010000:00010000:0.0:1651529344.451087:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451091:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 2/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451104:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451104:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451105:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 4/0,1 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451112:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 3/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1756 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451116:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 4/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.451120:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966603776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451129:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.451826:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966603456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451830:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: --/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451838:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451840:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: --/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451849:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966603392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451854:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451861:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966603520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451864:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: --/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.451898:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.451906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.451915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.451918:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246848 00010000:00010000:1.0:1651529344.451924:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 4/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1757 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451930:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247040 00010000:00010000:1.0:1651529344.451938:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 4/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1758 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451948:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246912 00000100:00100000:0.0:1651529344.451950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.451951:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 4/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1759 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451955:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246976 00000100:00100000:0.0:1651529344.451956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.451957:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 4/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1760 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451961:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247168 00010000:00010000:1.0:1651529344.451963:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 5/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1761 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451967:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247232 00000100:00100000:0.0:1651529344.451967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.451969:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 5/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1762 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.451973:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247360 00010000:00010000:1.0:1651529344.451975:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 5/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.451975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.451983:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966603776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451987:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451990:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247424 00010000:00010000:1.0:1651529344.451993:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 4/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1764 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.451994:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966603648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451996:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: --/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451997:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10977 00000100:00100000:1.0:1651529344.451999:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1764:41279:x1731746396246848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.452002:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.452003:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10978 00010000:00010000:1.0:1651529344.452004:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 4/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1764 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452005:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1764:41279:x1731746396247040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.452007:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 3/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1764 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452008:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.452010:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 4/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1764 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452013:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ab6ab2f/0xa29a79078f3b95cd lrc: 0/0,0 mode: --/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5a6 expref: 1764 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452014:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 3/0,0 mode: PR/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1764 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452017:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452017:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452018:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452020:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb5fc03/0xa29a79078f3b7b2b lrc: 0/0,0 mode: --/PR res: [0x2b2ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba32 expref: 1763 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452021:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 4/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452024:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452024:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452028:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.452032:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452036:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 4/0,1 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452037:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1762:41279:x1731746396246848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.452043:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.452047:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10977 00000100:00100000:0.0:1651529344.452050:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41279:x1731746396247040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.452052:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10979 00000100:00100000:1.0:1651529344.452054:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41278:x1731746396246912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.452054:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10978 00010000:00010000:1.0:1651529344.452056:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.452058:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 4/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1760 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452060:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10980 00010000:00010000:1.0:1651529344.452062:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 3/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1760 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452062:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1760:41278:x1731746396246976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.452065:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.452066:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 4/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1760 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452067:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea23a5b/0xa29a79078f3bb1aa lrc: 0/0,0 mode: --/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d452f expref: 1760 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452070:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452070:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 3/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1759 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452071:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452072:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452075:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 4/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452075:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa0f6/0xa29a79078f3b7ba2 lrc: 0/0,0 mode: --/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba6a expref: 1759 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452079:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452079:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452080:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452084:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.452090:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 4/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452091:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1758:41278:x1731746396246912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.452093:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10979 00000100:00100000:1.0:1651529344.452098:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10981 00010000:00010000:0.0:1651529344.452106:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.452111:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1757:41279:x1731746396247168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.452113:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1757:41278:x1731746396246976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.452115:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.452116:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 5/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1757 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452116:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10980 00010000:00010000:1.0:1651529344.452120:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 4/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452121:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10982 00000100:00100000:0.0:1651529344.452123:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41278:x1731746396247232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.452125:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452125:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.452126:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452127:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452127:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 4/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452130:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 4/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452131:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 3/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452134:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.452136:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062397369/0xa29a79078f3bbff0 lrc: 0/0,0 mode: --/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c8e expref: 1756 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452139:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.452140:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1755:41279:x1731746396247168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.452140:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452140:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452142:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10981 00010000:00010000:0.0:1651529344.452143:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 4/0,1 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452146:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10983 00000100:00100000:1.0:1651529344.452148:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1754:41278:x1731746396247360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.452150:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.452150:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.452152:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 5/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1754 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452155:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 4/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1754 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452155:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1754:41278:x1731746396247232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.452157:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10982 00000100:00100000:0.0:1651529344.452165:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10984 00000100:00100000:0.0:1651529344.452167:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1753:41279:x1731746396247424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.452168:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452168:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452169:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452169:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.452171:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 4/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1753 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452172:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 4/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452175:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 3/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1753 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.452176:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.452179:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed1ab460/0xa29a79078f3bb298 lrc: 0/0,0 mode: --/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4885 expref: 1753 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.452182:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1752:41278:x1731746396247360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.452182:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452183:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452184:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452185:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10983 00010000:00010000:0.0:1651529344.452186:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 4/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452192:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.452197:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049b45457/0xa29a79078f3bb8b1 lrc: 0/0,0 mode: --/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60f7 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.452198:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1751:41279:x1731746396247424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.452200:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10984 00000100:00100000:1.0:1651529344.452201:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966603584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.452204:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452207:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452207:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452210:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452210:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452213:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452213:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452216:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 2/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452223:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 2/0,0 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452260:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+314:39029:x1731745946365888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1493us (1603us total) trans 30064892879 rc 0/0 00000100:00100000:0.0:1651529344.452263:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152017 00000100:00100000:1.0:1651529344.452266:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+313:39030:x1731745946366080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1384us (1575us total) trans 30064892880 rc 0/0 00000100:00100000:1.0:1651529344.452269:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152020 00010000:00010000:0.0:1651529344.452270:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 2/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452273:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.452274:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 2/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452277:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 2/0,0 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452277:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 3/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452280:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.452281:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 2/0,0 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452281:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 1/0,0 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452284:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 3/0,0 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452284:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd8f5 lrc: 0/0,0 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452289:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 1/0,0 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452290:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452292:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd90a lrc: 0/0,0 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452293:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452296:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,1 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452298:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452299:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 2/0,0 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452301:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452312:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452315:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 2/0,0 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452343:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+314:39029:x1731745946366016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1473us (1665us total) trans 30064892881 rc 0/0 00000100:00100000:0.0:1651529344.452346:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152019 00010000:00010000:0.0:1651529344.452353:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 2/0,0 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452356:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+313:39030:x1731745946365952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1528us (1688us total) trans 30064892882 rc 0/0 00010000:00010000:0.0:1651529344.452356:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af9cd173 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.452357:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 2/0,0 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452359:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152018 00010000:00010000:0.0:1651529344.452360:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 3/0,0 mode: PW/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452364:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 1/0,0 mode: --/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452367:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af9cd173/0xa29a79078f3bd903 lrc: 0/0,0 mode: --/PW res: [0x2b2ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452370:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017454906/0xa29a79078f3bb466 lrc: 0/0,0 mode: --/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d509d expref: 1749 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452371:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 2/0,0 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452374:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.452375:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966603712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.452375:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 2/0,0 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452378:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452378:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 3/0,0 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452381:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 1/0,0 mode: --/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452382:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452384:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452384:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd8fc lrc: 0/0,0 mode: --/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452387:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452389:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452392:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452395:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452398:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 2/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452400:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 2/0,0 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452443:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+314:39030:x1731745946366464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1363us (1468us total) trans 30064892883 rc 0/0 00000100:00100000:0.0:1651529344.452446:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152023 00000100:00100000:1.0:1651529344.452449:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+313:39030:x1731745946366336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1432us (1483us total) trans 30064892884 rc 0/0 00000100:00100000:1.0:1651529344.452452:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152022 00010000:00010000:0.0:1651529344.452453:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 2/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452456:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.452457:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 2/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452460:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 2/0,0 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452460:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 3/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452463:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.452464:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 2/0,0 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452465:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 1/0,0 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452467:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 3/0,0 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452467:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd91f lrc: 0/0,0 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452472:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 1/0,0 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452473:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452475:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd918 lrc: 0/0,0 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452476:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452479:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,1 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452480:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452482:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 2/0,0 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452483:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452495:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452498:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 2/0,0 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452524:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+314:39029:x1731745946366144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1509us (1569us total) trans 30064892885 rc 0/0 00000100:00100000:0.0:1651529344.452527:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152021 00010000:00010000:0.0:1651529344.452533:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 2/0,0 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452537:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002818ea2d already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.452538:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+313:39030:x1731745946365824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1792us (1906us total) trans 30064892886 rc 0/0 00010000:00010000:0.0:1651529344.452538:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 2/0,0 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452540:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 3/0,0 mode: PW/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452541:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152016 00010000:00010000:0.0:1651529344.452545:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 1/0,0 mode: --/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452548:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002818ea2d/0xa29a79078f3bd911 lrc: 0/0,0 mode: --/PW res: [0x2b2ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452552:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 2/0,0 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452554:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.452555:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 2/0,0 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452558:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 3/0,0 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452561:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 1/0,0 mode: --/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452564:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd8ee lrc: 0/0,0 mode: --/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.452875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.452881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452889:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367168 00000100:00100000:0.0:1651529344.452891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452897:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367232 00000100:00100000:0.0:1651529344.452897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452901:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367296 00000100:00100000:0.0:1651529344.452903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452915:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367424 00000100:00100000:1.0:1651529344.452919:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367360 00000100:00100000:0.0:1651529344.452920:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452923:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367552 00000100:00100000:1.0:1651529344.452925:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367488 00000100:00100000:0.0:1651529344.452927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452929:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152024 00000100:00100000:1.0:1651529344.452930:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+319:39029:x1731745946367168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.452933:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367616 00002000:00080000:1.0:1651529344.452936:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176816 count 1 00010000:00010000:1.0:1651529344.452940:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: --/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452940:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152025 00000100:00100000:0.0:1651529344.452941:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+320:39030:x1731745946367232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.452946:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 2/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.452947:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176817 count 1 00010000:00010000:1.0:1651529344.452949:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452949:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452952:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452957:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 2/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.452958:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 4/0,1 mode: --/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452961:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452961:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452962:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 4/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452966:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 3/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.452969:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 3/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.452971:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 4/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.452973:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 4/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.452975:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.452977:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966603904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.452987:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.452987:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.452994:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152026 00000100:00100000:1.0:1651529344.452995:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+320:39029:x1731745946367296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.452996:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152027 00000100:00100000:0.0:1651529344.452997:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+320:39029:x1731745946367424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.453000:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176818 count 1 00002000:00080000:0.0:1651529344.453002:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176820 count 1 00010000:00010000:1.0:1651529344.453003:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453005:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453008:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 2/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453009:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 2/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.453011:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453011:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453012:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 4/0,1 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453012:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453013:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453014:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 4/0,1 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453018:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 3/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453020:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 3/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453024:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 4/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453027:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966604032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.453032:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 4/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453033:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.453037:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966603968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.453039:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152028 00000100:00100000:0.0:1651529344.453041:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+320:39030:x1731745946367360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.453045:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.453045:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176819 count 1 00010000:00010000:0.0:1651529344.453047:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: --/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453051:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152029 00010000:00010000:0.0:1651529344.453052:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 2/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.453053:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+320:39029:x1731745946367552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.453054:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453055:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453055:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 4/0,1 mode: --/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.453058:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176822 count 1 00010000:00010000:1.0:1651529344.453061:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453061:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 3/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.453065:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 2/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453067:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 4/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.453068:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453069:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453069:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 4/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453071:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966604096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.453076:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 3/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.453077:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.453079:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 4/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453083:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152030 00000100:00100000:0.0:1651529344.453084:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+320:39030:x1731745946367488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.453088:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176821 count 1 00010000:00010000:0.0:1651529344.453091:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453093:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.453095:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 2/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453098:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453098:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453099:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 4/0,1 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453101:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.453105:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 3/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.453107:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152031 00000100:00100000:1.0:1651529344.453109:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+320:39030:x1731745946367616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.453109:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 4/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.453113:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176823 count 1 00000100:00100000:0.0:1651529344.453116:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966604224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.453117:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453121:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 2/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.453121:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.453124:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453124:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453125:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 4/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453131:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 3/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1748 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.453135:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 4/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.453139:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966604288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.453145:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.453595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.453601:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966603840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.453602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.453624:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: --/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453628:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966603904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.453632:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248256 00010000:00010000:0.0:1651529344.453633:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453637:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 4/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1749 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453640:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966604032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.453643:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453644:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248320 00010000:00010000:1.0:1651529344.453647:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 4/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453649:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248384 00000100:00100000:1.0:1651529344.453652:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10985 00000100:00100000:1.0:1651529344.453653:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1751:41279:x1731746396248256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.453654:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 4/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.453656:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453658:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 4/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453661:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10986 00010000:00010000:1.0:1651529344.453662:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 3/0,0 mode: PR/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.453662:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1751:41278:x1731746396248320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.453665:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453667:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff9f704/0xa29a79078f3bc3af lrc: 0/0,0 mode: --/PR res: [0x2b2b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd0 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.453667:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 4/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.453671:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453671:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453671:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 3/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.453672:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453677:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6dda98/0xa29a79078f3bae4d lrc: 0/0,0 mode: --/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37d0 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.453681:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453682:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453682:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453685:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 4/0,1 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453686:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 4/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453692:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.453692:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.453704:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41278:x1731746396248320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.453707:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10986 00000100:00100000:1.0:1651529344.453708:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41279:x1731746396248256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.453711:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10985 00000100:00100000:0.0:1651529344.453713:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10987 00000100:00100000:0.0:1651529344.453715:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1747:41278:x1731746396248384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.453717:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.453719:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 4/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.453722:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 3/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1747 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.453723:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966603968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.453727:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453727:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3ba976 lrc: 0/0,0 mode: --/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24f2 expref: 1747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.453743:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453743:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453744:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453744:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453747:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453747:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 4/0,1 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453750:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,1 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453753:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 2/0,0 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453753:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.453759:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41278:x1731746396248384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.453762:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10987 00010000:00010000:0.0:1651529344.453768:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453772:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453775:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453778:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453800:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946367168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 868us (936us total) trans 30064892887 rc 0/0 00000100:00100000:1.0:1651529344.453820:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152024 00010000:00010000:1.0:1651529344.453835:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 2/0,0 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453838:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.453840:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 2/0,0 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453843:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 3/0,0 mode: PW/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453846:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+321:39030:x1731745946367232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 904us (971us total) trans 30064892888 rc 0/0 00010000:00010000:1.0:1651529344.453848:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 1/0,0 mode: --/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453850:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd926 lrc: 0/0,0 mode: --/PW res: [0x2b2b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453850:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152025 00010000:00010000:1.0:1651529344.453855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453858:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027416bb5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.453859:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453859:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453861:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 3/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453862:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453864:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 1/0,0 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453865:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,1 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453875:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027416bb5/0xa29a79078f3bd92d lrc: 0/0,0 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.453904:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 2/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453968:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946367424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 969us (1077us total) trans 30064892889 rc 0/0 00000100:00100000:0.0:1651529344.453971:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152027 00000100:00100000:1.0:1651529344.453975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.453978:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 2/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453982:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade9dc56 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.453983:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 2/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453986:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 3/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454002:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 1/0,0 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.454008:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade9dc56/0xa29a79078f3bd93b lrc: 0/0,0 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454019:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966604096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454023:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: --/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454030:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966604224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454033:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454039:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.454040:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248448 00010000:00010000:0.0:1651529344.454044:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 4/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454050:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248704 00000100:00100000:1.0:1651529344.454051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.454052:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 5/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1747 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454056:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248832 00000100:00100000:1.0:1651529344.454060:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.454065:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454072:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248640 00010000:00010000:0.0:1651529344.454072:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 4/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454077:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 4/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1749 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454079:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248896 00010000:00010000:0.0:1651529344.454082:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 5/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.454083:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10988 00000100:00100000:1.0:1651529344.454085:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1750:41279:x1731746396248448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.454088:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.454088:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10989 00010000:00010000:1.0:1651529344.454089:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 4/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454089:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1750:41279:x1731746396248704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.454092:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.454093:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 3/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454094:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 4/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454097:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 3/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454103:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25c2243/0xa29a79078f3bc3b6 lrc: 0/0,0 mode: --/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bd7 expref: 1750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454106:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454107:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454107:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454110:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000860b0778/0xa29a79078f3bbaf6 lrc: 0/0,0 mode: --/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68fa expref: 1749 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454111:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 4/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454114:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454115:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454116:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454121:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.454124:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 4/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454132:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41279:x1731746396248704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.454134:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10989 00010000:00010000:1.0:1651529344.454135:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.454144:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41279:x1731746396248448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.454147:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10988 00000100:00100000:0.0:1651529344.454152:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10990 00000100:00100000:0.0:1651529344.454154:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41279:x1731746396248832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.454156:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10991 00010000:00010000:0.0:1651529344.454157:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.454158:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41278:x1731746396248640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.454158:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 4/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454161:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.454162:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 4/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454162:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 3/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454166:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 3/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454167:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bbcbd lrc: 0/0,0 mode: --/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d706a expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454170:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454171:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002071dece/0xa29a79078f3bc282 lrc: 0/0,0 mode: --/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8785 expref: 1745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454171:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454172:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454175:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 4/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454181:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.454185:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454186:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454187:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454187:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1744:41279:x1731746396248832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.454190:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 4/0,1 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454190:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10990 00000100:00100000:0.0:1651529344.454194:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10992 00000100:00100000:0.0:1651529344.454195:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1743:41279:x1731746396248896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.454198:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.454205:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1743:41278:x1731746396248640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.454205:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.454206:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 5/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1743 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.454208:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10991 00000100:00100000:1.0:1651529344.454218:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966604288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454219:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 3/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1742 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454222:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454224:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3b9e7f lrc: 0/0,0 mode: --/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf82f expref: 1742 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454228:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454228:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454229:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454229:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454231:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454232:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 4/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454234:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454237:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 2/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454241:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.454247:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1741:41279:x1731746396248896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.454250:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10992 00010000:00010000:0.0:1651529344.454263:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 2/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454267:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.454268:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 2/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454271:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 3/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454289:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946367296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1293us (1407us total) trans 30064892890 rc 0/0 00000100:00100000:1.0:1651529344.454292:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152026 00010000:00010000:0.0:1651529344.454292:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 1/0,0 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454295:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd934 lrc: 0/0,0 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454302:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454305:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454308:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,1 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454311:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 2/0,0 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454313:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454316:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454327:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454329:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 2/0,0 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454360:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+322:39030:x1731745946367360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1318us (1462us total) trans 30064892891 rc 0/0 00000100:00100000:0.0:1651529344.454363:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152028 00010000:00010000:0.0:1651529344.454370:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 2/0,0 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454374:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfab8781 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.454375:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 2/0,0 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454378:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+321:39030:x1731745946367616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1268us (1450us total) trans 30064892892 rc 0/0 00000100:00100000:1.0:1651529344.454381:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152031 00010000:00010000:0.0:1651529344.454386:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 3/0,0 mode: PW/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454390:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 2/0,0 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454391:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 1/0,0 mode: --/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454393:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.454394:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 2/0,0 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454394:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfab8781/0xa29a79078f3bd942 lrc: 0/0,0 mode: --/PW res: [0x2b2b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454397:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 3/0,0 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454400:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454403:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454406:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454409:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 1/0,0 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454409:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 2/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454412:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd957 lrc: 0/0,0 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454417:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 2/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454419:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.454420:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 2/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454423:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 3/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454426:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 1/0,0 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454429:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd950 lrc: 0/0,0 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454435:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454437:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454445:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454445:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+321:39030:x1731745946367488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1360us (1524us total) trans 30064892893 rc 0/0 00010000:00010000:1.0:1651529344.454448:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 2/0,0 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454448:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152030 00010000:00010000:0.0:1651529344.454463:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 2/0,0 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454476:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.454477:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 2/0,0 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454480:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 3/0,0 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454485:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 1/0,0 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454486:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946367552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1432us (1583us total) trans 30064892894 rc 0/0 00010000:00010000:0.0:1651529344.454487:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd949 lrc: 0/0,0 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454489:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152029 00000100:00100000:0.0:1651529344.454561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454601:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367872 00000100:00100000:1.0:1651529344.454602:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367936 00000100:00100000:0.0:1651529344.454608:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368320 00000100:00100000:1.0:1651529344.454610:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152032 00000100:00100000:1.0:1651529344.454612:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+323:39030:x1731745946367872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.454614:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152033 00000100:00100000:0.0:1651529344.454616:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+323:39030:x1731745946367936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.454617:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176824 count 1 00010000:00010000:1.0:1651529344.454622:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454627:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 2/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1740 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454630:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454630:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454631:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 4/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.454636:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176825 count 1 00010000:00010000:1.0:1651529344.454638:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 3/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1740 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454651:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: --/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454652:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1740 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454656:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 2/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.454657:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454669:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.454670:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454671:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454671:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 4/0,1 mode: --/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454675:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152034 00000100:00100000:1.0:1651529344.454676:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+323:39030:x1731745946368320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.454681:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176826 count 1 00010000:00010000:1.0:1651529344.454685:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: --/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454689:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 2/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454692:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454692:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 3/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454693:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454694:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 4/0,1 mode: --/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454696:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 4/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454700:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 3/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.454701:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966604416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.454703:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 4/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454710:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454718:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966604480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.454725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.454726:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454740:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368512 00000100:00100000:1.0:1651529344.454750:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152035 00000100:00100000:1.0:1651529344.454752:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+324:39029:x1731745946368512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.454757:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176827 count 1 00010000:00010000:1.0:1651529344.454761:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: --/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454765:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 2/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454768:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454769:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454769:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 4/0,1 mode: --/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454776:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 3/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.454779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.454788:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 4/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454791:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.454793:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966604544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454825:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454832:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368576 00000100:00100000:0.0:1651529344.454833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.454847:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368640 00000100:00100000:1.0:1651529344.454851:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368768 00000100:00100000:1.0:1651529344.454854:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152036 00000100:00100000:0.0:1651529344.454861:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.454862:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+327:39030:x1731745946368576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.454867:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176828 count 1 00000100:00100000:0.0:1651529344.454870:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368704 00010000:00010000:1.0:1651529344.454871:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454876:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 2/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.454876:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152037 00000100:00100000:0.0:1651529344.454878:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+328:39029:x1731745946368640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.454879:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454879:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454880:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 4/0,1 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.454884:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176829 count 1 00010000:00010000:1.0:1651529344.454886:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 3/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454888:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454890:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 4/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.454893:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 2/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.454894:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966604608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454907:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454914:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152038 00000100:00100000:1.0:1651529344.454916:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+328:39030:x1731745946368768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.454921:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176831 count 1 00010000:00010000:1.0:1651529344.454924:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: --/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454927:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454928:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 2/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454928:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454929:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 4/0,1 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454932:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454932:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454933:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 4/0,1 mode: --/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454937:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 3/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454939:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 3/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454941:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 4/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.454943:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 4/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.454945:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966604672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454947:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966604736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.454955:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454956:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.454962:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152039 00000100:00100000:0.0:1651529344.454964:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+328:39029:x1731745946368704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.454969:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176830 count 1 00010000:00010000:0.0:1651529344.454973:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454977:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 2/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454980:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454981:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454981:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 4/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454999:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 3/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1740 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.455003:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 4/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455007:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966604800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.455022:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.455174:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455178:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455247:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966604416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455251:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: --/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455255:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966604480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455258:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: --/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455543:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966604672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.455544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.455548:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.455559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455563:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966604800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455566:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455573:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249344 00010000:00010000:0.0:1651529344.455578:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1741 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.455579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.455584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455594:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249472 00010000:00010000:0.0:1651529344.455598:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 4/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1742 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.455599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455602:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249536 00010000:00010000:0.0:1651529344.455604:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 4/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1743 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455608:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249600 00010000:00010000:0.0:1651529344.455610:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 5/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455614:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249728 00010000:00010000:0.0:1651529344.455615:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 4/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1745 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.455616:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966604736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.455619:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249664 00010000:00010000:1.0:1651529344.455620:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: --/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455621:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 5/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1746 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455625:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249856 00000100:00100000:1.0:1651529344.455627:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249792 00010000:00010000:0.0:1651529344.455627:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 4/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455632:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 4/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455632:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10993 00000100:00100000:0.0:1651529344.455633:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41279:x1731746396249344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.455639:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10994 00000100:00100000:1.0:1651529344.455640:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41279:x1731746396249472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.455643:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455643:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455644:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1748 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455645:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 4/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455648:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 3/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1748 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455649:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 3/0,0 mode: PR/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455654:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dabc7970/0xa29a79078f3b9667 lrc: 0/0,0 mode: --/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd77b expref: 1748 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455657:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b052d618/0xa29a79078f3bade4 lrc: 0/0,0 mode: --/PR res: [0x2b2b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3648 expref: 1748 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455658:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455659:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455660:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455661:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455662:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455663:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455663:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 4/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455666:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 4/0,1 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455672:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.455683:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455687:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41279:x1731746396249344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.455691:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41279:x1731746396249472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.455691:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10993 00000100:00100000:1.0:1651529344.455694:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10994 00000100:00100000:0.0:1651529344.455696:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10995 00000100:00100000:0.0:1651529344.455698:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1744:41278:x1731746396249536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.455699:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10996 00000100:00100000:1.0:1651529344.455701:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1744:41279:x1731746396249600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.455701:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455702:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 4/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455704:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.455705:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 5/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455709:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 4/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455714:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455715:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455715:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455717:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 3/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455718:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 4/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455722:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.455722:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3b9f9e lrc: 0/0,0 mode: --/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc73 expref: 1744 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455725:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.455726:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1743:41279:x1731746396249600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.455726:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455727:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455729:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10996 00010000:00010000:0.0:1651529344.455737:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 4/0,1 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455744:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10997 00010000:00010000:0.0:1651529344.455747:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.455752:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1742:41279:x1731746396249728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.455755:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.455755:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1742:41278:x1731746396249536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.455757:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 4/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1742 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455758:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10995 00010000:00010000:1.0:1651529344.455761:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 3/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1741 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455766:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bc31c lrc: 0/0,0 mode: --/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89d8 expref: 1741 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455768:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10998 00010000:00010000:1.0:1651529344.455769:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.455769:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1740:41278:x1731746396249664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.455770:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455771:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455772:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455773:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 5/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455776:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 4/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455777:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 4/0,0 mode: PR/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1740 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455785:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.455791:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1740:41279:x1731746396249728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.455794:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10997 00010000:00010000:0.0:1651529344.455795:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455796:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455797:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455799:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10999 00000100:00100000:1.0:1651529344.455800:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41279:x1731746396249856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.455800:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 4/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455819:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.455821:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 4/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1739 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455822:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.455825:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 3/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1739 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455829:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41278:x1731746396249664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (250us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.455830:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3ba03f lrc: 0/0,0 mode: --/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee2 expref: 1739 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.455832:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10998 00010000:00010000:1.0:1651529344.455833:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455834:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455835:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455837:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11000 00010000:00010000:1.0:1651529344.455838:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 4/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455839:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1737:41278:x1731746396249792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.455842:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455843:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 4/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1737 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455846:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.455852:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1737:41279:x1731746396249856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.455854:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 3/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1737 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.455855:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10999 00010000:00010000:1.0:1651529344.455864:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455867:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455867:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bc6a669/0xa29a79078f3bb179 lrc: 0/0,0 mode: --/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d444f expref: 1736 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.455870:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,1 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455871:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455873:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 2/0,0 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455876:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455879:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 4/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455887:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455894:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1735:41278:x1731746396249792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.455897:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11000 00010000:00010000:0.0:1651529344.455904:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455908:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455911:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455914:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 2/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455932:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946368320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1255us (1341us total) trans 30064892895 rc 0/0 00000100:00100000:1.0:1651529344.455936:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152034 00010000:00010000:1.0:1651529344.455943:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 2/0,0 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455946:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.455947:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 2/0,0 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455952:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 3/0,0 mode: PW/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455957:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 1/0,0 mode: --/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455960:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bd96c lrc: 0/0,0 mode: --/PW res: [0x2b2ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455962:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+329:39029:x1731745946368640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1083us (1170us total) trans 30064892896 rc 0/0 00010000:00010000:1.0:1651529344.455964:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 2/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455965:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152037 00010000:00010000:1.0:1651529344.455967:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.455968:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 2/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455971:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 3/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455974:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 1/0,0 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455974:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455976:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bd981 lrc: 0/0,0 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455986:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bbe06 lrc: 0/0,0 mode: --/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7502 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.455987:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455989:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966604544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455990:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455993:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455993:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 2/0,0 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455996:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455999:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456002:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456005:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 2/0,0 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456037:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+330:39029:x1731745946368704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1176us total) trans 30064892897 rc 0/0 00000100:00100000:0.0:1651529344.456040:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152039 00000100:00100000:1.0:1651529344.456045:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+329:39029:x1731745946368512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1292us (1320us total) trans 30064892898 rc 0/0 00010000:00010000:0.0:1651529344.456047:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 2/0,0 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456048:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152035 00010000:00010000:0.0:1651529344.456050:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.456051:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 2/0,0 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456054:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 3/0,0 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456056:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456059:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456059:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 1/0,0 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456061:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bd98f lrc: 0/0,0 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456064:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456067:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 2/0,0 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456074:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 2/0,0 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456077:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.456078:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 2/0,0 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456081:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 3/0,0 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456084:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 1/0,0 mode: --/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456087:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bd973 lrc: 0/0,0 mode: --/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456090:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 2/0,0 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456093:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006e1d96e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.456094:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 2/0,0 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456096:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 3/0,0 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456099:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946368768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1182us (1266us total) trans 30064892899 rc 0/0 00000100:00100000:1.0:1651529344.456102:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152038 00010000:00010000:0.0:1651529344.456107:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 1/0,0 mode: --/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456108:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456109:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e1d96e/0xa29a79078f3bd988 lrc: 0/0,0 mode: --/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456111:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456114:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456116:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456117:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 2/0,0 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456119:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456122:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,1 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456130:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 2/0,0 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456153:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+330:39030:x1731745946367872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1540us (1592us total) trans 30064892900 rc 0/0 00000100:00100000:1.0:1651529344.456156:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152032 00010000:00010000:1.0:1651529344.456163:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 2/0,0 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456167:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946367936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1550us (1584us total) trans 30064892901 rc 0/0 00010000:00010000:1.0:1651529344.456168:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.456169:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 2/0,0 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456170:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152033 00010000:00010000:1.0:1651529344.456172:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 3/0,0 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456177:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 1/0,0 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456178:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 2/0,0 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456179:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bd95e lrc: 0/0,0 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456181:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.456182:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 2/0,0 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456189:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3b998c lrc: 0/0,0 mode: --/PR res: [0x2b2bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce40f expref: 1733 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.456192:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966604608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456193:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 3/0,0 mode: PW/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456195:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456199:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456199:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 1/0,0 mode: --/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456201:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456201:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bd965 lrc: 0/0,0 mode: --/PW res: [0x2b2b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456206:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,1 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456209:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 2/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456250:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946368576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1393us (1471us total) trans 30064892902 rc 0/0 00000100:00100000:1.0:1651529344.456253:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152036 00010000:00010000:1.0:1651529344.456274:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 2/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456278:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dfc102d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.456279:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 2/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456306:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 3/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456311:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 1/0,0 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456314:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dfc102d/0xa29a79078f3bd97a lrc: 0/0,0 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456485:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.456505:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369344 00000100:00100000:1.0:1651529344.456516:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152040 00000100:00100000:1.0:1651529344.456518:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+329:39029:x1731745946369344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.456528:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176832 count 1 00010000:00010000:1.0:1651529344.456533:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456537:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 2/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.456539:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.456549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.456557:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.456557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.456558:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456558:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 4/0,1 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.456571:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 3/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.456571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.456575:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 4/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1732 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.456577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.456579:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966604864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.456586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.456593:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369408 00000100:00100000:1.0:1651529344.456595:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.456602:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369536 00000100:00100000:0.0:1651529344.456606:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369664 00000100:00100000:0.0:1651529344.456608:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369792 00000100:00100000:1.0:1651529344.456609:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369472 00000100:00100000:0.0:1651529344.456610:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369600 00000100:00100000:0.0:1651529344.456612:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369728 00000100:00100000:1.0:1651529344.456616:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152041 00000100:00100000:1.0:1651529344.456617:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946369408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.456619:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152042 00000100:00100000:0.0:1651529344.456621:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946369536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.456622:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176833 count 1 00010000:00010000:1.0:1651529344.456626:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.456627:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176835 count 1 00010000:00010000:1.0:1651529344.456630:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 2/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1732 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456631:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456633:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456634:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456635:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 4/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456637:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 2/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456640:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456640:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456641:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 3/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1732 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456641:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 4/0,1 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456644:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 4/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1732 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.456648:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456648:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 3/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456652:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 4/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1732 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.456655:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.456656:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966604992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456661:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152043 00000100:00100000:1.0:1651529344.456663:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946369664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.456665:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.456667:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176837 count 1 00010000:00010000:1.0:1651529344.456670:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: --/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456672:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152044 00000100:00100000:0.0:1651529344.456674:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946369792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.456675:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 2/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456677:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456678:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.456678:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176839 count 1 00010000:00010000:1.0:1651529344.456679:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 4/0,1 mode: --/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456681:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456684:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 3/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456686:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 2/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456688:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 4/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1732 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.456689:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456689:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456690:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 4/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456692:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966605056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456696:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 3/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.456698:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.456700:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 4/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1732 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.456704:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152045 00000100:00100000:0.0:1651529344.456704:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966605120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456706:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+336:39029:x1731745946369600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.456710:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176836 count 1 00000100:00100000:0.0:1651529344.456710:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.456713:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456716:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152046 00010000:00010000:1.0:1651529344.456717:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 2/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.456717:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+336:39029:x1731745946369472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.456720:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456720:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456721:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 4/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.456721:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176834 count 1 00010000:00010000:0.0:1651529344.456725:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: --/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456727:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 3/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1732 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456729:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 2/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456742:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456743:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456744:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 4/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1732 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.456744:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 4/0,1 mode: --/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456749:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966605184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456751:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 3/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.456756:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.456757:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1732 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.456761:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456763:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152047 00000100:00100000:1.0:1651529344.456764:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+336:39029:x1731745946369728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.456768:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.456769:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176838 count 1 00010000:00010000:1.0:1651529344.456772:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456777:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 2/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456780:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456780:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456781:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 4/0,1 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456787:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 3/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1732 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456791:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 4/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1732 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.456822:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966605312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456831:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.457299:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966604928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.457299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.457303:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.457316:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250432 00010000:00010000:1.0:1651529344.457330:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 5/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1733 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.457342:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250560 00010000:00010000:1.0:1651529344.457345:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 5/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.457346:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966604992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.457349:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250496 00010000:00010000:1.0:1651529344.457351:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 4/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1735 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457351:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457356:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11001 00000100:00100000:1.0:1651529344.457357:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1735:41278:x1731746396250432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.457359:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966605120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.457360:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457361:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 5/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1735 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457361:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457368:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457370:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: --/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457375:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 4/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1735 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.457377:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11002 00000100:00100000:0.0:1651529344.457379:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1735:41278:x1731746396250560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.457382:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457382:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457382:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457383:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457384:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 4/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457386:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 4/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457388:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 3/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457391:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.457394:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac106a04/0xa29a79078f3bbdc0 lrc: 0/0,0 mode: --/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73f8 expref: 1735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457398:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457398:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457399:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457403:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1734:41278:x1731746396250432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457406:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11001 00000100:00100000:1.0:1651529344.457411:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11003 00000100:00100000:1.0:1651529344.457413:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1733:41279:x1731746396250496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.457415:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457417:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 4/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1733 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457420:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 3/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1733 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457425:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061982de0/0xa29a79078f3b940d lrc: 0/0,0 mode: --/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde2 expref: 1733 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457432:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 4/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457443:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457444:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457445:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457448:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 4/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457449:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.457455:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.457457:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1732:41278:x1731746396250560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 77us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.457460:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11002 00000100:00100000:1.0:1651529344.457462:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1732:41279:x1731746396250496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457464:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11003 00010000:00010000:0.0:1651529344.457468:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457472:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457475:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457478:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457479:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966605056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.457483:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: --/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457490:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966605184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.457493:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457498:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457501:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457515:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457518:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457520:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+337:39030:x1731745946369536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 898us (970us total) trans 30064892903 rc 0/0 00000100:00100000:0.0:1651529344.457523:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152042 00010000:00010000:0.0:1651529344.457537:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457541:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.457542:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457545:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 3/0,0 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457550:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 1/0,0 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457553:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bd9a4 lrc: 0/0,0 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457557:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457560:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.457561:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457564:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 3/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457567:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 1/0,0 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457569:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+337:39030:x1731745946369408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1030us total) trans 30064892904 rc 0/0 00010000:00010000:0.0:1651529344.457570:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bd99d lrc: 0/0,0 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457572:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152041 00010000:00010000:1.0:1651529344.457585:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c428d7a0/0xa29a79078f3b857a lrc: 0/0,0 mode: --/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf79 expref: 1730 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.457596:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966604864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.457600:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457603:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457606:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457609:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.457623:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 2/0,0 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.457683:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+337:39029:x1731745946369344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1158us (1192us total) trans 30064892905 rc 0/0 00000100:00100000:1.0:1651529344.457687:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152040 00010000:00010000:1.0:1651529344.457694:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 2/0,0 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457699:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250688 00010000:00010000:1.0:1651529344.457703:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f28f648 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.457704:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 2/0,0 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457705:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 4/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1730 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457707:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 3/0,0 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457710:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250816 00010000:00010000:1.0:1651529344.457712:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 1/0,0 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457713:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 4/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1731 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457715:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f28f648/0xa29a79078f3bd996 lrc: 0/0,0 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457717:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250944 00010000:00010000:0.0:1651529344.457719:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 5/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1732 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.457723:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250752 00000100:00100000:0.0:1651529344.457725:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250880 00010000:00010000:1.0:1651529344.457727:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 4/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457728:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1734 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.457753:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11004 00000100:00100000:1.0:1651529344.457754:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1734:41279:x1731746396250688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.457757:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.457757:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11005 00010000:00010000:1.0:1651529344.457759:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 4/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.457759:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1734:41278:x1731746396250816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.457762:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457763:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 3/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457764:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 4/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457768:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3b9f74 lrc: 0/0,0 mode: --/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbd9 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457768:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 3/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1734 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457772:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457772:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457773:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457774:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4d835c2/0xa29a79078f3bb187 lrc: 0/0,0 mode: --/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4487 expref: 1733 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457776:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 4/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457778:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457778:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457779:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457782:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 4/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457783:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457800:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1732:41279:x1731746396250688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.457800:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457818:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11004 00000100:00100000:1.0:1651529344.457824:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11006 00000100:00100000:0.0:1651529344.457824:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1731:41278:x1731746396250816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457832:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1731:41278:x1731746396250944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.457835:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457837:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 5/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1731 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457840:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 4/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1731 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.457841:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11005 00010000:00010000:1.0:1651529344.457846:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457846:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457847:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457847:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11007 00000100:00100000:0.0:1651529344.457849:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1730:41279:x1731746396250752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.457850:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 4/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457852:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457854:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.457854:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 4/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1730 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457858:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 3/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1730 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.457861:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1730:41278:x1731746396250944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457863:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11006 00010000:00010000:0.0:1651529344.457863:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bbf56 lrc: 0/0,0 mode: --/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a26 expref: 1730 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457867:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.457868:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11008 00010000:00010000:0.0:1651529344.457868:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457868:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457870:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1728:41279:x1731746396250880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.457871:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 4/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457872:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457873:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1728 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457877:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 3/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1728 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457879:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.457885:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1728:41279:x1731746396250752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.457888:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11007 00010000:00010000:1.0:1651529344.457889:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9b97c8/0xa29a79078f3b77f8 lrc: 0/0,0 mode: --/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb562 expref: 1728 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.457892:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457893:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457894:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457895:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457897:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 4/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457898:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457901:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457905:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457911:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396250880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.457911:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457914:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11008 00010000:00010000:1.0:1651529344.457921:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457925:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457928:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457930:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 2/0,0 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457957:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+337:39030:x1731745946369792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1385us total) trans 30064892906 rc 0/0 00000100:00100000:0.0:1651529344.457961:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152044 00010000:00010000:0.0:1651529344.457968:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457971:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.457973:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457975:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 3/0,0 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457980:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+337:39030:x1731745946369664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1316us (1423us total) trans 30064892907 rc 0/0 00010000:00010000:0.0:1651529344.457980:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 1/0,0 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457983:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152043 00010000:00010000:0.0:1651529344.457983:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bd9b2 lrc: 0/0,0 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457987:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 2/0,0 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457990:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.457991:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 2/0,0 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457993:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 3/0,0 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457995:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fd72949/0xa29a79078f3b88b4 lrc: 0/0,0 mode: --/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc132 expref: 1725 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.457997:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 1/0,0 mode: --/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457999:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966605312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457999:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bd9ab lrc: 0/0,0 mode: --/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458003:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458005:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458006:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458007:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458009:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458010:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458012:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458013:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458014:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458059:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+338:39029:x1731745946369472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1340us (1493us total) trans 30064892908 rc 0/0 00000100:00100000:0.0:1651529344.458062:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152046 00000100:00100000:1.0:1651529344.458063:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+338:39029:x1731745946369728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1298us (1477us total) trans 30064892909 rc 0/0 00000100:00100000:1.0:1651529344.458066:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152047 00010000:00010000:0.0:1651529344.458069:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458072:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.458073:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458076:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 3/0,0 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458080:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 1/0,0 mode: --/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458083:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458083:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bd9c0 lrc: 0/0,0 mode: --/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458086:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.458087:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458090:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 3/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458095:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 1/0,0 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458098:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bd9c7 lrc: 0/0,0 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458104:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.458119:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458123:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458126:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458172:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+337:39029:x1731745946369600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1465us (1594us total) trans 30064892910 rc 0/0 00010000:00010000:0.0:1651529344.458192:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458196:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.458197:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458200:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 3/0,0 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458205:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 1/0,0 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458207:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152045 00010000:00010000:0.0:1651529344.458207:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bd9b9 lrc: 0/0,0 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458215:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370496 00000100:00100000:1.0:1651529344.458217:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370432 00000100:00100000:1.0:1651529344.458230:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370560 00000100:00100000:1.0:1651529344.458235:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152048 00000100:00100000:1.0:1651529344.458237:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+339:39029:x1731745946370496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.458242:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176841 count 1 00000100:00100000:0.0:1651529344.458243:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152049 00000100:00100000:0.0:1651529344.458245:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+339:39030:x1731745946370432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.458246:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458251:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 2/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.458251:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176840 count 1 00010000:00010000:1.0:1651529344.458254:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458255:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458256:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 4/0,1 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458256:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458260:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 2/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458262:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 3/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458263:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458264:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458265:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 4/0,1 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458266:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458271:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966605376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.458272:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 3/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458276:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 4/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.458280:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458285:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.458293:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152050 00000100:00100000:1.0:1651529344.458294:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+339:39030:x1731745946370560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.458297:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.458306:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176842 count 1 00010000:00010000:1.0:1651529344.458310:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458314:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 2/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458317:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458318:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458319:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 4/0,1 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458325:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 3/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458335:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 4/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458340:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966605504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458348:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458375:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370752 00000100:00100000:1.0:1651529344.458382:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152051 00000100:00100000:0.0:1651529344.458387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458395:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+340:39030:x1731745946370752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.458396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.458399:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176843 count 1 00000100:00100000:0.0:1651529344.458403:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.458404:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458408:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 2/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.458410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458416:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370880 00010000:00010000:1.0:1651529344.458419:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458419:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458420:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 4/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458423:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370816 00000100:00100000:0.0:1651529344.458426:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371008 00010000:00010000:1.0:1651529344.458427:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 3/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.458428:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370944 00010000:00010000:1.0:1651529344.458431:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 4/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458435:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966605568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.458445:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152052 00000100:00100000:1.0:1651529344.458448:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458453:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+344:39029:x1731745946370880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.458455:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152053 00000100:00100000:1.0:1651529344.458456:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+344:39030:x1731745946370816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.458458:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176845 count 1 00002000:00080000:1.0:1651529344.458461:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176844 count 1 00010000:00010000:1.0:1651529344.458465:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: --/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458469:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 2/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458472:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458472:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458473:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458473:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 4/0,1 mode: --/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458477:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 2/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458489:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 3/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458489:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458490:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458490:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 4/0,1 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458493:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 4/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458496:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966605632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.458499:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 3/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458502:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 4/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458504:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458507:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966605696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458510:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152054 00000100:00100000:1.0:1651529344.458512:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+344:39029:x1731745946371008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.458515:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.458516:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176847 count 1 00010000:00010000:1.0:1651529344.458520:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458522:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152055 00010000:00010000:1.0:1651529344.458524:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 2/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458527:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458528:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458528:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 4/0,1 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458534:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 3/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.458536:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+344:39030:x1731745946370944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.458538:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 4/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.458541:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176846 count 1 00010000:00010000:0.0:1651529344.458545:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458549:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966605760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.458550:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 2/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458553:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458553:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458554:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 4/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458556:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.458571:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 3/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458575:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 4/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.458588:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966605824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.458595:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.458650:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966605376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458655:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.458666:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251520 00010000:00010000:1.0:1651529344.458671:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.458680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.458691:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251648 00010000:00010000:1.0:1651529344.458695:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 5/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.458708:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.458709:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11009 00000100:00100000:1.0:1651529344.458710:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396251520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.458713:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.458715:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.458717:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458718:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 3/0,0 mode: PR/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1726 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.458722:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458724:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3ba3b8 lrc: 0/0,0 mode: --/PR res: [0x2b2c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d0c expref: 1726 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.458742:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458743:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458744:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458747:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 4/0,1 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458751:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251584 00010000:00010000:1.0:1651529344.458754:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.458756:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 4/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458766:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396251520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.458770:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11010 00000100:00100000:1.0:1651529344.458772:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11009 00000100:00100000:0.0:1651529344.458772:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396251648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.458775:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.458777:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11011 00010000:00010000:0.0:1651529344.458777:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 5/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458779:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1725:41278:x1731746396251584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.458780:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 4/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.458782:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.458784:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 4/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.458787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458788:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 3/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.458788:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458791:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 4/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458793:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997ca272/0xa29a79078f3bbbcf lrc: 0/0,0 mode: --/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d14 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.458796:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458796:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.458818:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458819:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458821:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396251648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (124us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.458823:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 4/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458824:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11010 00010000:00010000:1.0:1651529344.458830:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.458838:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1723:41278:x1731746396251584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.458840:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11011 00010000:00010000:0.0:1651529344.458842:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458846:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458849:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458852:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458853:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3baff1 lrc: 0/0,0 mode: --/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e83 expref: 1722 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.458857:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966605504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458860:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458864:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458866:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458870:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458872:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 2/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458893:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+345:39030:x1731745946370432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 647us (766us total) trans 30064892911 rc 0/0 00000100:00100000:0.0:1651529344.458897:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152049 00010000:00010000:0.0:1651529344.458904:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458910:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.458911:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458914:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 3/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458918:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 1/0,0 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458921:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bd9d5 lrc: 0/0,0 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458922:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+345:39030:x1731745946370560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 626us (776us total) trans 30064892912 rc 0/0 00000100:00100000:1.0:1651529344.458925:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152050 00010000:00010000:0.0:1651529344.458925:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 2/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458928:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.458929:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 2/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458931:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 3/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458934:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458935:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 1/0,0 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458938:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458940:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bd9dc lrc: 0/0,0 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458941:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,1 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458944:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 2/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458981:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+345:39029:x1731745946370496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 743us (870us total) trans 30064892913 rc 0/0 00000100:00100000:1.0:1651529344.458991:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152048 00010000:00010000:0.0:1651529344.458998:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 2/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459002:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.459003:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 2/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459006:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 3/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459010:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 1/0,0 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459013:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bd9ce lrc: 0/0,0 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459098:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966605568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459102:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459128:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966605632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.459129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.459131:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: --/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.459155:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251776 00010000:00010000:1.0:1651529344.459160:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 4/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1722 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.459178:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251904 00000100:00100000:0.0:1651529344.459179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.459182:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 5/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1723 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.459187:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251840 00010000:00010000:1.0:1651529344.459194:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 4/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.459199:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252096 00000100:00100000:0.0:1651529344.459200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.459202:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 5/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.459206:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11012 00000100:00100000:1.0:1651529344.459208:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1725:41279:x1731746396251776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.459208:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.459210:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459212:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 4/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.459215:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 3/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459217:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966605824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459221:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2314d53/0xa29a79078f3badcf lrc: 0/0,0 mode: --/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d361e expref: 1725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459221:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459228:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966605696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.459231:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459232:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459232:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459233:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459236:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 4/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459237:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371456 00010000:00010000:1.0:1651529344.459243:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.459244:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371520 00000100:00100000:0.0:1651529344.459247:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371584 00000100:00100000:0.0:1651529344.459251:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152056 00000100:00100000:1.0:1651529344.459255:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396251776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459258:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11012 00000100:00100000:0.0:1651529344.459259:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+347:39030:x1731745946371456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.459263:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252032 00002000:00080000:0.0:1651529344.459265:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176848 count 1 00010000:00010000:1.0:1651529344.459266:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 5/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1724 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.459272:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11013 00000100:00100000:1.0:1651529344.459273:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396251904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.459276:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459277:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 4/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459277:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: --/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459280:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 3/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459283:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 2/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459285:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb31b0d3/0xa29a79078f3b90c5 lrc: 0/0,0 mode: --/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc53e expref: 1724 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459286:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459286:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459287:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 4/0,1 mode: --/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459294:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 3/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1724 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459296:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459296:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459297:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459300:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 4/0,1 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459300:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 4/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459305:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459308:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.459314:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1723:41279:x1731746396251904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459317:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11013 00000100:00100000:0.0:1651529344.459320:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459322:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11014 00000100:00100000:1.0:1651529344.459323:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1722:41279:x1731746396251840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.459325:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459326:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459327:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 4/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1722 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459328:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459331:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 3/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1722 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459331:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459334:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459335:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088cd1b3a/0xa29a79078f3bbd5e lrc: 0/0,0 mode: --/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7293 expref: 1722 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.459339:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459353:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459354:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459357:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 4/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459363:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.459369:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1721:41279:x1731746396251840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459372:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11014 00000100:00100000:1.0:1651529344.459376:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11015 00000100:00100000:1.0:1651529344.459378:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1720:41278:x1731746396252096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.459378:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+348:39029:x1731745946370880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (991us total) trans 30064892914 rc 0/0 00010000:00010000:1.0:1651529344.459380:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.459381:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152052 00010000:00010000:1.0:1651529344.459382:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 4/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1720 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.459386:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 3/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1720 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459386:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152057 00000100:00100000:0.0:1651529344.459388:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+347:39029:x1731745946371520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.459390:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ba6a5d2/0xa29a79078f3bb515 lrc: 0/0,0 mode: --/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5336 expref: 1720 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.459392:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176849 count 1 00010000:00010000:1.0:1651529344.459394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459395:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459396:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459401:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 2/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1719 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.459404:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459405:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459405:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 4/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459406:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 4/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459412:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 3/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1719 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459415:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.459421:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1719:41278:x1731746396252096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459423:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11015 00010000:00010000:0.0:1651529344.459424:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1719 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.459428:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11016 00000100:00100000:0.0:1651529344.459428:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966605952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.459429:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1718:41279:x1731746396252032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.459432:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459433:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 5/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.459436:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.459437:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 4/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1718 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459441:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459442:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459442:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459443:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459444:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459446:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 4/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459447:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459449:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.459450:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459454:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1718:41279:x1731746396252032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459463:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11016 00010000:00010000:1.0:1651529344.459470:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459474:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008720c51b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.459475:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459478:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 3/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459482:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 1/0,0 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459484:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008720c51b/0xa29a79078f3bd9f1 lrc: 0/0,0 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459487:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+348:39030:x1731745946370944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1077us total) trans 30064892915 rc 0/0 00010000:00010000:1.0:1651529344.459489:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459491:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e08cf94 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.459491:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152055 00010000:00010000:1.0:1651529344.459492:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459495:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 3/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459496:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152058 00000100:00100000:0.0:1651529344.459497:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+347:39030:x1731745946371584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.459502:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176850 count 1 00010000:00010000:1.0:1651529344.459506:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 1/0,0 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459506:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459509:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e08cf94/0xa29a79078f3bd9ff lrc: 0/0,0 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459510:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 2/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1717 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.459513:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459514:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459514:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 4/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459519:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c64eccc/0xa29a79078f3bb2ad lrc: 0/0,0 mode: --/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48f5 expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.459521:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 3/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1717 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.459523:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966605760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.459524:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 4/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1716 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.459526:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459528:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459529:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459532:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459535:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459535:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.459538:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459552:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459556:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.459557:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459560:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 3/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459565:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 1/0,0 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459568:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bd9f8 lrc: 0/0,0 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459588:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+348:39029:x1731745946371008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1075us (1184us total) trans 30064892916 rc 0/0 00000100:00100000:1.0:1651529344.459597:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152054 00010000:00010000:1.0:1651529344.459606:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459615:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459619:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459621:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 2/0,0 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459690:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+348:39030:x1731745946370816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1233us (1294us total) trans 30064892917 rc 0/0 00000100:00100000:1.0:1651529344.459693:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152053 00010000:00010000:1.0:1651529344.459700:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 2/0,0 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459704:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.459705:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 2/0,0 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459708:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 3/0,0 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459713:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 1/0,0 mode: --/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459728:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bd9ea lrc: 0/0,0 mode: --/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459747:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459750:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459753:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459756:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459773:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459789:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.459790:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459793:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 3/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459795:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+348:39030:x1731745946370752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1404us (1434us total) trans 30064892918 rc 0/0 00000100:00100000:1.0:1651529344.459798:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152051 00010000:00010000:0.0:1651529344.459798:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 1/0,0 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459820:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bd9e3 lrc: 0/0,0 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.459886:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371776 00000100:00100000:0.0:1651529344.459892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.459905:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371840 00000100:00100000:1.0:1651529344.459911:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152059 00000100:00100000:1.0:1651529344.459912:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+349:39029:x1731745946371776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.459918:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176851 count 1 00000100:00100000:0.0:1651529344.459926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.459933:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: --/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.459946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.459950:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 2/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1716 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.459952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.459953:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459954:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459955:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 4/0,1 mode: --/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.459967:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 3/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1716 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.459970:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459971:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 4/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1716 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.459975:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966606080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.459975:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459991:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459997:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252544 00010000:00010000:1.0:1651529344.460002:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 5/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460003:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966605952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.460006:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460009:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252672 00010000:00010000:1.0:1651529344.460012:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 4/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460014:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966605888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460016:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252608 00010000:00010000:0.0:1651529344.460016:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: --/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460018:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1719 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460023:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371904 00000100:00100000:0.0:1651529344.460030:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371968 00000100:00100000:1.0:1651529344.460033:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11017 00000100:00100000:0.0:1651529344.460034:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152060 00000100:00100000:1.0:1651529344.460035:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1719:41279:x1731746396252544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.460036:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+351:39030:x1731745946371840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.460038:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.460039:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 4/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1719 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.460041:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176852 count 1 00010000:00010000:1.0:1651529344.460043:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 3/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1719 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460045:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: --/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460048:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d8e1b5/0xa29a79078f3bc059 lrc: 0/0,0 mode: --/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e47 expref: 1719 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460050:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 2/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1719 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460052:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460052:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460053:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460053:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460053:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460054:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 4/0,1 mode: --/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460056:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 4/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460061:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 3/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1718 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460065:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.460072:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1718:41279:x1731746396252544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.460072:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 4/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.460075:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11017 00000100:00100000:0.0:1651529344.460077:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966606144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460084:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11018 00000100:00100000:0.0:1651529344.460086:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460092:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152061 00000100:00100000:1.0:1651529344.460093:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41279:x1731746396252672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.460094:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+351:39029:x1731745946371904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.460096:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.460097:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 4/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.460098:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176853 count 1 00010000:00010000:1.0:1651529344.460101:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 3/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460102:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460106:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3bb084 lrc: 0/0,0 mode: --/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40eb expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460109:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 2/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1717 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460110:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460110:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460111:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460112:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460112:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460113:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 4/0,1 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460114:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 4/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460119:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 3/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1716 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460123:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.460129:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1716:41279:x1731746396252672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.460130:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 4/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1716 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.460132:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11018 00000100:00100000:0.0:1651529344.460134:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966606208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460136:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11019 00000100:00100000:1.0:1651529344.460138:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1715:41278:x1731746396252608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.460140:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.460141:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1715 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460141:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.460146:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460149:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460151:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 3/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1715 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460152:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460154:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460156:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c3c703/0xa29a79078f3bb1f7 lrc: 0/0,0 mode: --/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4663 expref: 1715 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.460160:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460160:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460161:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460164:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 4/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460171:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.460178:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396252608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.460181:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11019 00000100:00100000:1.0:1651529344.460189:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152062 00000100:00100000:1.0:1651529344.460191:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+352:39030:x1731745946371968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.460195:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176854 count 1 00010000:00010000:1.0:1651529344.460199:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460204:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 2/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460216:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460217:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460218:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 4/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460218:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+352:39030:x1731745946371584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 719us (1017us total) trans 30064892919 rc 0/0 00000100:00100000:0.0:1651529344.460221:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152058 00010000:00010000:1.0:1651529344.460225:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 3/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460229:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1713 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460229:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460232:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e76f4e0 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.460233:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966606272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.460233:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460236:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 3/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460240:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.460241:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 1/0,0 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460244:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bda14 lrc: 0/0,0 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460250:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460253:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460256:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460259:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 2/0,0 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460271:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 2/0,0 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460275:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.460276:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 2/0,0 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460279:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 3/0,0 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460284:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 1/0,0 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460296:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bda0d lrc: 0/0,0 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460296:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+352:39029:x1731745946371520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (1110us total) trans 30064892920 rc 0/0 00000100:00100000:0.0:1651529344.460299:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152057 00010000:00010000:0.0:1651529344.460307:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460310:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460313:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460316:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 2/0,0 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460348:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+352:39030:x1731745946371456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1094us (1178us total) trans 30064892921 rc 0/0 00000100:00100000:0.0:1651529344.460350:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152056 00010000:00010000:0.0:1651529344.460369:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 2/0,0 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460372:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.460373:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 2/0,0 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460376:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 3/0,0 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460381:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 1/0,0 mode: --/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460384:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bda06 lrc: 0/0,0 mode: --/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.460454:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372032 00000100:00100000:0.0:1651529344.460462:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152063 00000100:00100000:0.0:1651529344.460464:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+352:39030:x1731745946372032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.460469:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176855 count 1 00010000:00010000:0.0:1651529344.460474:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460479:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 2/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460482:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460482:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460483:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 4/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460508:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 3/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460515:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 4/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460520:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966606336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460531:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.460640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.460646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.460655:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372480 00000100:00100000:1.0:1651529344.460656:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372544 00000100:00100000:0.0:1651529344.460664:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372608 00000100:00100000:0.0:1651529344.460669:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152064 00000100:00100000:0.0:1651529344.460671:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946372480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.460672:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152065 00000100:00100000:1.0:1651529344.460674:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+355:39029:x1731745946372544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.460676:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176856 count 1 00002000:00080000:1.0:1651529344.460679:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176857 count 1 00010000:00010000:0.0:1651529344.460681:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460683:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460685:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 2/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460688:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 2/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460688:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460689:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460689:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 4/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460691:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460691:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460692:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 4/0,1 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460696:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 3/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460699:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 3/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460702:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 4/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1713 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.460703:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 4/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460706:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966606400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460707:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966606464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460717:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.460718:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460723:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152066 00000100:00100000:0.0:1651529344.460725:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946372608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.460759:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176858 count 1 00010000:00010000:0.0:1651529344.460782:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: --/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460788:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 2/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460791:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460791:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460792:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 4/0,1 mode: --/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460799:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 3/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1713 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460833:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 4/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460848:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460858:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.460899:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966606080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.460904:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: --/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.460933:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966606272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.460936:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.460946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.460955:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252864 00000100:00100000:0.0:1651529344.460956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.460965:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 4/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1714 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460967:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966606208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460971:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252928 00010000:00010000:0.0:1651529344.460972:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460973:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 5/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1715 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.460977:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252992 00000100:00100000:0.0:1651529344.460979:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966606144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.460980:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 4/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1716 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.460982:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: --/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460983:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253056 00010000:00010000:1.0:1651529344.460985:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.460989:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11020 00000100:00100000:0.0:1651529344.460991:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41278:x1731746396252864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.460994:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.460995:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11021 00000100:00100000:1.0:1651529344.460996:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41279:x1731746396252928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.460996:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 4/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1717 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.460999:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461000:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 3/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1717 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461007:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 4/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461011:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 3/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461017:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3b9993 lrc: 0/0,0 mode: --/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce41d expref: 1717 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461017:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064026358/0xa29a79078f3b9820 lrc: 0/0,0 mode: --/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdedd expref: 1717 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461020:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461021:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461021:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461021:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461022:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461022:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461025:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 4/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461025:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 4/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461034:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.461045:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1715:41279:x1731746396252928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.461047:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11021 00000100:00100000:1.0:1651529344.461052:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11022 00000100:00100000:1.0:1651529344.461054:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396252992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.461056:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461058:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 4/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1714 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461070:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.461077:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 3/0,0 mode: PR/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1714 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.461078:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396252864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461081:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11020 00010000:00010000:1.0:1651529344.461082:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006a8e814/0xa29a79078f3bc1cc lrc: 0/0,0 mode: --/PR res: [0x2b2d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8444 expref: 1714 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461086:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461086:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461087:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461088:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11023 00010000:00010000:1.0:1651529344.461090:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 4/0,1 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461090:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1712:41279:x1731746396253056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.461093:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461094:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1712 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461099:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.461105:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 3/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1712 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.461106:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1712:41278:x1731746396252992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.461109:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11022 00010000:00010000:0.0:1651529344.461111:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ac624f/0xa29a79078f3b9e55 lrc: 0/0,0 mode: --/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7b8 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461117:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461120:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461123:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461134:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461134:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461135:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 2/0,0 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461135:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461139:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 4/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461153:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461161:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1710:41279:x1731746396253056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461164:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11023 00010000:00010000:0.0:1651529344.461172:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 2/0,0 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461175:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001f08e14 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.461176:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 2/0,0 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461179:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 3/0,0 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461183:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 1/0,0 mode: --/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461186:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f08e14/0xa29a79078f3bda1b lrc: 0/0,0 mode: --/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461192:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+356:39029:x1731745946371776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1278us (1317us total) trans 30064892922 rc 0/0 00000100:00100000:1.0:1651529344.461195:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152059 00010000:00010000:1.0:1651529344.461202:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461202:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461205:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461206:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461208:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,1 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461209:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461211:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 2/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461212:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 2/0,0 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461260:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+357:39029:x1731745946371904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1164us (1333us total) trans 30064892923 rc 0/0 00000100:00100000:1.0:1651529344.461261:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+357:39030:x1731745946371968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1069us (1314us total) trans 30064892924 rc 0/0 00000100:00100000:0.0:1651529344.461263:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152061 00000100:00100000:1.0:1651529344.461264:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152062 00010000:00010000:0.0:1651529344.461270:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 2/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461272:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 2/0,0 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461274:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.461275:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9b26e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.461275:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 2/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461277:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 2/0,0 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461278:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 3/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461282:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 1/0,0 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461288:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 3/0,0 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461293:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 1/0,0 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461294:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bda29 lrc: 0/0,0 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461296:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9b26e9/0xa29a79078f3bda30 lrc: 0/0,0 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461301:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461303:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461307:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461309:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 2/0,0 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461361:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+356:39030:x1731745946371840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1324us (1468us total) trans 30064892925 rc 0/0 00000100:00100000:0.0:1651529344.461364:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152060 00010000:00010000:0.0:1651529344.461372:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 2/0,0 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461375:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006724e0ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.461376:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 2/0,0 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461379:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 3/0,0 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461392:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 1/0,0 mode: --/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461395:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bda22 lrc: 0/0,0 mode: --/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.461461:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966606464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.461465:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.461480:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253120 00010000:00010000:1.0:1651529344.461485:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 5/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1710 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.461490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.461503:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253440 00010000:00010000:1.0:1651529344.461506:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 5/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.461510:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.461518:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253568 00010000:00010000:1.0:1651529344.461521:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 4/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1712 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.461525:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253696 00000100:00100000:0.0:1651529344.461530:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461534:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: --/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461538:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 4/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.461541:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966606400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.461544:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11024 00010000:00010000:0.0:1651529344.461544:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461546:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1713:41279:x1731746396253120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.461548:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461550:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 5/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.461550:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966606336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461553:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461554:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 3/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461559:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0850744/0xa29a79078f3b8128 lrc: 0/0,0 mode: --/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd5e expref: 1713 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461563:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461563:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461564:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461567:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 4/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461577:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.461588:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1712:41279:x1731746396253120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461591:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11025 00000100:00100000:1.0:1651529344.461592:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11024 00000100:00100000:0.0:1651529344.461593:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1712:41279:x1731746396253440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.461602:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11026 00010000:00010000:0.0:1651529344.461605:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461607:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 4/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.461611:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1711:41279:x1731746396253568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.461611:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 3/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461613:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461615:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 4/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461617:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c669c4dd/0xa29a79078f3ba707 lrc: 0/0,0 mode: --/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bd0 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461619:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 3/0,0 mode: PR/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461621:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461622:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461622:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461624:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ab9013/0xa29a79078f3bc11d lrc: 0/0,0 mode: --/PR res: [0x2b2d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81b2 expref: 1710 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461626:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 4/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461627:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461628:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461629:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461632:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 4/0,1 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461632:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.461638:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461640:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1709:41279:x1731746396253440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461642:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11025 00000100:00100000:1.0:1651529344.461645:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1709:41279:x1731746396253568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.461647:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11026 00000100:00100000:0.0:1651529344.461649:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11027 00000100:00100000:0.0:1651529344.461651:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1707:41279:x1731746396253696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.461653:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461654:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461655:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 4/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461658:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461668:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 3/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.461670:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,1 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461673:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 2/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461673:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086fac319/0xa29a79078f3b9ea2 lrc: 0/0,0 mode: --/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf89f expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.461677:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461677:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461678:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461687:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 4/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461693:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461712:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1706:41279:x1731746396253696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461715:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11027 00000100:00100000:1.0:1651529344.461716:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+356:39029:x1731745946372544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1076us total) trans 30064892926 rc 0/0 00000100:00100000:1.0:1651529344.461719:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152065 00010000:00010000:0.0:1651529344.461743:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 2/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461747:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088407caf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.461748:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 2/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461751:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 3/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461763:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 1/0,0 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461766:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088407caf/0xa29a79078f3bda45 lrc: 0/0,0 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461773:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461776:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461779:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461782:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 2/0,0 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461795:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 2/0,0 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461799:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096250629 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.461800:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 2/0,0 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461818:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 3/0,0 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461823:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 1/0,0 mode: --/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461826:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096250629/0xa29a79078f3bda4c lrc: 0/0,0 mode: --/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461843:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+356:39030:x1731745946372608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1117us (1196us total) trans 30064892927 rc 0/0 00000100:00100000:0.0:1651529344.461846:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152066 00010000:00010000:0.0:1651529344.461853:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461857:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461870:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461873:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 2/0,0 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461910:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+356:39030:x1731745946372480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1238us (1278us total) trans 30064892928 rc 0/0 00000100:00100000:0.0:1651529344.461913:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152064 00010000:00010000:0.0:1651529344.461919:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 2/0,0 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461923:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.461924:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 2/0,0 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461927:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 3/0,0 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461932:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 1/0,0 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461934:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bda3e lrc: 0/0,0 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461940:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461951:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461954:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461957:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 2/0,0 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461993:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+356:39030:x1731745946372032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1528us (1593us total) trans 30064892929 rc 0/0 00000100:00100000:0.0:1651529344.461996:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152063 00010000:00010000:0.0:1651529344.462002:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 2/0,0 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462005:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.462006:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 2/0,0 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462009:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 3/0,0 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 1/0,0 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462016:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bda37 lrc: 0/0,0 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.462100:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372864 00000100:00100000:1.0:1651529344.462133:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372928 00000100:00100000:0.0:1651529344.462137:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372992 00000100:00100000:1.0:1651529344.462143:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373120 00000100:00100000:0.0:1651529344.462146:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152067 00000100:00100000:0.0:1651529344.462148:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+359:39030:x1731745946372864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.462150:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152068 00000100:00100000:1.0:1651529344.462152:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+359:39029:x1731745946372928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.462153:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176859 count 1 00002000:00080000:1.0:1651529344.462157:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176860 count 1 00010000:00010000:1.0:1651529344.462161:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: --/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462166:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 2/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462169:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462170:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462171:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 4/0,1 mode: --/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462177:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 3/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462180:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462181:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 4/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.462185:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966606592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.462185:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 2/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462188:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462189:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462189:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 4/0,1 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462201:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462208:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152069 00000100:00100000:1.0:1651529344.462210:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+359:39030:x1731745946372992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.462214:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 3/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.462215:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176861 count 1 00010000:00010000:0.0:1651529344.462218:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 4/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462222:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462225:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: --/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462229:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 2/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462233:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462233:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462234:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 4/0,1 mode: --/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462239:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.462240:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 3/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462244:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 4/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462247:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152070 00000100:00100000:1.0:1651529344.462248:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966606720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462249:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+359:39030:x1731745946373120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.462254:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176862 count 1 00000100:00100000:1.0:1651529344.462256:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.462258:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: --/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462262:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 2/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462265:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462266:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462267:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 4/0,1 mode: --/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462273:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 3/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462277:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 4/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462281:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966606784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462287:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.462350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462363:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373568 00000100:00100000:0.0:1651529344.462397:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373632 00000100:00100000:0.0:1651529344.462414:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152071 00000100:00100000:0.0:1651529344.462415:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946373568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.462418:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152072 00000100:00100000:1.0:1651529344.462420:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+361:39030:x1731745946373632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.462421:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176863 count 1 00002000:00080000:1.0:1651529344.462425:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176864 count 1 00010000:00010000:0.0:1651529344.462425:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462429:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462430:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 2/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462433:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462434:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 2/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462434:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462434:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 4/0,1 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462441:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 3/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462444:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462447:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462448:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462448:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 4/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462448:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966606848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462456:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 3/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462460:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462460:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462464:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966606912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.462472:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.462475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462511:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373760 00000100:00100000:0.0:1651529344.462518:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373696 00000100:00100000:0.0:1651529344.462525:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152073 00000100:00100000:0.0:1651529344.462526:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+363:39030:x1731745946373760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.462528:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152074 00000100:00100000:1.0:1651529344.462530:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+363:39029:x1731745946373696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.462535:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176865 count 1 00002000:00080000:0.0:1651529344.462538:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176866 count 1 00010000:00010000:1.0:1651529344.462539:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462543:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 2/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1705 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462543:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: --/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462546:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462547:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462547:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 4/0,1 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462547:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 2/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462550:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462551:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462551:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 4/0,1 mode: --/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462558:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 3/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1705 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462561:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 4/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462565:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 3/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1705 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.462565:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966606976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462568:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 4/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1705 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.462573:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462576:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462580:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462649:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966606592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462653:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: --/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462697:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966606720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462700:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: --/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462702:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.462711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.462716:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254080 00000100:00100000:0.0:1651529344.462717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.462726:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 5/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.462742:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254016 00010000:00010000:1.0:1651529344.462745:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 4/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.462750:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254144 00000100:00100000:0.0:1651529344.462766:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966606784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.462770:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: --/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462774:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 4/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1708 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.462779:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254208 00010000:00010000:1.0:1651529344.462782:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 4/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1709 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.462787:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11028 00000100:00100000:1.0:1651529344.462788:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1709:41279:x1731746396254080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.462789:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966606656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462791:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.462792:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462793:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 4/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1709 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462796:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 3/0,0 mode: PR/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1709 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462798:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966606848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.462800:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462816:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc3915b/0xa29a79078f3ba55c lrc: 0/0,0 mode: --/PR res: [0x2b2db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1460 expref: 1709 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462820:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462821:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462822:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462825:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 4/0,1 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462833:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.462843:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462846:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462850:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1708:41279:x1731746396254080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.462853:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11028 00000100:00100000:1.0:1651529344.462858:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11029 00000100:00100000:1.0:1651529344.462860:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1707:41279:x1731746396254016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.462860:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,1 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462863:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.462863:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 2/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462864:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 4/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462868:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 3/0,0 mode: PR/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462880:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bb03e lrc: 0/0,0 mode: --/PR res: [0x2b2dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f8d expref: 1707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462884:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462884:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462885:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462888:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 4/0,1 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462893:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.462899:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1706:41279:x1731746396254016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.462902:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11029 00000100:00100000:0.0:1651529344.462907:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+364:39030:x1731745946372864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 758us (857us total) trans 30064892930 rc 0/0 00000100:00100000:0.0:1651529344.462910:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152067 00000100:00100000:1.0:1651529344.462914:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11030 00000100:00100000:1.0:1651529344.462915:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41279:x1731746396254144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.462918:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.462919:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 4/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.462920:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11031 00000100:00100000:0.0:1651529344.462922:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41279:x1731746396254208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.462923:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 3/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.462925:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.462927:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 4/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462928:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2304a6d/0xa29a79078f3bac8d lrc: 0/0,0 mode: --/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30e5 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.462931:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 3/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.462932:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462932:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462933:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462936:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 4/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462937:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b53dd25/0xa29a79078f3bb8e9 lrc: 0/0,0 mode: --/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61c9 expref: 1704 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.462940:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462941:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462942:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.462942:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462945:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 4/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462948:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1703:41279:x1731746396254144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.462950:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11030 00010000:00010000:0.0:1651529344.462951:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.462957:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 2/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462957:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1702:41279:x1731746396254208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (231us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.462960:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f558526 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.462960:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11031 00010000:00010000:1.0:1651529344.462967:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 2/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462971:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 3/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462971:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462974:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462975:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 1/0,0 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462978:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f558526/0xa29a79078f3bda5a lrc: 0/0,0 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462980:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462982:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 2/0,0 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462986:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462988:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462992:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462994:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 2/0,0 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463027:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946373120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 777us (943us total) trans 30064892931 rc 0/0 00000100:00100000:0.0:1651529344.463030:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152070 00010000:00010000:0.0:1651529344.463037:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 2/0,0 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463038:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+364:39030:x1731745946372992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 827us (963us total) trans 30064892932 rc 0/0 00000100:00100000:1.0:1651529344.463041:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152069 00010000:00010000:0.0:1651529344.463041:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463042:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 2/0,0 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463045:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 3/0,0 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463049:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463061:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463063:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 1/0,0 mode: --/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463064:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,1 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463066:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 2/0,0 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463067:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bda68 lrc: 0/0,0 mode: --/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463071:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 2/0,0 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463074:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463075:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 2/0,0 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463078:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 3/0,0 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463081:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 1/0,0 mode: --/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463084:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bda61 lrc: 0/0,0 mode: --/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463087:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 2/0,0 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463090:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463091:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 2/0,0 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463093:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 3/0,0 mode: PW/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463096:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 1/0,0 mode: --/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463101:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946372928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 949us (1037us total) trans 30064892933 rc 0/0 00010000:00010000:0.0:1651529344.463102:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bda53 lrc: 0/0,0 mode: --/PW res: [0x2b2dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463104:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152068 00000100:00100000:1.0:1651529344.463116:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966606912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463119:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.463146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463157:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254272 00010000:00010000:1.0:1651529344.463162:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1702 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463175:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254336 00010000:00010000:1.0:1651529344.463178:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1703 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.463182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463184:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254592 00010000:00010000:1.0:1651529344.463186:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 5/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1704 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.463192:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463199:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254400 00010000:00010000:1.0:1651529344.463202:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 5/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463206:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11032 00000100:00100000:1.0:1651529344.463208:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41278:x1731746396254272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.463215:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.463217:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.463221:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 3/0,0 mode: PR/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.463230:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966606976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463234:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3ba3f7 lrc: 0/0,0 mode: --/PR res: [0x2b2df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dec expref: 1705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.463235:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: --/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463238:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463238:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463239:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463242:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 4/0,1 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463243:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11033 00000100:00100000:0.0:1651529344.463245:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1704:41279:x1731746396254336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.463248:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.463251:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.463256:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1704 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463262:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1704:41278:x1731746396254272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.463264:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 3/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1704 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463271:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11032 00000100:00100000:1.0:1651529344.463276:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11034 00000100:00100000:1.0:1651529344.463277:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1703:41279:x1731746396254592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.463280:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.463282:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 5/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1703 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.463284:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007e4821e/0xa29a79078f3b9d60 lrc: 0/0,0 mode: --/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ac expref: 1703 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.463285:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 4/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1703 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.463289:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463290:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463290:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463291:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463291:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463292:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463294:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 4/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463295:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 4/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463299:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.463303:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.463312:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1702:41279:x1731746396254336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.463313:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1702:41279:x1731746396254592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463314:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11033 00000100:00100000:1.0:1651529344.463316:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11034 00000100:00100000:1.0:1651529344.463320:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11035 00000100:00100000:1.0:1651529344.463322:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1700:41278:x1731746396254400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.463324:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463325:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463329:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463332:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 4/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.463332:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,1 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463334:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 2/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463336:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 3/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.463341:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae423169/0xa29a79078f3ba475 lrc: 0/0,0 mode: --/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1000 expref: 1700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.463344:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463345:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463346:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463348:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 4/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463356:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.463363:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41278:x1731746396254400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.463365:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11035 00010000:00010000:1.0:1651529344.463376:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e7ac84/0xa29a79078f3b7822 lrc: 0/0,0 mode: --/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb626 expref: 1698 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463380:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.463382:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946373568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 966us (1032us total) trans 30064892934 rc 0/0 00010000:00010000:1.0:1651529344.463384:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463385:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152071 00010000:00010000:1.0:1651529344.463396:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463399:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463402:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463404:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463408:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 2/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463427:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000052c1122 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463428:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 2/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463431:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 3/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463436:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 1/0,0 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463438:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bda6f lrc: 0/0,0 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463443:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463446:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946373696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 915us (957us total) trans 30064892935 rc 0/0 00010000:00010000:0.0:1651529344.463446:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463447:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463449:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152074 00010000:00010000:0.0:1651529344.463449:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 3/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463452:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 1/0,0 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463457:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463457:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bda7d lrc: 0/0,0 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463460:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463463:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463464:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463466:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 2/0,0 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463467:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463470:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463473:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 2/0,0 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463520:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946373760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 993us (1045us total) trans 30064892936 rc 0/0 00000100:00100000:1.0:1651529344.463523:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946373632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1102us (1165us total) trans 30064892937 rc 0/0 00000100:00100000:0.0:1651529344.463523:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152073 00000100:00100000:1.0:1651529344.463526:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152072 00010000:00010000:0.0:1651529344.463531:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 2/0,0 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463534:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 2/0,0 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463534:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.463535:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 2/0,0 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463537:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.463538:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 2/0,0 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463538:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 3/0,0 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463541:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 3/0,0 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463543:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 1/0,0 mode: --/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463546:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 1/0,0 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463546:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bda84 lrc: 0/0,0 mode: --/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463549:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bda76 lrc: 0/0,0 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.463582:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374016 00000100:00100000:0.0:1651529344.463588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.463601:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373952 00000100:00100000:1.0:1651529344.463609:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152075 00000100:00100000:1.0:1651529344.463610:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+365:39030:x1731745946374016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.463615:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176868 count 1 00000100:00100000:0.0:1651529344.463615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.463624:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463629:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.463641:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 2/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463644:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463645:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463645:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 4/0,1 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463658:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 3/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463662:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 4/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.463669:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374144 00000100:00100000:1.0:1651529344.463673:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966607104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.463676:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374080 00000100:00100000:0.0:1651529344.463680:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152076 00000100:00100000:0.0:1651529344.463682:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+367:39029:x1731745946373952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.463688:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.463693:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176867 count 1 00000100:00100000:1.0:1651529344.463695:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152077 00000100:00100000:1.0:1651529344.463697:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+367:39030:x1731745946374144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.463698:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.463702:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176870 count 1 00010000:00010000:1.0:1651529344.463706:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: --/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463710:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 2/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463713:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463719:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 2/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1697 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463720:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463721:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 4/0,1 mode: --/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463722:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463722:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463723:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 4/0,1 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463728:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 3/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463740:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 4/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.463740:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 3/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1697 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.463744:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.463744:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 4/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1697 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.463748:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966607232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.463752:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.463758:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152078 00000100:00100000:0.0:1651529344.463758:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.463760:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+367:39029:x1731745946374080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.463764:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176869 count 1 00010000:00010000:1.0:1651529344.463768:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: --/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463772:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 2/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1697 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463775:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463776:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463777:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 4/0,1 mode: --/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463782:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 3/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1697 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.463802:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 4/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1697 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.463824:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966607296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.463837:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.463887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.463917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.463952:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966607104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.463954:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.463957:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463976:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463979:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: --/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.464007:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374208 00000100:00100000:1.0:1651529344.464015:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966607296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464015:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374272 00010000:00010000:1.0:1651529344.464018:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: --/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464018:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374336 00000100:00100000:0.0:1651529344.464024:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374400 00000100:00100000:0.0:1651529344.464027:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152079 00000100:00100000:0.0:1651529344.464029:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+371:39029:x1731745946374208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.464032:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152080 00000100:00100000:1.0:1651529344.464034:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+371:39030:x1731745946374272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.464034:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176871 count 1 00010000:00010000:0.0:1651529344.464039:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: --/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.464040:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176872 count 1 00010000:00010000:1.0:1651529344.464044:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464044:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 2/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464047:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464047:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464048:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 4/0,1 mode: --/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464058:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 2/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464058:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 3/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464061:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 4/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464062:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464062:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464063:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 4/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464065:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966607360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464070:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 3/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464073:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 4/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464076:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.464077:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966607424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464082:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152081 00000100:00100000:0.0:1651529344.464084:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+371:39029:x1731745946374336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.464086:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.464088:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176873 count 1 00010000:00010000:0.0:1651529344.464092:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464110:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 2/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464113:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464114:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464115:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 4/0,1 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464122:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 3/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464125:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 4/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464130:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966607488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464137:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.464144:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152082 00000100:00100000:0.0:1651529344.464145:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+371:39030:x1731745946374400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.464150:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176874 count 1 00010000:00010000:0.0:1651529344.464153:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464157:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 2/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464160:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464161:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464161:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 4/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464167:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 3/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1697 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464170:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 4/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464174:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966607552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464180:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.464187:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966607232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464200:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.464245:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.464255:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255104 00000100:00100000:0.0:1651529344.464258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.464266:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 4/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464271:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.464283:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255040 00010000:00010000:1.0:1651529344.464285:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 4/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1699 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464290:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255232 00010000:00010000:1.0:1651529344.464292:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 4/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1700 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464302:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255168 00010000:00010000:0.0:1651529344.464307:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 4/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1701 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464311:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11036 00000100:00100000:1.0:1651529344.464313:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1701:41279:x1731746396255104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.464315:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11037 00010000:00010000:1.0:1651529344.464316:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.464317:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1701:41278:x1731746396255040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.464318:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 4/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464320:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464321:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 3/0,0 mode: PR/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464321:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 4/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464325:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 3/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464326:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000364f887/0xa29a79078f3ba467 lrc: 0/0,0 mode: --/PR res: [0x2b2e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fba expref: 1701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464330:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464331:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464331:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464332:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bbf4f lrc: 0/0,0 mode: --/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a18 expref: 1700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464335:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 4/0,1 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464336:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464336:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464337:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464341:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.464354:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41279:x1731746396255104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.464357:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11036 00000100:00100000:1.0:1651529344.464362:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11038 00000100:00100000:1.0:1651529344.464370:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1698:41279:x1731746396255232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.464370:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 4/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464373:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464374:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 4/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1698 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464378:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 3/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1698 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464380:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.464389:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008027bc0/0xa29a79078f3b98ba lrc: 0/0,0 mode: --/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0d5 expref: 1698 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464389:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1698:41278:x1731746396255040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.464392:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11037 00010000:00010000:1.0:1651529344.464393:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464395:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464398:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 4/0,1 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464398:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11039 00000100:00100000:0.0:1651529344.464400:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1696:41278:x1731746396255168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.464403:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464406:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.464411:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 4/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1696 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464413:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1696:41279:x1731746396255232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.464415:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 3/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1696 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464416:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11038 00010000:00010000:0.0:1651529344.464421:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3b7eea lrc: 0/0,0 mode: --/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc2a expref: 1695 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464424:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464425:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464426:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464428:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464429:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 4/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464432:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464444:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.464449:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,1 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464451:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41278:x1731746396255168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.464452:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 2/0,0 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464454:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11039 00010000:00010000:0.0:1651529344.464467:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 2/0,0 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464470:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.464472:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 2/0,0 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464474:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 3/0,0 mode: PW/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464479:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 1/0,0 mode: --/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464481:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bda99 lrc: 0/0,0 mode: --/PW res: [0x2b2e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464487:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464490:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464494:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+372:39030:x1731745946374144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 796us (878us total) trans 30064892938 rc 0/0 00000100:00100000:1.0:1651529344.464497:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152077 00010000:00010000:0.0:1651529344.464503:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,1 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464504:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464505:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 2/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464507:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464511:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464513:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 2/0,0 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464547:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+373:39029:x1731745946373952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 864us (958us total) trans 30064892939 rc 0/0 00000100:00100000:1.0:1651529344.464548:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+373:39029:x1731745946374080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 787us (918us total) trans 30064892940 rc 0/0 00000100:00100000:0.0:1651529344.464550:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152076 00000100:00100000:1.0:1651529344.464552:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152078 00010000:00010000:0.0:1651529344.464558:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 2/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464559:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 2/0,0 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464561:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.464562:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 2/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464565:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 3/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464572:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.464573:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 2/0,0 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464576:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 3/0,0 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464581:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 1/0,0 mode: --/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464584:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdaa0 lrc: 0/0,0 mode: --/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464585:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 1/0,0 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464591:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464594:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464596:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bda92 lrc: 0/0,0 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464597:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464600:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 2/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464654:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+372:39030:x1731745946374016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1065us total) trans 30064892941 rc 0/0 00000100:00100000:1.0:1651529344.464664:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152075 00000100:00100000:1.0:1651529344.464675:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966607424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.464679:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464689:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.464693:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255296 00010000:00010000:1.0:1651529344.464697:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 4/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464704:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255360 00010000:00010000:1.0:1651529344.464706:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 5/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.464723:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255424 00010000:00010000:1.0:1651529344.464726:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 5/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1696 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.464744:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255488 00010000:00010000:1.0:1651529344.464747:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 5/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464752:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11040 00000100:00100000:1.0:1651529344.464754:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1697:41278:x1731746396255296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.464760:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966607552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464762:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464764:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 4/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464765:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464772:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966607488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464775:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464777:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 3/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464780:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 2/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464782:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a034fa5e/0xa29a79078f3baac6 lrc: 0/0,0 mode: --/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a32 expref: 1697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464783:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000903748fd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.464784:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 2/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464786:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464787:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464787:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 3/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464788:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464791:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 4/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464798:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.464822:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1696:41278:x1731746396255296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.464825:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11040 00010000:00010000:0.0:1651529344.464827:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 1/0,0 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464830:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11041 00010000:00010000:0.0:1651529344.464830:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bda8b lrc: 0/0,0 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464832:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1695:41279:x1731746396255360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.464835:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464836:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 4/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464840:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 3/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.464845:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966607360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464848:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: --/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464852:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcd747ba/0xa29a79078f3bb6b2 lrc: 0/0,0 mode: --/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5909 expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464856:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464856:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464857:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464860:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 4/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464868:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.464874:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11042 00000100:00100000:1.0:1651529344.464875:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41279:x1731746396255360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.464877:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41278:x1731746396255424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.464878:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11041 00010000:00010000:0.0:1651529344.464880:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.464882:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11043 00010000:00010000:0.0:1651529344.464882:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 4/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.464884:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1693:41279:x1731746396255488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.464886:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 3/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464887:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.464888:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 4/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464892:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 3/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464892:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000181394d4/0xa29a79078f3bb45f lrc: 0/0,0 mode: --/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d508f expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.464897:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40e5fa5/0xa29a79078f3bb7fb lrc: 0/0,0 mode: --/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5df5 expref: 1692 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.464905:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464906:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464907:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464909:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464910:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464910:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 4/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464911:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464914:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 4/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464917:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.464922:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.464930:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1691:41278:x1731746396255424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.464931:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1691:41279:x1731746396255488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.464933:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11043 00000100:00100000:0.0:1651529344.464935:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11042 00010000:00010000:1.0:1651529344.464940:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464943:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464944:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464946:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464947:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464949:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464950:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464952:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 2/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464989:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+373:39030:x1731745946374272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 953us (1071us total) trans 30064892942 rc 0/0 00000100:00100000:1.0:1651529344.464991:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152080 00000100:00100000:0.0:1651529344.464993:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+373:39029:x1731745946374336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (1039us total) trans 30064892943 rc 0/0 00000100:00100000:0.0:1651529344.465004:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152081 00010000:00010000:1.0:1651529344.465007:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465010:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e76f4e0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.465011:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465012:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465014:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 3/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465015:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465018:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 1/0,0 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465018:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465020:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 2/0,0 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465021:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdaae lrc: 0/0,0 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465026:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 2/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465028:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.465029:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 2/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465032:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 3/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465035:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 1/0,0 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465045:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdab5 lrc: 0/0,0 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465049:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 2/0,0 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465052:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.465053:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 2/0,0 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465054:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+372:39030:x1731745946374400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (1075us total) trans 30064892944 rc 0/0 00010000:00010000:1.0:1651529344.465056:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 3/0,0 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465057:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152082 00010000:00010000:1.0:1651529344.465059:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 1/0,0 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465062:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdabc lrc: 0/0,0 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465065:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465068:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465071:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465074:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 2/0,0 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465105:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+372:39029:x1731745946374208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1075us (1228us total) trans 30064892945 rc 0/0 00000100:00100000:0.0:1651529344.465107:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152079 00010000:00010000:0.0:1651529344.465113:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 2/0,0 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465116:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.465117:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 2/0,0 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465120:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 3/0,0 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465125:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 1/0,0 mode: --/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465128:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdaa7 lrc: 0/0,0 mode: --/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.465198:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374976 00000100:00100000:1.0:1651529344.465205:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375040 00000100:00100000:1.0:1651529344.465209:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375168 00000100:00100000:1.0:1651529344.465228:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375104 00000100:00100000:1.0:1651529344.465239:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152083 00000100:00100000:0.0:1651529344.465243:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152084 00000100:00100000:0.0:1651529344.465245:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+375:39030:x1731745946375040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.465246:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+375:39029:x1731745946374976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.465251:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176875 count 1 00002000:00080000:0.0:1651529344.465251:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176876 count 1 00010000:00010000:0.0:1651529344.465255:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: --/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465262:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465267:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 2/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.465270:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465271:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465271:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 4/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465278:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 3/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.465282:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 4/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.465284:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 2/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.465286:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966607616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.465287:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465288:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465289:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 4/0,1 mode: --/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465296:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 3/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.465301:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.465308:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152085 00010000:00010000:0.0:1651529344.465309:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 4/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.465310:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012c9051d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+375:39030:x1731745946375168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.465314:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176878 count 1 00000100:00100000:0.0:1651529344.465314:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966607680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.465318:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: --/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465322:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 2/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.465323:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.465330:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152086 00000100:00100000:0.0:1651529344.465332:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+375:39029:x1731745946375104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.465335:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465336:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465336:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 4/0,1 mode: --/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.465336:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176877 count 1 00010000:00010000:0.0:1651529344.465340:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: --/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465343:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 3/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465344:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 2/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.465347:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 4/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.465347:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465348:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465349:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 4/0,1 mode: --/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465351:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.465355:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 3/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.465358:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.465358:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 4/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.465365:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966607808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.465371:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.465410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465438:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465449:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.465458:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375232 00000100:00100000:0.0:1651529344.465462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.465465:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375296 00000100:00100000:1.0:1651529344.465473:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375360 00000100:00100000:1.0:1651529344.465478:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375424 00000100:00100000:1.0:1651529344.465482:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152087 00000100:00100000:1.0:1651529344.465483:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+379:39029:x1731745946375232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.465491:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152088 00000100:00100000:0.0:1651529344.465493:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+379:39030:x1731745946375296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.465494:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176879 count 1 00010000:00010000:1.0:1651529344.465498:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: --/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.465498:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176880 count 1 00010000:00010000:0.0:1651529344.465502:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465503:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 2/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465507:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 2/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1689 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465510:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465511:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465511:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 4/0,1 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465516:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465517:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465517:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 4/0,1 mode: --/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465518:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 3/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1689 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465522:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 4/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1689 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.465524:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 3/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.465528:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 4/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.465529:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966607872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.465532:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966607936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.465548:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.465554:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152089 00000100:00100000:1.0:1651529344.465556:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+379:39029:x1731745946375360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.465556:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.465560:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176881 count 1 00000100:00100000:0.0:1651529344.465562:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152090 00010000:00010000:1.0:1651529344.465564:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: --/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465564:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+379:39030:x1731745946375424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.465568:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 2/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.465569:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176882 count 1 00010000:00010000:1.0:1651529344.465571:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465572:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465572:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 4/0,1 mode: --/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465573:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465577:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 2/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465580:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465581:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465581:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 4/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465588:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 3/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465588:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 3/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1689 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.465591:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 4/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.465592:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 4/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1689 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.465595:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.465596:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.465604:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.465605:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.466031:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966607616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466035:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.466056:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966607744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466064:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: --/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.466070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.466071:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256128 00010000:00010000:1.0:1651529344.466080:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 4/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466088:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256064 00010000:00010000:1.0:1651529344.466090:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 5/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1691 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.466095:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256256 00010000:00010000:1.0:1651529344.466108:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 5/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1692 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466113:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256192 00010000:00010000:1.0:1651529344.466115:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 4/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.466119:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256320 00010000:00010000:1.0:1651529344.466121:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 5/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466125:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11044 00000100:00100000:1.0:1651529344.466127:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41279:x1731746396256128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.466130:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.466130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.466131:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 4/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466135:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 3/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.466141:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c09128ca/0xa29a79078f3bb825 lrc: 0/0,0 mode: --/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb9 expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466151:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466152:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466153:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.466168:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966607680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466170:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 4/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466172:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: --/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466177:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.466179:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966607808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466182:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: --/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466190:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1693:41279:x1731746396256128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.466193:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11044 00000100:00100000:0.0:1651529344.466194:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966607872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466197:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466199:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256448 00010000:00010000:1.0:1651529344.466202:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 5/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466204:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466206:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466207:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256384 00010000:00010000:1.0:1651529344.466209:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 4/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1694 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466212:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256512 00000100:00100000:1.0:1651529344.466213:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11045 00000100:00100000:1.0:1651529344.466215:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1695:41278:x1731746396256064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.466217:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466217:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 5/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466218:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 4/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466222:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 3/0,0 mode: PR/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466226:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11046 00010000:00010000:1.0:1651529344.466227:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e9e2d41/0xa29a79078f3bb283 lrc: 0/0,0 mode: --/PR res: [0x2b2ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d485b expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466228:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1695:41279:x1731746396256256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.466231:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466233:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 4/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466236:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 3/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466238:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466238:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466239:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466242:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 4/0,1 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466242:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a41fa1ce/0xa29a79078f3baa72 lrc: 0/0,0 mode: --/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d282c expref: 1694 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466246:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466246:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466247:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466250:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.466257:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1693:41278:x1731746396256064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.466257:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 4/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466260:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11045 00010000:00010000:0.0:1651529344.466264:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.466269:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11047 00000100:00100000:1.0:1651529344.466271:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1692:41278:x1731746396256192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.466272:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1692:41279:x1731746396256256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.466273:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.466275:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 4/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1692 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466275:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11046 00010000:00010000:1.0:1651529344.466279:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 3/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1691 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.466280:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11048 00000100:00100000:0.0:1651529344.466282:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1691:41278:x1731746396256320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.466283:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3b9efd lrc: 0/0,0 mode: --/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa19 expref: 1691 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466285:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466286:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 5/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1691 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466287:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466290:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 4/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466294:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466294:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466295:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466296:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466296:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466298:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 4/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466299:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 4/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466303:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.466305:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.466307:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41278:x1731746396256320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.466310:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11048 00000100:00100000:1.0:1651529344.466312:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41278:x1731746396256192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.466313:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11049 00000100:00100000:1.0:1651529344.466315:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11047 00000100:00100000:0.0:1651529344.466315:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41278:x1731746396256448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.466317:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466319:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 4/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1688 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466320:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11050 00000100:00100000:1.0:1651529344.466321:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1688:41278:x1731746396256384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.466322:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 3/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1688 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466324:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.466325:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 4/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1688 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466327:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f16537a/0xa29a79078f3bbae8 lrc: 0/0,0 mode: --/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68d0 expref: 1688 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466329:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 3/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1688 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466330:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466331:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466331:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466334:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000205272ba/0xa29a79078f3b96ec lrc: 0/0,0 mode: --/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd957 expref: 1687 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466334:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 4/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466337:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466338:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466339:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466340:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.466344:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1686:41278:x1731746396256448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.466347:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11049 00010000:00010000:1.0:1651529344.466350:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 4/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466351:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11051 00000100:00100000:0.0:1651529344.466353:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1685:41279:x1731746396256512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.466355:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466356:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 5/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1685 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.466358:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.466365:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1685:41278:x1731746396256384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.466367:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 4/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1685 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466368:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11050 00010000:00010000:0.0:1651529344.466372:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466373:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466374:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466376:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466377:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 4/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466379:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466381:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.466382:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466385:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466386:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1684:41279:x1731746396256512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.466389:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11051 00010000:00010000:0.0:1651529344.466395:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466398:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466402:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466404:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 2/0,0 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466429:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+381:39029:x1731745946374976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1187us (1273us total) trans 30064892946 rc 0/0 00000100:00100000:1.0:1651529344.466432:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152083 00010000:00010000:1.0:1651529344.466439:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466442:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.466450:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466453:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+380:39029:x1731745946375104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1264us total) trans 30064892947 rc 0/0 00010000:00010000:1.0:1651529344.466454:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 3/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466457:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152086 00010000:00010000:1.0:1651529344.466458:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 1/0,0 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466461:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdaca lrc: 0/0,0 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466464:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 2/0,0 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466468:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466470:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.466471:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466471:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 2/0,0 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466474:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466474:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 3/0,0 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466476:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 2/0,0 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466479:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 1/0,0 mode: --/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466488:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdad8 lrc: 0/0,0 mode: --/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466493:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 2/0,0 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466496:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.466497:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 2/0,0 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466500:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 3/0,0 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466503:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 1/0,0 mode: --/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466508:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdad1 lrc: 0/0,0 mode: --/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466514:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466515:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012c9051d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946375168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1204us (1335us total) trans 30064892948 rc 0/0 00010000:00010000:0.0:1651529344.466517:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466518:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152085 00010000:00010000:0.0:1651529344.466520:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466523:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 2/0,0 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466529:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bbe1b lrc: 0/0,0 mode: --/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75aa expref: 1683 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.466548:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466552:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466555:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466558:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466561:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466564:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 2/0,0 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466581:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946375424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1015us (1118us total) trans 30064892949 rc 0/0 00000100:00100000:0.0:1651529344.466584:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152090 00010000:00010000:0.0:1651529344.466591:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466594:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466597:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466602:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 2/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466604:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+380:39029:x1731745946375360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1155us total) trans 30064892950 rc 0/0 00000100:00100000:1.0:1651529344.466607:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152089 00010000:00010000:1.0:1651529344.466615:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 2/0,0 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466618:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.466619:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 2/0,0 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466631:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 3/0,0 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466636:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 1/0,0 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466637:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946375296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1144us (1199us total) trans 30064892951 rc 0/0 00010000:00010000:1.0:1651529344.466639:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdaf4 lrc: 0/0,0 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466640:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152088 00010000:00010000:1.0:1651529344.466643:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 2/0,0 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466646:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.466646:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 2/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466647:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 2/0,0 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466650:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 3/0,0 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466650:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0cd2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.466651:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 2/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466653:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 1/0,0 mode: --/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466654:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 3/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466655:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdaed lrc: 0/0,0 mode: --/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466658:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 1/0,0 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466661:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48e0cd2/0xa29a79078f3bdae6 lrc: 0/0,0 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466665:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf224cb1/0xa29a79078f3b9bf4 lrc: 0/0,0 mode: --/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceda8 expref: 1682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.466666:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466669:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466673:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,1 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466674:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966607936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466675:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 2/0,0 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466678:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466681:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466690:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466694:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466696:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 2/0,0 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466721:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+381:39030:x1731745946375040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1476us (1552us total) trans 30064892952 rc 0/0 00000100:00100000:0.0:1651529344.466724:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152084 00000100:00100000:1.0:1651529344.466746:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+380:39029:x1731745946375232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1262us (1336us total) trans 30064892953 rc 0/0 00000100:00100000:1.0:1651529344.466749:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152087 00010000:00010000:0.0:1651529344.466755:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 2/0,0 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466758:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 2/0,0 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466758:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.466759:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 2/0,0 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466761:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.466762:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 2/0,0 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466762:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 3/0,0 mode: PW/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466767:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 1/0,0 mode: --/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466769:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdac3 lrc: 0/0,0 mode: --/PW res: [0x2b2ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466774:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 3/0,0 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466779:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 1/0,0 mode: --/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466782:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdadf lrc: 0/0,0 mode: --/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.466981:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376000 00000100:00100000:1.0:1651529344.466992:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152091 00000100:00100000:1.0:1651529344.466994:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946376000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.467000:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176883 count 1 00010000:00010000:1.0:1651529344.467004:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467017:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 2/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.467020:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467021:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467021:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 4/0,1 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467024:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376064 00010000:00010000:1.0:1651529344.467028:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 3/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467031:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152092 00000100:00100000:0.0:1651529344.467033:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+381:39030:x1731745946376064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.467038:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176884 count 1 00010000:00010000:1.0:1651529344.467042:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.467047:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966608128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.467051:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: --/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467056:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 2/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.467061:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467066:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467066:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467067:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 4/0,1 mode: --/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467090:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 3/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467094:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 4/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467098:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966608192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467107:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.467120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.467134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.467145:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376192 00000100:00100000:1.0:1651529344.467155:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376128 00000100:00100000:0.0:1651529344.467167:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152093 00000100:00100000:1.0:1651529344.467170:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152094 00000100:00100000:0.0:1651529344.467170:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+383:39030:x1731745946376192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.467172:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+383:39030:x1731745946376128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.467177:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176885 count 1 00010000:00010000:1.0:1651529344.467181:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467186:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 2/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1681 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467189:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467189:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467190:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 4/0,1 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467202:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 3/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1681 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467205:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 4/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1681 pid: 142994 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.467206:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176886 count 1 00010000:00010000:0.0:1651529344.467211:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: --/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467216:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 2/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.467219:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.467219:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467220:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467220:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 4/0,1 mode: --/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467227:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 3/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.467228:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467231:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 4/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467235:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467243:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.467257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.467270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.467280:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376320 00000100:00100000:1.0:1651529344.467290:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376256 00000100:00100000:0.0:1651529344.467302:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.467305:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376448 00000100:00100000:1.0:1651529344.467313:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152095 00000100:00100000:1.0:1651529344.467315:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+386:39030:x1731745946376320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.467315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.467320:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176888 count 1 00000100:00100000:0.0:1651529344.467322:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376384 00010000:00010000:1.0:1651529344.467324:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: --/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467328:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 2/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467328:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152096 00000100:00100000:0.0:1651529344.467330:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+387:39029:x1731745946376256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.467332:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467332:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467333:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 4/0,1 mode: --/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.467336:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176887 count 1 00010000:00010000:1.0:1651529344.467339:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467340:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: --/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467343:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.467345:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 2/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.467347:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966608384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.467348:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467349:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467350:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 4/0,1 mode: --/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467367:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.467374:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152097 00000100:00100000:1.0:1651529344.467376:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+387:39030:x1731745946376448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.467378:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.467381:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176890 count 1 00010000:00010000:0.0:1651529344.467382:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467384:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467386:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966608448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.467389:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 2/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467392:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467392:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467393:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 4/0,1 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467394:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.467399:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 3/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467401:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152098 00010000:00010000:1.0:1651529344.467402:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 4/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467402:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+387:39029:x1731745946376384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.467406:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966608512:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.467407:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176889 count 1 00010000:00010000:0.0:1651529344.467410:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467413:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467434:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 2/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467437:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467438:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467439:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 4/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467446:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1681 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467450:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467454:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966608576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467462:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.467509:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966608128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.467513:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467525:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.467537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.467538:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257152 00010000:00010000:1.0:1651529344.467543:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 5/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.467550:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257088 00010000:00010000:1.0:1651529344.467553:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1683 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467566:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.467576:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257216 00010000:00010000:1.0:1651529344.467579:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 5/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1684 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.467584:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11052 00000100:00100000:1.0:1651529344.467586:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1684:41279:x1731746396257152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.467589:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.467590:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 5/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1684 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467593:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 4/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1684 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467596:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.467601:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: --/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467606:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467607:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467607:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467617:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 4/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467621:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3ba0c4 lrc: 0/0,0 mode: --/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00cc expref: 1684 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467622:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.467626:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966608192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.467629:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1683:41279:x1731746396257152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (105us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.467630:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467632:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11052 00010000:00010000:0.0:1651529344.467633:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467636:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467639:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467641:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11053 00010000:00010000:0.0:1651529344.467641:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 2/0,0 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467643:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1682:41278:x1731746396257088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.467645:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.467647:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467651:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 3/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467655:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3ba3a3 lrc: 0/0,0 mode: --/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c95 expref: 1682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467659:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467659:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467660:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467663:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 4/0,1 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467676:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.467683:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1681:41278:x1731746396257088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.467685:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11053 00000100:00100000:1.0:1651529344.467690:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11054 00000100:00100000:1.0:1651529344.467691:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41278:x1731746396257216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.467692:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+388:39030:x1731745946376064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 658us (675us total) trans 30064892954 rc 0/0 00010000:00010000:1.0:1651529344.467694:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.467695:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 5/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1680 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467695:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152092 00010000:00010000:1.0:1651529344.467699:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 4/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1680 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.467703:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 2/0,0 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467709:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467710:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467711:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467714:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 4/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467718:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.467720:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006724e0ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.467721:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 2/0,0 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467724:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41278:x1731746396257216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.467724:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 3/0,0 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467726:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11054 00010000:00010000:0.0:1651529344.467729:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 1/0,0 mode: --/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467741:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdb02 lrc: 0/0,0 mode: --/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467745:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b5f093f/0xa29a79078f3b785a lrc: 0/0,0 mode: --/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ea expref: 1679 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.467756:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.467759:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467762:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467765:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467768:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467771:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467836:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467840:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.467842:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467845:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 3/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467849:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 1/0,0 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467852:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdb09 lrc: 0/0,0 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467860:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257280 00000100:00100000:1.0:1651529344.467865:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+388:39030:x1731745946376128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 693us (731us total) trans 30064892955 rc 0/0 00000100:00100000:1.0:1651529344.467869:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152094 00010000:00010000:0.0:1651529344.467872:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 4/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.467883:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11055 00000100:00100000:1.0:1651529344.467885:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966608384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467885:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1679:41279:x1731746396257280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.467888:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.467889:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: --/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467890:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 4/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.467894:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 3/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.467897:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467899:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006483fcc7/0xa29a79078f3bc37e lrc: 0/0,0 mode: --/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b1a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.467903:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467903:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467904:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467907:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 4/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467909:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467913:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,1 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467915:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 2/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467929:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.467937:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1678:41279:x1731746396257280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.467940:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11055 00010000:00010000:0.0:1651529344.467947:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467950:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467953:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+388:39030:x1731745946376000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 958us (983us total) trans 30064892956 rc 0/0 00000100:00100000:1.0:1651529344.467956:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152091 00010000:00010000:0.0:1651529344.467956:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467959:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 2/0,0 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467963:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 2/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467966:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.467967:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 2/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467970:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 3/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467975:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 1/0,0 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467977:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdafb lrc: 0/0,0 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467990:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 2/0,0 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467993:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3e400c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.467994:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 2/0,0 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467996:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 3/0,0 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468000:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 1/0,0 mode: --/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468002:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdb10 lrc: 0/0,0 mode: --/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468009:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+388:39030:x1731745946376192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 839us (888us total) trans 30064892957 rc 0/0 00000100:00100000:0.0:1651529344.468012:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152093 00000100:00100000:0.0:1651529344.468028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.468121:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966608512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.468124:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.468143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.468151:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257408 00000100:00100000:0.0:1651529344.468152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.468161:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1678 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468162:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.468171:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257600 00010000:00010000:1.0:1651529344.468174:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468174:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966608448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468178:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: --/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468186:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257664 00010000:00010000:1.0:1651529344.468189:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 4/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1680 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468193:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257792 00010000:00010000:1.0:1651529344.468195:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 5/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468199:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11056 00000100:00100000:1.0:1651529344.468201:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1681:41279:x1731746396257408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.468201:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966608576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.468203:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468204:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468205:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468208:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468211:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377024 00010000:00010000:1.0:1651529344.468214:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cb268c/0xa29a79078f3baed9 lrc: 0/0,0 mode: --/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39f2 expref: 1681 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468217:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.468222:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152099 00010000:00010000:1.0:1651529344.468224:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.468224:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+388:39030:x1731745946377024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.468225:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468228:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 4/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.468229:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176891 count 1 00010000:00010000:0.0:1651529344.468234:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468238:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 2/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1680 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468241:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.468241:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468242:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468243:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 4/0,1 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468249:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 3/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1680 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.468253:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41279:x1731746396257408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468255:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11056 00010000:00010000:0.0:1651529344.468260:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 4/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1679 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468261:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11057 00000100:00100000:1.0:1651529344.468262:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1679:41278:x1731746396257600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.468264:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.468265:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.468266:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468270:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468273:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.468275:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009837f552/0xa29a79078f3bc3d9 lrc: 0/0,0 mode: --/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c6a expref: 1679 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468279:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468280:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468280:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468280:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11058 00000100:00100000:0.0:1651529344.468281:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1678:41279:x1731746396257664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.468283:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 4/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468285:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468286:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 4/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1678 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468291:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.468296:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1678:41278:x1731746396257600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468305:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11057 00000100:00100000:1.0:1651529344.468310:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11059 00000100:00100000:1.0:1651529344.468311:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1677:41279:x1731746396257792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.468312:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 3/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468314:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.468315:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 4/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.468319:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 3/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.468319:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef2d50ee/0xa29a79078f3bbb6d lrc: 0/0,0 mode: --/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b70 expref: 1677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.468322:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468323:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468324:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000527c159a/0xa29a79078f3b9ce9 lrc: 0/0,0 mode: --/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf224 expref: 1676 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.468324:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468327:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 4/0,1 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468328:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468328:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468329:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468332:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 4/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468337:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.468344:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1675:41279:x1731746396257664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.468347:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.468353:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11058 00000100:00100000:1.0:1651529344.468354:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1675:41279:x1731746396257792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468356:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11059 00010000:00010000:0.0:1651529344.468361:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468364:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468367:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468368:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468370:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468378:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468381:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,1 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468384:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 2/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468413:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+390:39029:x1731745946376384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1009us (1102us total) trans 30064892958 rc 0/0 00000100:00100000:0.0:1651529344.468416:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152098 00010000:00010000:0.0:1651529344.468423:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468424:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+389:39030:x1731745946376448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1122us total) trans 30064892959 rc 0/0 00010000:00010000:0.0:1651529344.468426:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fde70ff5 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.468427:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152097 00010000:00010000:0.0:1651529344.468427:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468430:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 3/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468435:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 2/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468435:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 1/0,0 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468438:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.468438:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdb2c lrc: 0/0,0 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468439:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 2/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468442:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 3/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468443:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468446:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468447:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 1/0,0 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468449:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdb25 lrc: 0/0,0 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468449:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468452:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 2/0,0 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468461:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 2/0,0 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468464:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004a4e8bd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.468465:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 2/0,0 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468468:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 3/0,0 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468471:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 1/0,0 mode: --/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468474:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdb1e lrc: 0/0,0 mode: --/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468479:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468482:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468485:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468486:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+389:39029:x1731745946376256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1155us (1215us total) trans 30064892960 rc 0/0 00010000:00010000:1.0:1651529344.468487:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 2/0,0 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468488:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152096 00000100:00100000:0.0:1651529344.468523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.468537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.468540:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+389:39030:x1731745946376320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1224us (1283us total) trans 30064892961 rc 0/0 00000100:00100000:1.0:1651529344.468550:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152095 00000100:00100000:0.0:1651529344.468552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.468557:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377088 00000100:00100000:1.0:1651529344.468563:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377216 00000100:00100000:1.0:1651529344.468570:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377152 00000100:00100000:1.0:1651529344.468576:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152100 00000100:00100000:1.0:1651529344.468578:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946377088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.468583:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176892 count 1 00010000:00010000:1.0:1651529344.468599:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: --/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468606:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152101 00000100:00100000:0.0:1651529344.468608:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946377216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.468613:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176894 count 1 00010000:00010000:0.0:1651529344.468618:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468623:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 2/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468626:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 2/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.468626:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468626:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468627:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 4/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468629:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468630:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468631:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 4/0,1 mode: --/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468633:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 3/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468639:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 3/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468642:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 4/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468657:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966608768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468658:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 4/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468663:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966608704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.468670:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.468678:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152102 00000100:00100000:0.0:1651529344.468679:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.468680:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+391:39029:x1731745946377152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.468684:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176893 count 1 00010000:00010000:0.0:1651529344.468684:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 2/0,0 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468687:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.468688:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 2/0,0 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468689:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468691:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 3/0,0 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468693:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 2/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468696:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468696:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 1/0,0 mode: --/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468697:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468697:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 4/0,1 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468699:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdb17 lrc: 0/0,0 mode: --/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468703:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 3/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468707:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 4/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468711:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966608832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.468718:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.468781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.468791:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377280 00000100:00100000:1.0:1651529344.468827:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152103 00000100:00100000:1.0:1651529344.468829:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+392:39029:x1731745946377280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.468829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.468834:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176895 count 1 00000100:00100000:0.0:1651529344.468836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.468838:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: --/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.468843:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 2/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468846:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468847:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468847:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 4/0,1 mode: --/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468854:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 3/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468858:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 4/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.468861:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966608896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.468865:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377344 00000100:00100000:1.0:1651529344.468875:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.468881:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377472 00000100:00100000:1.0:1651529344.468890:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377408 00000100:00100000:1.0:1651529344.468893:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152104 00000100:00100000:1.0:1651529344.468895:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+395:39030:x1731745946377344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.468899:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176896 count 1 00000100:00100000:0.0:1651529344.468903:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152105 00000100:00100000:0.0:1651529344.468905:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+395:39030:x1731745946377472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.468910:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: --/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468914:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 2/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1673 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468917:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468918:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468918:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 4/0,1 mode: --/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.468919:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176898 count 1 00010000:00010000:0.0:1651529344.468923:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468925:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 3/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1673 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.468928:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 4/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1673 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.468928:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 2/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.468931:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.468932:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468932:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468933:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 4/0,1 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468940:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.468940:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 3/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.468944:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 4/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.468948:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966609024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.468957:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.468964:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152106 00000100:00100000:0.0:1651529344.468966:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+395:39029:x1731745946377408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.468970:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176897 count 1 00010000:00010000:0.0:1651529344.468973:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468980:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 2/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.468983:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468983:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468984:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 4/0,1 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469003:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 3/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1673 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469007:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 4/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.469019:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.469027:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.469066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.469075:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258112 00010000:00010000:1.0:1651529344.469085:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 5/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1674 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469094:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11060 00000100:00100000:1.0:1651529344.469095:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41278:x1731746396258112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.469098:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469099:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 5/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1674 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.469114:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.469122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.469127:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 4/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1674 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.469131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.469133:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469133:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469134:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469137:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 4/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469142:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.469155:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41278:x1731746396258112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469158:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11060 00010000:00010000:0.0:1651529344.469158:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ad6efc/0xa29a79078f3b941b lrc: 0/0,0 mode: --/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce44 expref: 1674 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469163:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258176 00000100:00100000:0.0:1651529344.469163:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966608640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.469166:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 5/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469167:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469171:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258240 00010000:00010000:1.0:1651529344.469173:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 5/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469173:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469176:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469177:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258304 00010000:00010000:1.0:1651529344.469179:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 5/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1675 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469179:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469181:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469199:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11061 00000100:00100000:1.0:1651529344.469201:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1675:41279:x1731746396258176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.469204:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469205:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 5/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1675 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469208:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 4/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1675 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469214:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469214:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469215:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469218:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 4/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469222:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.469224:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+396:39030:x1731745946377024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1195us total) trans 30064892962 rc 0/0 00000100:00100000:0.0:1651529344.469227:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152099 00000100:00100000:1.0:1651529344.469228:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1675:41279:x1731746396258176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469231:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11061 00000100:00100000:1.0:1651529344.469234:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11062 00000100:00100000:1.0:1651529344.469236:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41278:x1731746396258240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.469238:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.469238:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966608704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.469240:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 4/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469242:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469251:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 3/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469256:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001559e496/0xa29a79078f3bbff7 lrc: 0/0,0 mode: --/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ca3 expref: 1674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469260:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469260:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469261:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469264:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 4/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469265:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11063 00000100:00100000:0.0:1651529344.469267:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41279:x1731746396258304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.469272:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.469276:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.469278:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41278:x1731746396258240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.469278:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 5/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469281:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11062 00010000:00010000:0.0:1651529344.469285:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 4/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469288:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469291:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469292:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092586f6b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469292:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469293:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469293:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469295:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 3/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469296:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 4/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469300:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.469307:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 1/0,0 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469307:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1672:41279:x1731746396258304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (176us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.469309:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bdb33 lrc: 0/0,0 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469310:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11063 00010000:00010000:0.0:1651529344.469318:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469320:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c39cf1/0xa29a79078f3ba196 lrc: 0/0,0 mode: --/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d043e expref: 1671 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469321:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469323:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966608832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469324:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469327:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469327:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 2/0,0 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469330:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469333:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469336:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469339:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469390:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+397:39029:x1731745946377152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 710us (838us total) trans 30064892963 rc 0/0 00000100:00100000:1.0:1651529344.469401:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152102 00000100:00100000:0.0:1651529344.469403:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946377216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 794us (865us total) trans 30064892964 rc 0/0 00000100:00100000:0.0:1651529344.469406:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152101 00010000:00010000:1.0:1651529344.469413:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3ba7fc lrc: 0/0,0 mode: --/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fa4 expref: 1670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469414:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 2/0,0 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469417:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966608768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469418:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b306dd91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469419:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 2/0,0 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469421:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469422:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 3/0,0 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469424:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469427:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469427:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 1/0,0 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469429:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469429:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bdb41 lrc: 0/0,0 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469432:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 2/0,0 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469434:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469436:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469437:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469442:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 3/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469446:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 1/0,0 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469448:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdb48 lrc: 0/0,0 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469452:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 2/0,0 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469454:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469455:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 2/0,0 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469458:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 3/0,0 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469461:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 1/0,0 mode: --/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469464:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdb3a lrc: 0/0,0 mode: --/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469469:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+396:39030:x1731745946377088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 891us (946us total) trans 30064892965 rc 0/0 00000100:00100000:1.0:1651529344.469472:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152100 00000100:00100000:1.0:1651529344.469494:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966608896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.469503:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: --/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469518:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966608960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.469518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.469526:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: --/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.469534:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258432 00010000:00010000:1.0:1651529344.469538:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 5/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1670 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469545:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258560 00010000:00010000:1.0:1651529344.469548:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 5/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.469554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.469567:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258368 00010000:00010000:1.0:1651529344.469570:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 4/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1672 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469581:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11064 00000100:00100000:1.0:1651529344.469583:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1672:41279:x1731746396258432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.469583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.469586:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469587:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 5/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469591:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 4/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1672 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.469605:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469609:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469611:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469612:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469613:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469616:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 4/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469617:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4e5c3aa/0xa29a79078f3b78ed lrc: 0/0,0 mode: --/PR res: [0x2b302:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8db expref: 1672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469620:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.469621:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966609024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469624:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469627:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469630:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469633:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41279:x1731746396258432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469636:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11064 00000100:00100000:1.0:1651529344.469641:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258496 00010000:00010000:1.0:1651529344.469644:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 4/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1671 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.469649:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11065 00000100:00100000:1.0:1651529344.469651:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41279:x1731746396258560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.469653:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469654:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 4/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1671 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469654:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469657:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 2/0,0 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469658:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 3/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1671 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469662:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076bf2f5a/0xa29a79078f3b9cb1 lrc: 0/0,0 mode: --/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf13d expref: 1671 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469673:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469673:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469674:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469677:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 4/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469685:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.469691:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1670:41279:x1731746396258560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469694:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11065 00000100:00100000:1.0:1651529344.469698:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11066 00000100:00100000:1.0:1651529344.469700:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1669:41279:x1731746396258368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.469702:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469704:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 4/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469707:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 3/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469712:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e907ca4d/0xa29a79078f3b9b0d lrc: 0/0,0 mode: --/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea7c expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469715:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.469718:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+396:39030:x1731745946377472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 811us (881us total) trans 30064892966 rc 0/0 00010000:00010000:1.0:1651529344.469721:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.469721:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152105 00010000:00010000:1.0:1651529344.469722:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469725:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 4/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469728:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 2/0,0 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469740:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.469747:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1668:41279:x1731746396258368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469749:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11066 00010000:00010000:0.0:1651529344.469751:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b480d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469753:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 2/0,0 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469756:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 3/0,0 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469757:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11067 00000100:00100000:1.0:1651529344.469759:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1667:41279:x1731746396258496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.469761:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 1/0,0 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469762:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469763:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 4/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1667 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469763:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bdb5d lrc: 0/0,0 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469767:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 3/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1667 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.469771:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf03842a/0xa29a79078f3b7f30 lrc: 0/0,0 mode: --/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc62 expref: 1667 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.469771:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469774:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469775:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469775:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469776:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469777:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469779:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 2/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469788:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 4/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469795:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.469801:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1666:41279:x1731746396258496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.469822:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11067 00010000:00010000:1.0:1651529344.469829:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469833:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469836:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469839:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 2/0,0 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469841:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+396:39029:x1731745946377408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 874us (998us total) trans 30064892967 rc 0/0 00000100:00100000:0.0:1651529344.469844:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152106 00010000:00010000:0.0:1651529344.469851:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 2/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469855:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007d01aa6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469856:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 2/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469858:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 3/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469863:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 1/0,0 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469866:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bdb64 lrc: 0/0,0 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469870:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 2/0,0 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469872:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.469873:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 2/0,0 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469878:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 3/0,0 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469882:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 1/0,0 mode: --/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469884:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdb56 lrc: 0/0,0 mode: --/PW res: [0x2b300:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469887:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+396:39030:x1731745946377344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1059us total) trans 30064892968 rc 0/0 00000100:00100000:1.0:1651529344.469891:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152104 00010000:00010000:1.0:1651529344.469900:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469904:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469907:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.469924:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 2/0,0 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.469946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.469956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.469970:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+396:39029:x1731745946377280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1140us (1199us total) trans 30064892969 rc 0/0 00000100:00100000:1.0:1651529344.469973:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152103 00000100:00100000:1.0:1651529344.469978:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378048 00000100:00100000:1.0:1651529344.469988:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378176 00000100:00100000:1.0:1651529344.469999:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378240 00000100:00100000:1.0:1651529344.470006:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378112 00000100:00100000:1.0:1651529344.470019:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152107 00000100:00100000:1.0:1651529344.470020:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+399:39030:x1731745946378048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.470027:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152108 00000100:00100000:0.0:1651529344.470029:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+399:39029:x1731745946378176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.470030:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176899 count 1 00010000:00010000:1.0:1651529344.470035:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.470035:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176901 count 1 00010000:00010000:1.0:1651529344.470040:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 2/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470043:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470043:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470044:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 4/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470053:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 3/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470054:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470057:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 4/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.470061:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966609152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.470068:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 2/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470071:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470072:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.470075:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470078:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 4/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470083:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152109 00000100:00100000:1.0:1651529344.470085:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+399:39030:x1731745946378240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.470089:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176902 count 1 00010000:00010000:0.0:1651529344.470089:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 3/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470093:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470093:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.470097:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 2/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1665 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.470097:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966609216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.470100:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470101:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470102:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 4/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470106:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.470107:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 3/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1665 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470111:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 4/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1665 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470113:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152110 00000100:00100000:1.0:1651529344.470115:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966609280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470115:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+399:39029:x1731745946378112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.470119:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176900 count 1 00000100:00100000:1.0:1651529344.470123:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470123:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470127:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 2/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1665 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470130:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470131:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470146:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 4/0,1 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470153:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 3/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1665 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470157:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 4/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1665 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470172:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966609344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470180:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470186:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 2/0,0 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470189:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.470190:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 2/0,0 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470193:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 3/0,0 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470198:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 1/0,0 mode: --/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470201:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdb4f lrc: 0/0,0 mode: --/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.470243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.470252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.470264:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.470273:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378304 00000100:00100000:1.0:1651529344.470280:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378432 00000100:00100000:1.0:1651529344.470294:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378368 00000100:00100000:0.0:1651529344.470295:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378496 00000100:00100000:1.0:1651529344.470302:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152111 00000100:00100000:1.0:1651529344.470303:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946378304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.470307:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152112 00002000:00080000:1.0:1651529344.470308:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176903 count 1 00000100:00100000:0.0:1651529344.470309:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+403:39029:x1731745946378432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.470312:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.470315:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176905 count 1 00010000:00010000:1.0:1651529344.470317:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 2/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470320:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470320:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470320:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: --/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470321:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 4/0,1 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470325:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 2/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470327:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 3/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470330:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 4/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.470334:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966609408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.470342:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470343:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470344:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 4/0,1 mode: --/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470347:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.470354:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152113 00000100:00100000:1.0:1651529344.470355:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+403:39030:x1731745946378368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.470357:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 3/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.470360:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176904 count 1 00010000:00010000:0.0:1651529344.470361:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 4/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.470363:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: --/PW res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470365:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966609472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.470368:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 2/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470371:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470371:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470372:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 4/0,1 mode: --/PW res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470374:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.470378:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 3/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.470380:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152114 00010000:00010000:1.0:1651529344.470382:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 4/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470382:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+403:39030:x1731745946378496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.470386:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966609536:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.470387:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176906 count 1 00010000:00010000:0.0:1651529344.470390:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470393:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470395:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 2/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470398:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470398:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470399:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 4/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470420:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 3/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1665 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470423:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 4/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1665 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470427:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470444:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.470477:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966609152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.470481:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470513:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966609280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.470516:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470547:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966609216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.470551:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470558:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966609344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.470561:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.470754:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259136 00000100:00100000:0.0:1651529344.470754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.470760:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 4/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1666 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.470771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.470772:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259264 00010000:00010000:1.0:1651529344.470776:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 4/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1667 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470778:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259200 00000100:00100000:1.0:1651529344.470780:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259328 00010000:00010000:1.0:1651529344.470782:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 4/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1669 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470783:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.470787:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11068 00000100:00100000:1.0:1651529344.470788:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1669:41279:x1731746396259136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.470790:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11069 00010000:00010000:1.0:1651529344.470791:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470792:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 4/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470792:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1669:41278:x1731746396259264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.470795:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470796:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 3/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470797:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 4/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1669 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470800:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 3/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1669 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.470818:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26338a0/0xa29a79078f3bbcd2 lrc: 0/0,0 mode: --/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7094 expref: 1669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.470822:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470823:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470824:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470827:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 4/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470833:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.470838:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f38e40d/0xa29a79078f3b932d lrc: 0/0,0 mode: --/PR res: [0x2b306:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca77 expref: 1668 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.470845:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1667:41279:x1731746396259136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.470847:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.470848:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11068 00010000:00010000:0.0:1651529344.470848:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470849:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470852:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 4/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470853:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11070 00000100:00100000:1.0:1651529344.470855:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1666:41279:x1731746396259328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.470857:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470859:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 4/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1666 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470861:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.470869:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 3/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1666 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.470869:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1666:41278:x1731746396259264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 77us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.470872:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11069 00010000:00010000:1.0:1651529344.470874:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9dd71ad/0xa29a79078f3b7b63 lrc: 0/0,0 mode: --/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba4e expref: 1666 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.470880:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470881:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470882:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470884:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 4/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470893:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.470899:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1664:41279:x1731746396259328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470902:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11070 00000100:00100000:0.0:1651529344.470906:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11071 00000100:00100000:0.0:1651529344.470908:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396259200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.470911:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470915:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470918:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470919:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470920:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 2/0,0 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470921:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470925:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 3/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470936:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171edcce/0xa29a79078f3bac6a lrc: 0/0,0 mode: --/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3021 expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.470940:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470941:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470942:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470945:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 4/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470950:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.470957:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1662:41279:x1731746396259200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470969:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946378240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 883us (1022us total) trans 30064892970 rc 0/0 00000100:00100000:0.0:1651529344.470970:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11071 00000100:00100000:1.0:1651529344.470972:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152109 00010000:00010000:1.0:1651529344.470979:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470983:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470986:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470988:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 2/0,0 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470992:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470996:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470999:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471002:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 2/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471020:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946378048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1109us total) trans 30064892971 rc 0/0 00000100:00100000:1.0:1651529344.471023:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152107 00010000:00010000:1.0:1651529344.471030:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 2/0,0 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471033:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.471034:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 2/0,0 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471037:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 3/0,0 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471042:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 1/0,0 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471044:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946378112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 928us (1086us total) trans 30064892972 rc 0/0 00000100:00100000:0.0:1651529344.471047:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152110 00010000:00010000:0.0:1651529344.471054:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 2/0,0 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471055:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdb79 lrc: 0/0,0 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471057:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.471058:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 2/0,0 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471060:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 2/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471061:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 3/0,0 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471062:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004adc61cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.471063:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 2/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471066:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 3/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471066:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 1/0,0 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471069:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdb6b lrc: 0/0,0 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471070:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 1/0,0 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471072:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdb80 lrc: 0/0,0 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471075:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471078:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471081:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471083:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 2/0,0 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471117:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946378176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1188us total) trans 30064892973 rc 0/0 00000100:00100000:0.0:1651529344.471120:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152108 00010000:00010000:0.0:1651529344.471126:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 2/0,0 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471129:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.471130:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 2/0,0 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471132:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 3/0,0 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471137:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 1/0,0 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471139:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdb72 lrc: 0/0,0 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471182:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966609408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471186:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.471201:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259456 00010000:00010000:1.0:1651529344.471205:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 4/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1662 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471205:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.471226:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259520 00010000:00010000:1.0:1651529344.471230:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 5/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471235:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11072 00000100:00100000:1.0:1651529344.471237:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396259456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.471247:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471249:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 4/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.471253:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 3/0,0 mode: PR/PR res: [0x2b307:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.471258:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084393d17/0xa29a79078f3bbf72 lrc: 0/0,0 mode: --/PR res: [0x2b307:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aab expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.471262:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471262:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471263:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471266:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 4/0,1 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.471279:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.471289:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966609472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471293:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: --/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471297:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1662:41279:x1731746396259456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.471305:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11072 00000100:00100000:0.0:1651529344.471308:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.471311:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259584 00010000:00010000:0.0:1651529344.471311:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471314:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 5/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1662 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471319:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259648 00010000:00010000:1.0:1651529344.471321:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 4/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471326:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11073 00000100:00100000:1.0:1651529344.471327:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396259520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.471330:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471331:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 4/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471334:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11074 00010000:00010000:1.0:1651529344.471335:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 3/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471336:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396259584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.471339:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471340:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea92320d/0xa29a79078f3ba689 lrc: 0/0,0 mode: --/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d195a expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.471341:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 5/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.471343:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471344:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471344:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471345:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 4/0,0 mode: PR/PR res: [0x2b308:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1662 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.471347:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 4/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471351:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471351:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471352:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471358:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 4/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471362:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.471368:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1662:41279:x1731746396259520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.471369:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.471371:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11073 00000100:00100000:1.0:1651529344.471381:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11075 00000100:00100000:1.0:1651529344.471382:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1661:41278:x1731746396259648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.471385:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471386:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 4/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471387:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1661:41279:x1731746396259584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.471390:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 3/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.471390:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11074 00010000:00010000:1.0:1651529344.471395:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cebff5c/0xa29a79078f3bc1be lrc: 0/0,0 mode: --/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d841a expref: 1660 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.471399:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471399:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471399:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471400:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471402:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471403:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 4/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471405:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471408:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 2/0,0 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471411:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.471417:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1659:41278:x1731746396259648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.471430:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11075 00010000:00010000:1.0:1651529344.471438:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 2/0,0 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471441:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000903748fd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.471442:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 2/0,0 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471445:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 3/0,0 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471449:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 1/0,0 mode: --/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471452:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bdb8e lrc: 0/0,0 mode: --/PW res: [0x2b309:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471461:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3b9ff2 lrc: 0/0,0 mode: --/PR res: [0x2b308:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfda0 expref: 1658 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471465:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966609536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471468:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471472:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471479:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946378432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1235us total) trans 30064892974 rc 0/0 00000100:00100000:0.0:1651529344.471482:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152112 00010000:00010000:1.0:1651529344.471484:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471487:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,1 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471489:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 2/0,0 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471491:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471494:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471504:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471507:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471531:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+405:39030:x1731745946378368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1278us total) trans 30064892975 rc 0/0 00000100:00100000:1.0:1651529344.471534:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152113 00010000:00010000:1.0:1651529344.471541:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471545:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471545:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946378496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1281us total) trans 30064892976 rc 0/0 00010000:00010000:1.0:1651529344.471548:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,1 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471548:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152114 00010000:00010000:1.0:1651529344.471550:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 2/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471556:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 2/0,0 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471559:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.471560:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 2/0,0 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471563:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 3/0,0 mode: PW/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471568:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 1/0,0 mode: --/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471571:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdb95 lrc: 0/0,0 mode: --/PW res: [0x2b308:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471575:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471578:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.471579:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471581:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 3/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471583:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946378304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1279us (1354us total) trans 30064892977 rc 0/0 00010000:00010000:0.0:1651529344.471584:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 1/0,0 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471587:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdb9c lrc: 0/0,0 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471590:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 2/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471593:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.471594:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 2/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471595:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152111 00010000:00010000:0.0:1651529344.471596:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 3/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471599:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 1/0,0 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471604:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdb87 lrc: 0/0,0 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471642:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379072 00000100:00100000:1.0:1651529344.471652:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152115 00000100:00100000:1.0:1651529344.471654:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946379072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.471655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.471664:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176907 count 1 00010000:00010000:1.0:1651529344.471669:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471671:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.471674:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 2/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1657 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471677:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471677:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471678:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 4/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.471684:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 3/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1657 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471688:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 4/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1657 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471692:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966609664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.471701:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.471715:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379136 00000100:00100000:1.0:1651529344.471742:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379328 00000100:00100000:0.0:1651529344.471742:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379264 00000100:00100000:1.0:1651529344.471748:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152116 00000100:00100000:1.0:1651529344.471759:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946379136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.471760:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152117 00000100:00100000:0.0:1651529344.471762:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+407:39029:x1731745946379328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.471765:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176908 count 1 00010000:00010000:1.0:1651529344.471769:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: --/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471773:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 2/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471776:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471777:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471777:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 4/0,1 mode: --/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.471781:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176910 count 1 00010000:00010000:1.0:1651529344.471783:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 3/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471786:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471787:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 4/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471791:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966609728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471791:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 2/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471794:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471795:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471796:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 4/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471821:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.471826:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 3/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.471828:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152118 00000100:00100000:1.0:1651529344.471830:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946379264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.471831:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.471835:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176909 count 1 00000100:00100000:0.0:1651529344.471838:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966609792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471839:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471858:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 2/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471861:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471862:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471862:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 4/0,1 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471864:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.471869:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 3/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471872:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 4/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471876:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966609856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.471884:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.471902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471915:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379456 00000100:00100000:0.0:1651529344.471920:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471931:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379520 00000100:00100000:1.0:1651529344.471939:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152119 00000100:00100000:1.0:1651529344.471940:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+409:39029:x1731745946379456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.471945:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176911 count 1 00000100:00100000:0.0:1651529344.471946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.471949:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: --/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471953:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 2/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471973:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471973:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471974:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 4/0,1 mode: --/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.471981:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 3/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471984:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 4/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.471988:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966609920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.471998:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379584 00000100:00100000:1.0:1651529344.472008:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472011:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379648 00000100:00100000:0.0:1651529344.472015:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152120 00000100:00100000:1.0:1651529344.472016:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966609664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472017:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+411:39030:x1731745946379520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.472020:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.472022:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176912 count 1 00010000:00010000:0.0:1651529344.472026:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: --/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472039:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 2/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472043:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472044:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472044:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 4/0,1 mode: --/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472051:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 3/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472055:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 4/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472059:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472068:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472075:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152121 00000100:00100000:0.0:1651529344.472077:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+411:39029:x1731745946379584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.472081:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176913 count 1 00010000:00010000:0.0:1651529344.472092:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: --/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472097:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 2/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472100:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472100:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472101:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 4/0,1 mode: --/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472108:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 3/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472111:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 4/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472115:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966610048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472122:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472128:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152122 00000100:00100000:0.0:1651529344.472130:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+411:39030:x1731745946379648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.472135:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176914 count 1 00010000:00010000:0.0:1651529344.472138:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472142:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 2/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472146:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472146:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472147:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 4/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472153:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 3/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1657 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472156:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 4/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472160:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472166:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.472264:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966609728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.472267:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: --/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472284:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260160 00000100:00100000:0.0:1651529344.472285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.472293:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 4/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1658 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472294:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.472302:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.472311:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966609792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.472313:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260352 00010000:00010000:1.0:1651529344.472316:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1659 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472316:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472320:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260288 00010000:00010000:1.0:1651529344.472322:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 4/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1660 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472326:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260416 00010000:00010000:1.0:1651529344.472328:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 5/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472332:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11076 00000100:00100000:1.0:1651529344.472334:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1661:41278:x1731746396260160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.472337:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.472338:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 4/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1661 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472339:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11077 00010000:00010000:1.0:1651529344.472341:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 3/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1661 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472341:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1661:41279:x1731746396260352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.472344:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472346:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472347:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a486e40/0xa29a79078f3b94ed lrc: 0/0,0 mode: --/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd10e expref: 1661 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472350:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 3/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1660 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472351:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472356:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472356:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306f6595/0xa29a79078f3bad6d lrc: 0/0,0 mode: --/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34f8 expref: 1660 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472357:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472360:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472361:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 4/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472361:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472362:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472365:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 4/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472367:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.472371:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472379:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1659:41278:x1731746396260160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.472382:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11076 00000100:00100000:1.0:1651529344.472387:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11078 00000100:00100000:1.0:1651529344.472388:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1658:41278:x1731746396260288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.472391:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.472393:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 4/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1658 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472395:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1658:41279:x1731746396260352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (109us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.472397:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 3/0,0 mode: PR/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1658 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472398:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11077 00010000:00010000:1.0:1651529344.472401:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016811bd9/0xa29a79078f3bb9bb lrc: 0/0,0 mode: --/PR res: [0x2b30c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64d2 expref: 1658 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472405:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472406:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472406:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472414:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11079 00000100:00100000:0.0:1651529344.472416:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396260416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.472418:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 4/0,1 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472419:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472421:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 5/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1656 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472425:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.472425:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 4/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1656 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472430:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.472431:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396260288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.472431:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472431:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472434:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11078 00010000:00010000:0.0:1651529344.472434:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 4/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472439:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.472445:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68fcbad/0xa29a79078f3ba230 lrc: 0/0,0 mode: --/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d064b expref: 1655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472446:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1655:41278:x1731746396260416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.472448:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11079 00000100:00100000:1.0:1651529344.472449:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966609856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472452:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472455:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472458:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472461:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472464:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472469:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472473:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472476:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472486:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472514:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+413:39030:x1731745946379264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 683us (843us total) trans 30064892978 rc 0/0 00000100:00100000:1.0:1651529344.472517:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152118 00010000:00010000:1.0:1651529344.472524:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472527:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+412:39029:x1731745946379328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 765us (846us total) trans 30064892979 rc 0/0 00010000:00010000:1.0:1651529344.472528:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472531:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,1 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472531:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152117 00010000:00010000:1.0:1651529344.472534:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 2/0,0 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472540:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472543:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006724e0ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.472544:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472547:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 3/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472566:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946379136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 806us (917us total) trans 30064892980 rc 0/0 00000100:00100000:1.0:1651529344.472569:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152116 00010000:00010000:1.0:1651529344.472576:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472576:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 1/0,0 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472579:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.472580:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472580:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdbb8 lrc: 0/0,0 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472583:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 3/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472584:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 2/0,0 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472587:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e76f4e0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.472588:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 2/0,0 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472591:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 3/0,0 mode: PW/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472595:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 1/0,0 mode: --/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472596:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 1/0,0 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472597:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdbaa lrc: 0/0,0 mode: --/PW res: [0x2b30c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472599:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdbb1 lrc: 0/0,0 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472606:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472608:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472611:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472614:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 2/0,0 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472667:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+412:39029:x1731745946379072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1034us total) trans 30064892981 rc 0/0 00000100:00100000:1.0:1651529344.472670:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152115 00000100:00100000:0.0:1651529344.472670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.472681:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966609920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472684:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: --/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472688:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.472701:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260480 00000100:00100000:0.0:1651529344.472713:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.472724:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 4/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1654 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472744:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260544 00000100:00100000:0.0:1651529344.472744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.472748:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 5/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472753:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260672 00010000:00010000:1.0:1651529344.472755:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 5/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1656 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472759:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260736 00000100:00100000:0.0:1651529344.472766:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966609984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472767:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 5/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472771:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: --/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472773:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11080 00000100:00100000:1.0:1651529344.472774:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1657:41279:x1731746396260480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.472777:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.472778:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966610048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472779:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 4/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472781:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: --/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472782:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 3/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.472787:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472788:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b682801/0xa29a79078f3ba8a4 lrc: 0/0,0 mode: --/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2228 expref: 1657 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472790:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472801:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472801:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472817:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472820:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 4/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472827:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.472827:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 2/0,0 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472831:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.472832:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 2/0,0 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472835:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 3/0,0 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472838:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41279:x1731746396260480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.472840:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11080 00010000:00010000:0.0:1651529344.472845:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 1/0,0 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472851:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11081 00000100:00100000:1.0:1651529344.472853:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1655:41278:x1731746396260544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.472855:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.472857:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 4/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1655 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472857:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdba3 lrc: 0/0,0 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472861:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 3/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1655 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472866:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff2732/0xa29a79078f3b9c56 lrc: 0/0,0 mode: --/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef92 expref: 1655 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472869:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472876:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472877:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472879:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11082 00010000:00010000:1.0:1651529344.472880:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 4/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472881:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1654:41278:x1731746396260672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.472889:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472895:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1654:41278:x1731746396260544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.472898:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11081 00010000:00010000:0.0:1651529344.472898:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472900:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 4/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1653 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.472903:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11083 00000100:00100000:1.0:1651529344.472904:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1653:41279:x1731746396260736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.472905:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 3/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1653 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472907:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.472908:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 4/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1653 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.472912:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 3/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1653 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472913:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d242824/0xa29a79078f3bb9ec lrc: 0/0,0 mode: --/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65b2 expref: 1653 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472916:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472917:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa2dcd9/0xa29a79078f3b99ee lrc: 0/0,0 mode: --/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce57b expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.472917:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472918:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472920:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472921:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472921:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 4/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472922:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472933:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 4/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472937:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.472941:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472947:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1651:41279:x1731746396260736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.472950:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11083 00000100:00100000:0.0:1651529344.472950:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1651:41278:x1731746396260672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.472953:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11082 00010000:00010000:1.0:1651529344.472958:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472961:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472961:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472965:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472965:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472967:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 2/0,0 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472968:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472970:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 2/0,0 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473014:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+413:39029:x1731745946379456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1112us total) trans 30064892982 rc 0/0 00000100:00100000:1.0:1651529344.473017:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152119 00010000:00010000:1.0:1651529344.473024:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 2/0,0 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473024:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946379648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 893us (1045us total) trans 30064892983 rc 0/0 00010000:00010000:1.0:1651529344.473028:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a73acf9f already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.473028:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152122 00010000:00010000:0.0:1651529344.473035:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 2/0,0 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473037:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 2/0,0 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473039:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.473040:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 3/0,0 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473040:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 2/0,0 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473043:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 3/0,0 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473045:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 1/0,0 mode: --/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473047:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 1/0,0 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473048:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdbbf lrc: 0/0,0 mode: --/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473050:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdbd4 lrc: 0/0,0 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473056:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473059:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473062:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473065:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 2/0,0 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473098:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+412:39029:x1731745946379584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1020us (1152us total) trans 30064892984 rc 0/0 00000100:00100000:0.0:1651529344.473101:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152121 00010000:00010000:0.0:1651529344.473107:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473111:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473113:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473116:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 2/0,0 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473128:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 2/0,0 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473131:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.473132:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 2/0,0 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473135:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 3/0,0 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473138:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 1/0,0 mode: --/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473141:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdbcd lrc: 0/0,0 mode: --/PW res: [0x2b311:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473153:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 2/0,0 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473153:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946379520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1135us (1233us total) trans 30064892985 rc 0/0 00000100:00100000:0.0:1651529344.473155:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152120 00010000:00010000:1.0:1651529344.473156:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.473157:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 2/0,0 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473160:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 3/0,0 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473163:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 1/0,0 mode: --/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473165:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdbc6 lrc: 0/0,0 mode: --/PW res: [0x2b310:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473217:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473225:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380096 00000100:00100000:1.0:1651529344.473232:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380160 00000100:00100000:1.0:1651529344.473236:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380224 00000100:00100000:1.0:1651529344.473255:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380288 00000100:00100000:1.0:1651529344.473266:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152123 00000100:00100000:1.0:1651529344.473268:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+415:39030:x1731745946380096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.473271:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152124 00000100:00100000:0.0:1651529344.473273:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+415:39030:x1731745946380160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.473277:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176915 count 1 00002000:00080000:0.0:1651529344.473279:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176916 count 1 00010000:00010000:1.0:1651529344.473282:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473284:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: --/PW res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473286:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 2/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473297:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473297:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473298:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 4/0,1 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473303:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 2/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473305:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 3/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473309:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 4/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473313:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966610176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473315:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473316:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473317:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 4/0,1 mode: --/PW res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473327:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.473331:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 3/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.473335:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152125 00000100:00100000:1.0:1651529344.473336:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+415:39029:x1731745946380224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.473336:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 4/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.473340:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966610240:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.473341:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176917 count 1 00010000:00010000:1.0:1651529344.473345:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473349:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 2/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.473349:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.473352:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473353:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473353:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 4/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473356:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152126 00000100:00100000:0.0:1651529344.473358:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+415:39030:x1731745946380288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.473362:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176918 count 1 00010000:00010000:0.0:1651529344.473366:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: --/PW res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473369:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 3/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473373:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473377:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966610304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473384:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.473387:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 2/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473390:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473391:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473392:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 4/0,1 mode: --/PW res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473399:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 3/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473402:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 4/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.473416:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966610368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.473424:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.473451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473483:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380480 00000100:00100000:0.0:1651529344.473489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473492:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380544 00000100:00100000:1.0:1651529344.473499:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380608 00000100:00100000:1.0:1651529344.473505:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380672 00000100:00100000:1.0:1651529344.473509:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152127 00000100:00100000:1.0:1651529344.473510:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+419:39029:x1731745946380480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.473518:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152128 00000100:00100000:0.0:1651529344.473520:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+419:39030:x1731745946380544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.473521:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176919 count 1 00010000:00010000:1.0:1651529344.473525:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.473525:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176920 count 1 00010000:00010000:0.0:1651529344.473529:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473530:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 2/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473533:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473533:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473534:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 4/0,1 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473536:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 2/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473539:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473540:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 3/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473540:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473541:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 4/0,1 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473552:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 4/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473556:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966610432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473562:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 3/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473566:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 4/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473569:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.473577:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152129 00000100:00100000:0.0:1651529344.473577:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473578:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+419:39029:x1731745946380608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.473583:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176921 count 1 00000100:00100000:0.0:1651529344.473586:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.473592:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152130 00010000:00010000:1.0:1651529344.473593:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473594:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+419:39030:x1731745946380672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.473599:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176922 count 1 00010000:00010000:1.0:1651529344.473602:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 2/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473602:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473605:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473606:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473606:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 4/0,1 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473607:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 2/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1649 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473610:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473610:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473611:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 4/0,1 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473613:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 3/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473616:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 4/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.473618:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 3/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1649 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473621:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 4/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1649 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.473625:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966610624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473628:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966610560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.473631:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.473635:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.473690:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966610176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.473694:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473703:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966610240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473707:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966610304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473707:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: --/PW res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473710:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.473951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.473961:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261248 00000100:00100000:0.0:1651529344.473962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.473972:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 4/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1650 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473984:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261184 00010000:00010000:1.0:1651529344.473987:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 4/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.473988:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966610368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473991:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261312 00010000:00010000:0.0:1651529344.473992:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: --/PW res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473993:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.473997:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11084 00000100:00100000:1.0:1651529344.473999:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1652:41279:x1731746396261248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.473999:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474002:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474010:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474012:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 4/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474012:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11085 00000100:00100000:0.0:1651529344.474013:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1652:41279:x1731746396261184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.474016:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 3/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474017:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.474019:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 4/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474022:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3e697a/0xa29a79078f3ba9df lrc: 0/0,0 mode: --/PR res: [0x2b314:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d261f expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474022:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 3/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1652 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474025:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474026:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474027:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474028:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab64b7aa/0xa29a79078f3ba9f4 lrc: 0/0,0 mode: --/PR res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2673 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474030:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 4/0,1 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474032:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474033:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474034:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474039:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.474043:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 4/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474049:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1650:41279:x1731746396261248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474052:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11084 00010000:00010000:0.0:1651529344.474057:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474063:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11086 00000100:00100000:0.0:1651529344.474064:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41279:x1731746396261184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474065:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41279:x1731746396261312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.474068:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.474068:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11085 00010000:00010000:1.0:1651529344.474070:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474076:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474080:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474083:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 3/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1648 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474083:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,1 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474085:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 2/0,0 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474088:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcaa07d/0xa29a79078f3bae15 lrc: 0/0,0 mode: --/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d371a expref: 1648 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474092:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474092:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474093:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474096:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 4/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474102:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474109:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1647:41279:x1731746396261312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474111:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11086 00010000:00010000:1.0:1651529344.474119:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474122:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474125:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474126:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+420:39030:x1731745946380160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 852us (929us total) trans 30064892986 rc 0/0 00000100:00100000:0.0:1651529344.474129:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152124 00010000:00010000:1.0:1651529344.474136:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474136:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 2/0,0 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474139:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.474140:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 2/0,0 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474150:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 3/0,0 mode: PW/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474178:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 1/0,0 mode: --/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474187:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+420:39029:x1731745946380224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 849us (979us total) trans 30064892987 rc 0/0 00000100:00100000:1.0:1651529344.474190:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152125 00010000:00010000:0.0:1651529344.474190:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdbe2 lrc: 0/0,0 mode: --/PW res: [0x2b314:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474195:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474198:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004a4e8bd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.474199:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474201:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966610432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474202:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 3/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474205:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474206:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 1/0,0 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474208:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bdbe9 lrc: 0/0,0 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474211:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474214:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474217:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474219:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 2/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.474269:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+420:39030:x1731745946380096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1000us (1085us total) trans 30064892988 rc 0/0 00000100:00100000:0.0:1651529344.474270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.474272:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152123 00000100:00100000:0.0:1651529344.474283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.474290:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261440 00010000:00010000:1.0:1651529344.474295:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 4/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1647 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.474300:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261568 00000100:00100000:0.0:1651529344.474304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.474310:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 4/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1648 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.474316:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261696 00010000:00010000:1.0:1651529344.474318:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 5/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1649 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.474329:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261632 00000100:00100000:0.0:1651529344.474331:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966610624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.474332:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 4/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1650 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.474336:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261760 00010000:00010000:0.0:1651529344.474336:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474338:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 5/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474343:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11087 00000100:00100000:1.0:1651529344.474345:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11088 00000100:00100000:0.0:1651529344.474345:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1651:41279:x1731746396261440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.474347:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1651:41278:x1731746396261568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.474349:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474350:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.474350:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 4/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474351:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 4/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474354:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 3/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474355:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 3/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474359:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb003dd2/0xa29a79078f3badf9 lrc: 0/0,0 mode: --/PR res: [0x2b316:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36a3 expref: 1651 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474363:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474364:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474365:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474368:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 4/0,1 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474369:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2b4557e/0xa29a79078f3bb420 lrc: 0/0,0 mode: --/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fa8 expref: 1650 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474373:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474374:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474374:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.474375:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474378:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 4/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474382:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41279:x1731746396261440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.474385:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.474385:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11087 00000100:00100000:1.0:1651529344.474392:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41278:x1731746396261568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474395:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11088 00000100:00100000:1.0:1651529344.474400:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11089 00000100:00100000:1.0:1651529344.474402:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1648:41278:x1731746396261696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.474404:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474406:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 4/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1647 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474409:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 3/0,0 mode: PR/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1647 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474412:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11090 00010000:00010000:1.0:1651529344.474414:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f50d8208/0xa29a79078f3b9476 lrc: 0/0,0 mode: --/PR res: [0x2b31a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf5c expref: 1647 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474414:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1647:41279:x1731746396261632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.474417:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.474418:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 4/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474423:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 3/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474428:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000650057f3/0xa29a79078f3ba8f1 lrc: 0/0,0 mode: --/PR res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2340 expref: 1647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474430:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474431:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474432:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474432:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474433:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474434:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 4/0,1 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474436:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 4/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474443:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474450:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1645:41278:x1731746396261696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.474451:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474452:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11089 00000100:00100000:1.0:1651529344.474457:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11091 00000100:00100000:1.0:1651529344.474458:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1644:41279:x1731746396261760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.474458:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1644:41279:x1731746396261632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.474461:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.474461:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11090 00010000:00010000:1.0:1651529344.474462:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 5/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1644 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474466:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 4/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1643 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474468:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474471:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474471:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474471:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474472:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474474:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,1 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474479:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 2/0,0 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474483:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 4/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474488:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474494:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1643:41279:x1731746396261760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474496:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11091 00010000:00010000:1.0:1651529344.474503:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 2/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474507:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fde70ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.474508:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 2/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474510:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 3/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474514:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 1/0,0 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474517:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bdbdb lrc: 0/0,0 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474521:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 2/0,0 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474532:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.474533:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 2/0,0 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474533:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+420:39030:x1731745946380288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1316us total) trans 30064892989 rc 0/0 00010000:00010000:1.0:1651529344.474536:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 3/0,0 mode: PW/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474536:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152126 00010000:00010000:1.0:1651529344.474540:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 1/0,0 mode: --/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474542:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdbf0 lrc: 0/0,0 mode: --/PW res: [0x2b316:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474543:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474547:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474550:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474552:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a8dfa0/0xa29a79078f3bbc07 lrc: 0/0,0 mode: --/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dca expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.474552:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 2/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474556:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966610560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.474559:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474562:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474565:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474576:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474579:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 2/0,0 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474587:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+420:39030:x1731745946380544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1067us (1121us total) trans 30064892990 rc 0/0 00000100:00100000:0.0:1651529344.474590:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152128 00010000:00010000:0.0:1651529344.474596:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 2/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474599:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677dae30 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.474600:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 2/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474603:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 3/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474608:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 1/0,0 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474611:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdbfe lrc: 0/0,0 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474615:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 2/0,0 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474618:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.474619:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 2/0,0 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474620:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+420:39029:x1731745946380608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1145us total) trans 30064892991 rc 0/0 00010000:00010000:0.0:1651529344.474622:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 3/0,0 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474623:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152129 00010000:00010000:0.0:1651529344.474625:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 1/0,0 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474628:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc05 lrc: 0/0,0 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474631:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474633:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474635:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474636:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474638:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474639:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,1 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474641:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 2/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474641:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 2/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474673:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+421:39029:x1731745946380480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1222us total) trans 30064892992 rc 0/0 00000100:00100000:1.0:1651529344.474676:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152127 00000100:00100000:0.0:1651529344.474676:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+421:39030:x1731745946380672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1187us total) trans 30064892993 rc 0/0 00000100:00100000:0.0:1651529344.474679:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152130 00010000:00010000:1.0:1651529344.474682:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 2/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474686:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 2/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474689:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.474690:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 2/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474692:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 3/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474694:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3e400c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.474696:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 2/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474697:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 1/0,0 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474698:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 3/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474699:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdc0c lrc: 0/0,0 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474703:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 1/0,0 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474706:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bdbf7 lrc: 0/0,0 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.474749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.474759:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381248 00000100:00100000:0.0:1651529344.474764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.474765:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381312 00000100:00100000:1.0:1651529344.474773:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381184 00000100:00100000:1.0:1651529344.474778:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152131 00000100:00100000:1.0:1651529344.474780:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+422:39029:x1731745946381248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.474785:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176924 count 1 00010000:00010000:1.0:1651529344.474789:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: --/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474793:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 2/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.474802:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474826:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474833:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 4/0,1 mode: --/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474842:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 3/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.474852:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 4/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.474857:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966610688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.474865:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152132 00000100:00100000:1.0:1651529344.474872:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.474880:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152133 00000100:00100000:1.0:1651529344.474881:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+422:39029:x1731745946381184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.474885:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+422:39030:x1731745946381312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.474886:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176923 count 1 00010000:00010000:1.0:1651529344.474890:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: --/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.474891:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176925 count 1 00010000:00010000:1.0:1651529344.474894:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 2/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.474896:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: --/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474898:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474898:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474899:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 4/0,1 mode: --/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474901:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 2/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.474904:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474904:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474905:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 3/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.474905:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 4/0,1 mode: --/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474912:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 3/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.474916:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 4/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.474918:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 4/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.474920:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.474922:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966610752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.474929:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.474931:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.475011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.475022:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381504 00000100:00100000:1.0:1651529344.475033:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152134 00000100:00100000:1.0:1651529344.475035:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+423:39029:x1731745946381504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.475038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.475039:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176926 count 1 00010000:00010000:1.0:1651529344.475043:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475045:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.475047:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 2/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.475055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.475057:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475057:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475058:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 4/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.475065:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 3/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.475068:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381568 00010000:00010000:1.0:1651529344.475069:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.475083:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966610880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.475096:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.475102:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381696 00000100:00100000:0.0:1651529344.475104:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381632 00000100:00100000:1.0:1651529344.475111:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381760 00000100:00100000:1.0:1651529344.475115:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152135 00000100:00100000:1.0:1651529344.475117:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+427:39030:x1731745946381568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.475118:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152136 00000100:00100000:0.0:1651529344.475119:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+427:39030:x1731745946381696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.475121:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176927 count 1 00010000:00010000:1.0:1651529344.475125:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.475125:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176929 count 1 00010000:00010000:0.0:1651529344.475129:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475130:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 2/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1641 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475133:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475133:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475134:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 4/0,1 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475134:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 2/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1641 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475137:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475138:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475138:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 4/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475140:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 3/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1641 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475143:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 4/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1641 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475145:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 3/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1641 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.475147:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966610944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475149:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 4/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1641 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475153:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966611008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475162:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.475164:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.475168:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152137 00000100:00100000:0.0:1651529344.475170:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+427:39029:x1731745946381632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.475174:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176928 count 1 00010000:00010000:0.0:1651529344.475177:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: --/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475181:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 2/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475184:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475185:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475185:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 4/0,1 mode: --/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475191:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 3/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475194:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 4/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475198:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966611072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475204:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.475210:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152138 00000100:00100000:0.0:1651529344.475211:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+427:39030:x1731745946381760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.475215:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176930 count 1 00010000:00010000:0.0:1651529344.475218:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475224:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 2/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475227:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475227:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475228:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 4/0,1 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475234:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 3/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1641 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475237:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 4/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475240:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966611136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475246:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.475272:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966610688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475276:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: --/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475316:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966610752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475320:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: --/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475339:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262272 00010000:00010000:1.0:1651529344.475344:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 5/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475363:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11092 00000100:00100000:1.0:1651529344.475365:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41279:x1731746396262272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.475366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.475368:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475369:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 5/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475373:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 4/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475375:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966610816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475379:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f110dbf3/0xa29a79078f3bb864 lrc: 0/0,0 mode: --/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fd1 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475380:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: --/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475383:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475390:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475391:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475395:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 4/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475404:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.475407:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262208 00000100:00100000:1.0:1651529344.475414:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41279:x1731746396262272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.475417:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11092 00010000:00010000:0.0:1651529344.475417:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 4/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.475422:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262336 00010000:00010000:1.0:1651529344.475426:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 4/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475427:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11093 00000100:00100000:0.0:1651529344.475428:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41278:x1731746396262208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.475431:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11094 00010000:00010000:0.0:1651529344.475431:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.475432:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41278:x1731746396262336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.475433:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 4/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475435:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475436:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 4/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475436:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 3/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475440:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 3/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475442:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f0aac98/0xa29a79078f3b9dc2 lrc: 0/0,0 mode: --/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf550 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475444:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003895fe1a/0xa29a79078f3b9a5e lrc: 0/0,0 mode: --/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce734 expref: 1642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475446:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475446:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475447:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475448:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475450:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 4/0,1 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475454:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475455:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475460:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.475465:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 4/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475467:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1640:41278:x1731746396262208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.475470:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11093 00010000:00010000:1.0:1651529344.475471:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.475477:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475478:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1639:41278:x1731746396262336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.475480:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11094 00010000:00010000:0.0:1651529344.475481:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475484:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475487:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 2/0,0 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475492:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475495:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475498:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475501:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 2/0,0 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475550:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+429:39030:x1731745946381312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 682us (800us total) trans 30064892994 rc 0/0 00000100:00100000:1.0:1651529344.475552:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+429:39029:x1731745946381184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 669us (787us total) trans 30064892995 rc 0/0 00000100:00100000:0.0:1651529344.475553:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152132 00000100:00100000:1.0:1651529344.475555:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152133 00010000:00010000:0.0:1651529344.475560:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 2/0,0 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475562:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475564:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000052c1122 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.475565:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 2/0,0 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475567:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 3/0,0 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475572:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 1/0,0 mode: --/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475575:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475575:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdc21 lrc: 0/0,0 mode: --/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475578:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,1 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 2/0,0 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475581:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 2/0,0 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475582:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.475583:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 2/0,0 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475586:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 3/0,0 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475589:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 1/0,0 mode: --/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475591:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdc1a lrc: 0/0,0 mode: --/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475595:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 2/0,0 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475597:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.475598:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 2/0,0 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475601:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 3/0,0 mode: PW/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475615:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+428:39029:x1731745946381248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 835us (888us total) trans 30064892996 rc 0/0 00000100:00100000:1.0:1651529344.475618:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152131 00010000:00010000:0.0:1651529344.475622:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 1/0,0 mode: --/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475633:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdc13 lrc: 0/0,0 mode: --/PW res: [0x2b31c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475676:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966610880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475680:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475696:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966610944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475703:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475716:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262592 00010000:00010000:1.0:1651529344.475721:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1639 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475727:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475743:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262656 00010000:00010000:1.0:1651529344.475754:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 4/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1640 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.475765:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262720 00000100:00100000:0.0:1651529344.475765:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966611072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475768:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 5/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1641 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475769:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: --/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475773:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11095 00000100:00100000:1.0:1651529344.475775:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1641:41278:x1731746396262592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.475777:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966611008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475778:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475779:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475780:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475783:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 3/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475787:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11096 00010000:00010000:1.0:1651529344.475788:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3ba50f lrc: 0/0,0 mode: --/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d133a expref: 1641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475789:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1641:41279:x1731746396262656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.475792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475792:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475793:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475794:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 4/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1640 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475796:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 4/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475798:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 3/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1640 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475822:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.475836:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1640:41278:x1731746396262592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.475839:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11095 00010000:00010000:0.0:1651529344.475841:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002daf45dc/0xa29a79078f3b7ad0 lrc: 0/0,0 mode: --/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9fa expref: 1640 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.475844:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11097 00000100:00100000:1.0:1651529344.475846:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1638:41278:x1731746396262720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.475846:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475846:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475847:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475849:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475850:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 4/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1638 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475850:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 4/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475854:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 3/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1638 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475860:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.475867:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2a1fa6e/0xa29a79078f3b952c lrc: 0/0,0 mode: --/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd234 expref: 1638 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.475868:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1638:41279:x1731746396262656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 79us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.475871:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475871:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.475871:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11096 00010000:00010000:1.0:1651529344.475872:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475875:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 4/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475884:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.475891:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1636:41278:x1731746396262720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.475893:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11097 00000100:00100000:0.0:1651529344.475895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475904:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262848 00010000:00010000:1.0:1651529344.475907:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 4/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1636 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.475913:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11098 00000100:00100000:1.0:1651529344.475914:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1636:41278:x1731746396262848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.475916:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475918:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 4/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1636 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475921:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 3/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1636 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.475923:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475927:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475930:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475932:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475934:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bb014 lrc: 0/0,0 mode: --/PR res: [0x2b320:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f0f expref: 1636 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.475938:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475939:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475939:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475948:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 4/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475957:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.475967:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1635:41278:x1731746396262848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.475969:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11098 00010000:00010000:1.0:1651529344.475983:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475986:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.475987:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475990:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 3/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475990:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+428:39030:x1731745946381696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 870us (935us total) trans 30064892997 rc 0/0 00000100:00100000:0.0:1651529344.475994:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152136 00010000:00010000:1.0:1651529344.475995:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 1/0,0 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475997:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdc36 lrc: 0/0,0 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476001:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476003:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476004:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476006:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476008:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476009:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476012:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 2/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476030:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 2/0,0 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476052:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+428:39030:x1731745946381568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 934us (1014us total) trans 30064892998 rc 0/0 00000100:00100000:1.0:1651529344.476063:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152135 00010000:00010000:1.0:1651529344.476070:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476074:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476077:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476079:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 2/0,0 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476080:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+428:39029:x1731745946381632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (1034us total) trans 30064892999 rc 0/0 00000100:00100000:0.0:1651529344.476083:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152137 00010000:00010000:0.0:1651529344.476091:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 2/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476094:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.476095:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 2/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476098:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 3/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476103:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 1/0,0 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476106:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdc2f lrc: 0/0,0 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476110:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 2/0,0 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476113:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.476114:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+428:39029:x1731745946381504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1078us (1103us total) trans 30064893000 rc 0/0 00010000:00010000:0.0:1651529344.476114:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 2/0,0 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476117:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152134 00010000:00010000:0.0:1651529344.476117:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 3/0,0 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476120:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 1/0,0 mode: --/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476122:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdc3d lrc: 0/0,0 mode: --/PW res: [0x2b320:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476124:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 2/0,0 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476127:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.476128:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 2/0,0 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476131:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 3/0,0 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476136:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 1/0,0 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476146:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdc28 lrc: 0/0,0 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476167:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382208 00000100:00100000:1.0:1651529344.476182:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152139 00000100:00100000:1.0:1651529344.476184:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+428:39029:x1731745946382208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.476189:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176931 count 1 00000100:00100000:0.0:1651529344.476192:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.476193:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: --/PW res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.476210:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 2/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1634 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476214:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476214:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476215:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 4/0,1 mode: --/PW res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476222:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 3/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1634 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.476228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.476233:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 4/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1634 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.476238:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476250:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966611136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476254:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476258:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476268:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382336 00000100:00100000:1.0:1651529344.476270:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382400 00000100:00100000:0.0:1651529344.476279:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152140 00000100:00100000:0.0:1651529344.476281:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+430:39030:x1731745946382336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.476286:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152141 00000100:00100000:1.0:1651529344.476287:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+430:39030:x1731745946382400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.476292:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176933 count 1 00010000:00010000:1.0:1651529344.476296:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.476299:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176932 count 1 00010000:00010000:1.0:1651529344.476300:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 2/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476303:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476304:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476304:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: --/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476305:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 4/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476309:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 2/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476311:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 3/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476312:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476312:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476313:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 4/0,1 mode: --/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476314:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.476318:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966611264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476320:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 3/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476324:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 4/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.476326:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476328:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966611328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.476334:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263104 00000100:00100000:0.0:1651529344.476337:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.476338:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 4/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1635 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.476345:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11099 00000100:00100000:1.0:1651529344.476356:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1635:41279:x1731746396263104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.476358:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.476360:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 4/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1635 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476364:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 3/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1635 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476369:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3ba413 lrc: 0/0,0 mode: --/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e63 expref: 1635 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476373:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476373:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476374:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476377:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 4/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476393:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.476396:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476400:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476404:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1634:41279:x1731746396263104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.476407:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11099 00010000:00010000:0.0:1651529344.476420:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476423:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 2/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476482:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+431:39030:x1731745946381760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1270us (1420us total) trans 30064893001 rc 0/0 00000100:00100000:0.0:1651529344.476485:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152138 00010000:00010000:0.0:1651529344.476493:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 2/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476497:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.476498:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 2/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476500:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 3/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476505:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 1/0,0 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476508:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdc44 lrc: 0/0,0 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476581:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.476585:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: --/PW res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476621:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966611264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.476624:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476649:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382528 00000100:00100000:1.0:1651529344.476655:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382592 00000100:00100000:0.0:1651529344.476657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476676:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382656 00000100:00100000:1.0:1651529344.476681:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382720 00000100:00100000:1.0:1651529344.476687:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152142 00000100:00100000:1.0:1651529344.476689:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+434:39029:x1731745946382528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.476692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.476694:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176934 count 1 00010000:00010000:1.0:1651529344.476703:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476704:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.476712:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 2/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1633 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476715:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476716:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476717:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 4/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476724:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 3/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1633 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476727:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.476742:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.476751:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966611392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.476759:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382976 00000100:00100000:1.0:1651529344.476766:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476772:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152143 00000100:00100000:1.0:1651529344.476773:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263232 00000100:00100000:0.0:1651529344.476774:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3a5a2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+435:39030:x1731745946382592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.476777:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 4/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1634 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.476780:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176935 count 1 00000100:00100000:1.0:1651529344.476784:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263296 00010000:00010000:0.0:1651529344.476784:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: --/PW res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476787:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1635 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476789:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 2/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1635 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.476791:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263360 00010000:00010000:0.0:1651529344.476792:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476793:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 5/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1636 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476793:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476793:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 4/0,1 mode: --/PW res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476798:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11100 00000100:00100000:1.0:1651529344.476799:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1636:41279:x1731746396263232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.476801:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 3/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1636 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476815:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.476817:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 4/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1636 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476821:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 3/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1636 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476822:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 4/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1636 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476826:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3b97b7 lrc: 0/0,0 mode: --/PR res: [0x2b323:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc2 expref: 1636 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.476827:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966611456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476837:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.476839:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476839:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476840:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476843:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 4/0,1 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476844:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966611328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476848:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: --/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476850:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.476855:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152144 00000100:00100000:1.0:1651529344.476857:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1635:41279:x1731746396263232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.476857:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+435:39029:x1731745946382656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.476860:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11100 00002000:00080000:0.0:1651529344.476862:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176936 count 1 00000100:00100000:1.0:1651529344.476865:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11101 00010000:00010000:0.0:1651529344.476865:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: --/PW res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476867:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1634:41279:x1731746396263296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.476869:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.476869:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 2/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476871:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476872:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476873:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476874:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 3/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476874:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 4/0,1 mode: --/PW res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476879:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011cbe9cb/0xa29a79078f3b9c09 lrc: 0/0,0 mode: --/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee0a expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476880:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 3/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1634 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476883:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476883:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 4/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476889:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476890:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476890:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966611520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.476893:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 4/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476897:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.476900:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.476902:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152145 00000100:00100000:0.0:1651529344.476904:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+435:39030:x1731745946382720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.476907:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1633:41279:x1731746396263296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (203us total) trans 0 rc 0/0 00002000:00080000:0.0:1651529344.476908:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176937 count 1 00000100:00100000:1.0:1651529344.476909:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11101 00010000:00010000:0.0:1651529344.476911:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476916:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 2/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1632 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.476918:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11102 00010000:00010000:0.0:1651529344.476919:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476919:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.476920:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1632:41278:x1731746396263360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.476920:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 4/0,1 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476922:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.476924:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 4/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476926:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 3/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1632 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476928:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 3/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.476929:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 4/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476932:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3ba1b9 lrc: 0/0,0 mode: --/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ae expref: 1632 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.476933:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966611584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.476936:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476936:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476937:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476939:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476944:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152146 00000100:00100000:0.0:1651529344.476946:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+435:39030:x1731745946382976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.476949:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 4/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.476950:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176938 count 1 00010000:00010000:0.0:1651529344.476953:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476957:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.476964:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1631:41278:x1731746396263360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (222us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.476965:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 2/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1631 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.476966:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11102 00010000:00010000:0.0:1651529344.476968:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476969:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476969:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 4/0,1 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476973:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476976:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476976:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 3/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476979:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 4/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.476980:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476982:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 2/0,0 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476983:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966611648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476995:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.477003:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 2/0,0 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477006:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.477007:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 2/0,0 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477013:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 3/0,0 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477018:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 1/0,0 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477020:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdc52 lrc: 0/0,0 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477023:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+436:39030:x1731745946382400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 734us (795us total) trans 30064893002 rc 0/0 00000100:00100000:1.0:1651529344.477026:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152141 00010000:00010000:0.0:1651529344.477026:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477029:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477032:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477034:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477035:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 2/0,0 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477038:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477052:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,1 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477055:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 2/0,0 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477085:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+437:39030:x1731745946382336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 803us (892us total) trans 30064893003 rc 0/0 00000100:00100000:0.0:1651529344.477088:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152140 00000100:00100000:1.0:1651529344.477095:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+436:39029:x1731745946382208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 910us (944us total) trans 30064893004 rc 0/0 00010000:00010000:0.0:1651529344.477095:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 2/0,0 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477098:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152139 00010000:00010000:0.0:1651529344.477101:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.477102:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 2/0,0 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477105:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 3/0,0 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477106:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 2/0,0 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477109:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.477109:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 1/0,0 mode: --/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477110:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 2/0,0 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477112:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdc59 lrc: 0/0,0 mode: --/PW res: [0x2b324:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477113:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 3/0,0 mode: PW/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477118:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 1/0,0 mode: --/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477121:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdc4b lrc: 0/0,0 mode: --/PW res: [0x2b323:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477306:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966611392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477317:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.477482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.477491:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383232 00000100:00100000:1.0:1651529344.477501:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383168 00000100:00100000:1.0:1651529344.477506:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152147 00000100:00100000:1.0:1651529344.477508:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+437:39030:x1731745946383232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.477513:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176940 count 1 00010000:00010000:1.0:1651529344.477517:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: --/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477521:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 2/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477524:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477525:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477533:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 4/0,1 mode: --/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.477546:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 3/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477550:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 4/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477551:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.477558:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.477559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.477568:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.477568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.477584:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383296 00000100:00100000:0.0:1651529344.477599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.477600:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152148 00000100:00100000:1.0:1651529344.477602:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+438:39029:x1731745946383168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.477610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.477612:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176939 count 1 00010000:00010000:1.0:1651529344.477616:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: --/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477619:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966611456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477620:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 2/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477623:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477624:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477624:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: --/PW res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477625:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 4/0,1 mode: --/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477631:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 3/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.477632:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152149 00010000:00010000:1.0:1651529344.477634:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 4/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477634:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+438:39029:x1731745946383296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.477638:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966611776:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.477640:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176941 count 1 00010000:00010000:0.0:1651529344.477644:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477648:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 2/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1630 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.477652:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477659:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263808 00010000:00010000:0.0:1651529344.477659:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477660:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477660:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 4/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477663:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1631 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.477668:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 3/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1631 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.477669:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263872 00010000:00010000:0.0:1651529344.477671:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477676:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966611840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477679:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 4/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1632 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.477683:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263936 00010000:00010000:1.0:1651529344.477685:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 5/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477685:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477689:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264000 00010000:00010000:1.0:1651529344.477691:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 5/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477692:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966611520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.477695:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11103 00010000:00010000:0.0:1651529344.477696:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: --/PW res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477697:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1634:41279:x1731746396263808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.477699:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477700:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477704:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 3/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477709:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023262946/0xa29a79078f3bbd49 lrc: 0/0,0 mode: --/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7254 expref: 1634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477713:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477713:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477714:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477722:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966611584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477725:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 4/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477725:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477739:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.477747:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1633:41279:x1731746396263808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.477750:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11103 00000100:00100000:0.0:1651529344.477751:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966611648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.477754:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264064 00010000:00010000:0.0:1651529344.477754:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477758:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 4/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477762:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11104 00000100:00100000:0.0:1651529344.477764:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1633:41279:x1731746396263872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.477765:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11105 00000100:00100000:1.0:1651529344.477766:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1633:41279:x1731746396263936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.477767:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477769:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.477769:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 4/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1633 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477770:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 4/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477773:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 3/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477778:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000146ee0bb/0xa29a79078f3bba4e lrc: 0/0,0 mode: --/PR res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6710 expref: 1633 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477781:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477782:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477786:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 3/0,0 mode: PR/PR res: [0x2b327:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1632 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477789:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477792:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 4/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477792:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3b7853 lrc: 0/0,0 mode: --/PR res: [0x2b327:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6dc expref: 1632 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.477796:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477797:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477798:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477801:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.477824:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1631:41279:x1731746396263936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (256us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.477826:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 4/0,1 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477827:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11105 00000100:00100000:1.0:1651529344.477832:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11106 00000100:00100000:1.0:1651529344.477833:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1630:41278:x1731746396264000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.477833:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.477836:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477837:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 4/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477841:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 3/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477846:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3b9e71 lrc: 0/0,0 mode: --/PR res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7f0 expref: 1630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.477849:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1630:41279:x1731746396263872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 84us (289us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.477850:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477850:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477851:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477852:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11104 00010000:00010000:1.0:1651529344.477854:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 4/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477858:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11107 00000100:00100000:0.0:1651529344.477860:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396264064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.477863:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.477865:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 4/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.477869:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.477876:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41278:x1731746396264000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (277us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.477876:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 3/0,0 mode: PR/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.477879:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11106 00010000:00010000:0.0:1651529344.477882:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c4407da/0xa29a79078f3bba24 lrc: 0/0,0 mode: --/PR res: [0x2b32a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6692 expref: 1627 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.477886:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477887:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477887:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477887:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477890:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477890:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 4/0,1 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477893:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477896:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 2/0,0 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477896:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.477908:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41279:x1731746396264064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477911:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11107 00010000:00010000:0.0:1651529344.477924:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 2/0,0 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477928:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.477929:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 2/0,0 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477932:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 3/0,0 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477936:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 1/0,0 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477937:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946382528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1247us (1392us total) trans 30064893005 rc 0/0 00010000:00010000:0.0:1651529344.477939:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdc60 lrc: 0/0,0 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477940:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152142 00010000:00010000:0.0:1651529344.477945:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477948:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477951:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477954:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 2/0,0 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477996:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946382656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1138us (1356us total) trans 30064893006 rc 0/0 00000100:00100000:0.0:1651529344.478007:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152144 00010000:00010000:0.0:1651529344.478015:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 2/0,0 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478018:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.478019:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 2/0,0 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478022:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 3/0,0 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478027:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 1/0,0 mode: --/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478030:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdc6e lrc: 0/0,0 mode: --/PW res: [0x2b328:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478036:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478039:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478042:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,1 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478044:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 2/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478062:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 2/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478066:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e76f4e0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.478067:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 2/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478079:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 3/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478085:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 1/0,0 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478087:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdc7c lrc: 0/0,0 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478095:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946382976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1147us (1341us total) trans 30064893007 rc 0/0 00000100:00100000:0.0:1651529344.478098:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152146 00010000:00010000:0.0:1651529344.478105:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478108:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478111:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,1 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478114:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 2/0,0 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478145:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3a5a2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946382592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1541us total) trans 30064893008 rc 0/0 00000100:00100000:0.0:1651529344.478148:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152143 00010000:00010000:0.0:1651529344.478169:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 2/0,0 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478173:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.478174:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 2/0,0 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478176:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 3/0,0 mode: PW/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478189:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 1/0,0 mode: --/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478192:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdc67 lrc: 0/0,0 mode: --/PW res: [0x2b327:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478198:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478201:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478204:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478207:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 2/0,0 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478244:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946382720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1587us total) trans 30064893009 rc 0/0 00000100:00100000:0.0:1651529344.478246:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152145 00010000:00010000:0.0:1651529344.478253:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 2/0,0 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478256:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.478257:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 2/0,0 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478267:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 3/0,0 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478272:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 1/0,0 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478275:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdc75 lrc: 0/0,0 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478301:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.478305:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: --/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.478335:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264256 00010000:00010000:1.0:1651529344.478340:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 4/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.478347:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11108 00000100:00100000:1.0:1651529344.478354:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41279:x1731746396264256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.478361:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478363:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 4/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478367:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 3/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478383:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000454d4d4a/0xa29a79078f3bbd3b lrc: 0/0,0 mode: --/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d720e expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478393:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478393:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478394:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478397:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 4/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478404:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.478417:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41279:x1731746396264256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478420:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11108 00010000:00010000:1.0:1651529344.478432:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478435:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478438:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478441:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 2/0,0 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478506:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946383232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 997us (1036us total) trans 30064893010 rc 0/0 00000100:00100000:1.0:1651529344.478510:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152147 00010000:00010000:1.0:1651529344.478517:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 2/0,0 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478520:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.478521:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 2/0,0 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478524:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 3/0,0 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478529:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 1/0,0 mode: --/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478532:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdc83 lrc: 0/0,0 mode: --/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478545:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966611776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.478548:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: --/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478588:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966611840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478593:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.478624:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383808 00000100:00100000:1.0:1651529344.478634:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152150 00000100:00100000:1.0:1651529344.478636:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946383808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.478651:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176942 count 1 00000100:00100000:0.0:1651529344.478651:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.478655:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: --/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.478660:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 2/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478663:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478664:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478664:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 4/0,1 mode: --/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.478671:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 3/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.478672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.478674:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 4/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.478685:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.478695:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.478695:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383872 00000100:00100000:1.0:1651529344.478701:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384000 00000100:00100000:1.0:1651529344.478707:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383936 00000100:00100000:0.0:1651529344.478712:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384064 00000100:00100000:1.0:1651529344.478717:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152151 00000100:00100000:1.0:1651529344.478719:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+443:39030:x1731745946384000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.478722:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152152 00002000:00080000:1.0:1651529344.478723:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176945 count 1 00000100:00100000:0.0:1651529344.478724:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+443:39030:x1731745946383872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.478727:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: --/PW res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.478729:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176943 count 1 00010000:00010000:0.0:1651529344.478743:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478746:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 2/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478749:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478750:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478750:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 4/0,1 mode: --/PW res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478757:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 3/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478758:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 2/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478760:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 4/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.478762:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478763:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478763:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 4/0,1 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478764:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966611968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478771:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 3/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.478772:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.478775:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 4/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.478779:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152153 00000100:00100000:0.0:1651529344.478779:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966612032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.478781:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+443:39029:x1731745946383936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.478785:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176944 count 1 00000100:00100000:0.0:1651529344.478788:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.478789:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478794:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 2/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1624 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.478796:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152154 00010000:00010000:1.0:1651529344.478797:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.478797:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+443:39029:x1731745946384064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.478802:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176946 count 1 00010000:00010000:1.0:1651529344.478818:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478819:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 4/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478824:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: --/PW res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478827:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 3/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1624 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478829:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 2/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478831:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1624 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.478833:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.478835:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966612096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478840:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478841:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 4/0,1 mode: --/PW res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478843:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.478849:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 3/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478853:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 4/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.478857:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966612160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.478865:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.478883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.478894:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264704 00010000:00010000:1.0:1651529344.478898:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 4/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.478902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.478906:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11109 00000100:00100000:1.0:1651529344.478908:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41279:x1731746396264704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.478911:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478912:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 4/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.478913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.478916:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 3/0,0 mode: PR/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478921:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000247eadb8/0xa29a79078f3bc235 lrc: 0/0,0 mode: --/PR res: [0x2b32b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8604 expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478935:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478936:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478937:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478941:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384128 00000100:00100000:0.0:1651529344.478950:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152155 00000100:00100000:0.0:1651529344.478951:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+444:39030:x1731745946384128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.478956:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176947 count 1 00010000:00010000:0.0:1651529344.478961:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478965:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 2/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478966:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 4/0,1 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478968:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478969:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478969:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 4/0,1 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478973:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.478986:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1624:41279:x1731746396264704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 77us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478989:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11109 00010000:00010000:0.0:1651529344.478991:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 3/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1624 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.478995:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264768 00010000:00010000:0.0:1651529344.478995:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 4/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1623 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.478999:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479006:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11110 00000100:00100000:1.0:1651529344.479007:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1624:41278:x1731746396264768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479010:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479011:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479014:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966612224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479015:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 3/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479020:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d8114d/0xa29a79078f3bbc31 lrc: 0/0,0 mode: --/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e1e expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479023:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.479031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479032:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479035:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 4/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479044:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.479050:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1623:41278:x1731746396264768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479053:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11110 00010000:00010000:0.0:1651529344.479061:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479065:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479068:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479071:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 2/0,0 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479084:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479088:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479091:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,1 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479094:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 2/0,0 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479134:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+446:39029:x1731745946383296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1499us (1598us total) trans 30064893011 rc 0/0 00000100:00100000:1.0:1651529344.479138:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+446:39029:x1731745946383168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1534us (1654us total) trans 30064893012 rc 0/0 00000100:00100000:0.0:1651529344.479138:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152149 00000100:00100000:1.0:1651529344.479141:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152148 00010000:00010000:0.0:1651529344.479145:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 2/0,0 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479160:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006724e0ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.479176:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 2/0,0 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479180:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 3/0,0 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479185:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 1/0,0 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479188:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdc91 lrc: 0/0,0 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479202:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 2/0,0 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479205:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.479206:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 2/0,0 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479208:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 3/0,0 mode: PW/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479212:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 1/0,0 mode: --/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479223:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdc8a lrc: 0/0,0 mode: --/PW res: [0x2b32b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479269:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966611904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479274:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: --/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479289:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966611968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479292:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: --/PW res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479304:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966612096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479307:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479307:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966612160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.479312:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: --/PW res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479319:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966612032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.479322:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.479469:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384640 00000100:00100000:1.0:1651529344.479480:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152156 00000100:00100000:1.0:1651529344.479481:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+445:39030:x1731745946384640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.479486:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176949 count 1 00010000:00010000:1.0:1651529344.479490:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479495:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 2/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1622 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.479498:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479498:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479499:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 4/0,1 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.479511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.479521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.479522:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 3/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1622 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.479530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.479531:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 4/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1622 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479539:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966612288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.479544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479549:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.479552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479555:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264896 00010000:00010000:1.0:1651529344.479559:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 4/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1623 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479565:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265024 00010000:00010000:1.0:1651529344.479567:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 4/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479574:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384576 00000100:00100000:1.0:1651529344.479579:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265088 00000100:00100000:0.0:1651529344.479582:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152157 00010000:00010000:1.0:1651529344.479583:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 4/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479584:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+446:39029:x1731745946384576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.479587:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265152 00010000:00010000:1.0:1651529344.479589:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1626 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.479589:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176948 count 1 00000100:00100000:1.0:1651529344.479593:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265280 00010000:00010000:0.0:1651529344.479594:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: --/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479595:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 4/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1627 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479599:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265408 00010000:00010000:1.0:1651529344.479601:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 5/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479605:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11111 00000100:00100000:1.0:1651529344.479607:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396264896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479609:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.479609:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 2/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1628 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.479610:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 4/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479612:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479613:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479613:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 4/0,1 mode: --/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479614:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 3/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479619:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494b56cf/0xa29a79078f3ba142 lrc: 0/0,0 mode: --/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d030a expref: 1628 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479621:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 3/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1628 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.479623:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479623:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479624:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479624:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 4/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1627 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479627:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 4/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479628:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966612352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479634:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.479639:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.479640:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1627:41279:x1731746396264896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479643:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11111 00000100:00100000:1.0:1651529344.479648:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11112 00000100:00100000:0.0:1651529344.479648:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966612224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.479649:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41278:x1731746396265024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.479651:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479652:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479653:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 4/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479657:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 3/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479659:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11113 00010000:00010000:1.0:1651529344.479661:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a409e5/0xa29a79078f3ba2ed lrc: 0/0,0 mode: --/PR res: [0x2b331:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09e0 expref: 1626 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.479661:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41279:x1731746396265088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479664:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479664:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479665:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479666:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479666:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 4/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479668:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 4/0,1 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479674:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.479678:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41278:x1731746396265024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.479680:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 3/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479681:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11112 00000100:00100000:1.0:1651529344.479684:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11114 00010000:00010000:0.0:1651529344.479685:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033dfc238/0xa29a79078f3bb34e lrc: 0/0,0 mode: --/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c2f expref: 1624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479686:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1624:41278:x1731746396265152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.479688:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.479689:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479690:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1623 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479690:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479691:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479693:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 3/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1623 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479694:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 4/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479698:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da04fd7/0xa29a79078f3b976a lrc: 0/0,0 mode: --/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbd4 expref: 1623 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479700:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.479701:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479702:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479702:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479705:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 4/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479707:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1622:41279:x1731746396265088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.479710:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11113 00010000:00010000:1.0:1651529344.479711:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.479715:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1621:41278:x1731746396265152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.479716:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11115 00000100:00100000:1.0:1651529344.479718:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11114 00000100:00100000:0.0:1651529344.479718:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1621:41278:x1731746396265280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.479720:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.479722:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11116 00010000:00010000:0.0:1651529344.479722:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 4/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.479723:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1620:41279:x1731746396265408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.479726:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.479726:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 3/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479727:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 4/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479740:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 3/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479745:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392255a6/0xa29a79078f3bb29f lrc: 0/0,0 mode: --/PR res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4893 expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.479745:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b24572/0xa29a79078f3bc331 lrc: 0/0,0 mode: --/PR res: [0x2b332:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a2c expref: 1620 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.479749:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479750:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479750:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479750:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479750:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479753:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 4/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479753:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 4/0,1 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479762:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.479766:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.479767:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41279:x1731746396265408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479770:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11116 00010000:00010000:1.0:1651529344.479777:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479780:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479783:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479788:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479788:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1617:41278:x1731746396265280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.479791:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11115 00010000:00010000:0.0:1651529344.479821:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479825:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479828:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,1 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479830:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 2/0,0 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479862:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+447:39029:x1731745946383936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1196us total) trans 30064893013 rc 0/0 00000100:00100000:1.0:1651529344.479865:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152153 00010000:00010000:1.0:1651529344.479873:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479877:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.479878:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479880:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 3/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479885:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 1/0,0 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479888:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdcad lrc: 0/0,0 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479892:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 2/0,0 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479893:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+447:39029:x1731745946384064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1095us (1221us total) trans 30064893014 rc 0/0 00010000:00010000:1.0:1651529344.479895:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.479896:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 2/0,0 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479897:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152154 00010000:00010000:1.0:1651529344.479899:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 3/0,0 mode: PW/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479902:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 1/0,0 mode: --/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479904:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdcb4 lrc: 0/0,0 mode: --/PW res: [0x2b332:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479904:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479908:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479910:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479911:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479912:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479913:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 2/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479915:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,1 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479918:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 2/0,0 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479947:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+448:39030:x1731745946383872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1296us total) trans 30064893015 rc 0/0 00000100:00100000:0.0:1651529344.479949:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152152 00000100:00100000:1.0:1651529344.479954:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946384000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1234us (1294us total) trans 30064893016 rc 0/0 00010000:00010000:0.0:1651529344.479956:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 2/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479957:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152151 00010000:00010000:0.0:1651529344.479959:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a73acf9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.479960:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 2/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479963:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 3/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479964:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 2/0,0 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479967:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.479968:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 2/0,0 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479968:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 1/0,0 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479971:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 3/0,0 mode: PW/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479971:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdca6 lrc: 0/0,0 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479975:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 1/0,0 mode: --/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479977:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479978:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdc9f lrc: 0/0,0 mode: --/PW res: [0x2b331:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479980:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479983:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479985:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479986:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 2/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479988:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479991:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479994:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 2/0,0 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480020:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+448:39030:x1731745946384128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1068us (1118us total) trans 30064893017 rc 0/0 00000100:00100000:0.0:1651529344.480023:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152155 00000100:00100000:1.0:1651529344.480027:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+447:39029:x1731745946383808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1390us (1420us total) trans 30064893018 rc 0/0 00010000:00010000:0.0:1651529344.480030:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 2/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480033:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677dae30 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.480034:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 2/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480037:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 3/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480038:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152150 00010000:00010000:0.0:1651529344.480041:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 1/0,0 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480044:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdcbb lrc: 0/0,0 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480045:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 2/0,0 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480049:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.480050:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 2/0,0 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480053:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 3/0,0 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480057:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 1/0,0 mode: --/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480060:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdc98 lrc: 0/0,0 mode: --/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480077:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966612288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.480081:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.480106:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265664 00010000:00010000:1.0:1651529344.480111:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 4/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1617 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.480124:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11117 00000100:00100000:1.0:1651529344.480143:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1617:41278:x1731746396265664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.480163:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.480165:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 4/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1617 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480174:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 3/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1617 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480180:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3b8f75 lrc: 0/0,0 mode: --/PR res: [0x2b335:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc49d expref: 1617 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480184:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480184:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480185:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480188:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 4/0,1 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480195:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.480208:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1616:41278:x1731746396265664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.480211:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11117 00010000:00010000:1.0:1651529344.480218:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480221:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480238:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,1 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480241:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 2/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480252:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 2/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480256:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.480257:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 2/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480260:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 3/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480265:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 1/0,0 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480268:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdcc2 lrc: 0/0,0 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480287:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946384640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 805us (827us total) trans 30064893019 rc 0/0 00000100:00100000:1.0:1651529344.480290:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152156 00000100:00100000:0.0:1651529344.480368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480385:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385024 00000100:00100000:1.0:1651529344.480392:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152158 00000100:00100000:0.0:1651529344.480392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.480394:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946385024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.480399:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176950 count 1 00010000:00010000:1.0:1651529344.480403:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: --/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480414:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 2/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480417:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480418:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480419:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 4/0,1 mode: --/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480432:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 3/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.480436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.480446:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 4/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.480446:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480455:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966612416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.480463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480466:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.480468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480480:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385152 00000100:00100000:1.0:1651529344.480498:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385088 00000100:00100000:0.0:1651529344.480501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480504:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385280 00000100:00100000:1.0:1651529344.480514:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385216 00000100:00100000:1.0:1651529344.480517:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385344 00000100:00100000:1.0:1651529344.480520:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385472 00000100:00100000:0.0:1651529344.480522:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966612352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480523:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152159 00000100:00100000:1.0:1651529344.480524:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+453:39030:x1731745946385152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.480526:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: --/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.480529:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176952 count 1 00010000:00010000:1.0:1651529344.480533:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480534:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152160 00000100:00100000:0.0:1651529344.480536:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+453:39029:x1731745946385088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.480538:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 2/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480541:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480541:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.480541:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176951 count 1 00010000:00010000:1.0:1651529344.480542:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 4/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480546:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480548:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 3/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480550:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 2/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480553:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480554:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480555:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 4/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480561:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 3/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480562:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.480566:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966612480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.480568:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 4/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.480572:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966612544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480579:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.480586:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152161 00000100:00100000:1.0:1651529344.480588:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+453:39030:x1731745946385280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.480588:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.480593:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176954 count 1 00000100:00100000:0.0:1651529344.480594:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152162 00000100:00100000:0.0:1651529344.480596:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+453:39030:x1731745946385216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.480597:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.480600:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176953 count 1 00010000:00010000:1.0:1651529344.480601:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 2/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480604:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480604:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480605:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480605:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 4/0,1 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480608:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 2/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480611:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480612:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 3/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480612:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480612:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 4/0,1 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480615:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 4/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.480618:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 3/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480622:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 4/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.480629:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966612608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480637:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.480643:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265792 00000100:00100000:0.0:1651529344.480645:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966612672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.480647:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 4/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1616 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.480653:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.480655:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11118 00000100:00100000:1.0:1651529344.480656:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1616:41279:x1731746396265792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.480659:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.480660:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 4/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480664:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 3/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480669:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011919525/0xa29a79078f3bb63b lrc: 0/0,0 mode: --/PR res: [0x2b334:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5750 expref: 1616 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.480671:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152163 00010000:00010000:1.0:1651529344.480673:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480673:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.480673:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+453:39030:x1731745946385344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.480674:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480677:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 4/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.480677:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176955 count 1 00010000:00010000:0.0:1651529344.480682:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: --/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480686:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 2/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480689:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480689:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480690:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 4/0,1 mode: --/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480695:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.480703:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41279:x1731746396265792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (311us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.480703:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 3/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1615 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.480706:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11118 00010000:00010000:0.0:1651529344.480707:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 4/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.480711:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966612736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480714:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152164 00000100:00100000:1.0:1651529344.480716:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+453:39029:x1731745946385472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.480718:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.480721:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176956 count 1 00010000:00010000:1.0:1651529344.480724:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480725:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480729:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 2/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1614 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480729:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480740:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480741:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480741:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 4/0,1 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480741:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480744:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 2/0,0 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480748:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 3/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1614 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480752:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 4/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1614 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.480756:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966612800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480764:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.480784:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+454:39029:x1731745946384576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1199us (1307us total) trans 30064893020 rc 0/0 00000100:00100000:0.0:1651529344.480787:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152157 00010000:00010000:0.0:1651529344.480795:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 2/0,0 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480798:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.480799:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 2/0,0 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480802:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 3/0,0 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480826:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 1/0,0 mode: --/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480829:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdcc9 lrc: 0/0,0 mode: --/PW res: [0x2b334:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.480935:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966612416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.480940:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: --/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480948:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265856 00010000:00010000:1.0:1651529344.480952:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 4/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.480960:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11119 00000100:00100000:1.0:1651529344.480962:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41278:x1731746396265856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.480964:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.480966:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 4/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480969:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 3/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480975:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bc30e lrc: 0/0,0 mode: --/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8984 expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.480978:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480979:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480980:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480983:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 4/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480998:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.481000:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.481005:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385728 00000100:00100000:1.0:1651529344.481009:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1614:41278:x1731746396265856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481012:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11119 00000100:00100000:0.0:1651529344.481013:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152165 00000100:00100000:0.0:1651529344.481014:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+454:39030:x1731745946385728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.481018:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.481020:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176957 count 1 00010000:00010000:1.0:1651529344.481021:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481024:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481027:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 2/0,0 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481033:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: --/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481038:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 2/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.481041:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481042:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481042:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 4/0,1 mode: --/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481050:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 3/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.481053:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 4/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481057:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966612864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.481070:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+455:39030:x1731745946385024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 675us (702us total) trans 30064893021 rc 0/0 00000100:00100000:1.0:1651529344.481073:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152158 00000100:00100000:0.0:1651529344.481074:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.481080:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 2/0,0 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481084:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.481085:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 2/0,0 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481097:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 3/0,0 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481102:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 1/0,0 mode: --/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481110:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdcd0 lrc: 0/0,0 mode: --/PW res: [0x2b336:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.481268:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385792 00000100:00100000:0.0:1651529344.481279:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152166 00000100:00100000:0.0:1651529344.481281:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+455:39030:x1731745946385792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.481286:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176958 count 1 00010000:00010000:0.0:1651529344.481290:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: --/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481295:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 2/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.481298:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481299:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481299:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 4/0,1 mode: --/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481306:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 3/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.481310:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 4/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481314:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966612928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.481327:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.481569:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966612480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.481574:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481613:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966612608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.481617:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481628:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481636:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966612800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.481636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.481643:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481646:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481650:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266432 00000100:00100000:0.0:1651529344.481652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.481660:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1614 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481676:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266560 00010000:00010000:1.0:1651529344.481679:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 5/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481683:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266496 00010000:00010000:1.0:1651529344.481685:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 4/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1616 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481689:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266688 00010000:00010000:1.0:1651529344.481691:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 5/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1617 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481695:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266624 00010000:00010000:1.0:1651529344.481697:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 5/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1618 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481701:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266752 00010000:00010000:1.0:1651529344.481702:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 4/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1619 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481707:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11120 00000100:00100000:1.0:1651529344.481709:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1619:41278:x1731746396266432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.481711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.481712:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481713:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1619 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481721:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966612544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481725:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481741:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 3/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1619 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481742:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966612672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481745:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481747:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfc12f12/0xa29a79078f3b9a57 lrc: 0/0,0 mode: --/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce726 expref: 1619 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481750:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481751:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481752:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481755:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 4/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481768:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.481771:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966612736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481774:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: --/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481781:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41278:x1731746396266432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 72us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481784:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11120 00000100:00100000:0.0:1651529344.481788:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966612864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.481789:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266816 00010000:00010000:0.0:1651529344.481791:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: --/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481793:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 4/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1618 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481798:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966612928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.481799:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11121 00000100:00100000:1.0:1651529344.481800:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41278:x1731746396266560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.481800:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: --/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481818:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481820:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 4/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1618 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481824:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11122 00000100:00100000:0.0:1651529344.481826:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41279:x1731746396266496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.481831:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 3/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1618 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481837:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040b25e81/0xa29a79078f3ba508 lrc: 0/0,0 mode: --/PR res: [0x2b337:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d132c expref: 1618 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.481838:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481840:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481840:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 4/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1617 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481841:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481842:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481844:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 3/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1617 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481845:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 4/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481850:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000197f77aa/0xa29a79078f3ba77e lrc: 0/0,0 mode: --/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d9e expref: 1617 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481853:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481859:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1616:41278:x1731746396266560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.481859:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481860:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481861:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481862:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11121 00010000:00010000:0.0:1651529344.481864:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 4/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481867:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11123 00000100:00100000:1.0:1651529344.481869:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41278:x1731746396266688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.481873:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.481878:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481880:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 4/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481881:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41279:x1731746396266496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.481883:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 3/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481884:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11122 00010000:00010000:1.0:1651529344.481895:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081e36568/0xa29a79078f3b9a26 lrc: 0/0,0 mode: --/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce61c expref: 1614 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.481895:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11124 00000100:00100000:0.0:1651529344.481896:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1614:41279:x1731746396266624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.481899:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481899:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481899:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481900:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481900:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 4/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1613 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481903:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 4/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481911:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481918:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1613:41278:x1731746396266688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481920:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11123 00010000:00010000:0.0:1651529344.481921:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 3/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481925:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11125 00010000:00010000:0.0:1651529344.481926:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8fa0d50/0xa29a79078f3ba754 lrc: 0/0,0 mode: --/PR res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d04 expref: 1612 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481927:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1612:41279:x1731746396266752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.481929:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481930:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481930:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481931:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 4/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.481931:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481934:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 3/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.481934:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 4/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481939:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b78646/0xa29a79078f3ba310 lrc: 0/0,0 mode: --/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a65 expref: 1611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.481940:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.481946:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41279:x1731746396266624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.481949:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11124 00010000:00010000:1.0:1651529344.481951:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481952:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481952:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481954:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11126 00010000:00010000:1.0:1651529344.481955:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 4/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481956:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1609:41279:x1731746396266816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.481959:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481960:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 4/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1609 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481962:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.481964:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 3/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1609 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.481968:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1609:41279:x1731746396266752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481971:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11125 00010000:00010000:0.0:1651529344.481977:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c768c85a/0xa29a79078f3bc0ec lrc: 0/0,0 mode: --/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80a8 expref: 1608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.481978:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481980:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481981:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481981:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481982:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481984:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481985:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 4/0,1 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481987:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 2/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481991:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.482003:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1607:41279:x1731746396266816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.482005:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11126 00010000:00010000:0.0:1651529344.482013:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 2/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482016:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.482017:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 2/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482020:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 3/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482024:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 1/0,0 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482030:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946385280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1441us (1573us total) trans 30064893022 rc 0/0 00000100:00100000:1.0:1651529344.482033:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152161 00010000:00010000:0.0:1651529344.482036:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdce5 lrc: 0/0,0 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482043:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482046:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482048:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482049:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482051:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482052:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 2/0,0 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482054:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482057:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 2/0,0 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482096:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946385344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1422us (1627us total) trans 30064893023 rc 0/0 00000100:00100000:1.0:1651529344.482097:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946385152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1572us (1661us total) trans 30064893024 rc 0/0 00000100:00100000:0.0:1651529344.482099:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152163 00000100:00100000:1.0:1651529344.482101:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152159 00010000:00010000:0.0:1651529344.482106:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 2/0,0 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482107:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 2/0,0 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482110:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.482111:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.482111:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 2/0,0 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482112:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 2/0,0 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482114:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 3/0,0 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482115:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 3/0,0 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482119:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 1/0,0 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482126:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 1/0,0 mode: --/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482129:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdcf3 lrc: 0/0,0 mode: --/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482132:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdcd7 lrc: 0/0,0 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482135:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482138:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482139:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482141:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482142:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482144:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 2/0,0 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482145:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482148:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 2/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482187:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+457:39029:x1731745946385088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1650us (1740us total) trans 30064893025 rc 0/0 00000100:00100000:1.0:1651529344.482190:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+457:39029:x1731745946385472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1472us (1688us total) trans 30064893026 rc 0/0 00000100:00100000:0.0:1651529344.482190:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152160 00000100:00100000:1.0:1651529344.482193:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152164 00010000:00010000:0.0:1651529344.482197:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482200:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.482214:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,1 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482217:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 2/0,0 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482257:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946385728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1241us (1258us total) trans 30064893027 rc 0/0 00000100:00100000:0.0:1651529344.482259:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152165 00010000:00010000:0.0:1651529344.482266:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482270:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482273:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482275:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 2/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482305:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946385216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1708us (1842us total) trans 30064893028 rc 0/0 00000100:00100000:0.0:1651529344.482308:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152162 00010000:00010000:0.0:1651529344.482314:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 2/0,0 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482320:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.482321:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 2/0,0 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482324:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 3/0,0 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482328:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 1/0,0 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482331:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdcde lrc: 0/0,0 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482335:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 2/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482337:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.482338:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 2/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482341:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 3/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482344:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 1/0,0 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482348:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 2/0,0 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482349:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdcfa lrc: 0/0,0 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482352:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.482353:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 2/0,0 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482353:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 2/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482355:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.482366:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 3/0,0 mode: PW/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482371:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 1/0,0 mode: --/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482374:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdd01 lrc: 0/0,0 mode: --/PW res: [0x2b33d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482374:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 2/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482377:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 3/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482381:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 1/0,0 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482383:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266880 00010000:00010000:0.0:1651529344.482384:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdcec lrc: 0/0,0 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482388:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 4/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.482399:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11127 00000100:00100000:1.0:1651529344.482401:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1607:41278:x1731746396266880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.482404:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.482405:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 4/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.482409:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 3/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.482414:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000633971a7/0xa29a79078f3baf5e lrc: 0/0,0 mode: --/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bc7 expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.482432:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482433:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482434:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482437:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 4/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482445:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.482456:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41278:x1731746396266880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.482458:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11127 00010000:00010000:0.0:1651529344.482461:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482465:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482468:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482471:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 2/0,0 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482518:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946385792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1262us total) trans 30064893029 rc 0/0 00000100:00100000:0.0:1651529344.482521:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152166 00000100:00100000:0.0:1651529344.482526:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386304 00000100:00100000:1.0:1651529344.482531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482546:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386368 00000100:00100000:0.0:1651529344.482561:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152167 00000100:00100000:0.0:1651529344.482563:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946386304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.482568:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176959 count 1 00010000:00010000:0.0:1651529344.482573:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.482578:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 2/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482581:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482581:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482582:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 4/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.482594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.482596:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 3/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482600:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.482601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482605:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966612992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.482608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482620:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482627:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386432 00000100:00100000:0.0:1651529344.482633:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386624 00000100:00100000:0.0:1651529344.482635:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386560 00000100:00100000:0.0:1651529344.482638:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386688 00000100:00100000:0.0:1651529344.482640:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386752 00000100:00100000:0.0:1651529344.482643:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152168 00000100:00100000:0.0:1651529344.482644:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946386368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.482645:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 2/0,0 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.482649:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176960 count 1 00010000:00010000:1.0:1651529344.482650:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.482651:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 2/0,0 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482652:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482654:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 3/0,0 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482667:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 1/0,0 mode: --/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482670:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdd08 lrc: 0/0,0 mode: --/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482679:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152169 00000100:00100000:1.0:1651529344.482680:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946386432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.482687:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 2/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482691:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482691:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.482698:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176961 count 1 00010000:00010000:1.0:1651529344.482702:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482702:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 4/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482707:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 2/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1605 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482710:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482711:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482711:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 3/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482712:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 4/0,1 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482715:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.482719:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 3/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1605 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.482722:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966613056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.482723:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 4/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1605 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.482739:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966613120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482741:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.482749:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482749:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152170 00000100:00100000:0.0:1651529344.482750:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+462:39029:x1731745946386624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.482755:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176963 count 1 00000100:00100000:1.0:1651529344.482756:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152171 00000100:00100000:1.0:1651529344.482758:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946386560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.482759:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.482763:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176962 count 1 00010000:00010000:0.0:1651529344.482764:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 2/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1605 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482766:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482767:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482768:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482768:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 4/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482771:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 2/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482774:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482774:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482774:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 3/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1605 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482775:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 4/0,1 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482778:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1605 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.482781:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 3/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.482782:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966613184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.482785:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 4/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.482789:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966613248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.482820:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482820:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482826:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152172 00000100:00100000:1.0:1651529344.482828:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152173 00000100:00100000:0.0:1651529344.482828:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033321bfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946386688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.482830:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946386752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.482835:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176965 count 1 00010000:00010000:1.0:1651529344.482839:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482843:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 2/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.482845:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176964 count 1 00010000:00010000:1.0:1651529344.482846:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482847:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482847:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 4/0,1 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482850:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482853:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 3/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482854:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 2/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482857:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 4/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.482857:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482858:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482859:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 4/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482860:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966613312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.482865:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 3/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.482867:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.482869:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.482873:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966613376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482881:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.482882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482887:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386816 00000100:00100000:0.0:1651529344.482893:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152174 00000100:00100000:0.0:1651529344.482895:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+463:39030:x1731745946386816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.482908:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176966 count 1 00010000:00010000:0.0:1651529344.482912:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482919:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 2/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.482922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.482922:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482922:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482923:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 4/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482929:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 3/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482932:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.482936:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966613440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482943:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482955:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966612992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.482959:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482982:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267392 00010000:00010000:1.0:1651529344.482987:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.482999:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11128 00000100:00100000:1.0:1651529344.483001:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41278:x1731746396267392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.483003:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483005:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483009:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 3/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483014:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7f93c2/0xa29a79078f3bbc4d lrc: 0/0,0 mode: --/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ef0 expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483018:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483018:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483019:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483022:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 4/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483030:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.483033:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483037:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483041:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41278:x1731746396267392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.483043:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11128 00010000:00010000:0.0:1651529344.483048:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483050:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483099:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+464:39030:x1731745946386304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 534us (600us total) trans 30064893030 rc 0/0 00000100:00100000:0.0:1651529344.483102:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152167 00010000:00010000:0.0:1651529344.483110:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483113:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483114:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483117:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 3/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483122:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 1/0,0 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483125:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdd0f lrc: 0/0,0 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.483353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.483357:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966613184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.483360:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.483361:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.483375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.483375:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966613056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483378:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483384:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387008 00000100:00100000:0.0:1651529344.483421:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152175 00000100:00100000:1.0:1651529344.483422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.483423:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+464:39030:x1731745946387008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.483427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.483428:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176967 count 1 00010000:00010000:0.0:1651529344.483433:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483437:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 2/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1604 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483440:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.483441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.483441:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483441:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 4/0,1 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483448:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 3/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1604 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483452:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 4/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1604 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.483455:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267584 00000100:00100000:0.0:1651529344.483456:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966613504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.483460:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1605 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.483466:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267456 00010000:00010000:1.0:1651529344.483468:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483468:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.483472:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267648 00010000:00010000:1.0:1651529344.483474:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 5/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483475:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966613376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.483478:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267520 00010000:00010000:1.0:1651529344.483479:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 5/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1608 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.483479:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483483:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267712 00010000:00010000:1.0:1651529344.483485:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 5/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1609 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483486:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966613440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.483488:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267776 00010000:00010000:0.0:1651529344.483488:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483490:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1610 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483494:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267840 00000100:00100000:1.0:1651529344.483495:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11129 00000100:00100000:1.0:1651529344.483496:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41279:x1731746396267584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.483499:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483500:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483502:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1611 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483505:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 3/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1611 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483505:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11130 00000100:00100000:0.0:1651529344.483507:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41278:x1731746396267456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.483510:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483511:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bbcd233/0xa29a79078f3b9771 lrc: 0/0,0 mode: --/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf0 expref: 1611 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.483511:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483514:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483515:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483515:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 3/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1610 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483516:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483519:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 4/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483523:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f577b2/0xa29a79078f3bb252 lrc: 0/0,0 mode: --/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4789 expref: 1610 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483529:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.483536:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.483537:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1609:41279:x1731746396267584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.483537:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483538:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483540:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11129 00010000:00010000:0.0:1651529344.483541:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 4/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483547:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.483549:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11131 00000100:00100000:1.0:1651529344.483551:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1608:41279:x1731746396267648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.483554:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.483554:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1608:41278:x1731746396267456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.483555:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 5/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1608 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483557:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11130 00010000:00010000:1.0:1651529344.483561:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 4/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1607 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483562:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11132 00000100:00100000:0.0:1651529344.483564:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1607:41278:x1731746396267520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.483566:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483567:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483567:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483567:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.483568:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 5/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1607 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483570:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 4/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483572:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 4/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1607 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483574:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.483576:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483577:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483578:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483579:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1607:41279:x1731746396267648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.483581:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 4/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483582:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11131 00010000:00010000:0.0:1651529344.483585:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.483586:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11133 00000100:00100000:1.0:1651529344.483587:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41279:x1731746396267712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.483589:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41278:x1731746396267520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.483590:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483591:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 5/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483592:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11132 00010000:00010000:1.0:1651529344.483595:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 4/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483596:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11134 00000100:00100000:0.0:1651529344.483597:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396267776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.483599:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483599:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483599:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483600:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483601:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483603:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 4/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483604:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 3/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.483607:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.483609:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069611c7b/0xa29a79078f3bc3ee lrc: 0/0,0 mode: --/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cb0 expref: 1605 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.483611:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396267712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.483612:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483612:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.483613:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11133 00010000:00010000:0.0:1651529344.483613:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483617:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11135 00000100:00100000:1.0:1651529344.483619:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1603:41278:x1731746396267840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.483619:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 4/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483621:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.483622:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1603 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.483624:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.483626:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 3/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1603 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483629:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1603:41279:x1731746396267776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.483630:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3b9fac lrc: 0/0,0 mode: --/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc8f expref: 1603 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.483632:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11134 00010000:00010000:1.0:1651529344.483634:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483634:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483635:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483637:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483638:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 4/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483641:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483644:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483647:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.483653:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1601:41278:x1731746396267840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.483653:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483655:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11135 00010000:00010000:1.0:1651529344.483666:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637b0210/0xa29a79078f3b94a0 lrc: 0/0,0 mode: --/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccff6 expref: 1600 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.483670:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966613120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.483674:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483677:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483680:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483683:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483685:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483700:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033321bfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 871us (1098us total) trans 30064893031 rc 0/0 00000100:00100000:0.0:1651529344.483703:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152172 00010000:00010000:0.0:1651529344.483711:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483714:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483716:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483719:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 3/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483723:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 1/0,0 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483726:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdd39 lrc: 0/0,0 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483738:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483741:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483742:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483745:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 3/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483746:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1064us (1170us total) trans 30064893032 rc 0/0 00010000:00010000:0.0:1651529344.483748:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 1/0,0 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483751:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdd1d lrc: 0/0,0 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483758:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152169 00010000:00010000:0.0:1651529344.483759:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483762:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483765:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483767:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483772:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3b9d21 lrc: 0/0,0 mode: --/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2da expref: 1599 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.483776:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966613248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.483779:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483783:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483786:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483788:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483791:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483828:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 932us (945us total) trans 30064893033 rc 0/0 00000100:00100000:0.0:1651529344.483831:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152174 00010000:00010000:0.0:1651529344.483838:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483841:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483842:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483845:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 3/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483850:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 1/0,0 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483851:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1256us total) trans 30064893034 rc 0/0 00010000:00010000:0.0:1651529344.483853:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdd40 lrc: 0/0,0 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483854:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152171 00010000:00010000:0.0:1651529344.483857:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483859:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483860:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483863:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 3/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483865:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3ba3e9 lrc: 0/0,0 mode: --/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dad expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.483866:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 1/0,0 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483869:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdd2b lrc: 0/0,0 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483874:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483877:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483880:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966613312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483880:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483883:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483883:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483887:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483896:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483899:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483902:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483930:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+466:39029:x1731745946386624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1179us (1346us total) trans 30064893035 rc 0/0 00000100:00100000:0.0:1651529344.483933:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152170 00010000:00010000:0.0:1651529344.483940:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483943:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1334us total) trans 30064893036 rc 0/0 00010000:00010000:0.0:1651529344.483944:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.483945:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483946:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152173 00010000:00010000:0.0:1651529344.483947:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 3/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483952:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 1/0,0 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483954:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483954:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdd24 lrc: 0/0,0 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483957:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.483958:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483960:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483963:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483966:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483969:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483971:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 3/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483976:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 1/0,0 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483979:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bdd32 lrc: 0/0,0 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483983:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483986:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.483987:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483990:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 3/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483993:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 1/0,0 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483996:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdd16 lrc: 0/0,0 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484002:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946386368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1357us (1471us total) trans 30064893037 rc 0/0 00000100:00100000:0.0:1651529344.484005:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152168 00000100:00100000:0.0:1651529344.484195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.484202:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387456 00000100:00100000:0.0:1651529344.484216:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152176 00000100:00100000:0.0:1651529344.484218:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946387456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.484223:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176968 count 1 00010000:00010000:0.0:1651529344.484228:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484232:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 2/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484235:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484236:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484237:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 4/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484243:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 3/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484247:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.484251:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966613568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.484265:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.484332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.484342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.484344:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966613504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484348:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.484364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.484373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.484375:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387520 00000100:00100000:1.0:1651529344.484379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.484382:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387584 00000100:00100000:0.0:1651529344.484386:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387648 00000100:00100000:1.0:1651529344.484387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.484397:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387712 00000100:00100000:0.0:1651529344.484399:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387840 00000100:00100000:0.0:1651529344.484402:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387776 00000100:00100000:1.0:1651529344.484404:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152177 00000100:00100000:1.0:1651529344.484405:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+471:39029:x1731745946387520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.484407:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152178 00000100:00100000:0.0:1651529344.484408:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946387584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.484411:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176969 count 1 00002000:00080000:0.0:1651529344.484413:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176970 count 1 00010000:00010000:1.0:1651529344.484416:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484421:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 2/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.484424:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484425:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484425:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 4/0,1 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484432:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 3/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.484436:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 4/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.484440:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966613632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484444:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484449:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 2/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484452:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484453:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484454:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 4/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484461:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.484461:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 3/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484465:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.484469:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966613696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484476:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152179 00000100:00100000:1.0:1651529344.484478:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+471:39029:x1731745946387648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.484478:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.484483:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176971 count 1 00000100:00100000:0.0:1651529344.484484:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152180 00000100:00100000:0.0:1651529344.484486:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946387712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.484487:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484491:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 2/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.484491:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176972 count 1 00010000:00010000:1.0:1651529344.484494:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484495:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484495:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484496:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 4/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484499:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 2/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.484502:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 3/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484502:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484502:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484503:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 4/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484505:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.484509:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 3/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.484510:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966613760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484515:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.484517:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.484519:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966613824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484523:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152181 00000100:00100000:1.0:1651529344.484525:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946387840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.484525:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.484529:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176974 count 1 00000100:00100000:0.0:1651529344.484531:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152182 00010000:00010000:1.0:1651529344.484532:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484533:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+471:39029:x1731745946387776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.484537:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176973 count 1 00010000:00010000:0.0:1651529344.484540:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484544:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 2/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.484546:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 2/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1597 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484547:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484548:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484548:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 4/0,1 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484549:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484550:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484550:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 4/0,1 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484554:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 3/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1597 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.484557:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 3/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1597 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.484557:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 4/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484561:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 4/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1597 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.484564:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966613888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484565:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966613952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.484570:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.484572:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.484579:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268416 00010000:00010000:1.0:1651529344.484583:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 4/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.484591:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11136 00000100:00100000:1.0:1651529344.484593:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1598:41279:x1731746396268416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.484595:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.484596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.484597:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 4/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484614:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 3/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484620:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85fe23c/0xa29a79078f3bc0c2 lrc: 0/0,0 mode: --/PR res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8007 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484624:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484624:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.484632:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966613568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484637:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484644:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484653:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 4/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484663:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.484666:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484670:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484674:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1597:41279:x1731746396268416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484677:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11136 00000100:00100000:1.0:1651529344.484687:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268480 00010000:00010000:1.0:1651529344.484690:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.484692:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484695:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484700:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11137 00000100:00100000:1.0:1651529344.484701:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1597:41279:x1731746396268480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.484704:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.484705:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484716:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 3/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484721:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b829d583/0xa29a79078f3bb78b lrc: 0/0,0 mode: --/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c0b expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.484725:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484725:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484726:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484729:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 4/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484746:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.484753:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1596:41279:x1731746396268480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484756:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11137 00000100:00100000:0.0:1651529344.484758:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946387008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1334us (1417us total) trans 30064893038 rc 0/0 00000100:00100000:0.0:1651529344.484761:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152175 00010000:00010000:0.0:1651529344.484769:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484775:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.484776:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484792:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 3/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484798:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 1/0,0 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484801:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdd47 lrc: 0/0,0 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484820:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484823:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484831:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484834:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484847:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484852:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.484853:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484861:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 3/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484873:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 1/0,0 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484876:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdd4e lrc: 0/0,0 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484888:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966613632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.484891:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484915:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946387456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 696us (720us total) trans 30064893039 rc 0/0 00000100:00100000:0.0:1651529344.484918:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152176 00000100:00100000:0.0:1651529344.484941:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966613696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484945:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484967:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966613824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484968:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966613760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484970:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484973:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.485020:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388032 00000100:00100000:0.0:1651529344.485027:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152183 00000100:00100000:0.0:1651529344.485029:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946388032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.485034:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176975 count 1 00010000:00010000:0.0:1651529344.485038:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485043:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 2/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1595 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485046:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485046:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485047:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 4/0,1 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485053:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 3/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1595 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485058:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 4/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1595 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485062:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966614016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.485115:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.485136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.485154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.485164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485168:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268608 00010000:00010000:0.0:1651529344.485175:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1596 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485186:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268544 00000100:00100000:1.0:1651529344.485187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.485189:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 4/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485193:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268672 00010000:00010000:0.0:1651529344.485201:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485206:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268736 00010000:00010000:0.0:1651529344.485208:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1599 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485212:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268928 00010000:00010000:0.0:1651529344.485214:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 5/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1600 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485219:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11138 00000100:00100000:1.0:1651529344.485221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485229:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1600:41278:x1731746396268608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.485232:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485234:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1600 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485235:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268864 00010000:00010000:0.0:1651529344.485238:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 3/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1601 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485240:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 5/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1601 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485244:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061ee886f/0xa29a79078f3ba4ec lrc: 0/0,0 mode: --/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1253 expref: 1601 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485247:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11139 00010000:00010000:0.0:1651529344.485247:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485248:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485249:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485252:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 4/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485257:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1600:41279:x1731746396268544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.485259:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.485260:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.485262:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 4/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485266:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 3/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1600 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485271:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1600:41278:x1731746396268608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.485274:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11138 00010000:00010000:1.0:1651529344.485278:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2a258a/0xa29a79078f3bb458 lrc: 0/0,0 mode: --/PR res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5088 expref: 1599 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485279:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11140 00000100:00100000:0.0:1651529344.485281:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1599:41279:x1731746396268672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.485282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485283:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485283:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485285:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485286:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 4/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485293:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.485301:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1598:41279:x1731746396268544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.485303:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11139 00000100:00100000:1.0:1651529344.485309:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11141 00000100:00100000:1.0:1651529344.485310:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1597:41278:x1731746396268736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.485313:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485313:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 3/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485314:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485318:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3ba054 lrc: 0/0,0 mode: --/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff44 expref: 1597 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485322:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485323:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485324:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485326:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 3/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1596 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485327:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 4/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485331:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad847f8/0xa29a79078f3bc220 lrc: 0/0,0 mode: --/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85b0 expref: 1596 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485336:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.485341:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485341:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485342:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485343:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1595:41279:x1731746396268672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.485345:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 4/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485346:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11140 00000100:00100000:0.0:1651529344.485351:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11142 00010000:00010000:1.0:1651529344.485354:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.485360:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1594:41279:x1731746396268928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.485361:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1594:41278:x1731746396268736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.485363:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11141 00010000:00010000:0.0:1651529344.485363:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485364:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 5/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1594 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485368:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11143 00010000:00010000:0.0:1651529344.485368:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 4/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1593 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485369:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1593:41279:x1731746396268864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.485372:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.485374:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 5/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1593 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485377:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 4/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1593 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485380:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485381:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485382:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485385:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 4/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485389:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485389:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.485390:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485391:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485394:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 4/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485395:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1593:41279:x1731746396268928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.485398:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.485398:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11142 00000100:00100000:1.0:1651529344.485404:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1592:41279:x1731746396268864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.485406:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11143 00010000:00010000:0.0:1651529344.485409:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034b7bbd2/0xa29a79078f3bad9e lrc: 0/0,0 mode: --/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3576 expref: 1591 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.485413:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966613888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485416:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485417:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485420:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485420:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485422:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485423:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485425:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485426:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485441:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485471:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+474:39029:x1731745946387520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1064us (1129us total) trans 30064893040 rc 0/0 00000100:00100000:1.0:1651529344.485474:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152177 00000100:00100000:1.0:1651529344.485479:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388416 00000100:00100000:0.0:1651529344.485483:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+474:39029:x1731745946387776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 949us (1095us total) trans 30064893041 rc 0/0 00000100:00100000:0.0:1651529344.485486:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152182 00000100:00100000:1.0:1651529344.485488:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152184 00000100:00100000:1.0:1651529344.485489:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+473:39030:x1731745946388416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.485493:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.485494:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176976 count 1 00010000:00010000:0.0:1651529344.485497:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e76f4e0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.485498:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485498:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485501:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 3/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485503:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 2/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1590 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.485506:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485506:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 1/0,0 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485507:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485508:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 4/0,1 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485509:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e76f4e0/0xa29a79078f3bdd55 lrc: 0/0,0 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485513:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485514:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 3/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1590 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485516:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.485518:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 4/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1590 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485522:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966614080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485525:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485528:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 3/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485530:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.485532:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 1/0,0 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485535:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485535:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdd78 lrc: 0/0,0 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485538:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485541:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485543:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485545:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485546:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485548:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485550:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485582:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+475:39029:x1731745946387648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1103us (1217us total) trans 30064893042 rc 0/0 00000100:00100000:1.0:1651529344.485585:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152179 00000100:00100000:0.0:1651529344.485587:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+475:39030:x1731745946387712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1100us (1213us total) trans 30064893043 rc 0/0 00000100:00100000:0.0:1651529344.485590:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152180 00010000:00010000:1.0:1651529344.485592:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485596:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a73acf9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.485597:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485597:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485600:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 3/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485604:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 1/0,0 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485607:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73acf9f/0xa29a79078f3bdd63 lrc: 0/0,0 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485608:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.485609:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485612:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 3/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485617:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001738121d/0xa29a79078f3b990e lrc: 0/0,0 mode: --/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce209 expref: 1590 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.485617:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 1/0,0 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485619:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdd6a lrc: 0/0,0 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485626:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485629:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966613952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485629:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485632:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485633:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485634:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485636:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485639:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485642:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485645:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485669:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+475:39030:x1731745946387584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1259us (1310us total) trans 30064893044 rc 0/0 00000100:00100000:0.0:1651529344.485679:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152178 00000100:00100000:1.0:1651529344.485683:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+474:39030:x1731745946387840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1157us (1303us total) trans 30064893045 rc 0/0 00000100:00100000:1.0:1651529344.485686:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152181 00010000:00010000:0.0:1651529344.485686:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485690:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.485691:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485693:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485694:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 3/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485696:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006724e0ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.485697:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485698:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 1/0,0 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485701:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdd5c lrc: 0/0,0 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485710:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 3/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485715:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 1/0,0 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485718:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006724e0ed/0xa29a79078f3bdd71 lrc: 0/0,0 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485752:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.485765:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268992 00010000:00010000:1.0:1651529344.485771:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 5/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1590 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.485784:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11144 00000100:00100000:1.0:1651529344.485786:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1590:41279:x1731746396268992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.485792:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966614016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.485795:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485796:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485797:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 4/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1590 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485801:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 3/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1590 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485823:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d2538bd/0xa29a79078f3b9525 lrc: 0/0,0 mode: --/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd226 expref: 1590 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.485829:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485830:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485831:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485834:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 4/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485840:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.485842:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485846:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485847:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41279:x1731746396268992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.485850:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11144 00010000:00010000:0.0:1651529344.485858:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485861:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485903:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+474:39030:x1731745946388032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 873us (890us total) trans 30064893046 rc 0/0 00000100:00100000:0.0:1651529344.485906:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152183 00010000:00010000:0.0:1651529344.485913:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.485917:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485920:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 3/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485925:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 1/0,0 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485928:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdd7f lrc: 0/0,0 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.485980:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.485980:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388544 00000100:00100000:1.0:1651529344.485989:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388672 00000100:00100000:1.0:1651529344.485997:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152185 00000100:00100000:1.0:1651529344.485998:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+475:39029:x1731745946388544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.486004:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176977 count 1 00010000:00010000:1.0:1651529344.486008:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486019:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 2/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.486020:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152186 00010000:00010000:1.0:1651529344.486023:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486023:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486024:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 4/0,1 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486034:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+475:39029:x1731745946388672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.486037:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 3/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486041:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 4/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.486041:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176979 count 1 00000100:00100000:1.0:1651529344.486045:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966614144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486045:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486050:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 2/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486053:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486053:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.486054:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.486054:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 4/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486061:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 3/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.486065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.486065:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 4/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486090:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966614208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.486100:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.486107:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388608 00000100:00100000:0.0:1651529344.486115:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152187 00000100:00100000:0.0:1651529344.486116:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+476:39030:x1731745946388608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.486120:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.486121:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176978 count 1 00010000:00010000:0.0:1651529344.486131:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486136:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 2/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1588 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486139:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486140:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486140:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 4/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486146:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1588 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486150:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1588 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.486154:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966614272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.486161:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.486162:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.486167:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388800 00000100:00100000:0.0:1651529344.486174:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388736 00000100:00100000:0.0:1651529344.486178:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152188 00000100:00100000:0.0:1651529344.486179:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+478:39029:x1731745946388800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.486183:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176981 count 1 00000100:00100000:1.0:1651529344.486190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.486207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.486207:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486212:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 2/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.486213:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388864 00000100:00100000:1.0:1651529344.486218:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388928 00010000:00010000:0.0:1651529344.486218:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.486221:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152189 00000100:00100000:1.0:1651529344.486223:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+480:39030:x1731745946388736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.486228:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176980 count 1 00010000:00010000:0.0:1651529344.486233:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486234:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 4/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486238:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486242:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 3/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486243:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 2/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486246:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486246:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 4/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486247:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486248:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 4/0,1 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486258:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966614336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.486259:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 3/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486262:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 4/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486266:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966614400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.486267:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.486274:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152190 00000100:00100000:1.0:1651529344.486275:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.486276:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+480:39030:x1731745946388864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.486280:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176982 count 1 00000100:00100000:1.0:1651529344.486283:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966614080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486284:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486286:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486288:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 2/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486291:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486292:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486292:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 4/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486293:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152191 00000100:00100000:1.0:1651529344.486295:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+480:39029:x1731745946388928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.486300:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176983 count 1 00010000:00010000:0.0:1651529344.486301:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 3/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486303:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486307:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 2/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486310:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486311:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486311:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 4/0,1 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486318:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 3/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1588 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486318:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486322:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 4/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486323:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966614464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.486326:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966614528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.486331:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.486332:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.486338:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269568 00010000:00010000:1.0:1651529344.486342:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 4/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1589 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486357:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11145 00000100:00100000:1.0:1651529344.486359:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41279:x1731746396269568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.486362:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486363:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 4/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1589 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486367:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 3/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1589 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486372:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1f4574/0xa29a79078f3bb895 lrc: 0/0,0 mode: --/PR res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d604f expref: 1589 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486378:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486379:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486380:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486390:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.486391:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 4/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486402:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486409:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41279:x1731746396269568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486412:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11145 00000100:00100000:1.0:1651529344.486416:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269632 00010000:00010000:1.0:1651529344.486419:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 5/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486430:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11146 00000100:00100000:1.0:1651529344.486438:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41279:x1731746396269632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.486440:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.486441:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486442:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 5/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486446:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 4/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486451:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486452:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486452:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486461:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 4/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.486466:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.486470:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966614272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.486477:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41279:x1731746396269632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486480:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11146 00010000:00010000:0.0:1651529344.486480:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486484:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269696 00010000:00010000:1.0:1651529344.486488:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 5/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486488:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966614208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486491:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486492:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269760 00010000:00010000:1.0:1651529344.486494:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1589 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486498:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11147 00000100:00100000:1.0:1651529344.486500:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11148 00000100:00100000:1.0:1651529344.486502:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41278:x1731746396269760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.486504:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486505:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1589 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486509:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1589 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486513:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41279:x1731746396269696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.486516:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3b8bfc lrc: 0/0,0 mode: --/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2dd expref: 1589 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.486517:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486519:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486519:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 4/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1589 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486520:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486521:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486523:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 3/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486524:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 4/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486529:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee2532e/0xa29a79078f3bc0e5 lrc: 0/0,0 mode: --/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d809a expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486532:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486537:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41278:x1731746396269760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (76us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.486539:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486539:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.486540:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11148 00010000:00010000:0.0:1651529344.486540:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486547:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486550:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486552:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 4/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486553:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486556:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486560:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.486582:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1586:41279:x1731746396269696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.486585:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11147 00010000:00010000:0.0:1651529344.486594:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486597:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.486598:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486601:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 3/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486602:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+481:39030:x1731745946388416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1111us (1447us total) trans 30064893047 rc 0/0 00000100:00100000:1.0:1651529344.486605:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152184 00010000:00010000:0.0:1651529344.486606:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 1/0,0 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486609:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdd86 lrc: 0/0,0 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486615:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486616:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046629d3b/0xa29a79078f3baf96 lrc: 0/0,0 mode: --/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d17 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.486618:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486620:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966614144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486621:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486624:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486624:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486627:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486630:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486641:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486644:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486676:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+482:39030:x1731745946388608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 559us (611us total) trans 30064893048 rc 0/0 00000100:00100000:0.0:1651529344.486679:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152187 00000100:00100000:1.0:1651529344.486683:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+481:39029:x1731745946388544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 684us (715us total) trans 30064893049 rc 0/0 00000100:00100000:1.0:1651529344.486686:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152185 00010000:00010000:0.0:1651529344.486687:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486690:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.486691:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486694:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 3/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486699:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 1/0,0 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486702:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdd9b lrc: 0/0,0 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486703:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486706:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.486707:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486707:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486710:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 3/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486710:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486713:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486715:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 1/0,0 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486716:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486718:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdd8d lrc: 0/0,0 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486722:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486725:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.486726:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486729:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 3/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486741:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 1/0,0 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486751:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdd94 lrc: 0/0,0 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486820:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+481:39029:x1731745946388672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 792us (835us total) trans 30064893050 rc 0/0 00000100:00100000:0.0:1651529344.486823:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152186 00000100:00100000:1.0:1651529344.486840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.486841:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966614464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486845:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486853:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966614336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486855:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.486881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.486901:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269888 00010000:00010000:0.0:1651529344.486907:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 5/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.486920:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269824 00010000:00010000:0.0:1651529344.486923:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 4/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1586 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.486926:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270016 00000100:00100000:0.0:1651529344.486928:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269952 00010000:00010000:1.0:1651529344.486931:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 5/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.486931:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.486936:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11149 00000100:00100000:0.0:1651529344.486937:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41278:x1731746396269888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.486939:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11150 00010000:00010000:0.0:1651529344.486940:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.486941:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41279:x1731746396269824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.486944:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486945:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 4/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486949:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 3/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486955:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8dd5ca/0xa29a79078f3b805d lrc: 0/0,0 mode: --/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcee expref: 1588 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.486955:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 5/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486959:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486959:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486960:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 4/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1587 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.486968:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486968:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486969:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486970:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486972:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 4/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486973:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 4/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486978:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.486981:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486992:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1587:41279:x1731746396269824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486995:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11150 00000100:00100000:0.0:1651529344.486996:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1587:41278:x1731746396269888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.486999:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11149 00000100:00100000:1.0:1651529344.487001:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11151 00000100:00100000:1.0:1651529344.487003:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1585:41279:x1731746396269952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.487005:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487007:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487010:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 3/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487010:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11152 00000100:00100000:0.0:1651529344.487012:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1585:41278:x1731746396270016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.487014:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487015:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3b9fba lrc: 0/0,0 mode: --/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcc0 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.487016:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 5/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1585 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487019:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487020:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487020:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487020:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 4/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1584 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487023:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 4/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487037:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.487044:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1584:41279:x1731746396269952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.487047:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11151 00010000:00010000:0.0:1651529344.487060:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487061:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487062:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487063:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a4d4934/0xa29a79078f3bb378 lrc: 0/0,0 mode: --/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ca6 expref: 1583 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.487067:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966614400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487068:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 4/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487071:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487073:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.487074:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487077:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487080:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487080:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41278:x1731746396270016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 68us (199us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.487083:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487083:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11152 00010000:00010000:0.0:1651529344.487099:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487102:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487105:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487108:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487132:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+482:39030:x1731745946388736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (969us total) trans 30064893051 rc 0/0 00000100:00100000:1.0:1651529344.487144:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152189 00000100:00100000:0.0:1651529344.487150:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+481:39029:x1731745946388800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 970us (1037us total) trans 30064893052 rc 0/0 00010000:00010000:1.0:1651529344.487152:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487153:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152188 00010000:00010000:1.0:1651529344.487156:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.487157:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487160:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 3/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487161:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487164:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 1/0,0 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487164:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487167:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdda9 lrc: 0/0,0 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487167:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487170:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487171:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487174:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.487175:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487178:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 3/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487189:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 1/0,0 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487192:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdda2 lrc: 0/0,0 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487196:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487198:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.487199:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487201:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+481:39030:x1731745946388864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (1011us total) trans 30064893053 rc 0/0 00010000:00010000:1.0:1651529344.487202:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 3/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487204:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152190 00010000:00010000:1.0:1651529344.487205:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 1/0,0 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487208:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bddb0 lrc: 0/0,0 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487217:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803d0cf1/0xa29a79078f3ba118 lrc: 0/0,0 mode: --/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0262 expref: 1581 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.487221:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966614528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.487237:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487241:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487244:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487246:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487246:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.487249:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.487307:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+481:39029:x1731745946388928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1004us (1094us total) trans 30064893054 rc 0/0 00000100:00100000:1.0:1651529344.487310:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152191 00010000:00010000:0.0:1651529344.487318:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487322:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389504 00010000:00010000:0.0:1651529344.487322:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.487323:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487326:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 3/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487329:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389632 00010000:00010000:0.0:1651529344.487331:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 1/0,0 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487336:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389568 00000100:00100000:1.0:1651529344.487340:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389696 00010000:00010000:0.0:1651529344.487342:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bddb7 lrc: 0/0,0 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487346:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152192 00000100:00100000:1.0:1651529344.487348:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+484:39029:x1731745946389504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.487353:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176984 count 1 00010000:00010000:1.0:1651529344.487357:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487371:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 2/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.487372:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152193 00010000:00010000:1.0:1651529344.487374:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.487374:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+484:39030:x1731745946389632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.487375:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487375:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 4/0,1 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.487380:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176986 count 1 00010000:00010000:1.0:1651529344.487382:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 3/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487384:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487386:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 4/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.487388:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 2/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.487390:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966614592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487391:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487392:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487392:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 4/0,1 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487399:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 3/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.487404:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.487410:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 4/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.487411:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152194 00000100:00100000:1.0:1651529344.487413:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+484:39029:x1731745946389568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.487415:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966614656:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.487418:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176985 count 1 00010000:00010000:1.0:1651529344.487421:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487424:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.487430:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152195 00000100:00100000:0.0:1651529344.487432:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+484:39029:x1731745946389696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.487433:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 2/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487436:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.487437:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176987 count 1 00010000:00010000:0.0:1651529344.487440:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487441:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487441:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 4/0,1 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487444:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 2/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1580 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487447:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487448:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487448:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 4/0,1 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487449:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 3/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487452:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 4/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.487454:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 3/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1580 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.487456:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966614720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487458:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 4/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1580 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487462:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966614784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.487464:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.487484:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.487490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.487501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487554:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389824 00000100:00100000:0.0:1651529344.487564:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389760 00000100:00100000:0.0:1651529344.487568:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389952 00000100:00100000:1.0:1651529344.487571:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389888 00000100:00100000:0.0:1651529344.487572:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152196 00000100:00100000:0.0:1651529344.487573:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+488:39029:x1731745946389824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.487578:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152197 00002000:00080000:0.0:1651529344.487579:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176989 count 1 00000100:00100000:1.0:1651529344.487580:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+488:39030:x1731745946389760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.487583:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.487585:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176988 count 1 00010000:00010000:1.0:1651529344.487590:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487594:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 2/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487597:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487598:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487599:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 4/0,1 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487602:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 2/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487605:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487606:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487607:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 4/0,1 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487614:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 3/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487617:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 3/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487617:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 4/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487621:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 4/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487621:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966614848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.487625:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966614912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487633:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.487634:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.487639:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152198 00000100:00100000:1.0:1651529344.487641:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152199 00000100:00100000:0.0:1651529344.487641:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+488:39029:x1731745946389952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.487643:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+488:39030:x1731745946389888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.487646:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176991 count 1 00002000:00080000:1.0:1651529344.487648:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176990 count 1 00010000:00010000:0.0:1651529344.487649:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487651:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487654:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 2/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487656:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 2/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487657:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487658:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487658:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 4/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487659:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487659:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487660:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 4/0,1 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487664:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 3/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.487666:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 3/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1580 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487668:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487669:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 4/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487672:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966614976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487678:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.487681:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.487689:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.487924:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966614656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487929:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487943:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966614784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.487944:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.487946:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487955:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270656 00000100:00100000:1.0:1651529344.487957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.487960:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 5/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1581 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.487964:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270784 00000100:00100000:0.0:1651529344.487968:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270592 00010000:00010000:1.0:1651529344.487969:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 4/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1582 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.487971:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 5/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1583 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487975:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270720 00000100:00100000:1.0:1651529344.487976:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11153 00010000:00010000:0.0:1651529344.487977:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 4/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1584 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.487978:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1584:41278:x1731746396270656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.487981:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487982:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 5/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1584 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.487982:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11154 00000100:00100000:0.0:1651529344.487984:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1584:41278:x1731746396270784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.487986:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 4/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1584 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.487987:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.487988:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 4/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1584 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487992:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487992:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 3/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1584 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.487993:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487993:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487997:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 4/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487998:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3b9453 lrc: 0/0,0 mode: --/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceec expref: 1584 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488001:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488002:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488003:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488006:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 4/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488010:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.488022:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1583:41278:x1731746396270656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.488025:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11153 00000100:00100000:1.0:1651529344.488031:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11155 00000100:00100000:1.0:1651529344.488033:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41278:x1731746396270592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.488035:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.488037:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 5/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1582 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488046:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.488047:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 4/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1582 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488053:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488054:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488054:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488057:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 4/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488062:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.488067:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41278:x1731746396270592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.488074:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41278:x1731746396270784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 89us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.488078:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11155 00000100:00100000:1.0:1651529344.488082:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11156 00000100:00100000:1.0:1651529344.488091:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1581:41278:x1731746396270720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.488091:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11154 00010000:00010000:1.0:1651529344.488094:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.488096:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 4/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488100:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 3/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488100:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488103:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488105:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bb068 lrc: 0/0,0 mode: --/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d405f expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488107:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488108:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488109:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488109:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488110:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488113:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 4/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488121:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.488128:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1579:41278:x1731746396270720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.488131:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11156 00010000:00010000:1.0:1651529344.488141:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcd361c1/0xa29a79078f3bae77 lrc: 0/0,0 mode: --/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d384e expref: 1578 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.488145:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966614720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.488156:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488159:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488162:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488165:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488167:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488176:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+489:39029:x1731745946389696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 743us (898us total) trans 30064893055 rc 0/0 00000100:00100000:0.0:1651529344.488180:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152195 00010000:00010000:0.0:1651529344.488187:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488191:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.488192:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488206:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 3/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488209:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+489:39029:x1731745946389568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 795us (952us total) trans 30064893056 rc 0/0 00010000:00010000:0.0:1651529344.488211:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 1/0,0 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488212:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152194 00010000:00010000:0.0:1651529344.488214:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bddd3 lrc: 0/0,0 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488218:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.488222:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488224:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd9c0427/0xa29a79078f3bb57e lrc: 0/0,0 mode: --/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54fd expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488225:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 3/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488228:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966614592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488228:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 1/0,0 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488230:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bddcc lrc: 0/0,0 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488231:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488234:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488236:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488244:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488247:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488247:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488249:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488250:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488253:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488286:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+490:39030:x1731745946389632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 912us (1040us total) trans 30064893057 rc 0/0 00000100:00100000:0.0:1651529344.488289:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152193 00000100:00100000:1.0:1651529344.488291:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+490:39029:x1731745946389504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 943us (1060us total) trans 30064893058 rc 0/0 00000100:00100000:1.0:1651529344.488295:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152192 00010000:00010000:0.0:1651529344.488297:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488300:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.488300:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488302:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488303:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 3/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488306:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.488307:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488308:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 1/0,0 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488309:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 3/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488310:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bddc5 lrc: 0/0,0 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488314:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 1/0,0 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488317:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bddbe lrc: 0/0,0 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488353:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966614848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488358:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488371:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966614976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488374:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.488405:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.488424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.488437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.488447:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270912 00010000:00010000:1.0:1651529344.488452:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 5/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.488458:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270848 00010000:00010000:1.0:1651529344.488460:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 4/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1578 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488461:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270976 00000100:00100000:1.0:1651529344.488464:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271040 00010000:00010000:1.0:1651529344.488466:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 5/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488466:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.488471:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11157 00000100:00100000:1.0:1651529344.488473:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1580:41278:x1731746396270912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.488475:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.488475:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11158 00010000:00010000:1.0:1651529344.488477:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 5/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488477:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1580:41278:x1731746396270848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.488480:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 4/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488480:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.488481:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 4/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488485:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 3/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488486:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488490:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3ba077 lrc: 0/0,0 mode: --/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffa6 expref: 1580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488494:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488495:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488498:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 4/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488503:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.488506:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488506:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488507:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488510:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 4/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488515:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1579:41278:x1731746396270912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.488518:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11157 00010000:00010000:0.0:1651529344.488522:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.488527:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11159 00000100:00100000:1.0:1651529344.488529:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1578:41279:x1731746396271040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.488531:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1578:41278:x1731746396270848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.488532:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.488533:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 5/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1578 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488534:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11158 00010000:00010000:1.0:1651529344.488537:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 4/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488539:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11160 00000100:00100000:0.0:1651529344.488541:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1577:41278:x1731746396270976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.488542:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488542:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488543:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488544:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.488545:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488546:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 4/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488549:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 3/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.488550:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.488554:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000013ff51/0xa29a79078f3bc1c5 lrc: 0/0,0 mode: --/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8436 expref: 1577 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.488557:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.488563:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396271040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.488565:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11159 00010000:00010000:0.0:1651529344.488565:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488566:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488569:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 4/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488576:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa896de7/0xa29a79078f3bb1f0 lrc: 0/0,0 mode: --/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4655 expref: 1575 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.488581:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966614912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.488584:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488595:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488595:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.488598:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488601:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488603:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488617:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1574:41278:x1731746396270976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.488620:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11160 00010000:00010000:0.0:1651529344.488627:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488630:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488634:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488636:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488646:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+489:39030:x1731745946389760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1065us (1145us total) trans 30064893059 rc 0/0 00000100:00100000:1.0:1651529344.488649:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152197 00010000:00010000:1.0:1651529344.488661:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832ce51c/0xa29a79078f3b9db4 lrc: 0/0,0 mode: --/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf50a expref: 1573 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488675:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+489:39029:x1731745946389824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1101us (1185us total) trans 30064893060 rc 0/0 00000100:00100000:1.0:1651529344.488676:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.488678:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152196 00010000:00010000:1.0:1651529344.488680:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488683:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488685:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488686:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488689:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488691:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488700:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488703:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488706:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488728:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+490:39030:x1731745946389888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1084us (1182us total) trans 30064893061 rc 0/0 00000100:00100000:1.0:1651529344.488740:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152199 00010000:00010000:1.0:1651529344.488748:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488751:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.488751:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+489:39029:x1731745946389952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1109us (1216us total) trans 30064893062 rc 0/0 00010000:00010000:1.0:1651529344.488752:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488754:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152198 00010000:00010000:0.0:1651529344.488761:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488764:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 3/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488764:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.488766:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488768:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 3/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488769:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 1/0,0 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488771:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdde1 lrc: 0/0,0 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488773:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 1/0,0 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488776:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488776:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bddda lrc: 0/0,0 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488779:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000903748fd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.488780:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488782:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 3/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488785:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 1/0,0 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488788:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bddef lrc: 0/0,0 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488788:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488791:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.488792:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488794:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 3/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488798:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 1/0,0 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488800:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdde8 lrc: 0/0,0 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.488864:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390464 00000100:00100000:0.0:1651529344.488880:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152200 00000100:00100000:0.0:1651529344.488882:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+489:39029:x1731745946390464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.488888:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176993 count 1 00010000:00010000:0.0:1651529344.488892:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488896:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 2/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1572 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488910:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488911:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488911:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 4/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488919:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 3/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1572 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488923:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1572 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.488927:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966615104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.488966:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.488977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488995:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390400 00000100:00100000:0.0:1651529344.488995:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.489013:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390592 00000100:00100000:1.0:1651529344.489018:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152201 00000100:00100000:0.0:1651529344.489018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.489020:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dd40c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+491:39030:x1731745946390400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.489025:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176992 count 1 00010000:00010000:1.0:1651529344.489030:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489035:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 2/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489038:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489038:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489039:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 4/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.489058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.489060:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 3/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489064:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.489066:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390528 00000100:00100000:1.0:1651529344.489069:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489073:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390784 00000100:00100000:0.0:1651529344.489076:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390848 00000100:00100000:1.0:1651529344.489080:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489093:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152202 00000100:00100000:1.0:1651529344.489112:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152203 00000100:00100000:0.0:1651529344.489112:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+494:39029:x1731745946390592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.489118:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176995 count 1 00000100:00100000:1.0:1651529344.489122:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+494:39030:x1731745946390528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.489127:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176994 count 1 00010000:00010000:0.0:1651529344.489130:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489138:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489141:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 2/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489143:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 2/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489145:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489145:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489146:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489146:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 4/0,1 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489147:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489147:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 4/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489154:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 3/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489154:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 3/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489158:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.489158:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 4/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489162:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966615296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489162:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966615232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489171:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.489173:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489179:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152204 00000100:00100000:1.0:1651529344.489181:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152205 00000100:00100000:0.0:1651529344.489181:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+494:39030:x1731745946390784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.489183:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+494:39030:x1731745946390848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.489185:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176996 count 1 00002000:00080000:1.0:1651529344.489187:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176997 count 1 00010000:00010000:0.0:1651529344.489189:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489191:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489193:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 2/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489195:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 2/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489196:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489204:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489204:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 4/0,1 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489208:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489209:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489209:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 4/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489212:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 3/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489215:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 4/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489216:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 3/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.489219:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966615360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489220:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 4/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489224:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966615424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489226:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.489232:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.489259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.489265:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390912 00000100:00100000:0.0:1651529344.489271:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390976 00000100:00100000:0.0:1651529344.489275:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152206 00000100:00100000:0.0:1651529344.489277:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+496:39030:x1731745946390912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.489282:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176998 count 1 00010000:00010000:0.0:1651529344.489286:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489291:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 2/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489293:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489294:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489295:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 4/0,1 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489296:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152207 00000100:00100000:1.0:1651529344.489298:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+496:39030:x1731745946390976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.489304:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:176999 count 1 00010000:00010000:1.0:1651529344.489309:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489313:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 2/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489316:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489317:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489318:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 4/0,1 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489324:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 3/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.489328:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 4/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.489332:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966615488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489335:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 3/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1572 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489339:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 4/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489343:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966615552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.489354:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489356:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489403:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966615104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489408:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489418:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271616 00010000:00010000:1.0:1651529344.489423:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1573 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489431:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11161 00000100:00100000:1.0:1651529344.489433:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1573:41279:x1731746396271616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.489435:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489437:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1573 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489440:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 3/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1573 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489446:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000009c0231/0xa29a79078f3b8ecd lrc: 0/0,0 mode: --/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc449 expref: 1573 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489461:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489462:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489463:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489478:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 4/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489488:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.489497:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489504:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396271616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (94us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.489506:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489507:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11161 00010000:00010000:0.0:1651529344.489509:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489512:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489523:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489528:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489534:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489537:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.489538:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489541:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 3/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489555:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 1/0,0 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489557:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+497:39029:x1731745946390464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 674us (716us total) trans 30064893063 rc 0/0 00010000:00010000:1.0:1651529344.489558:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bddf6 lrc: 0/0,0 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489569:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152200 00000100:00100000:1.0:1651529344.489574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489591:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271680 00010000:00010000:1.0:1651529344.489610:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489618:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11162 00000100:00100000:1.0:1651529344.489620:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41278:x1731746396271680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.489623:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489624:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489628:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 3/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489633:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f8bfdbf/0xa29a79078f3b95e2 lrc: 0/0,0 mode: --/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5f3 expref: 1572 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.489636:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489637:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489645:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489649:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 4/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489656:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.489667:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1571:41278:x1731746396271680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.489670:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11162 00010000:00010000:1.0:1651529344.489677:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489681:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489684:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489694:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489705:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489709:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004adc61cf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.489711:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489714:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 3/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489719:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 1/0,0 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489722:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bddfd lrc: 0/0,0 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489754:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dd40c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+497:39030:x1731745946390400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 733us (777us total) trans 30064893064 rc 0/0 00000100:00100000:1.0:1651529344.489757:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152201 00000100:00100000:1.0:1651529344.489833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.489841:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391040 00000100:00100000:1.0:1651529344.489850:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152208 00000100:00100000:1.0:1651529344.489852:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+497:39030:x1731745946391040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.489883:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177000 count 1 00010000:00010000:1.0:1651529344.489888:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.489897:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 2/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1570 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.489899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.489901:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489906:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489906:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 4/0,1 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489914:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 3/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.489917:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 4/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1570 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.489921:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489946:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.489954:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966615296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489958:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.489965:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966615424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489968:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489975:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271744 00010000:00010000:1.0:1651529344.489979:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 5/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1571 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.489984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.489995:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489998:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271872 00010000:00010000:1.0:1651529344.490001:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 5/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1572 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.490001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.490006:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271808 00010000:00010000:1.0:1651529344.490008:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1573 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.490008:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391168 00000100:00100000:1.0:1651529344.490012:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272000 00010000:00010000:1.0:1651529344.490014:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 5/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1574 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.490016:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152209 00000100:00100000:1.0:1651529344.490017:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271936 00000100:00100000:0.0:1651529344.490018:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+498:39030:x1731745946391168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.490019:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 4/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1575 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490023:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272064 00010000:00010000:1.0:1651529344.490025:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 5/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1576 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490029:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11163 00002000:00080000:0.0:1651529344.490030:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177001 count 1 00000100:00100000:1.0:1651529344.490031:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396271744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.490035:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.490035:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490036:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 5/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1576 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490040:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 4/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1576 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.490040:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 2/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1576 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490043:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490043:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490044:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 4/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490045:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490046:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490047:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490050:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 4/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490051:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 3/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1576 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490054:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.490055:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1576 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.490059:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966615680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.490067:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396271744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490069:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11163 00000100:00100000:1.0:1651529344.490074:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11164 00000100:00100000:1.0:1651529344.490076:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1575:41279:x1731746396271872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.490079:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.490080:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 5/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1575 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490084:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 4/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1575 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490091:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490092:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490092:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490094:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.490095:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 4/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490099:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.490103:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3ba069 lrc: 0/0,0 mode: --/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff8a expref: 1575 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490104:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1575:41279:x1731746396271872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490107:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11164 00000100:00100000:0.0:1651529344.490108:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966615232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490111:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490114:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11165 00000100:00100000:1.0:1651529344.490116:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1573:41279:x1731746396271808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.490118:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.490119:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1573 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490123:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 3/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1573 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.490125:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490127:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e981fc9/0xa29a79078f3bbe84 lrc: 0/0,0 mode: --/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7732 expref: 1573 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.490128:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490131:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490131:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490134:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490139:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490140:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490143:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 4/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490150:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.490156:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396271808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490159:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11165 00000100:00100000:1.0:1651529344.490163:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11166 00000100:00100000:1.0:1651529344.490165:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1571:41279:x1731746396272000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.490167:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.490168:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 5/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1571 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490172:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 4/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1571 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490176:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490177:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490178:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490180:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 4/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490184:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.490187:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+499:39029:x1731745946390592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1191us total) trans 30064893065 rc 0/0 00000100:00100000:0.0:1651529344.490190:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152202 00000100:00100000:1.0:1651529344.490196:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1571:41279:x1731746396272000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490199:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11166 00010000:00010000:0.0:1651529344.490201:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3b99bd lrc: 0/0,0 mode: --/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4d3 expref: 1571 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490203:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11167 00000100:00100000:1.0:1651529344.490205:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1569:41279:x1731746396271936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.490205:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966615360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490207:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.490208:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490209:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 4/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1569 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.490211:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490212:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 3/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1569 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490217:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000becbb5cc/0xa29a79078f3bad82 lrc: 0/0,0 mode: --/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d353e expref: 1569 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490220:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490221:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490222:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490224:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 4/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490225:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490229:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490230:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.490231:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490235:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1568:41279:x1731746396271936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490237:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11167 00000100:00100000:1.0:1651529344.490251:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11168 00000100:00100000:1.0:1651529344.490253:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1567:41279:x1731746396272064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.490256:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.490257:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 5/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1567 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490261:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 4/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1567 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490266:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490267:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490267:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490270:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 4/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490270:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+499:39030:x1731745946390784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1089us (1223us total) trans 30064893066 rc 0/0 00010000:00010000:1.0:1651529344.490274:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.490274:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152204 00000100:00100000:1.0:1651529344.490280:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1567:41279:x1731746396272064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.490282:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11168 00010000:00010000:0.0:1651529344.490284:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c89c1bf5/0xa29a79078f3ba20d lrc: 0/0,0 mode: --/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05db expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490288:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490289:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966615488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490292:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.490292:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490293:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490295:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490298:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490306:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 3/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490310:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 1/0,0 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490311:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490313:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bde04 lrc: 0/0,0 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490314:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490317:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490320:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.490321:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490323:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 3/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490327:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 1/0,0 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490329:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bde12 lrc: 0/0,0 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490333:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490340:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.490341:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490344:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 3/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490347:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 1/0,0 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490350:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bde20 lrc: 0/0,0 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490350:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+499:39030:x1731745946390912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1072us (1108us total) trans 30064893067 rc 0/0 00000100:00100000:0.0:1651529344.490353:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152206 00010000:00010000:1.0:1651529344.490356:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490359:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490362:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490365:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.490419:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+499:39030:x1731745946390528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1303us (1400us total) trans 30064893068 rc 0/0 00000100:00100000:1.0:1651529344.490438:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152203 00000100:00100000:0.0:1651529344.490449:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272128 00010000:00010000:0.0:1651529344.490455:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 5/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.490466:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11169 00000100:00100000:0.0:1651529344.490468:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41278:x1731746396272128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.490471:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.490473:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 5/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490475:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490476:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 4/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.490479:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcd72238 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.490480:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490483:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 3/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490488:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 1/0,0 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490491:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd72238/0xa29a79078f3bde0b lrc: 0/0,0 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490497:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490498:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490499:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490502:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490505:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490507:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490507:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490510:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 4/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490516:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.490544:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41278:x1731746396272128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.490547:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11169 00010000:00010000:0.0:1651529344.490554:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490555:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+499:39030:x1731745946390848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1371us (1496us total) trans 30064893069 rc 0/0 00010000:00010000:0.0:1651529344.490557:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042602142 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.490558:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152205 00010000:00010000:0.0:1651529344.490558:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490561:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 3/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490565:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 1/0,0 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490568:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bde19 lrc: 0/0,0 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490569:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000426808fa/0xa29a79078f3ba19d lrc: 0/0,0 mode: --/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d045a expref: 1565 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490574:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966615552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490577:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490581:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490583:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490586:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490589:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490626:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.490640:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+499:39030:x1731745946390976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1341us (1380us total) trans 30064893070 rc 0/0 00000100:00100000:1.0:1651529344.490643:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152207 00000100:00100000:0.0:1651529344.490654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.490666:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391744 00000100:00100000:1.0:1651529344.490680:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391680 00000100:00100000:0.0:1651529344.490682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.490687:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152210 00000100:00100000:1.0:1651529344.490689:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+500:39029:x1731745946391744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.490694:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177003 count 1 00010000:00010000:1.0:1651529344.490698:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.490703:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 2/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490706:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490707:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490707:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 4/0,1 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490714:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 3/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490718:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 4/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.490719:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490722:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966615744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490723:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000152886c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.490725:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490728:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 3/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490742:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.490747:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 1/0,0 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490749:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391808 00010000:00010000:0.0:1651529344.490750:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bde27 lrc: 0/0,0 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490758:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391872 00000100:00100000:1.0:1651529344.490762:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152211 00000100:00100000:1.0:1651529344.490763:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+502:39030:x1731745946391680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.490765:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152212 00000100:00100000:0.0:1651529344.490767:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+502:39030:x1731745946391808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.490774:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177004 count 1 00002000:00080000:1.0:1651529344.490775:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177002 count 1 00010000:00010000:0.0:1651529344.490778:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490779:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490782:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 2/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490783:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 2/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490785:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490786:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490786:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490787:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490788:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 4/0,1 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490794:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 3/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490794:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 4/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490797:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 4/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490801:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966615808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.490825:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.490830:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 3/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.490832:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152213 00000100:00100000:1.0:1651529344.490833:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+502:39029:x1731745946391872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.490836:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 4/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.490838:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177005 count 1 00010000:00010000:1.0:1651529344.490842:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490846:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 2/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.490851:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966615872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490858:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 4/0,1 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490861:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.490865:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 3/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1564 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490869:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 4/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490873:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966615936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.490880:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.490881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.490889:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bc323 lrc: 0/0,0 mode: --/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a02 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.490893:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966615616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490897:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490900:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490903:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.490913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.490915:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490924:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490943:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391936 00000100:00100000:0.0:1651529344.490950:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392000 00000100:00100000:0.0:1651529344.490954:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152214 00000100:00100000:0.0:1651529344.490956:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+505:39030:x1731745946391936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.490961:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177006 count 1 00010000:00010000:0.0:1651529344.490965:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490970:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 2/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1563 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.490979:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+505:39030:x1731745946391040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1126us (1146us total) trans 30064893071 rc 0/0 00000100:00100000:1.0:1651529344.490983:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152208 00000100:00100000:1.0:1651529344.490989:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152215 00000100:00100000:1.0:1651529344.490990:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+504:39029:x1731745946392000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.490995:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177007 count 1 00010000:00010000:0.0:1651529344.490997:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490997:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490998:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 4/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490999:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491003:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 2/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1563 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.491006:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491007:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491007:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 3/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1563 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.491008:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 4/0,1 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491010:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1563 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491014:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 3/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1563 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.491015:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.491023:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.491028:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 4/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1563 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491032:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966616064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.491032:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966615680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491035:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491047:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.491052:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491056:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004a4e8bd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.491057:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491060:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 3/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491076:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 1/0,0 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491079:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3bde2e lrc: 0/0,0 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491093:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272576 00010000:00010000:1.0:1651529344.491098:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491109:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11170 00000100:00100000:1.0:1651529344.491117:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1564:41278:x1731746396272576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.491120:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491121:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491125:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 3/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491130:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfaa90d/0xa29a79078f3bbc69 lrc: 0/0,0 mode: --/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f98 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491134:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491135:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491135:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491139:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 4/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491147:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.491149:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491154:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491157:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1563:41278:x1731746396272576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.491160:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11170 00010000:00010000:0.0:1651529344.491162:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491165:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.491252:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+505:39030:x1731745946391168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1233us (1292us total) trans 30064893072 rc 0/0 00000100:00100000:0.0:1651529344.491255:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152209 00000100:00100000:0.0:1651529344.491275:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392064 00000100:00100000:0.0:1651529344.491302:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152216 00000100:00100000:0.0:1651529344.491304:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+505:39030:x1731745946392064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.491309:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177008 count 1 00010000:00010000:0.0:1651529344.491319:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491324:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.491324:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 2/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491327:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491328:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491329:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 4/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.491339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.491341:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 3/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491344:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1562 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.491349:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966616128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.491363:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.491368:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491374:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.491375:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491389:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272832 00010000:00010000:1.0:1651529344.491399:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 5/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1563 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491401:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 3/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491406:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272960 00010000:00010000:0.0:1651529344.491406:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 1/0,0 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491409:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 5/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491413:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272768 00010000:00010000:1.0:1651529344.491415:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 5/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1565 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491417:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bde35 lrc: 0/0,0 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491418:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272896 00010000:00010000:1.0:1651529344.491420:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 5/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491424:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11171 00000100:00100000:1.0:1651529344.491426:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41278:x1731746396272832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.491429:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491430:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 5/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491430:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966615872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.491433:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 4/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491434:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491439:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491440:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491440:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491441:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491444:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491451:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11172 00010000:00010000:1.0:1651529344.491452:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 4/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491453:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41278:x1731746396272960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.491456:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491457:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.491458:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 5/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491461:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 4/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1566 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491465:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41278:x1731746396272832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.491467:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11171 00010000:00010000:0.0:1651529344.491467:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491467:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491468:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491471:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 4/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491475:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491477:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11173 00000100:00100000:1.0:1651529344.491479:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1565:41279:x1731746396272768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.491481:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.491482:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1565:41278:x1731746396272960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.491483:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 5/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1565 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491485:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11172 00010000:00010000:1.0:1651529344.491486:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 4/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1565 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491490:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11174 00010000:00010000:1.0:1651529344.491491:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491492:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.491492:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1564:41279:x1731746396272896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.491493:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491494:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491496:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 4/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491496:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 4/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491499:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.491500:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 3/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1564 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491505:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1564:41279:x1731746396272768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.491507:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11173 00010000:00010000:1.0:1651529344.491518:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009083bab8/0xa29a79078f3bb913 lrc: 0/0,0 mode: --/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62be expref: 1563 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491520:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b77968c5/0xa29a79078f3bb83a lrc: 0/0,0 mode: --/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f29 expref: 1563 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.491522:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966615808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.491525:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491525:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491525:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491526:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491528:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491529:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 4/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491531:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491534:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491536:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491537:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491559:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1561:41279:x1731746396272896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.491562:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11174 00010000:00010000:0.0:1651529344.491569:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491573:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fde70ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.491574:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491577:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 3/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491580:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+506:39030:x1731745946391680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 815us (926us total) trans 30064893073 rc 0/0 00010000:00010000:0.0:1651529344.491581:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 1/0,0 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491583:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152211 00010000:00010000:0.0:1651529344.491584:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3bde4a lrc: 0/0,0 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491592:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491594:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb16f8aa/0xa29a79078f3baae9 lrc: 0/0,0 mode: --/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aa2 expref: 1560 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491595:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491598:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491601:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491615:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966615936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.491619:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491623:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491625:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491628:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491631:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491650:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+506:39030:x1731745946391808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 882us (968us total) trans 30064893074 rc 0/0 00000100:00100000:0.0:1651529344.491653:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152212 00010000:00010000:0.0:1651529344.491660:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491664:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.491665:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491667:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 3/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491671:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+506:39029:x1731745946391872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 837us (971us total) trans 30064893075 rc 0/0 00010000:00010000:0.0:1651529344.491672:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 1/0,0 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491674:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152213 00010000:00010000:0.0:1651529344.491675:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bde43 lrc: 0/0,0 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491679:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491682:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007d01aa6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.491683:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491685:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 3/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491687:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4309ff/0xa29a79078f3b9bb5 lrc: 0/0,0 mode: --/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec90 expref: 1559 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491689:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 1/0,0 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491691:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966615744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491691:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3bde51 lrc: 0/0,0 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491694:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491697:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491700:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491703:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491705:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491722:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.491761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.491770:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+506:39029:x1731745946391744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1153us total) trans 30064893076 rc 0/0 00000100:00100000:1.0:1651529344.491773:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152210 00000100:00100000:0.0:1651529344.491776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.491778:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392128 00000100:00100000:1.0:1651529344.491793:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152217 00000100:00100000:1.0:1651529344.491794:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+506:39030:x1731745946392128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.491799:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177009 count 1 00010000:00010000:1.0:1651529344.491821:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.491826:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 2/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1558 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.491829:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491837:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491837:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 4/0,1 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491850:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 3/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1558 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491859:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491861:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 4/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1558 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491862:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3e400c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.491864:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491866:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966616192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491866:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 3/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491871:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 1/0,0 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491874:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3bde3c lrc: 0/0,0 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491881:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.491888:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273024 00010000:00010000:1.0:1651529344.491893:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1559 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491893:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966616128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491897:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491898:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273088 00010000:00010000:1.0:1651529344.491901:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 5/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1560 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491904:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273152 00000100:00100000:1.0:1651529344.491905:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11175 00000100:00100000:1.0:1651529344.491907:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1561:41279:x1731746396273024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.491909:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1561 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491910:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491911:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1561 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491915:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 3/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1561 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491928:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bab37b/0xa29a79078f3b9d05 lrc: 0/0,0 mode: --/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf278 expref: 1561 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491930:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11176 00010000:00010000:1.0:1651529344.491932:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491932:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.491932:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1560:41278:x1731746396273088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.491933:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491935:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491936:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 4/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491937:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 5/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1560 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.491941:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 4/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1560 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491945:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491952:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1560:41279:x1731746396273024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.491954:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491954:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.491955:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11175 00010000:00010000:0.0:1651529344.491955:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491958:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 4/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491960:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11177 00000100:00100000:1.0:1651529344.491961:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1559:41279:x1731746396273152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.491963:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491964:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491966:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1559 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491969:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 3/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1559 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.491971:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1559:41278:x1731746396273088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.491973:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11176 00010000:00010000:1.0:1651529344.491974:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cf682d8/0xa29a79078f3bc06e lrc: 0/0,0 mode: --/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eb7 expref: 1559 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.491980:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491980:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491981:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491982:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491984:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 4/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491984:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491987:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491989:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491992:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491998:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1557:41279:x1731746396273152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.492001:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11177 00010000:00010000:1.0:1651529344.492014:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492017:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.492018:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492021:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 3/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492025:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 1/0,0 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492028:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bde58 lrc: 0/0,0 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492050:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a3e016/0xa29a79078f3bc33f lrc: 0/0,0 mode: --/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a56 expref: 1556 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.492051:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+507:39030:x1731745946391936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1094us (1170us total) trans 30064893077 rc 0/0 00000100:00100000:1.0:1651529344.492054:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966616064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.492055:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152214 00010000:00010000:1.0:1651529344.492057:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492061:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492062:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492063:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492066:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492069:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492082:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492085:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492088:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492111:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+508:39029:x1731745946392000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1120us (1207us total) trans 30064893078 rc 0/0 00000100:00100000:1.0:1651529344.492114:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152215 00000100:00100000:0.0:1651529344.492128:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+507:39030:x1731745946392064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 823us (916us total) trans 30064893079 rc 0/0 00000100:00100000:0.0:1651529344.492131:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152216 00010000:00010000:0.0:1651529344.492138:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492142:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b480d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.492143:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492145:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 3/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492150:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.492150:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 1/0,0 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492163:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3bde5f lrc: 0/0,0 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.492168:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492170:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.492171:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492174:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 3/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492177:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 1/0,0 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.492180:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bde66 lrc: 0/0,0 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.492193:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392704 00000100:00100000:0.0:1651529344.492200:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392640 00000100:00100000:0.0:1651529344.492207:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392768 00000100:00100000:0.0:1651529344.492211:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392832 00000100:00100000:0.0:1651529344.492215:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152218 00000100:00100000:0.0:1651529344.492217:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+510:39030:x1731745946392704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.492222:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177011 count 1 00010000:00010000:0.0:1651529344.492226:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492231:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 2/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492234:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492234:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492235:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 4/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492242:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 3/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492245:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.492246:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152219 00000100:00100000:1.0:1651529344.492248:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+510:39029:x1731745946392640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.492249:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616256:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.492254:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177010 count 1 00010000:00010000:1.0:1651529344.492258:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492263:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 2/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492266:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492267:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492267:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 4/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492274:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 3/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492278:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.492281:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.492289:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152220 00000100:00100000:1.0:1651529344.492290:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966616320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.492291:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+510:39029:x1731745946392768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.492296:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177012 count 1 00000100:00100000:1.0:1651529344.492299:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.492300:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492304:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 2/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.492305:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152221 00000100:00100000:1.0:1651529344.492307:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+510:39030:x1731745946392832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.492310:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492310:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.492311:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177013 count 1 00010000:00010000:0.0:1651529344.492311:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 4/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492315:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492318:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 3/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492319:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 2/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492321:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 4/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.492322:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492323:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492323:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 4/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492325:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966616384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492329:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492333:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.492333:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.492337:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966616448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.492343:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.492400:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.492408:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393024 00000100:00100000:0.0:1651529344.492410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.492419:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392960 00000100:00100000:1.0:1651529344.492423:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152222 00000100:00100000:1.0:1651529344.492425:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+512:39029:x1731745946393024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.492429:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177015 count 1 00000100:00100000:0.0:1651529344.492430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.492433:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492437:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 2/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.492437:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393088 00000100:00100000:0.0:1651529344.492445:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152223 00000100:00100000:0.0:1651529344.492446:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+513:39030:x1731745946392960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.492451:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492451:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492452:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 4/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.492452:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177014 count 1 00010000:00010000:0.0:1651529344.492456:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492459:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492461:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 2/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1555 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492463:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.492467:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966616512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.492477:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.492482:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492482:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492483:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 4/0,1 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492499:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 3/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1555 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492509:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 4/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1555 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.492513:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966616576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.492523:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.492528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.492529:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152224 00000100:00100000:0.0:1651529344.492531:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+513:39030:x1731745946393088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.492535:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177016 count 1 00010000:00010000:0.0:1651529344.492539:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492544:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 2/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492547:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492547:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492548:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 4/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492557:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273664 00010000:00010000:1.0:1651529344.492562:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 5/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1556 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.492570:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11178 00000100:00100000:1.0:1651529344.492572:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1556:41279:x1731746396273664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.492578:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 3/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1556 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492580:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.492581:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 5/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1556 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.492582:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1556 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.492585:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 4/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1556 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.492586:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966616640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492592:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492592:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492593:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492595:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.492596:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 4/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492601:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.492608:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1556:41279:x1731746396273664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.492611:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11178 00010000:00010000:1.0:1651529344.492625:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3b4ed2c/0xa29a79078f3bac47 lrc: 0/0,0 mode: --/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fcd expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.492629:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966616192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492633:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492636:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492639:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492642:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492648:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.492672:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492689:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492693:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492725:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946392128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1002us total) trans 30064893080 rc 0/0 00000100:00100000:1.0:1651529344.492729:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152217 00010000:00010000:1.0:1651529344.492744:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492747:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb283dfa already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.492748:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492751:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 3/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492763:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 1/0,0 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492766:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3bde6d lrc: 0/0,0 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492777:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966616320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492781:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492790:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273792 00010000:00010000:1.0:1651529344.492794:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.492801:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11179 00000100:00100000:1.0:1651529344.492819:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1555:41278:x1731746396273792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.492822:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.492823:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.492827:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 3/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.492833:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000410bb5e/0xa29a79078f3bada5 lrc: 0/0,0 mode: --/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3584 expref: 1555 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.492836:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492837:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492838:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492841:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 4/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492849:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.492857:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41278:x1731746396273792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.492858:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492863:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492866:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492873:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11179 00010000:00010000:0.0:1651529344.492879:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.492935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.492947:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946392704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 729us (796us total) trans 30064893081 rc 0/0 00000100:00100000:0.0:1651529344.492950:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152218 00000100:00100000:0.0:1651529344.492956:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393216 00000100:00100000:0.0:1651529344.492963:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152225 00000100:00100000:0.0:1651529344.492964:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946393216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.492969:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177017 count 1 00010000:00010000:0.0:1651529344.492973:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492989:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 2/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1553 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.492992:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966616448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492993:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492993:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492994:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 4/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492996:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493001:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 3/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1553 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.493004:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273856 00010000:00010000:0.0:1651529344.493004:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 4/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1553 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493008:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493009:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.493015:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11180 00000100:00100000:1.0:1651529344.493017:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41278:x1731746396273856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.493020:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.493021:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493024:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.493029:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493031:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 3/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493033:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.493037:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ecbf982/0xa29a79078f3bc075 lrc: 0/0,0 mode: --/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f19 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493041:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493042:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493050:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493053:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 4/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493063:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493066:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.493067:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 3/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493072:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 1/0,0 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493073:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41278:x1731746396273856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.493075:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bde74 lrc: 0/0,0 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493076:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11180 00010000:00010000:1.0:1651529344.493083:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493086:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493086:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966616384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.493089:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493090:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493092:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493098:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966616576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493107:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493128:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966616640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493133:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493134:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+515:39029:x1731745946392640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 885us (965us total) trans 30064893082 rc 0/0 00000100:00100000:1.0:1651529344.493137:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152219 00010000:00010000:0.0:1651529344.493138:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493141:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b306dd91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.493142:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493145:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 3/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493149:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966616512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493149:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 1/0,0 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493151:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3bde7b lrc: 0/0,0 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493153:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.493185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.493207:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273984 00010000:00010000:1.0:1651529344.493228:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 4/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1553 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493236:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274112 00010000:00010000:1.0:1651529344.493238:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 4/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1554 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493247:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11181 00000100:00100000:1.0:1651529344.493249:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41278:x1731746396273984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.493252:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.493252:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11182 00010000:00010000:1.0:1651529344.493253:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 4/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493255:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41278:x1731746396274112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.493257:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 3/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493259:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.493261:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 4/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1554 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493263:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003933525f/0xa29a79078f3baa17 lrc: 0/0,0 mode: --/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ce expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493266:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493267:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493268:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493268:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 3/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1553 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493273:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3b9445 lrc: 0/0,0 mode: --/PR res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccec2 expref: 1553 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493277:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493277:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493278:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493280:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 4/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493282:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 4/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493289:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.493295:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.493299:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1552:41278:x1731746396273984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.493302:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11181 00000100:00100000:1.0:1651529344.493311:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393408 00000100:00100000:1.0:1651529344.493317:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152226 00000100:00100000:1.0:1651529344.493318:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+515:39030:x1731745946393408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.493322:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41278:x1731746396274112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (136us total) trans 0 rc 0/0 00002000:00080000:1.0:1651529344.493323:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177018 count 1 00000100:00100000:0.0:1651529344.493325:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11182 00010000:00010000:1.0:1651529344.493327:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493332:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 2/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1550 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493333:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493335:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493336:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493336:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 4/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493336:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493340:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493343:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 3/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1550 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493345:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493346:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1550 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493351:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966616768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.493367:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.493372:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493375:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.493376:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493379:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 3/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493383:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 1/0,0 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493386:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bde97 lrc: 0/0,0 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.493414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.493415:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+516:39030:x1731745946392960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 952us (990us total) trans 30064893083 rc 0/0 00000100:00100000:0.0:1651529344.493418:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152223 00010000:00010000:0.0:1651529344.493430:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493434:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493437:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493440:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.493467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.493482:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+516:39029:x1731745946392768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1301us total) trans 30064893084 rc 0/0 00000100:00100000:0.0:1651529344.493485:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152220 00000100:00100000:0.0:1651529344.493490:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393792 00000100:00100000:0.0:1651529344.493500:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152227 00000100:00100000:0.0:1651529344.493502:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+516:39030:x1731745946393792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.493507:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177019 count 1 00010000:00010000:0.0:1651529344.493511:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493522:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 2/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1550 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.493525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.493526:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493527:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493527:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 4/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493532:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273920 00010000:00010000:1.0:1651529344.493538:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493548:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 3/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1551 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493552:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493554:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274048 00010000:00010000:1.0:1651529344.493557:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1552 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493561:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274176 00010000:00010000:1.0:1651529344.493563:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1553 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493570:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966616832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.493574:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274240 00010000:00010000:1.0:1651529344.493576:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 5/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493580:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.493581:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11183 00000100:00100000:1.0:1651529344.493583:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41279:x1731746396273920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.493585:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493586:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.493587:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493589:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.493590:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493590:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493593:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 3/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493596:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f6d01c1/0xa29a79078f3bbfa3 lrc: 0/0,0 mode: --/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b92 expref: 1554 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493599:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493607:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493608:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493611:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 4/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493614:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 1/0,0 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493617:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bde82 lrc: 0/0,0 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493619:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.493626:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41279:x1731746396273920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.493629:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11183 00000100:00100000:1.0:1651529344.493634:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11184 00000100:00100000:1.0:1651529344.493635:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1552:41279:x1731746396274048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.493637:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.493638:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.493639:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1552 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493641:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493643:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1552 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493648:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bda3721/0xa29a79078f3bbe92 lrc: 0/0,0 mode: --/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d775c expref: 1552 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.493648:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11185 00000100:00100000:0.0:1651529344.493650:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1552:41279:x1731746396274176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.493651:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493652:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493652:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493653:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.493655:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493658:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 4/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493659:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 3/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493663:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.493664:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e5ce2c/0xa29a79078f3baf88 lrc: 0/0,0 mode: --/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c8b expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.493668:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41279:x1731746396274048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.493670:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11184 00000100:00100000:1.0:1651529344.493674:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11186 00000100:00100000:1.0:1651529344.493676:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1550:41279:x1731746396274240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.493678:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.493679:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 4/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1549 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493679:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493680:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493681:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493683:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 3/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1549 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.493684:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 4/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493688:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b15918/0xa29a79078f3ba5a2 lrc: 0/0,0 mode: --/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d158d expref: 1549 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.493691:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493691:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493691:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.493692:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493695:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 4/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493699:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1548:41279:x1731746396274176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.493702:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11185 00010000:00010000:1.0:1651529344.493704:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.493710:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1548:41279:x1731746396274240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.493713:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11186 00010000:00010000:0.0:1651529344.493719:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493720:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493723:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493723:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493726:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493726:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493729:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493729:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493785:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946392832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1477us (1592us total) trans 30064893085 rc 0/0 00000100:00100000:1.0:1651529344.493788:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152221 00000100:00100000:0.0:1651529344.493790:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946393088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1258us (1360us total) trans 30064893086 rc 0/0 00000100:00100000:0.0:1651529344.493793:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152224 00010000:00010000:1.0:1651529344.493796:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493799:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092586f6b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.493800:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493822:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493826:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.493828:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493829:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 3/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493831:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 3/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493834:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 1/0,0 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493835:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 1/0,0 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493837:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3bde89 lrc: 0/0,0 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493838:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bde9e lrc: 0/0,0 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493844:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493847:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493848:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493850:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493850:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493853:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493853:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493856:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493888:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946393216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 922us (953us total) trans 30064893087 rc 0/0 00000100:00100000:0.0:1651529344.493891:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152225 00000100:00100000:1.0:1651529344.493894:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+517:39029:x1731745946393024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1468us (1494us total) trans 30064893088 rc 0/0 00000100:00100000:1.0:1651529344.493897:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152222 00010000:00010000:0.0:1651529344.493898:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493901:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.493903:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493904:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493905:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 3/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493910:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000903748fd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.493910:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 1/0,0 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493911:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493912:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdea5 lrc: 0/0,0 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493913:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 3/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493918:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 1/0,0 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493920:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3bde90 lrc: 0/0,0 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.493969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.493999:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966616768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.494003:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494010:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393856 00000100:00100000:0.0:1651529344.494019:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393920 00000100:00100000:0.0:1651529344.494025:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152228 00000100:00100000:0.0:1651529344.494026:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946393856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.494032:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177020 count 1 00010000:00010000:0.0:1651529344.494036:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494038:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152229 00000100:00100000:1.0:1651529344.494040:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946393920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.494041:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 2/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1546 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.494046:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177021 count 1 00010000:00010000:0.0:1651529344.494047:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494047:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494048:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 4/0,1 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494050:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494054:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 3/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1546 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494055:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 2/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1546 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494058:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494058:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 4/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1546 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.494059:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494059:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 4/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494062:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.494066:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 3/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1546 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494070:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1546 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.494074:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966616960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494083:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.494088:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.494089:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274496 00010000:00010000:1.0:1651529344.494094:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.494102:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11187 00000100:00100000:1.0:1651529344.494103:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1547:41279:x1731746396274496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.494106:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.494107:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.494111:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 3/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.494129:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3bafea lrc: 0/0,0 mode: --/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e59 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.494133:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494133:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494134:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494137:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 4/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494143:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.494151:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1546:41279:x1731746396274496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.494153:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11187 00010000:00010000:1.0:1651529344.494160:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494163:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494166:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494169:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494190:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494194:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.494195:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494198:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 3/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494218:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 1/0,0 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494219:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+519:39030:x1731745946393408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 900us (1034us total) trans 30064893089 rc 0/0 00000100:00100000:1.0:1651529344.494222:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152226 00010000:00010000:0.0:1651529344.494232:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3bdeac lrc: 0/0,0 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494357:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394112 00000100:00100000:1.0:1651529344.494366:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394176 00000100:00100000:1.0:1651529344.494372:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394240 00000100:00100000:1.0:1651529344.494376:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394368 00000100:00100000:0.0:1651529344.494383:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152230 00000100:00100000:1.0:1651529344.494386:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152231 00000100:00100000:0.0:1651529344.494386:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+522:39030:x1731745946394112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.494387:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+522:39029:x1731745946394176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.494393:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177023 count 1 00010000:00010000:1.0:1651529344.494397:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494402:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 2/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.494403:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177022 count 1 00010000:00010000:1.0:1651529344.494405:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494406:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494406:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 4/0,1 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494408:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494413:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 3/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494413:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 2/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1545 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494416:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494416:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494417:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 4/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494424:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 3/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1545 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494426:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1545 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.494428:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1545 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.494431:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966617024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.494432:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966617088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494443:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.494443:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.494449:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152232 00000100:00100000:1.0:1651529344.494451:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+522:39030:x1731745946394240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.494451:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152233 00000100:00100000:0.0:1651529344.494453:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+522:39029:x1731745946394368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.494455:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177024 count 1 00002000:00080000:0.0:1651529344.494457:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177025 count 1 00010000:00010000:1.0:1651529344.494458:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494461:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494463:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 2/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494466:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494466:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494467:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 4/0,1 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494473:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 3/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494477:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 4/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1545 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.494480:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 2/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.494484:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494490:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.494491:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494492:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494493:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 4/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494500:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 3/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.494504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.494504:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1545 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.494508:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966617216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.494516:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.494530:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394432 00000100:00100000:0.0:1651529344.494538:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152234 00000100:00100000:0.0:1651529344.494540:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+523:39030:x1731745946394432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.494544:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177026 count 1 00010000:00010000:0.0:1651529344.494548:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494555:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 2/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494558:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494558:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494559:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 4/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494565:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 3/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1545 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494568:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 4/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1545 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.494572:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966617280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494579:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966616960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.494583:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494597:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.494608:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966616832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.494625:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494676:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966616896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.494680:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.495032:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274880 00000100:00100000:0.0:1651529344.495032:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.495041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.495043:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1546 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495057:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275008 00000100:00100000:0.0:1651529344.495064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.495065:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 4/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495070:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274944 00000100:00100000:0.0:1651529344.495070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.495072:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1548 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495076:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275072 00000100:00100000:0.0:1651529344.495077:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.495079:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1549 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495083:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275200 00010000:00010000:1.0:1651529344.495084:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1550 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495085:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966617088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495089:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495091:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275264 00010000:00010000:1.0:1651529344.495093:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 5/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495097:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11188 00000100:00100000:1.0:1651529344.495099:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11189 00000100:00100000:0.0:1651529344.495099:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41278:x1731746396274880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.495101:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41278:x1731746396275008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.495102:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495104:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495104:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495105:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 4/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495108:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 3/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495109:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 3/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495114:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3ba405 lrc: 0/0,0 mode: --/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e39 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495115:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a07d4d/0xa29a79078f3ba302 lrc: 0/0,0 mode: --/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a42 expref: 1551 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495118:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495118:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495119:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495119:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495119:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495120:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495122:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 4/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495123:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 4/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495129:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.495133:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495143:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1549:41278:x1731746396275008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495144:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1549:41278:x1731746396274880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495147:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11188 00000100:00100000:0.0:1651529344.495153:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11190 00000100:00100000:1.0:1651529344.495155:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11189 00000100:00100000:0.0:1651529344.495155:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1548:41279:x1731746396274944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.495158:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495159:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495161:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11191 00000100:00100000:1.0:1651529344.495162:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1547:41279:x1731746396275072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.495163:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 3/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495165:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495167:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495168:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc81d2b2/0xa29a79078f3baa1e lrc: 0/0,0 mode: --/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2706 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495171:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1547 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495172:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495172:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495173:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495176:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495176:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 4/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495177:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495177:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495181:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 4/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495186:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.495191:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.495192:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1546:41279:x1731746396274944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495195:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11190 00000100:00100000:1.0:1651529344.495198:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1545:41279:x1731746396275072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495199:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11192 00000100:00100000:1.0:1651529344.495201:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11191 00000100:00100000:0.0:1651529344.495202:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1545:41278:x1731746396275200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.495204:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.495206:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11193 00010000:00010000:0.0:1651529344.495206:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1544 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495208:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1544:41278:x1731746396275264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.495209:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 3/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1544 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495210:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495214:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090226d7/0xa29a79078f3b9223 lrc: 0/0,0 mode: --/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc648 expref: 1544 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495218:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495218:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495219:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 5/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1543 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495219:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495222:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 4/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495223:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 4/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1543 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.495228:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495228:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495229:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495232:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 4/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495236:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495243:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1543:41278:x1731746396275264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.495243:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495245:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11193 00000100:00100000:0.0:1651529344.495251:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1542:41278:x1731746396275200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.495252:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495256:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495259:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495262:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495284:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11192 00010000:00010000:0.0:1651529344.495296:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495300:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495303:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495305:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495327:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946393920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1358us total) trans 30064893090 rc 0/0 00000100:00100000:1.0:1651529344.495330:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152229 00010000:00010000:1.0:1651529344.495338:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495341:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004adc61cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.495342:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495345:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 3/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495350:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 1/0,0 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495351:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946393792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1848us (1899us total) trans 30064893091 rc 0/0 00010000:00010000:1.0:1651529344.495353:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3bdec1 lrc: 0/0,0 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495354:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152227 00010000:00010000:1.0:1651529344.495357:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495360:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.495361:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495363:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495366:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 3/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495366:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495369:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 1/0,0 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495369:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495372:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdeb3 lrc: 0/0,0 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495372:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495378:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495380:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.495381:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495384:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 3/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495387:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 1/0,0 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495390:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdecf lrc: 0/0,0 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495399:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0689ef/0xa29a79078f3b9ae3 lrc: 0/0,0 mode: --/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9f0 expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495405:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946394112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1019us (1113us total) trans 30064893092 rc 0/0 00000100:00100000:0.0:1651529344.495409:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152230 00000100:00100000:1.0:1651529344.495412:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966617024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495416:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495416:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495419:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495420:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495421:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495423:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495424:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495426:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495427:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495456:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+525:39030:x1731745946393856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1429us (1517us total) trans 30064893093 rc 0/0 00000100:00100000:0.0:1651529344.495459:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152228 00000100:00100000:1.0:1651529344.495466:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+524:39029:x1731745946394176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1078us (1133us total) trans 30064893094 rc 0/0 00000100:00100000:1.0:1651529344.495469:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152231 00010000:00010000:1.0:1651529344.495477:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495478:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495480:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.495481:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495481:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.495482:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495485:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 3/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495486:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 3/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495490:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 1/0,0 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495491:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 1/0,0 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495493:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdeba lrc: 0/0,0 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495493:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdec8 lrc: 0/0,0 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495504:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085456ddd/0xa29a79078f3b9c41 lrc: 0/0,0 mode: --/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef06 expref: 1540 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.495507:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495511:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495514:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495517:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495520:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495523:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.495550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.495587:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946394240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1135us (1246us total) trans 30064893095 rc 0/0 00000100:00100000:1.0:1651529344.495590:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152232 00000100:00100000:1.0:1651529344.495599:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275520 00010000:00010000:1.0:1651529344.495609:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 5/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1540 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495618:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966617216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495622:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495623:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275456 00010000:00010000:1.0:1651529344.495627:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495630:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966617280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495632:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495633:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11194 00000100:00100000:1.0:1651529344.495634:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1541:41278:x1731746396275520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.495637:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495638:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495639:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 4/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495640:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.495641:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495642:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 3/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495645:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 3/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495648:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3babc9 lrc: 0/0,0 mode: --/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dab expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495649:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 1/0,0 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495652:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495652:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495653:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495656:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 4/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495666:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495676:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1540:41278:x1731746396275520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495679:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11194 00000100:00100000:1.0:1651529344.495683:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11195 00000100:00100000:1.0:1651529344.495685:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41278:x1731746396275456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.495687:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495688:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495689:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bded6 lrc: 0/0,0 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495692:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 3/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495696:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495697:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e29c8a/0xa29a79078f3bba55 lrc: 0/0,0 mode: --/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d672c expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495699:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495700:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495701:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495701:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495702:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495704:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 4/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495705:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495717:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495723:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1538:41278:x1731746396275456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495725:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11195 00010000:00010000:1.0:1651529344.495743:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495747:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042602142 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.495748:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495750:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 3/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495755:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 1/0,0 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495757:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdee4 lrc: 0/0,0 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495763:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946394432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1258us total) trans 30064893096 rc 0/0 00000100:00100000:0.0:1651529344.495766:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152234 00010000:00010000:0.0:1651529344.495774:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495777:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495780:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495785:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.495861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.495870:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394944 00000100:00100000:1.0:1651529344.495879:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395008 00000100:00100000:1.0:1651529344.495884:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152235 00000100:00100000:1.0:1651529344.495886:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+526:39029:x1731745946394944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.495909:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177027 count 1 00010000:00010000:1.0:1651529344.495914:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495917:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+526:39029:x1731745946394368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1463us (1566us total) trans 30064893097 rc 0/0 00010000:00010000:1.0:1651529344.495919:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 2/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1537 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.495920:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152233 00010000:00010000:1.0:1651529344.495922:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495923:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495923:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 4/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495925:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152236 00000100:00100000:0.0:1651529344.495927:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+525:39030:x1731745946395008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.495930:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 3/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1537 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.495932:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177028 count 1 00010000:00010000:1.0:1651529344.495934:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1537 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.495936:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495938:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495941:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 2/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.495945:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495945:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.495948:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.495959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.495959:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 4/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495968:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 3/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.495972:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.495980:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966617408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.495988:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.495994:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495997:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000152886c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.495998:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496001:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 3/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.496013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 1/0,0 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496016:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3bdedd lrc: 0/0,0 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.496030:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395136 00000100:00100000:0.0:1651529344.496041:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395072 00000100:00100000:0.0:1651529344.496045:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395200 00000100:00100000:0.0:1651529344.496049:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152237 00000100:00100000:0.0:1651529344.496051:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+528:39030:x1731745946395136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.496055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.496056:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177030 count 1 00010000:00010000:0.0:1651529344.496059:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.496064:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 2/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1537 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496067:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496068:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.496069:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395264 00010000:00010000:0.0:1651529344.496069:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 4/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496074:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395392 00000100:00100000:1.0:1651529344.496077:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152238 00000100:00100000:1.0:1651529344.496087:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946395072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.496090:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 3/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1537 pid: 142994 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.496093:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177029 count 1 00010000:00010000:0.0:1651529344.496094:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1537 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496098:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966617472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496102:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496106:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 2/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496110:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496110:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496111:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 4/0,1 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496123:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.496124:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 3/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496128:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 4/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496130:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152239 00000100:00100000:1.0:1651529344.496132:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966617536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496132:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946395200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.496137:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177031 count 1 00000100:00100000:1.0:1651529344.496141:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.496141:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496145:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 2/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.496147:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152240 00010000:00010000:0.0:1651529344.496148:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.496149:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946395264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.496149:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496149:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 4/0,1 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.496153:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177032 count 1 00010000:00010000:0.0:1651529344.496156:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 3/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496157:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496159:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 4/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496163:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966617600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496170:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.496172:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 2/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1537 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496175:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.496175:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152241 00010000:00010000:1.0:1651529344.496176:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496177:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 4/0,1 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496177:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+530:39030:x1731745946395392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.496181:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177033 count 1 00010000:00010000:1.0:1651529344.496183:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 3/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1537 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496184:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496187:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 4/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1537 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496188:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 2/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.496191:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966617664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.496191:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496192:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496192:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 4/0,1 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496198:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.496198:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 3/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496204:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 4/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496208:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966617728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.496212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.496214:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.496219:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395456 00000100:00100000:0.0:1651529344.496239:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152242 00000100:00100000:0.0:1651529344.496241:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+531:39030:x1731745946395456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.496246:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177034 count 1 00010000:00010000:0.0:1651529344.496250:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496254:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 2/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496257:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496258:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496259:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 4/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496265:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 3/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1537 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496268:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 4/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496275:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966617792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496282:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496304:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496309:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496353:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275904 00000100:00100000:0.0:1651529344.496356:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966617408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496358:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1538 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496360:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496368:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275968 00010000:00010000:1.0:1651529344.496370:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496370:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11196 00000100:00100000:0.0:1651529344.496372:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41278:x1731746396275904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.496376:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11197 00010000:00010000:0.0:1651529344.496376:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.496378:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41279:x1731746396275968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.496378:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1539 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.496381:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.496381:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 3/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1539 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.496383:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.496386:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 3/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496387:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da3e610/0xa29a79078f3b954f lrc: 0/0,0 mode: --/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2dc expref: 1539 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496391:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496391:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496392:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bbf10 lrc: 0/0,0 mode: --/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d790e expref: 1538 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496392:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496395:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 4/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496396:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496396:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496397:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496400:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 4/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496406:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.496415:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.496422:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1537:41278:x1731746396275904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.496423:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1537:41279:x1731746396275968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.496425:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11196 00000100:00100000:1.0:1651529344.496427:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11197 00010000:00010000:0.0:1651529344.496432:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496436:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496439:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496442:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496445:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496458:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496462:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496465:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496499:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+533:39029:x1731745946394944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 612us (649us total) trans 30064893098 rc 0/0 00000100:00100000:1.0:1651529344.496502:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152235 00000100:00100000:0.0:1651529344.496508:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+532:39030:x1731745946395008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 580us (646us total) trans 30064893099 rc 0/0 00010000:00010000:1.0:1651529344.496510:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496511:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152236 00010000:00010000:1.0:1651529344.496513:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.496514:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496517:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 3/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496519:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496521:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 1/0,0 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496522:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.496523:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496524:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdeeb lrc: 0/0,0 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496528:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 3/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496533:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 1/0,0 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496536:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdef2 lrc: 0/0,0 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496572:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966617472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.496576:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.496759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.496766:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395840 00000100:00100000:1.0:1651529344.496783:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395904 00000100:00100000:1.0:1651529344.496791:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152243 00000100:00100000:1.0:1651529344.496793:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+533:39030:x1731745946395840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.496798:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177035 count 1 00010000:00010000:1.0:1651529344.496815:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496821:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 2/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1535 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496824:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496824:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496825:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 4/0,1 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496837:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 3/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1535 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496841:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 4/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1535 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.496850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496857:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.496872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496873:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496879:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276224 00010000:00010000:1.0:1651529344.496884:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1536 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.496890:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276352 00000100:00100000:0.0:1651529344.496896:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.496901:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 5/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496906:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276480 00010000:00010000:1.0:1651529344.496909:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 5/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1538 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496910:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152244 00000100:00100000:1.0:1651529344.496913:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276288 00000100:00100000:0.0:1651529344.496913:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+533:39030:x1731745946395904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.496915:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 5/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.496919:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276416 00002000:00080000:0.0:1651529344.496919:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177036 count 1 00010000:00010000:1.0:1651529344.496921:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 5/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1540 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496923:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496924:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276544 00010000:00010000:1.0:1651529344.496926:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 5/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1541 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.496928:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 2/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1541 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496931:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496932:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496933:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 4/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496939:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 3/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1541 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.496942:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11198 00010000:00010000:0.0:1651529344.496943:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1541 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.496944:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1541:41279:x1731746396276224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.496947:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.496947:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966617920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496948:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1541 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.496952:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 3/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1541 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.496958:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e37f451/0xa29a79078f3b87e9 lrc: 0/0,0 mode: --/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0ad expref: 1541 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.496958:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.496961:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496962:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496963:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496966:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 4/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496967:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966617600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.496971:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496975:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.496982:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1540:41279:x1731746396276224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.496984:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11198 00000100:00100000:0.0:1651529344.496987:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966617728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.496989:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11199 00010000:00010000:0.0:1651529344.496989:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496996:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966617792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.496997:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41279:x1731746396276352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.496998:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497000:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497001:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 4/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497005:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 3/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497006:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497009:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497010:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c7daa99/0xa29a79078f3bbc9a lrc: 0/0,0 mode: --/PR res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7008 expref: 1539 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497012:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497014:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497014:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497014:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497015:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497018:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 4/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497026:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497032:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1538:41279:x1731746396276352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497035:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11199 00000100:00100000:1.0:1651529344.497043:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11200 00000100:00100000:1.0:1651529344.497045:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1537:41279:x1731746396276480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.497047:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497049:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 4/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497059:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 3/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.497060:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+534:39030:x1731745946395136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1008us (1101us total) trans 30064893100 rc 0/0 00000100:00100000:0.0:1651529344.497063:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152237 00010000:00010000:1.0:1651529344.497064:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000808d2f6e/0xa29a79078f3bb5e7 lrc: 0/0,0 mode: --/PR res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5631 expref: 1537 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497068:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497068:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497069:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497071:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497072:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 4/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497075:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.497076:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497080:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.497085:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 3/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497086:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1536:41279:x1731746396276480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497088:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11200 00010000:00010000:0.0:1651529344.497091:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 1/0,0 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497093:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11201 00000100:00100000:1.0:1651529344.497094:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1535:41279:x1731746396276288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.497094:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdef9 lrc: 0/0,0 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497097:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497098:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 5/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1535 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497100:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497101:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 4/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1535 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497103:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497106:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497108:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497112:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497113:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497114:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497124:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 4/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497128:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497134:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1535:41279:x1731746396276288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497136:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11201 00000100:00100000:1.0:1651529344.497140:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11202 00000100:00100000:1.0:1651529344.497142:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1534:41279:x1731746396276416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.497145:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497146:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 5/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1534 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497149:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 4/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1534 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.497149:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+534:39030:x1731745946395392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 971us (1086us total) trans 30064893101 rc 0/0 00000100:00100000:0.0:1651529344.497152:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152241 00010000:00010000:1.0:1651529344.497154:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497154:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497155:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497168:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 4/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497172:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.497177:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497178:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1534:41279:x1731746396276416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497180:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11202 00010000:00010000:0.0:1651529344.497181:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497184:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11203 00010000:00010000:0.0:1651529344.497184:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497186:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1533:41279:x1731746396276544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.497188:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.497189:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497190:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 4/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1533 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497193:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 3/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1533 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497198:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b227ccab/0xa29a79078f3b9e0f lrc: 0/0,0 mode: --/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf684 expref: 1533 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497202:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497202:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497203:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497206:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 4/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497220:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497226:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1532:41279:x1731746396276544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497229:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11203 00010000:00010000:1.0:1651529344.497236:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497239:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.497240:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497243:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 3/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497247:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 1/0,0 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497247:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+534:39029:x1731745946395200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1114us (1228us total) trans 30064893102 rc 0/0 00010000:00010000:1.0:1651529344.497250:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bdf15 lrc: 0/0,0 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497250:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152239 00010000:00010000:1.0:1651529344.497253:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497256:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.497257:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497259:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497262:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497265:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497268:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 3/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497268:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497272:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 1/0,0 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497275:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3bdf07 lrc: 0/0,0 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497279:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497281:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.497282:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497285:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 3/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497288:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 1/0,0 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497290:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3bdf1c lrc: 0/0,0 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497300:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015ca5fa2/0xa29a79078f3ba149 lrc: 0/0,0 mode: --/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0318 expref: 1531 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.497302:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+534:39030:x1731745946395456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1089us total) trans 30064893103 rc 0/0 00000100:00100000:0.0:1651529344.497304:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152242 00000100:00100000:1.0:1651529344.497309:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966617536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497313:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497316:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497319:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497322:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497331:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.497383:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+534:39029:x1731745946395072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1295us (1381us total) trans 30064893104 rc 0/0 00000100:00100000:1.0:1651529344.497392:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152238 00010000:00010000:0.0:1651529344.497405:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497409:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.497411:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497414:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 3/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497419:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 1/0,0 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497422:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3bdf00 lrc: 0/0,0 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497429:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276928 00010000:00010000:1.0:1651529344.497434:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afaf36ce/0xa29a79078f3b939d lrc: 0/0,0 mode: --/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc53 expref: 1531 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497435:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 5/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1531 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.497439:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966617664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.497446:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11204 00010000:00010000:1.0:1651529344.497448:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497448:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1530:41278:x1731746396276928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.497451:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.497452:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 5/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497459:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497461:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497464:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497467:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497473:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 4/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497479:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497480:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497481:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497484:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 4/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497489:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.497499:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1530:41278:x1731746396276928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.497501:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11204 00000100:00100000:1.0:1651529344.497505:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+534:39029:x1731745946395264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1355us (1450us total) trans 30064893105 rc 0/0 00000100:00100000:1.0:1651529344.497508:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152240 00010000:00010000:1.0:1651529344.497515:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497518:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.497519:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497522:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 3/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497533:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 1/0,0 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497549:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdf0e lrc: 0/0,0 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497564:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7095266/0xa29a79078f3ba38e lrc: 0/0,0 mode: --/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c2c expref: 1529 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.497567:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497571:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.497580:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497584:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497587:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497589:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.497639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.497648:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+534:39030:x1731745946395840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 849us (902us total) trans 30064893106 rc 0/0 00000100:00100000:1.0:1651529344.497652:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152243 00000100:00100000:0.0:1651529344.497664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.497674:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396224 00000100:00100000:0.0:1651529344.497674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.497683:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396160 00000100:00100000:1.0:1651529344.497689:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396352 00000100:00100000:1.0:1651529344.497693:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152245 00000100:00100000:1.0:1651529344.497695:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+536:39029:x1731745946396224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.497700:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177038 count 1 00010000:00010000:1.0:1651529344.497704:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497704:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.497709:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 2/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497712:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497713:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497713:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 4/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.497720:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 3/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497723:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1528 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.497723:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966617920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.497727:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497727:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497745:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497749:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.497753:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.497754:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497756:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396288 00010000:00010000:0.0:1651529344.497760:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 3/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497761:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396416 00000100:00100000:1.0:1651529344.497764:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396480 00010000:00010000:0.0:1651529344.497765:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 1/0,0 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497766:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152246 00000100:00100000:1.0:1651529344.497775:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946396160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.497780:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177037 count 1 00010000:00010000:1.0:1651529344.497784:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497788:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 2/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497790:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdf23 lrc: 0/0,0 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497791:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497800:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.497800:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152247 00010000:00010000:1.0:1651529344.497801:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 4/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497819:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+539:39029:x1731745946396352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.497824:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 3/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.497825:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177040 count 1 00010000:00010000:1.0:1651529344.497828:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1528 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497829:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497832:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966618048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497834:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 2/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1528 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497837:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497837:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497838:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 4/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497840:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.497845:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 3/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1528 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.497847:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152248 00000100:00100000:1.0:1651529344.497848:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946396288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.497851:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1528 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.497853:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177039 count 1 00000100:00100000:0.0:1651529344.497855:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966618112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497856:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497864:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.497871:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 2/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.497871:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152249 00000100:00100000:0.0:1651529344.497873:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946396416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.497874:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497874:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497875:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 4/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.497877:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177041 count 1 00010000:00010000:0.0:1651529344.497881:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497882:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 3/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497885:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1528 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497885:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 2/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497888:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497888:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.497889:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966618176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497889:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 4/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497895:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 3/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1528 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.497897:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.497899:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1528 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.497903:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276992 00000100:00100000:0.0:1651529344.497906:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966618240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497907:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1529 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.497912:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.497915:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11205 00000100:00100000:1.0:1651529344.497917:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1529:41279:x1731746396276992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.497917:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152250 00000100:00100000:0.0:1651529344.497919:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946396480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.497920:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497921:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1529 pid: 128009 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.497923:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177042 count 1 00010000:00010000:0.0:1651529344.497926:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497930:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 2/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1529 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497933:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497933:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497934:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 4/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497935:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 3/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1529 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497940:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026278f26/0xa29a79078f3b9270 lrc: 0/0,0 mode: --/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc791 expref: 1529 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.497940:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 3/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1529 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497943:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1529 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.497944:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497945:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497946:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497947:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966618304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497949:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 4/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497953:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.497957:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497964:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1528:41279:x1731746396276992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497967:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11205 00010000:00010000:0.0:1651529344.497968:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497972:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497975:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497977:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.498018:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+540:39030:x1731745946395904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1104us (1258us total) trans 30064893107 rc 0/0 00000100:00100000:0.0:1651529344.498021:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152244 00000100:00100000:0.0:1651529344.498026:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396544 00000100:00100000:0.0:1651529344.498033:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152251 00000100:00100000:0.0:1651529344.498035:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+540:39030:x1731745946396544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.498040:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177043 count 1 00010000:00010000:0.0:1651529344.498044:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498078:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 2/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1527 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498081:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498082:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498083:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 4/0,1 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498093:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 3/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1527 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498097:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 4/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1527 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.498101:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966618368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.498114:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.498120:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498123:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.498124:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498127:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 3/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498132:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 1/0,0 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498158:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bdf2a lrc: 0/0,0 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.498182:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966617984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.498186:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498220:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966618048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.498232:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498255:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966618176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.498261:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396928 00010000:00010000:1.0:1651529344.498263:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498272:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152252 00000100:00100000:0.0:1651529344.498274:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+541:39030:x1731745946396928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.498279:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177044 count 1 00010000:00010000:0.0:1651529344.498283:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498306:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 2/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1527 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498309:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498310:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498310:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 4/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498318:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 3/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1527 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498321:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1527 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.498325:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966618432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.498340:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.498353:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966618112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498357:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498365:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966618240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498368:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498374:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966618304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498377:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498392:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966618368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498394:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.498761:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277312 00000100:00100000:1.0:1651529344.498764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.498767:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1528 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498777:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277440 00000100:00100000:0.0:1651529344.498780:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277568 00010000:00010000:1.0:1651529344.498782:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1530 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498783:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.498788:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277248 00000100:00100000:1.0:1651529344.498789:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277376 00010000:00010000:1.0:1651529344.498791:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1532 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498791:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1532 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498795:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277632 00000100:00100000:0.0:1651529344.498795:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277504 00010000:00010000:0.0:1651529344.498797:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1534 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498798:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 4/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1534 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498819:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11206 00000100:00100000:1.0:1651529344.498827:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1534:41278:x1731746396277312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.498831:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498833:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1534 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.498833:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11207 00000100:00100000:0.0:1651529344.498835:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1534:41278:x1731746396277440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.498837:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 3/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1534 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498838:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498840:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1534 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498843:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3ba547 lrc: 0/0,0 mode: --/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d140c expref: 1534 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498844:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 3/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1534 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498847:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498847:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498848:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498850:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000020f10bc/0xa29a79078f3b7837 lrc: 0/0,0 mode: --/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb66c expref: 1533 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498851:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 4/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498854:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498854:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498855:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498858:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.498858:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 4/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498865:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.498866:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1532:41278:x1731746396277312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.498869:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11206 00000100:00100000:0.0:1651529344.498872:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1531:41278:x1731746396277440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.498875:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11207 00000100:00100000:1.0:1651529344.498880:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11208 00000100:00100000:1.0:1651529344.498882:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1530:41278:x1731746396277568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.498882:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11209 00000100:00100000:0.0:1651529344.498883:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1530:41279:x1731746396277248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.498884:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498886:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498886:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498887:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498891:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 3/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498896:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1dc534/0xa29a79078f3badba lrc: 0/0,0 mode: --/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35e6 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498897:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 3/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1530 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498899:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498899:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498900:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498902:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3bafce lrc: 0/0,0 mode: --/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3de9 expref: 1529 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498903:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 4/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498906:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498907:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498907:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498913:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.498916:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 4/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498919:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1528:41279:x1731746396277248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.498922:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11209 00010000:00010000:1.0:1651529344.498926:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.498932:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11210 00000100:00100000:1.0:1651529344.498933:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1527:41278:x1731746396277568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.498934:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1527:41279:x1731746396277376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.498936:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11208 00010000:00010000:0.0:1651529344.498936:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498938:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1527 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498941:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11211 00010000:00010000:0.0:1651529344.498942:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 3/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1526 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498943:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1526:41279:x1731746396277632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.498945:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498947:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 4/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1526 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498947:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc43a0f1/0xa29a79078f3bb944 lrc: 0/0,0 mode: --/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6320 expref: 1526 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498950:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 3/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.498950:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498951:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498952:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498954:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 4/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498963:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.498968:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006381d01c/0xa29a79078f3bb681 lrc: 0/0,0 mode: --/PR res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5861 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.498969:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1525:41279:x1731746396277376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.498972:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.498972:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11210 00010000:00010000:1.0:1651529344.498973:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498973:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498976:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 4/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498976:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11212 00000100:00100000:0.0:1651529344.498978:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1523:41279:x1731746396277504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.498980:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498981:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1523 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.498985:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.498991:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 3/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1523 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.498992:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1523:41279:x1731746396277632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.498995:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11211 00010000:00010000:0.0:1651529344.498997:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bbf17 lrc: 0/0,0 mode: --/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d792a expref: 1523 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.499002:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499003:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499003:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499004:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499005:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499007:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 4/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499008:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499011:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499012:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.499018:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396277504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.499020:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11212 00010000:00010000:0.0:1651529344.499029:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499032:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499035:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499038:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499060:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+543:39030:x1731745946396288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1210us (1385us total) trans 30064893108 rc 0/0 00000100:00100000:1.0:1651529344.499063:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152248 00010000:00010000:1.0:1651529344.499070:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499073:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.499074:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499077:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 3/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499078:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+542:39029:x1731745946396352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1413us total) trans 30064893109 rc 0/0 00000100:00100000:0.0:1651529344.499081:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152247 00010000:00010000:1.0:1651529344.499082:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 1/0,0 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499085:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bdf46 lrc: 0/0,0 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499088:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499089:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499092:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.499092:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499093:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499095:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499097:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499105:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 3/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499109:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 1/0,0 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499112:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bdf3f lrc: 0/0,0 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499116:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499119:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.499120:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499122:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 3/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499125:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 1/0,0 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499128:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3bdf4d lrc: 0/0,0 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499130:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+542:39030:x1731745946396416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1256us (1449us total) trans 30064893110 rc 0/0 00010000:00010000:1.0:1651529344.499133:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499133:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152249 00010000:00010000:0.0:1651529344.499139:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499141:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499143:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499144:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499146:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499147:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499148:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499193:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+543:39030:x1731745946396160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1417us (1554us total) trans 30064893112 rc 0/0 00000100:00100000:0.0:1651529344.499195:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+543:39030:x1731745946396480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1481us total) trans 30064893111 rc 0/0 00000100:00100000:1.0:1651529344.499196:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152246 00000100:00100000:0.0:1651529344.499198:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152250 00010000:00010000:1.0:1651529344.499202:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499206:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.499206:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499206:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499209:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 3/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499210:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.499211:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499214:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 1/0,0 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499214:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 3/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499216:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bdf38 lrc: 0/0,0 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499219:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 1/0,0 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499221:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bdf54 lrc: 0/0,0 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499228:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499231:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499232:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499234:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499235:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499237:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499238:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499240:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499279:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+543:39029:x1731745946396224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1583us (1685us total) trans 30064893113 rc 0/0 00000100:00100000:1.0:1651529344.499281:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152245 00000100:00100000:0.0:1651529344.499289:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+542:39030:x1731745946396544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1253us (1304us total) trans 30064893114 rc 0/0 00000100:00100000:0.0:1651529344.499293:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152251 00000100:00100000:1.0:1651529344.499298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.499300:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499304:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.499305:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499307:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 3/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499312:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 1/0,0 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499315:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bdf5b lrc: 0/0,0 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499319:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499322:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.499323:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499328:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 3/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499331:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 1/0,0 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499334:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bdf31 lrc: 0/0,0 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499343:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966618432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499346:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499401:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277952 00010000:00010000:1.0:1651529344.499407:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.499415:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11213 00000100:00100000:1.0:1651529344.499416:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396277952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.499419:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.499421:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.499435:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 3/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.499441:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd07d08/0xa29a79078f3b98a5 lrc: 0/0,0 mode: --/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce088 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.499445:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499446:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499447:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499450:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 4/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499459:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.499465:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499469:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1520:41279:x1731746396277952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.499472:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11213 00010000:00010000:0.0:1651529344.499473:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499477:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499479:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499487:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499490:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.499491:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499494:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 3/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499506:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 1/0,0 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499509:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bdf62 lrc: 0/0,0 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499535:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+542:39030:x1731745946396928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1259us (1366us total) trans 30064893115 rc 0/0 00000100:00100000:0.0:1651529344.499538:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152252 00000100:00100000:0.0:1651529344.499624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.499634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.499640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.499652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.499658:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397440 00000100:00100000:0.0:1651529344.499659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.499667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.499678:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397568 00000100:00100000:1.0:1651529344.499683:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397696 00000100:00100000:1.0:1651529344.499686:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397504 00000100:00100000:1.0:1651529344.499691:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397632 00000100:00100000:1.0:1651529344.499704:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397760 00000100:00100000:1.0:1651529344.499708:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152253 00000100:00100000:1.0:1651529344.499710:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+547:39030:x1731745946397440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.499711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.499716:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177045 count 1 00010000:00010000:1.0:1651529344.499720:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.499725:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 2/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.499727:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397824 00010000:00010000:1.0:1651529344.499728:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499729:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499730:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 4/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499742:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397888 00000100:00100000:0.0:1651529344.499746:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152254 00000100:00100000:0.0:1651529344.499747:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946397568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.499748:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 3/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.499753:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177047 count 1 00010000:00010000:0.0:1651529344.499758:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499762:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.499763:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 2/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1519 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.499766:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966618496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499766:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499767:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499767:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 4/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499774:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 3/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1519 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.499779:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.499781:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1519 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.499785:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152255 00000100:00100000:0.0:1651529344.499785:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966618560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.499787:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946397696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.499792:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177049 count 1 00000100:00100000:0.0:1651529344.499794:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.499796:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499800:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 2/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.499801:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152256 00000100:00100000:0.0:1651529344.499802:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+549:39029:x1731745946397504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.499822:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499823:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499824:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 4/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.499826:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177046 count 1 00010000:00010000:0.0:1651529344.499830:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499831:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 3/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499835:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.499835:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 2/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499838:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499838:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499839:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 4/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499845:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.499849:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966618624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499849:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.499856:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966618688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.499857:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.499864:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152257 00000100:00100000:0.0:1651529344.499864:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.499866:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+549:39029:x1731745946397632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.499870:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177048 count 1 00000100:00100000:0.0:1651529344.499870:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152258 00000100:00100000:0.0:1651529344.499872:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+549:39029:x1731745946397760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.499874:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.499876:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177050 count 1 00010000:00010000:1.0:1651529344.499878:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 2/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499880:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499881:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499882:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499882:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 4/0,1 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499884:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 2/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499887:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499887:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499888:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 3/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499888:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 4/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499892:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 4/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.499894:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 3/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.499896:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966618752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499898:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.499901:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966618816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.499903:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.499908:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.499909:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152259 00000100:00100000:1.0:1651529344.499917:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946397824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.499918:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152260 00000100:00100000:0.0:1651529344.499920:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946397888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.499922:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177051 count 1 00002000:00080000:0.0:1651529344.499924:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177052 count 1 00010000:00010000:1.0:1651529344.499926:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499928:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499930:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 2/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499932:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 2/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499933:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499934:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499934:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 4/0,1 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499935:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499936:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499936:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 4/0,1 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499941:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 3/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499942:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 3/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1519 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499945:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 4/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.499946:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 4/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.499949:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966618880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.499950:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966618944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.499957:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.499958:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.500443:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966618496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500453:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500461:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966618624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500464:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500511:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966618752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.500512:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.500520:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.500529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500533:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278528 00000100:00100000:0.0:1651529344.500535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.500543:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1520 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.500548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500550:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278656 00010000:00010000:1.0:1651529344.500552:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1521 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500557:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11214 00000100:00100000:1.0:1651529344.500558:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396278528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.500561:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.500561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.500562:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1521 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500566:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 3/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1521 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500570:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966618560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500572:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f77d7e6f/0xa29a79078f3bc07c lrc: 0/0,0 mode: --/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f35 expref: 1521 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500574:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500576:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.500582:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966618688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500584:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500584:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500585:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500588:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 4/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500590:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966618816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.500593:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500595:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.500599:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966618944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.500601:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500605:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1520:41279:x1731746396278528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500607:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278784 00000100:00100000:1.0:1651529344.500608:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11214 00000100:00100000:1.0:1651529344.500613:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278592 00010000:00010000:0.0:1651529344.500613:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 4/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1520 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500616:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500618:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278912 00000100:00100000:1.0:1651529344.500621:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278720 00010000:00010000:0.0:1651529344.500621:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 5/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1522 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500623:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1523 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500625:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279040 00000100:00100000:1.0:1651529344.500628:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278848 00010000:00010000:0.0:1651529344.500628:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 4/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1524 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500630:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.500633:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11215 00000100:00100000:0.0:1651529344.500635:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1525:41279:x1731746396278656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.500636:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11216 00000100:00100000:1.0:1651529344.500637:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1525:41279:x1731746396278784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.500638:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500639:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500640:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.500641:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 4/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500643:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 3/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500648:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3b9907 lrc: 0/0,0 mode: --/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce202 expref: 1525 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500652:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500653:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500653:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500654:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 3/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1524 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500657:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 4/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500660:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d76b4fa/0xa29a79078f3bae07 lrc: 0/0,0 mode: --/PR res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36bf expref: 1524 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500663:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500666:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.500670:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500671:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500674:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 4/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500674:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1523:41279:x1731746396278656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500677:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11215 00010000:00010000:1.0:1651529344.500680:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.500682:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11217 00000100:00100000:0.0:1651529344.500684:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1522:41278:x1731746396278592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.500686:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1522:41279:x1731746396278784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.500686:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500688:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1522 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500689:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11216 00010000:00010000:0.0:1651529344.500691:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 3/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500694:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11218 00000100:00100000:1.0:1651529344.500696:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396278912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.500696:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b005d73/0xa29a79078f3b9786 lrc: 0/0,0 mode: --/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc21 expref: 1521 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500698:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500699:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500700:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 5/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1520 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500700:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500701:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500703:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 4/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1520 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500704:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 4/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500710:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.500715:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1520:41278:x1731746396278592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.500716:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500716:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500717:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500717:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11217 00010000:00010000:1.0:1651529344.500720:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 4/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500722:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11219 00000100:00100000:0.0:1651529344.500723:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1519:41278:x1731746396278720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.500724:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.500726:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500727:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500739:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1519:41279:x1731746396278912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.500740:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1519 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500742:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11218 00010000:00010000:0.0:1651529344.500745:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb36a31/0xa29a79078f3bb419 lrc: 0/0,0 mode: --/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f9a expref: 1518 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500747:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11220 00000100:00100000:1.0:1651529344.500749:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1517:41279:x1731746396279040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.500749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500750:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500751:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.500753:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 4/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1517 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500753:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 4/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500756:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 3/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1517 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500759:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.500761:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429332da/0xa29a79078f3ba746 lrc: 0/0,0 mode: --/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cbe expref: 1517 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500765:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.500765:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1516:41278:x1731746396278720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500768:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11219 00010000:00010000:1.0:1651529344.500771:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500772:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500772:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11221 00000100:00100000:0.0:1651529344.500774:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41278:x1731746396278848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.500775:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 4/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500776:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500778:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1515 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500781:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 3/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1515 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.500784:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.500790:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41279:x1731746396279040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.500793:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11220 00010000:00010000:0.0:1651529344.500794:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cd52/0xa29a79078f3bc098 lrc: 0/0,0 mode: --/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f89 expref: 1515 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.500797:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500798:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500798:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500801:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 4/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500820:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500824:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500824:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.500827:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500830:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500830:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1513:41278:x1731746396278848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500833:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11221 00010000:00010000:0.0:1651529344.500848:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500851:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.500853:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500856:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 3/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500860:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 1/0,0 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500865:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bdf85 lrc: 0/0,0 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500871:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500876:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+550:39029:x1731745946397632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1010us (1217us total) trans 30064893116 rc 0/0 00010000:00010000:0.0:1651529344.500879:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500880:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152257 00010000:00010000:0.0:1651529344.500883:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500885:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500887:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500893:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500896:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500899:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500934:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+551:39030:x1731745946397696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1146us (1294us total) trans 30064893117 rc 0/0 00000100:00100000:1.0:1651529344.500937:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152255 00000100:00100000:0.0:1651529344.500941:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946397888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1020us (1221us total) trans 30064893118 rc 0/0 00010000:00010000:1.0:1651529344.500944:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500944:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152260 00010000:00010000:1.0:1651529344.500947:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.500948:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500951:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 3/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500952:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500956:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 1/0,0 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500956:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.500957:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500958:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3bdf9a lrc: 0/0,0 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500960:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 3/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500965:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 1/0,0 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500968:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bdf77 lrc: 0/0,0 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500970:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36753ef/0xa29a79078f3ba348 lrc: 0/0,0 mode: --/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b53 expref: 1512 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.500974:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966618880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.500974:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500977:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500978:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500980:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500981:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500982:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500984:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500986:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500989:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501018:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+551:39029:x1731745946397760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1145us (1350us total) trans 30064893119 rc 0/0 00000100:00100000:0.0:1651529344.501021:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152258 00000100:00100000:1.0:1651529344.501024:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946397824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1106us (1313us total) trans 30064893120 rc 0/0 00000100:00100000:1.0:1651529344.501027:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152259 00010000:00010000:0.0:1651529344.501028:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501031:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501034:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501036:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501039:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501040:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.501041:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501044:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 3/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501048:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 1/0,0 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501051:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3bdf8c lrc: 0/0,0 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501055:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501058:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.501059:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501062:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 3/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501065:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 1/0,0 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501070:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bdf93 lrc: 0/0,0 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501071:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+550:39029:x1731745946397504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1268us (1419us total) trans 30064893121 rc 0/0 00010000:00010000:1.0:1651529344.501073:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501074:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152256 00010000:00010000:1.0:1651529344.501076:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.501076:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501079:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 3/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501081:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501082:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 1/0,0 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501084:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501085:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bdf7e lrc: 0/0,0 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501087:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501089:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501089:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501092:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501095:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501110:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501125:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946397568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1377us (1491us total) trans 30064893122 rc 0/0 00000100:00100000:0.0:1651529344.501128:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152254 00010000:00010000:0.0:1651529344.501135:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501140:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.501141:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501144:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 3/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501146:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946397440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1435us (1522us total) trans 30064893123 rc 0/0 00010000:00010000:0.0:1651529344.501148:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 1/0,0 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501149:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152253 00010000:00010000:0.0:1651529344.501151:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bdf70 lrc: 0/0,0 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501155:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501158:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.501159:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501161:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 3/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501165:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 1/0,0 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501170:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bdf69 lrc: 0/0,0 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.501547:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.501548:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398528 00000100:00100000:0.0:1651529344.501554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.501566:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398592 00000100:00100000:1.0:1651529344.501573:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398656 00000100:00100000:0.0:1651529344.501576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.501585:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398720 00000100:00100000:1.0:1651529344.501590:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152261 00000100:00100000:0.0:1651529344.501590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.501592:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+553:39029:x1731745946398528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.501596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.501598:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177053 count 1 00010000:00010000:1.0:1651529344.501602:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.501607:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 2/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.501609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.501611:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501611:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501612:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 4/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501615:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398784 00010000:00010000:1.0:1651529344.501619:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 3/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.501620:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398848 00000100:00100000:0.0:1651529344.501622:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398976 00000100:00100000:0.0:1651529344.501624:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398912 00000100:00100000:0.0:1651529344.501627:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152262 00000100:00100000:0.0:1651529344.501629:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946398592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.501634:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 4/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1511 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.501634:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177054 count 1 00000100:00100000:1.0:1651529344.501638:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966619008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501639:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501644:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 2/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501647:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501647:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501648:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 4/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501651:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.501655:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 3/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.501657:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152263 00000100:00100000:1.0:1651529344.501659:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+557:39029:x1731745946398656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.501659:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1511 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.501663:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177055 count 1 00000100:00100000:0.0:1651529344.501664:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966619072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.501667:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501671:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 2/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.501672:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.501675:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501675:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501676:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 4/0,1 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501679:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152264 00000100:00100000:0.0:1651529344.501680:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946398720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.501682:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 3/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501685:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 4/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1511 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.501685:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177056 count 1 00010000:00010000:0.0:1651529344.501688:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501692:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 2/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501695:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501696:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501697:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 4/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501700:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966619136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501703:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 3/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501706:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1511 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.501708:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.501710:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966619200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501714:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152265 00000100:00100000:1.0:1651529344.501716:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+557:39029:x1731745946398784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.501716:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.501721:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177057 count 1 00000100:00100000:0.0:1651529344.501722:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152266 00010000:00010000:1.0:1651529344.501724:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501724:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946398848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.501728:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 2/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.501728:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177058 count 1 00010000:00010000:1.0:1651529344.501741:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501741:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501742:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501742:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 4/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501746:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 2/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501749:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 3/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501749:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501750:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501750:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 4/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501753:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1511 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.501757:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966619264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501757:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 3/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1511 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501760:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1511 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.501764:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.501764:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966619328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501770:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152267 00000100:00100000:0.0:1651529344.501771:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.501779:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946398976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.501779:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152268 00000100:00100000:0.0:1651529344.501781:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+557:39029:x1731745946398912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.501784:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177060 count 1 00002000:00080000:0.0:1651529344.501786:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177059 count 1 00010000:00010000:1.0:1651529344.501788:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501789:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501792:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 2/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501793:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 2/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501795:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501795:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501796:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 4/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501796:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501797:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501797:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 4/0,1 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501821:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 3/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501824:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1511 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501825:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1511 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.501829:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 4/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1511 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.501830:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966619392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.501833:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966619456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501838:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.501841:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.502145:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966619008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.502154:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502167:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966619136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.502170:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502186:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966619264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.502189:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502200:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966619072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502205:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502209:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966619392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.502212:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502212:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966619200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502215:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502221:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966619328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502224:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502418:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279616 00000100:00100000:1.0:1651529344.502423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.502424:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 4/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1512 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502430:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279744 00010000:00010000:0.0:1651529344.502432:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1513 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502437:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279680 00010000:00010000:0.0:1651529344.502439:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1514 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502447:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279872 00000100:00100000:0.0:1651529344.502450:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279808 00010000:00010000:1.0:1651529344.502453:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1516 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502453:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 4/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1516 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.502457:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279936 00010000:00010000:0.0:1651529344.502459:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1517 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502460:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280000 00010000:00010000:1.0:1651529344.502462:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1518 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.502464:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11222 00000100:00100000:0.0:1651529344.502466:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1518:41278:x1731746396279616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.502467:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11223 00000100:00100000:1.0:1651529344.502468:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1518:41278:x1731746396279744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.502469:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.502470:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 4/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1518 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502474:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 3/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1518 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502479:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.502480:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3b9461 lrc: 0/0,0 mode: --/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf16 expref: 1518 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502481:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1518 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502483:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502484:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 3/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1517 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502484:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502485:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502488:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 4/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502491:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d09429b/0xa29a79078f3b933b lrc: 0/0,0 mode: --/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaa1 expref: 1517 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502495:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502498:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.502501:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502503:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502506:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 4/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502508:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1516:41278:x1731746396279616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.502511:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11222 00010000:00010000:1.0:1651529344.502515:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.502523:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1516:41278:x1731746396279744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.502526:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11223 00000100:00100000:0.0:1651529344.502537:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11224 00000100:00100000:1.0:1651529344.502539:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11225 00000100:00100000:0.0:1651529344.502539:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1514:41279:x1731746396279680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.502541:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1514:41279:x1731746396279808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.502542:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.502544:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.502544:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1514 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502545:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 4/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1514 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502550:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 3/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1514 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502555:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bd3532a/0xa29a79078f3ba5f6 lrc: 0/0,0 mode: --/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d172a expref: 1514 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502559:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 3/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1513 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502559:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502559:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502560:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502563:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 4/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502564:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b37fa9/0xa29a79078f3bbc93 lrc: 0/0,0 mode: --/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ffa expref: 1513 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502568:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502568:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502569:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502569:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.502572:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 4/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502575:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1512:41279:x1731746396279680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.502578:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11224 00010000:00010000:1.0:1651529344.502579:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.502582:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11226 00000100:00100000:0.0:1651529344.502584:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1511:41278:x1731746396279872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.502585:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1511:41279:x1731746396279808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.502586:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.502588:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11225 00010000:00010000:0.0:1651529344.502588:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1511 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502591:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 3/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1510 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502592:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11227 00000100:00100000:1.0:1651529344.502594:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1510:41279:x1731746396279936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.502596:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038d5978f/0xa29a79078f3b9509 lrc: 0/0,0 mode: --/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1a8 expref: 1510 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502597:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.502598:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1510 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502599:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502600:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502601:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502602:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 3/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1509 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502604:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 4/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502612:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.502618:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1509:41278:x1731746396279872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.502619:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000532931c2/0xa29a79078f3b97a2 lrc: 0/0,0 mode: --/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc6e expref: 1509 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.502620:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11226 00010000:00010000:1.0:1651529344.502623:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502624:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502624:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502624:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11228 00000100:00100000:0.0:1651529344.502626:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1507:41279:x1731746396280000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.502627:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 4/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502628:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.502630:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1507 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.502633:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 3/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1507 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.502636:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.502643:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1507:41279:x1731746396279936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.502645:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032809480/0xa29a79078f3bbd03 lrc: 0/0,0 mode: --/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7158 expref: 1507 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.502646:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11227 00010000:00010000:0.0:1651529344.502651:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502651:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502652:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502655:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 4/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502657:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502660:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502663:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.502669:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502669:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1505:41279:x1731746396280000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.502672:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502672:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11228 00000100:00100000:0.0:1651529344.502682:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966619456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502685:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502691:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502694:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502697:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502700:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502722:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+558:39029:x1731745946398656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1062us (1167us total) trans 30064893124 rc 0/0 00000100:00100000:1.0:1651529344.502725:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152263 00010000:00010000:1.0:1651529344.502742:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502746:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.502747:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502750:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 3/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502755:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 1/0,0 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502755:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+558:39030:x1731745946398848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1158us total) trans 30064893125 rc 0/0 00010000:00010000:1.0:1651529344.502758:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bdfaf lrc: 0/0,0 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502758:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152266 00010000:00010000:1.0:1651529344.502762:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502765:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000019d6555c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.502766:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502767:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502771:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502774:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502776:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502782:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 3/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502786:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 1/0,0 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502788:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3bdfc4 lrc: 0/0,0 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502792:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502795:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.502796:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502798:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 3/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502801:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 1/0,0 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502820:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3bdfb6 lrc: 0/0,0 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502826:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502830:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+558:39030:x1731745946398720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1149us (1259us total) trans 30064893126 rc 0/0 00000100:00100000:0.0:1651529344.502834:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152264 00010000:00010000:1.0:1651529344.502835:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502838:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502841:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502844:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502854:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502857:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502862:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502888:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+559:39029:x1731745946398784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1170us (1297us total) trans 30064893127 rc 0/0 00000100:00100000:1.0:1651529344.502891:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152265 00010000:00010000:1.0:1651529344.502899:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502902:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.502902:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+558:39030:x1731745946398592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1272us (1354us total) trans 30064893128 rc 0/0 00010000:00010000:1.0:1651529344.502903:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502905:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152262 00010000:00010000:1.0:1651529344.502906:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 3/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502910:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 1/0,0 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502912:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502913:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bdfbd lrc: 0/0,0 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502915:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.502917:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502919:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 3/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502924:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 1/0,0 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502927:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3bdfa8 lrc: 0/0,0 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502930:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502933:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502936:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502939:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502990:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+558:39030:x1731745946398976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1210us (1387us total) trans 30064893129 rc 0/0 00000100:00100000:1.0:1651529344.502993:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152267 00000100:00100000:1.0:1651529344.503008:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280064 00010000:00010000:1.0:1651529344.503025:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 4/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.503030:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503037:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042602142 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.503038:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503041:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 3/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503045:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 1/0,0 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503048:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3bdfcb lrc: 0/0,0 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503054:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11229 00000100:00100000:1.0:1651529344.503055:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1505:41279:x1731746396280064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.503059:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503060:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 4/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503075:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503081:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5173d53/0xa29a79078f3ba9d8 lrc: 0/0,0 mode: --/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2603 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503084:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503085:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503086:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503089:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 4/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503098:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.503102:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503106:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503108:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1504:41279:x1731746396280064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.503111:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11229 00010000:00010000:1.0:1651529344.503119:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503119:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503122:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503122:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503125:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503141:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503182:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+559:39029:x1731745946398528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1589us (1646us total) trans 30064893131 rc 0/0 00000100:00100000:1.0:1651529344.503185:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152261 00010000:00010000:1.0:1651529344.503192:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503192:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+558:39029:x1731745946398912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1401us (1574us total) trans 30064893130 rc 0/0 00010000:00010000:1.0:1651529344.503196:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677dae30 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.503196:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152268 00010000:00010000:1.0:1651529344.503197:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503199:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 3/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503204:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 1/0,0 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503207:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3bdfd2 lrc: 0/0,0 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503211:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503215:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.503216:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503219:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 3/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503224:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 1/0,0 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503227:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bdfa1 lrc: 0/0,0 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503260:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399680 00000100:00100000:0.0:1651529344.503275:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152269 00000100:00100000:0.0:1651529344.503277:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+558:39029:x1731745946399680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.503283:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177061 count 1 00010000:00010000:0.0:1651529344.503287:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503292:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 2/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503312:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503313:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503313:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 4/0,1 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503321:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 3/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503325:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 4/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1503 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.503329:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966619520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.503347:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.503360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.503395:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399744 00000100:00100000:1.0:1651529344.503406:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399808 00000100:00100000:1.0:1651529344.503411:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399872 00000100:00100000:1.0:1651529344.503428:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399936 00000100:00100000:0.0:1651529344.503431:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400000 00000100:00100000:1.0:1651529344.503435:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152270 00000100:00100000:1.0:1651529344.503437:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+563:39030:x1731745946399744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.503443:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177062 count 1 00000100:00100000:0.0:1651529344.503444:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152271 00000100:00100000:0.0:1651529344.503445:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+563:39029:x1731745946399808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.503447:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.503450:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177063 count 1 00010000:00010000:1.0:1651529344.503452:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 2/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503455:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503455:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503456:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503457:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 4/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503464:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503467:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 4/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1503 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.503471:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966619584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503476:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 2/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503480:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503480:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.503481:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.503481:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 4/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503488:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152272 00010000:00010000:0.0:1651529344.503488:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 3/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503490:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+563:39030:x1731745946399872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.503492:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1503 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.503494:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177064 count 1 00000100:00100000:0.0:1651529344.503496:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966619648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503498:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503505:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503510:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 2/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.503512:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152273 00010000:00010000:1.0:1651529344.503513:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503514:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.503514:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+563:39029:x1731745946399936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.503515:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 4/0,1 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.503518:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177065 count 1 00010000:00010000:1.0:1651529344.503521:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 3/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503522:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503525:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 4/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1503 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.503527:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 2/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503529:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966619712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503530:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503530:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.503537:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.503543:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152274 00010000:00010000:0.0:1651529344.503544:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 4/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503545:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+563:39030:x1731745946400000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.503549:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177066 count 1 00010000:00010000:1.0:1651529344.503553:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503555:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 3/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503557:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 2/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503558:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1503 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503560:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.503562:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966619776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503567:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503568:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 4/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503570:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503575:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 3/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503579:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1503 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.503583:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966619840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.503586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.503590:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.503596:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400128 00000100:00100000:1.0:1651529344.503606:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152275 00000100:00100000:1.0:1651529344.503608:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+564:39030:x1731745946400128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.503612:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177068 count 1 00000100:00100000:0.0:1651529344.503617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.503622:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503627:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 2/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503630:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503631:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503631:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 4/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503638:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 3/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1503 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.503639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.503659:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1503 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.503666:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400064 00000100:00100000:0.0:1651529344.503674:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152276 00000100:00100000:0.0:1651529344.503676:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+565:39029:x1731745946400064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.503681:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177067 count 1 00010000:00010000:0.0:1651529344.503685:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503686:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966619904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503690:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 2/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1503 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503693:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503693:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503694:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 4/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503701:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.503707:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280640 00010000:00010000:0.0:1651529344.503711:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 3/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503712:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 5/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.503715:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.503719:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966619968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.503720:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11230 00000100:00100000:1.0:1651529344.503722:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1504:41278:x1731746396280640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.503725:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503726:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 5/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.503727:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503730:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 4/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503745:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503745:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503746:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503749:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 4/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503763:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfe7438/0xa29a79078f3baa5d lrc: 0/0,0 mode: --/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27c3 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.503764:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.503768:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966619520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.503771:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1503:41278:x1731746396280640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.503772:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503773:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11230 00010000:00010000:0.0:1651529344.503775:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503778:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503781:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503784:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503848:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+566:39029:x1731745946399680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 570us (606us total) trans 30064893132 rc 0/0 00000100:00100000:0.0:1651529344.503852:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152269 00010000:00010000:0.0:1651529344.503882:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503886:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf025eac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.503887:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503890:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 3/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503895:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 1/0,0 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503898:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3bdfd9 lrc: 0/0,0 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503917:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966619584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503927:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503936:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966619648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503940:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503963:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966619776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503966:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503969:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966619712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503974:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.504015:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400576 00000100:00100000:0.0:1651529344.504022:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152277 00000100:00100000:0.0:1651529344.504023:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+566:39029:x1731745946400576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.504029:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177069 count 1 00010000:00010000:0.0:1651529344.504033:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504038:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 2/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1502 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504041:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504041:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504042:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 4/0,1 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504048:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 3/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1502 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504052:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 4/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1502 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504056:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966620032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.504074:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.504234:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966619840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.504238:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504251:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966619904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.504253:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504276:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280896 00000100:00100000:0.0:1651529344.504277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.504286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.504288:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1503 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504293:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.504302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.504306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504307:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280960 00010000:00010000:1.0:1651529344.504310:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 4/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1504 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504314:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280832 00010000:00010000:1.0:1651529344.504316:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 4/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504320:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281088 00000100:00100000:0.0:1651529344.504320:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966619968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.504322:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1506 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504324:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504326:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281024 00010000:00010000:1.0:1651529344.504328:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1507 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504332:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281152 00010000:00010000:1.0:1651529344.504334:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1508 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504338:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281216 00010000:00010000:1.0:1651529344.504345:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1509 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504349:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11231 00000100:00100000:0.0:1651529344.504351:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1509:41278:x1731746396280896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.504352:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11232 00000100:00100000:1.0:1651529344.504354:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1509:41278:x1731746396280960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.504355:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504357:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1509 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504360:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 3/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1509 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504365:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504366:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 4/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1509 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504366:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bb4e4 lrc: 0/0,0 mode: --/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5264 expref: 1509 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504370:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 3/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1508 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504370:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504370:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504371:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504374:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 4/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504376:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005777e81e/0xa29a79078f3b9406 lrc: 0/0,0 mode: --/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdc6 expref: 1508 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504380:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504380:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504381:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504381:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.504384:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 4/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504388:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1507:41278:x1731746396280896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.504391:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.504391:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11231 00000100:00100000:0.0:1651529344.504397:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11233 00000100:00100000:1.0:1651529344.504399:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1506:41278:x1731746396280960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.504399:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1506:41279:x1731746396280832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.504401:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.504402:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11232 00010000:00010000:0.0:1651529344.504403:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 4/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1506 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504406:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11234 00010000:00010000:0.0:1651529344.504407:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504408:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1505:41278:x1731746396281088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.504410:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504412:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504412:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034bd1be1/0xa29a79078f3b9eb7 lrc: 0/0,0 mode: --/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8e5 expref: 1505 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504415:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504416:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504417:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504419:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 4/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504428:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.504431:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 3/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504434:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1504:41279:x1731746396280832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.504437:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b6fbeb/0xa29a79078f3ba5e1 lrc: 0/0,0 mode: --/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16d6 expref: 1504 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504437:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11233 00010000:00010000:1.0:1651529344.504441:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504441:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504442:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504442:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11235 00000100:00100000:0.0:1651529344.504443:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1502:41279:x1731746396281024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.504445:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 4/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504446:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504447:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1502 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504451:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.504451:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 3/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1502 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504456:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034747eda/0xa29a79078f3b98b3 lrc: 0/0,0 mode: --/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ce expref: 1502 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.504457:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1502:41278:x1731746396281088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.504459:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.504460:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11234 00010000:00010000:0.0:1651529344.504460:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504461:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504463:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 4/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504469:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11236 00010000:00010000:0.0:1651529344.504469:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.504471:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41279:x1731746396281152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.504474:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.504474:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41279:x1731746396281024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.504475:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1500 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504476:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11235 00010000:00010000:1.0:1651529344.504479:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 3/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1499 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.504480:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11237 00000100:00100000:0.0:1651529344.504482:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1499:41279:x1731746396281216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.504484:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504486:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1499 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504489:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 3/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1499 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504492:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3b974e lrc: 0/0,0 mode: --/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb48 expref: 1499 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504494:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be22eac3/0xa29a79078f3b9c4f lrc: 0/0,0 mode: --/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef84 expref: 1499 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504496:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504496:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504497:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504497:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504497:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504498:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504500:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 4/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504501:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 4/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504506:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.504506:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.504510:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1497:41279:x1731746396281216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.504513:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1497:41279:x1731746396281152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.504513:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11237 00000100:00100000:1.0:1651529344.504516:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11236 00010000:00010000:0.0:1651529344.504518:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504522:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504524:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504528:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504531:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504533:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504541:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504544:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504583:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+568:39030:x1731745946399872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1204us total) trans 30064893133 rc 0/0 00000100:00100000:1.0:1651529344.504586:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152272 00000100:00100000:0.0:1651529344.504587:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+568:39029:x1731745946399808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1216us total) trans 30064893134 rc 0/0 00000100:00100000:0.0:1651529344.504590:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152271 00010000:00010000:1.0:1651529344.504593:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504597:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.504598:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504598:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504601:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 3/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504601:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504604:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504606:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 1/0,0 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504607:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504609:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bdfee lrc: 0/0,0 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504613:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504615:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.504616:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504629:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 3/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504633:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 1/0,0 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504635:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3bdfe7 lrc: 0/0,0 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504639:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504642:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000052c1122 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.504642:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+567:39029:x1731745946399936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1127us (1257us total) trans 30064893135 rc 0/0 00010000:00010000:1.0:1651529344.504643:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504645:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152273 00010000:00010000:1.0:1651529344.504646:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 3/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504649:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 1/0,0 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504651:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3bdff5 lrc: 0/0,0 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504652:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504657:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504658:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504661:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504663:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504664:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504667:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504670:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504706:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+568:39029:x1731745946400064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1029us (1088us total) trans 30064893136 rc 0/0 00000100:00100000:0.0:1651529344.504708:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152276 00000100:00100000:1.0:1651529344.504711:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946400000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1166us (1317us total) trans 30064893137 rc 0/0 00000100:00100000:1.0:1651529344.504714:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152274 00010000:00010000:0.0:1651529344.504715:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504718:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.504719:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504722:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504722:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 3/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504725:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504727:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 1/0,0 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504728:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504729:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be00a lrc: 0/0,0 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504740:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504744:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504747:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.504747:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504750:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 3/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504754:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 1/0,0 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504756:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3bdffc lrc: 0/0,0 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504760:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504762:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.504763:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504766:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 3/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504771:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 1/0,0 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504774:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946399744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1336us (1414us total) trans 30064893138 rc 0/0 00010000:00010000:0.0:1651529344.504774:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bdfe0 lrc: 0/0,0 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504786:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152270 00010000:00010000:1.0:1651529344.504794:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504798:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504801:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504818:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504874:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946400128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1265us (1288us total) trans 30064893139 rc 0/0 00000100:00100000:1.0:1651529344.504877:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152275 00000100:00100000:1.0:1651529344.504904:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281344 00000100:00100000:0.0:1651529344.504904:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966620032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.504908:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504909:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 4/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1496 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504916:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504918:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11238 00000100:00100000:1.0:1651529344.504919:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396281344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.504919:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.504920:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504922:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504923:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 4/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1496 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.504923:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 3/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504927:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 1/0,0 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504930:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be003 lrc: 0/0,0 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504938:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 3/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1496 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504944:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bad4a lrc: 0/0,0 mode: --/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3442 expref: 1496 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.504948:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504949:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504950:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504953:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 4/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504961:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.504965:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504969:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504972:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1495:41279:x1731746396281344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.504975:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11238 00010000:00010000:0.0:1651529344.504982:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504985:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505030:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+567:39029:x1731745946400576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1021us total) trans 30064893140 rc 0/0 00000100:00100000:0.0:1651529344.505033:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152277 00010000:00010000:0.0:1651529344.505040:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505044:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.505045:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505048:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 3/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505071:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 1/0,0 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505074:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be011 lrc: 0/0,0 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.505088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.505097:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400832 00000100:00100000:1.0:1651529344.505103:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400768 00000100:00100000:1.0:1651529344.505120:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152278 00000100:00100000:1.0:1651529344.505122:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+568:39029:x1731745946400832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.505126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.505127:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177071 count 1 00010000:00010000:1.0:1651529344.505132:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.505151:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 2/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.505153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.505155:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505155:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505156:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 4/0,1 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.505168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.505169:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 3/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505173:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 4/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505175:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400960 00000100:00100000:1.0:1651529344.505177:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966620096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.505182:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400896 00000100:00100000:0.0:1651529344.505185:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401088 00000100:00100000:0.0:1651529344.505187:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401024 00000100:00100000:0.0:1651529344.505189:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401152 00000100:00100000:1.0:1651529344.505192:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.505198:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152279 00000100:00100000:1.0:1651529344.505200:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152280 00000100:00100000:0.0:1651529344.505200:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946400768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.505202:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+573:39029:x1731745946400960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.505216:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177073 count 1 00002000:00080000:0.0:1651529344.505216:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177070 count 1 00010000:00010000:1.0:1651529344.505220:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505221:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505224:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 2/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505226:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 2/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505227:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505230:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505230:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505231:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 4/0,1 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505234:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505235:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 4/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505238:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 3/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505242:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 3/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505242:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 4/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505246:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966620160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505247:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.505250:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966620224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.505255:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505258:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.505262:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152281 00000100:00100000:0.0:1651529344.505264:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946400896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.505265:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152282 00000100:00100000:1.0:1651529344.505267:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+573:39029:x1731745946401088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.505268:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177072 count 1 00002000:00080000:1.0:1651529344.505271:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177075 count 1 00010000:00010000:0.0:1651529344.505272:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505275:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505276:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 2/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1494 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505279:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 2/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1494 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505279:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505279:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505280:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 4/0,1 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505282:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505283:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505284:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 4/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505286:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 3/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1494 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505289:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 3/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1494 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505290:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 4/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1494 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505297:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966620288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505303:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1494 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505303:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505307:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966620352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.505309:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152283 00000100:00100000:0.0:1651529344.505311:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946401024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.505314:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177074 count 1 00000100:00100000:1.0:1651529344.505315:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.505317:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505321:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152284 00010000:00010000:0.0:1651529344.505322:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 2/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.505323:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946401152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.505325:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505325:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505326:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 4/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.505327:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177076 count 1 00010000:00010000:1.0:1651529344.505330:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505332:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 3/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505335:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 2/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505335:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.505337:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505338:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505339:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 4/0,1 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505339:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966620416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505345:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 3/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.505345:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.505349:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 4/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.505363:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966620480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.505370:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.505410:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401216 00000100:00100000:0.0:1651529344.505418:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152285 00000100:00100000:0.0:1651529344.505435:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+574:39030:x1731745946401216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.505449:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177077 count 1 00010000:00010000:0.0:1651529344.505454:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505458:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 2/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505462:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505462:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505463:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 4/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505470:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 3/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1494 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505473:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505477:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966620544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.505492:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505555:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966620096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505560:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505605:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966620160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.505614:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966620224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505618:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505621:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505673:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966620352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505676:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505690:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966620288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.505694:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505701:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966620416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.505704:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.505895:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966620544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.505903:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281856 00010000:00010000:1.0:1651529344.505908:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 4/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1495 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.505915:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11239 00000100:00100000:1.0:1651529344.505917:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1495:41279:x1731746396281856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.505920:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.505929:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 4/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1495 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.505934:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505941:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 3/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1495 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.505947:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da056297/0xa29a79078f3ba5be lrc: 0/0,0 mode: --/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1635 expref: 1495 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.505956:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505957:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505958:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.505961:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 4/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.505967:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.505971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.505976:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1494:41279:x1731746396281856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.505977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.505978:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11239 00000100:00100000:1.0:1651529344.505984:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281984 00010000:00010000:1.0:1651529344.505987:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1494 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.505991:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281920 00010000:00010000:1.0:1651529344.505994:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 4/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1495 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.505999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.506004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.506008:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282112 00000100:00100000:0.0:1651529344.506011:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282048 00010000:00010000:0.0:1651529344.506016:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 4/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1497 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506018:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1497 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.506022:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282240 00000100:00100000:1.0:1651529344.506023:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282176 00010000:00010000:1.0:1651529344.506026:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1498 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.506030:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282304 00010000:00010000:1.0:1651529344.506031:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1499 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506034:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 5/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.506036:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11240 00000100:00100000:1.0:1651529344.506038:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41279:x1731746396281984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.506040:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.506040:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11241 00010000:00010000:1.0:1651529344.506042:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.506042:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41278:x1731746396281920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.506045:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 3/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506045:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.506047:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 4/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506050:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7bc2123/0xa29a79078f3bac4e lrc: 0/0,0 mode: --/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fdb expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506050:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 3/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1500 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506054:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506054:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506055:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506057:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d63d378/0xa29a79078f3ba0ee lrc: 0/0,0 mode: --/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d019e expref: 1499 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506061:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506061:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506062:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506065:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 4/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506066:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 4/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506072:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.506073:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506081:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1498:41279:x1731746396281984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506081:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1498:41278:x1731746396281920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506083:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11241 00000100:00100000:1.0:1651529344.506085:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11240 00000100:00100000:0.0:1651529344.506088:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11242 00000100:00100000:1.0:1651529344.506097:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11243 00000100:00100000:0.0:1651529344.506097:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41278:x1731746396282048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.506099:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396282112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.506100:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506101:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.506102:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 4/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506103:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506106:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 3/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506107:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 3/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506111:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3b930a lrc: 0/0,0 mode: --/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f9 expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506112:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c832cb5a/0xa29a79078f3b92e0 lrc: 0/0,0 mode: --/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8ef expref: 1496 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506114:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506115:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506115:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506115:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506116:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506116:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506118:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 4/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506119:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 4/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506125:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.506126:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506131:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1494:41279:x1731746396282112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506131:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1494:41278:x1731746396282048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506133:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11242 00000100:00100000:1.0:1651529344.506135:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11243 00000100:00100000:0.0:1651529344.506138:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11244 00000100:00100000:1.0:1651529344.506140:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11245 00000100:00100000:0.0:1651529344.506140:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41278:x1731746396282176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.506141:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41278:x1731746396282304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.506142:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506144:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.506144:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506145:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506149:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 3/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506153:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3ba3b1 lrc: 0/0,0 mode: --/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ce9 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506154:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 3/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506156:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506157:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506157:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506159:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b0a54b/0xa29a79078f3bb7ed lrc: 0/0,0 mode: --/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d93 expref: 1491 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506160:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 4/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506164:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506169:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.506173:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 4/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506174:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1490:41278:x1731746396282304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.506177:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11245 00010000:00010000:0.0:1651529344.506179:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506181:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11246 00000100:00100000:1.0:1651529344.506183:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41279:x1731746396282240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.506185:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.506185:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41278:x1731746396282176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (187us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.506186:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 5/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1489 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.506188:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11244 00010000:00010000:1.0:1651529344.506190:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 4/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1489 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.506194:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506195:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506195:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506195:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506198:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 4/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506198:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506201:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506202:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506207:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1488:41279:x1731746396282240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.506209:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11246 00010000:00010000:0.0:1651529344.506214:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506216:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506220:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506237:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506239:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506264:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+576:39030:x1731745946400768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1063us (1175us total) trans 30064893141 rc 0/0 00000100:00100000:0.0:1651529344.506267:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152279 00010000:00010000:0.0:1651529344.506274:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506278:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506281:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506284:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+575:39029:x1731745946400960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1158us total) trans 30064893142 rc 0/0 00010000:00010000:0.0:1651529344.506284:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506287:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152280 00010000:00010000:1.0:1651529344.506295:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506298:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506299:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506302:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 3/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506307:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 1/0,0 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506310:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be026 lrc: 0/0,0 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506314:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506318:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946400896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1053us (1172us total) trans 30064893143 rc 0/0 00000100:00100000:0.0:1651529344.506321:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152281 00010000:00010000:1.0:1651529344.506325:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506326:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506328:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 3/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506328:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506331:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506332:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 1/0,0 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506334:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be01f lrc: 0/0,0 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506338:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506341:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506342:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506344:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 3/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506345:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506347:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 1/0,0 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506348:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506357:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be02d lrc: 0/0,0 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506361:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506364:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506365:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506367:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 3/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506371:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 1/0,0 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506373:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be049 lrc: 0/0,0 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506379:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506382:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506383:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946401216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 948us (1023us total) trans 30064893144 rc 0/0 00010000:00010000:1.0:1651529344.506384:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506386:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152285 00010000:00010000:1.0:1651529344.506392:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506393:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506396:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506399:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506402:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506429:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+576:39029:x1731745946401088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1161us (1276us total) trans 30064893145 rc 0/0 00000100:00100000:1.0:1651529344.506432:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152282 00000100:00100000:0.0:1651529344.506434:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+576:39030:x1731745946401024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1122us (1274us total) trans 30064893146 rc 0/0 00000100:00100000:0.0:1651529344.506436:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152283 00010000:00010000:1.0:1651529344.506439:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506443:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506444:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506444:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506446:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 3/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506451:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 1/0,0 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506453:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be034 lrc: 0/0,0 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506457:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.506458:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506461:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 3/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506464:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000537eddd/0xa29a79078f3ba4de lrc: 0/0,0 mode: --/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d123e expref: 1487 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506466:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 1/0,0 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506468:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966620480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.506469:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be03b lrc: 0/0,0 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506480:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506483:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506485:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506488:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506491:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506576:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946401152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1253us (1407us total) trans 30064893147 rc 0/0 00000100:00100000:1.0:1651529344.506580:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152284 00010000:00010000:1.0:1651529344.506587:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506590:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004adc61cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.506591:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506594:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 3/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506615:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 1/0,0 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506618:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be042 lrc: 0/0,0 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506625:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506628:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506631:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506633:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506644:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506648:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.506649:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506653:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 3/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506658:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 1/0,0 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506670:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be018 lrc: 0/0,0 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506677:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+575:39029:x1731745946400832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1554us (1599us total) trans 30064893148 rc 0/0 00000100:00100000:1.0:1651529344.506680:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152278 00000100:00100000:1.0:1651529344.506753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.506761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.506767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.506778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.506778:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401792 00000100:00100000:1.0:1651529344.506785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.506786:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401920 00000100:00100000:0.0:1651529344.506789:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402048 00000100:00100000:1.0:1651529344.506799:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401856 00000100:00100000:1.0:1651529344.506836:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401984 00000100:00100000:0.0:1651529344.506845:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152286 00000100:00100000:1.0:1651529344.506847:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152287 00000100:00100000:0.0:1651529344.506847:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+579:39030:x1731745946401792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.506849:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+579:39030:x1731745946401920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.506853:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177078 count 1 00002000:00080000:1.0:1651529344.506855:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177080 count 1 00010000:00010000:0.0:1651529344.506857:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506859:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506862:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 2/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.506864:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 2/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.506865:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506866:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506866:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 4/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506867:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506868:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506869:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 4/0,1 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506874:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 3/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.506876:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 3/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.506880:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 4/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.506884:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966620672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.506896:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.506900:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 4/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.506905:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966620608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.506912:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152288 00000100:00100000:1.0:1651529344.506914:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+579:39030:x1731745946402048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.506919:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177082 count 1 00000100:00100000:0.0:1651529344.506922:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.506930:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506930:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152289 00000100:00100000:0.0:1651529344.506932:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+579:39030:x1731745946401856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.506935:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 2/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.506937:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177079 count 1 00010000:00010000:1.0:1651529344.506938:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506938:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506939:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 4/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506941:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506945:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 2/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1486 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.506946:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 3/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.506948:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506949:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.506949:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506950:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 4/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506953:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966620736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.506956:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1486 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.506960:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 4/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1486 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.506961:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.506964:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966620800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.506968:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152290 00000100:00100000:1.0:1651529344.506970:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+579:39030:x1731745946401984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.506970:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.506974:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177081 count 1 00010000:00010000:1.0:1651529344.506978:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506982:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 2/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.506988:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.506995:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506995:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506996:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 4/0,1 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507002:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.507003:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 3/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507007:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 4/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507010:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966620864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.507013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.507018:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.507024:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402112 00000100:00100000:1.0:1651529344.507034:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402176 00000100:00100000:1.0:1651529344.507047:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402240 00000100:00100000:1.0:1651529344.507051:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152291 00000100:00100000:1.0:1651529344.507052:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+582:39030:x1731745946402112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.507060:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152292 00002000:00080000:1.0:1651529344.507063:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177083 count 1 00000100:00100000:0.0:1651529344.507063:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+582:39030:x1731745946402176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.507067:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.507068:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177084 count 1 00010000:00010000:1.0:1651529344.507072:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 2/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1486 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507072:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507075:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507077:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 2/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1486 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507080:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507080:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507081:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 4/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507082:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507083:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 4/0,1 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507087:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 3/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1486 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507091:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 3/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1486 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507095:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 4/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1486 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507099:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966620992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.507106:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 4/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1486 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507111:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.507116:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966620928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.507125:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.507132:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152293 00000100:00100000:0.0:1651529344.507133:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+582:39030:x1731745946402240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.507138:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177085 count 1 00010000:00010000:0.0:1651529344.507142:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507148:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 2/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507151:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507152:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507153:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 4/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507159:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 3/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1486 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507162:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 4/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.507166:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966621056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.507179:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.507416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.507425:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966620736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.507426:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.507434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.507435:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507447:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282880 00010000:00010000:1.0:1651529344.507452:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 5/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1487 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.507453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.507458:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282944 00010000:00010000:1.0:1651529344.507460:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 5/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1488 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.507462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.507464:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283008 00010000:00010000:1.0:1651529344.507466:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1489 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.507476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.507485:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966620608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.507487:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283072 00010000:00010000:1.0:1651529344.507490:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 5/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1490 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507490:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507494:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283136 00010000:00010000:1.0:1651529344.507496:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 5/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1491 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507499:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283200 00000100:00100000:0.0:1651529344.507500:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966620800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.507502:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 5/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1492 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507507:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11247 00000100:00100000:1.0:1651529344.507508:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41279:x1731746396282880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.507511:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.507512:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 5/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507519:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507522:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 4/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507528:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.507528:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11248 00010000:00010000:1.0:1651529344.507529:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507530:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507530:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41278:x1731746396282944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.507533:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.507535:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 4/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507539:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 3/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507541:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 4/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507544:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3bc2f2 lrc: 0/0,0 mode: --/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d891b expref: 1492 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507547:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.507548:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507549:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507549:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507553:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 4/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507559:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1491:41279:x1731746396282880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.507562:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11247 00010000:00010000:0.0:1651529344.507564:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.507567:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11249 00000100:00100000:1.0:1651529344.507569:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1490:41279:x1731746396283008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.507572:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.507572:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1490:41278:x1731746396282944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.507573:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1490 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.507575:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11248 00010000:00010000:1.0:1651529344.507577:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 3/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1490 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507582:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006385fddf/0xa29a79078f3bc39a lrc: 0/0,0 mode: --/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b6e expref: 1489 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507586:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507586:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507587:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507590:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 4/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507609:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11250 00000100:00100000:0.0:1651529344.507611:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1488:41278:x1731746396283072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.507613:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.507614:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.507616:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 4/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1488 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507620:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1488:41279:x1731746396283008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (186us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.507620:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1488 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507623:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11249 00010000:00010000:0.0:1651529344.507625:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228cd3f7/0xa29a79078f3b925b lrc: 0/0,0 mode: --/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc74b expref: 1488 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507628:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11251 00010000:00010000:0.0:1651529344.507629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.507630:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1486:41279:x1731746396283136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.507630:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507633:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.507633:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 4/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507634:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 5/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.507638:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 4/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1486 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507640:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.507643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507644:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507646:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1486:41278:x1731746396283072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.507647:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 4/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507649:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11250 00010000:00010000:1.0:1651529344.507651:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.507654:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11252 00000100:00100000:1.0:1651529344.507656:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1485:41279:x1731746396283136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.507656:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1485:41278:x1731746396283200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.507658:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11251 00010000:00010000:0.0:1651529344.507658:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.507660:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 5/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1485 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507663:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 4/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1484 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507668:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507669:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074bc1ce8/0xa29a79078f3b7cba lrc: 0/0,0 mode: --/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb12 expref: 1484 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.507669:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507669:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507672:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 4/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507673:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966620672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.507676:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507676:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.507680:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507681:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1483:41278:x1731746396283200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.507682:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507683:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11252 00010000:00010000:1.0:1651529344.507685:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507688:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507689:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507692:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507702:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507705:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507750:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+584:39030:x1731745946401920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 899us (988us total) trans 30064893149 rc 0/0 00000100:00100000:1.0:1651529344.507753:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152287 00010000:00010000:1.0:1651529344.507760:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507760:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946401856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 827us (981us total) trans 30064893150 rc 0/0 00010000:00010000:1.0:1651529344.507763:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a76c9f8 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.507763:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152289 00010000:00010000:1.0:1651529344.507764:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507770:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 3/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507771:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507774:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 1/0,0 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507774:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.507775:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507777:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a76c9f8/0xa29a79078f3be057 lrc: 0/0,0 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507778:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 3/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507783:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507783:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 1/0,0 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507786:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507786:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be065 lrc: 0/0,0 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507789:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507792:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507792:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507795:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507823:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507827:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507863:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+584:39030:x1731745946402048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (1095us total) trans 30064893151 rc 0/0 00000100:00100000:1.0:1651529344.507866:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152288 00000100:00100000:0.0:1651529344.507869:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946401792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1021us (1116us total) trans 30064893152 rc 0/0 00000100:00100000:0.0:1651529344.507872:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152286 00010000:00010000:1.0:1651529344.507873:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507888:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000903748fd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.507889:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507892:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 3/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507892:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507895:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.507896:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507897:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 1/0,0 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507899:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 3/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507900:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903748fd/0xa29a79078f3be05e lrc: 0/0,0 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507904:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 1/0,0 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507907:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be050 lrc: 0/0,0 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507911:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd41859/0xa29a79078f3ba157 lrc: 0/0,0 mode: --/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0334 expref: 1482 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.507915:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966620864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.507919:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507922:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507925:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507936:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507939:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.507983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.507986:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946401984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1014us (1200us total) trans 30064893153 rc 0/0 00000100:00100000:1.0:1651529344.507989:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152290 00000100:00100000:1.0:1651529344.507997:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283264 00010000:00010000:1.0:1651529344.508001:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 5/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1482 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508015:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283328 00010000:00010000:1.0:1651529344.508018:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 5/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1483 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508032:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966620928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508037:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508043:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508046:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000019d6555c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.508047:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508050:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 3/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508054:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 1/0,0 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508055:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11253 00000100:00100000:1.0:1651529344.508057:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1483:41278:x1731746396283264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.508057:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be06c lrc: 0/0,0 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508060:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.508061:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 4/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1483 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.508065:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 3/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1483 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508065:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966621056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508067:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508074:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29a9856/0xa29a79078f3b77f1 lrc: 0/0,0 mode: --/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb53f expref: 1483 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508075:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11254 00010000:00010000:1.0:1651529344.508077:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.508077:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1483:41279:x1731746396283328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.508078:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508079:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508080:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.508081:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 4/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1482 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.508082:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 4/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508092:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.508103:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1482:41278:x1731746396283264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508106:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11253 00010000:00010000:0.0:1651529344.508115:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 3/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1481 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.508118:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d34caa2c/0xa29a79078f3b8025 lrc: 0/0,0 mode: --/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbccb expref: 1481 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.508121:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084da5742/0xa29a79078f3b9c5d lrc: 0/0,0 mode: --/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefa0 expref: 1481 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508122:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966620992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508125:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508125:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508126:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508126:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508129:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508129:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 4/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508132:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508135:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508135:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.508138:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508143:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1479:41279:x1731746396283328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.508146:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11254 00010000:00010000:0.0:1651529344.508153:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508157:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508162:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508165:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508175:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946402112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1122us (1187us total) trans 30064893154 rc 0/0 00000100:00100000:1.0:1651529344.508178:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152291 00010000:00010000:1.0:1651529344.508185:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508188:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.508189:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508192:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 3/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508196:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 1/0,0 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508199:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be073 lrc: 0/0,0 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508203:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508204:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946402240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1191us total) trans 30064893155 rc 0/0 00000100:00100000:0.0:1651529344.508207:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152293 00010000:00010000:1.0:1651529344.508214:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.508215:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508218:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 3/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508222:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 1/0,0 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508224:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be081 lrc: 0/0,0 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508240:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508244:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508247:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508250:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508295:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946402176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1231us (1292us total) trans 30064893156 rc 0/0 00000100:00100000:0.0:1651529344.508298:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152292 00000100:00100000:0.0:1651529344.508303:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402816 00000100:00100000:0.0:1651529344.508310:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402944 00000100:00100000:0.0:1651529344.508319:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402880 00000100:00100000:1.0:1651529344.508323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508324:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152294 00000100:00100000:0.0:1651529344.508325:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+585:39030:x1731745946402816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.508331:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177086 count 1 00000100:00100000:1.0:1651529344.508335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.508335:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508345:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 2/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1478 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508349:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508349:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508350:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 4/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508357:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 3/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1478 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508361:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1478 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508364:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403072 00000100:00100000:0.0:1651529344.508365:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966621120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.508374:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403008 00000100:00100000:1.0:1651529344.508381:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152295 00000100:00100000:1.0:1651529344.508383:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+587:39030:x1731745946402944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.508388:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.508393:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177088 count 1 00000100:00100000:0.0:1651529344.508395:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152296 00000100:00100000:0.0:1651529344.508397:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+587:39029:x1731745946402880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.508398:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508403:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 2/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508414:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508414:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508415:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 4/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.508415:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177087 count 1 00010000:00010000:0.0:1651529344.508420:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508423:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 3/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508425:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 2/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508427:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.508428:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508429:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508429:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 4/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508431:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966621184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508436:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 3/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508439:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508440:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.508443:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966621248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.508447:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152297 00000100:00100000:1.0:1651529344.508448:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+587:39030:x1731745946403072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.508451:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.508453:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177090 count 1 00010000:00010000:1.0:1651529344.508456:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508458:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152298 00000100:00100000:0.0:1651529344.508460:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+587:39029:x1731745946403008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.508461:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 2/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508463:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508464:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.508464:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177089 count 1 00010000:00010000:1.0:1651529344.508465:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 4/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508468:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508472:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 2/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508473:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 3/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508475:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508475:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508476:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 4/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508477:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 4/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508481:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966621312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508482:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 3/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508486:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508487:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.508490:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966621376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508496:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.508503:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508506:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.508507:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508510:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 3/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508529:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 1/0,0 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508532:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be07a lrc: 0/0,0 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508572:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403200 00000100:00100000:1.0:1651529344.508573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508590:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403136 00000100:00100000:0.0:1651529344.508597:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403264 00000100:00100000:0.0:1651529344.508604:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152299 00000100:00100000:0.0:1651529344.508605:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+590:39030:x1731745946403200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.508609:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152300 00002000:00080000:0.0:1651529344.508610:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177092 count 1 00000100:00100000:1.0:1651529344.508611:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+590:39029:x1731745946403136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.508614:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.508616:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177091 count 1 00010000:00010000:0.0:1651529344.508618:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 2/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508621:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508621:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508622:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508623:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 4/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508625:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 2/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508628:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508629:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508629:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 4/0,1 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508629:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 3/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508632:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508636:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966621440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.508637:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 3/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508641:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 4/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508645:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966621504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508647:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.508653:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.508653:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152301 00000100:00100000:0.0:1651529344.508655:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+590:39029:x1731745946403264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.508659:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177093 count 1 00010000:00010000:0.0:1651529344.508662:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508666:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 2/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508669:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508670:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508670:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 4/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508676:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 3/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.508680:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508684:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966621568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508690:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.508887:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966621120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508892:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508915:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966621248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508918:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.508929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.508935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.508940:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966621376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508944:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508952:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283904 00010000:00010000:0.0:1651529344.508957:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1479 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.508963:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284032 00010000:00010000:0.0:1651529344.508966:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1480 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.508968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.508970:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284096 00010000:00010000:0.0:1651529344.508972:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 5/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1481 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508983:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283968 00000100:00100000:1.0:1651529344.508984:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966621184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508986:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1482 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.508989:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508990:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284160 00010000:00010000:0.0:1651529344.508992:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1483 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.508996:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11255 00000100:00100000:1.0:1651529344.508997:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966621312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508998:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1483:41279:x1731746396283904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.508999:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509001:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509002:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1483 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509006:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11256 00010000:00010000:0.0:1651529344.509006:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 3/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1483 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509008:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1483:41279:x1731746396284032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.509011:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509012:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24b6fab/0xa29a79078f3b8d14 lrc: 0/0,0 mode: --/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc362 expref: 1483 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509013:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1483 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509015:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509016:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509017:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509020:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 4/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509026:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.509027:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 3/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1482 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509033:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c3e329e/0xa29a79078f3bb62d lrc: 0/0,0 mode: --/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d571f expref: 1482 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.509034:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1482:41279:x1731746396283904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.509037:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.509037:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11255 00010000:00010000:1.0:1651529344.509038:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509038:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509042:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 4/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509046:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11257 00000100:00100000:0.0:1651529344.509048:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1480:41279:x1731746396284096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.509050:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509058:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1480:41279:x1731746396284032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.509058:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509060:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 4/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1480 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509061:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11256 00010000:00010000:0.0:1651529344.509066:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 3/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1479 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509067:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11258 00000100:00100000:1.0:1651529344.509068:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1479:41278:x1731746396283968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.509071:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509071:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8db52f1/0xa29a79078f3baaf7 lrc: 0/0,0 mode: --/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ac5 expref: 1479 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509073:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1479 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509075:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509075:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509076:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 3/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509076:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509079:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 4/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509082:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a0f037/0xa29a79078f3bb6e3 lrc: 0/0,0 mode: --/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59bf expref: 1478 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509085:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509085:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509088:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.509093:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509096:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 4/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509102:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.509134:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1477:41279:x1731746396284096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.509137:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11257 00000100:00100000:1.0:1651529344.509141:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41278:x1731746396283968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.509143:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11259 00000100:00100000:1.0:1651529344.509145:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11258 00000100:00100000:0.0:1651529344.509145:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41278:x1731746396284160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.509148:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509149:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509152:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509153:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 3/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509156:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509159:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509159:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e4d4a/0xa29a79078f3bba86 lrc: 0/0,0 mode: --/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67c6 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509161:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509162:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509164:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509167:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 4/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509173:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.509179:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1474:41278:x1731746396284160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.509182:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11259 00010000:00010000:0.0:1651529344.509188:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509192:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509195:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509197:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509204:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+591:39030:x1731745946403072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 755us (881us total) trans 30064893157 rc 0/0 00000100:00100000:1.0:1651529344.509207:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152297 00010000:00010000:1.0:1651529344.509214:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509218:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000052c1122 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.509219:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509222:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 3/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509226:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 1/0,0 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509229:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052c1122/0xa29a79078f3be09d lrc: 0/0,0 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509233:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509236:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042602142 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.509236:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509240:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+591:39029:x1731745946402880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 842us (950us total) trans 30064893158 rc 0/0 00000100:00100000:0.0:1651529344.509243:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152296 00010000:00010000:1.0:1651529344.509251:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 3/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509251:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509255:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 1/0,0 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509255:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509257:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042602142/0xa29a79078f3be096 lrc: 0/0,0 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509258:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509260:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509263:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509266:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509269:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509272:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509302:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+592:39029:x1731745946403008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 841us (967us total) trans 30064893159 rc 0/0 00000100:00100000:0.0:1651529344.509305:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152298 00000100:00100000:1.0:1651529344.509312:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+591:39030:x1731745946402944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 928us (1033us total) trans 30064893160 rc 0/0 00010000:00010000:0.0:1651529344.509312:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509315:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152295 00010000:00010000:0.0:1651529344.509316:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.509317:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509320:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 3/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509325:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 1/0,0 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509328:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be0a4 lrc: 0/0,0 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509332:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509334:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.509335:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509338:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 3/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509342:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 1/0,0 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509344:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be08f lrc: 0/0,0 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.509362:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966621568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.509366:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509375:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966621440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509383:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.509389:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509391:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509395:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509397:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509437:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+591:39030:x1731745946402816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1110us (1177us total) trans 30064893161 rc 0/0 00000100:00100000:0.0:1651529344.509440:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152294 00000100:00100000:0.0:1651529344.509448:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284224 00010000:00010000:0.0:1651529344.509452:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1474 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.509462:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284288 00010000:00010000:0.0:1651529344.509465:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 5/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509475:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284352 00010000:00010000:1.0:1651529344.509481:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509488:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11260 00000100:00100000:1.0:1651529344.509490:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41279:x1731746396284224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.509490:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11261 00010000:00010000:1.0:1651529344.509492:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.509492:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41279:x1731746396284352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.509494:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509495:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509497:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509498:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 3/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509504:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f05a3adf/0xa29a79078f3ba700 lrc: 0/0,0 mode: --/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b6e expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509508:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509508:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509509:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509510:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 3/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1476 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509512:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 4/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509517:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a53a2b1/0xa29a79078f3bc2b3 lrc: 0/0,0 mode: --/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8826 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.509523:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.509527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509528:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509532:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1474:41279:x1731746396284224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.509532:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 4/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509538:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509544:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11260 00000100:00100000:0.0:1651529344.509545:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1474:41279:x1731746396284352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.509548:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11261 00000100:00100000:1.0:1651529344.509550:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11262 00000100:00100000:1.0:1651529344.509551:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1472:41279:x1731746396284288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.509554:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509555:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509556:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 5/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1472 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509558:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509560:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 4/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1472 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509561:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509564:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509565:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509566:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509566:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509569:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 4/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509574:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509579:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1472:41279:x1731746396284288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.509582:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11262 00010000:00010000:1.0:1651529344.509593:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509596:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.509604:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509608:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 3/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509612:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 1/0,0 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509615:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be088 lrc: 0/0,0 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509619:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509622:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.509623:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509626:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 3/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509629:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 1/0,0 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509631:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be0b9 lrc: 0/0,0 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509637:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+591:39029:x1731745946403264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 981us (1054us total) trans 30064893162 rc 0/0 00000100:00100000:0.0:1651529344.509640:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152301 00010000:00010000:1.0:1651529344.509649:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083183c8f/0xa29a79078f3bb44a lrc: 0/0,0 mode: --/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5042 expref: 1471 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509649:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509652:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966621504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509652:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509655:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509656:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509657:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509659:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509662:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509665:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509667:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509691:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+592:39030:x1731745946403200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1084us (1129us total) trans 30064893163 rc 0/0 00000100:00100000:0.0:1651529344.509696:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152299 00010000:00010000:0.0:1651529344.509702:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509705:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.509706:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509707:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+591:39029:x1731745946403136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1095us (1133us total) trans 30064893164 rc 0/0 00010000:00010000:0.0:1651529344.509709:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 3/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509710:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152300 00010000:00010000:0.0:1651529344.509714:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 1/0,0 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509717:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509717:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be0ab lrc: 0/0,0 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509737:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056105ab4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.509739:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509742:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 3/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509747:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 1/0,0 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.509763:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056105ab4/0xa29a79078f3be0b2 lrc: 0/0,0 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509771:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403904 00000100:00100000:0.0:1651529344.509771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.509782:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403840 00000100:00100000:1.0:1651529344.509788:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152302 00000100:00100000:1.0:1651529344.509790:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+592:39029:x1731745946403904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.509794:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.509795:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177095 count 1 00010000:00010000:1.0:1651529344.509821:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509826:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 2/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.509826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.509829:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509829:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509837:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 4/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.509845:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 3/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509849:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 4/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.509853:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966621632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.509868:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403968 00000100:00100000:0.0:1651529344.509882:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404032 00000100:00100000:1.0:1651529344.509884:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.509886:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404096 00000100:00100000:0.0:1651529344.509891:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152303 00000100:00100000:1.0:1651529344.509893:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152304 00000100:00100000:0.0:1651529344.509893:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+595:39029:x1731745946403840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.509895:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+595:39030:x1731745946403968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.509899:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177094 count 1 00002000:00080000:1.0:1651529344.509900:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177096 count 1 00010000:00010000:1.0:1651529344.509904:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509904:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509908:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 2/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509909:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 2/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509911:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509912:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509912:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 4/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509912:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509913:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509914:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 4/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509918:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 3/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509933:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 4/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509936:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 3/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.509937:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966621696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509940:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.509944:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966621760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509945:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.509952:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152305 00000100:00100000:1.0:1651529344.509953:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+595:39029:x1731745946404032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.509954:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.509958:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177097 count 1 00010000:00010000:1.0:1651529344.509961:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509961:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152306 00000100:00100000:0.0:1651529344.509963:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+595:39030:x1731745946404096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.509965:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 2/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.509967:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177098 count 1 00010000:00010000:1.0:1651529344.509968:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509969:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509969:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 4/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509971:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509975:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 3/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509975:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 2/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509978:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509979:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.509979:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509980:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 4/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509986:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 3/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509989:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.509993:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966621888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509994:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966621824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510000:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.510002:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.510112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.510119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.510126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.510132:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404352 00000100:00100000:0.0:1651529344.510139:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404480 00000100:00100000:0.0:1651529344.510142:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404416 00000100:00100000:0.0:1651529344.510149:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152307 00000100:00100000:0.0:1651529344.510151:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+598:39030:x1731745946404352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.510154:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152308 00000100:00100000:1.0:1651529344.510156:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+598:39030:x1731745946404480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.510156:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177099 count 1 00010000:00010000:0.0:1651529344.510160:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.510162:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177101 count 1 00010000:00010000:0.0:1651529344.510165:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 2/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510166:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510168:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510169:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510169:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 4/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510170:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 2/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510173:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510174:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510175:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 4/0,1 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510176:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 3/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510179:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 4/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510181:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 3/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.510183:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966621952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510185:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 4/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510189:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966622016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510197:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.510203:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152309 00000100:00100000:1.0:1651529344.510205:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.510205:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+598:39030:x1731745946404416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.510210:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177100 count 1 00010000:00010000:0.0:1651529344.510213:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510218:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 2/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510221:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510221:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510222:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 4/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510230:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 3/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510234:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.510238:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966622080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510247:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.510405:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966621760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.510408:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966621696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510420:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510422:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510430:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966621632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510432:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510440:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966621888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.510443:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510485:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966621824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510488:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.510504:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284928 00000100:00100000:0.0:1651529344.510505:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.510513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.510514:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 4/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1471 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510529:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285056 00010000:00010000:1.0:1651529344.510532:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1472 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510537:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285184 00000100:00100000:0.0:1651529344.510537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.510539:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1473 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510543:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284992 00000100:00100000:0.0:1651529344.510543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.510545:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 4/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1474 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510564:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285120 00010000:00010000:1.0:1651529344.510567:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.510576:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966621952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.510578:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11263 00000100:00100000:1.0:1651529344.510580:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1475:41279:x1731746396284928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.510580:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510584:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.510585:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 4/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510589:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 3/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.510590:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966622080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.510592:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510594:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecfd2ef6/0xa29a79078f3ba87a lrc: 0/0,0 mode: --/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2164 expref: 1475 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510598:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510599:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.510599:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11264 00010000:00010000:1.0:1651529344.510600:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510601:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1474:41279:x1731746396285056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.510603:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 4/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510604:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.510606:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1474 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510609:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.510609:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 3/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1474 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.510615:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dfcadfc/0xa29a79078f3b9a03 lrc: 0/0,0 mode: --/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ba expref: 1474 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.510618:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1474:41279:x1731746396284928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (123us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.510619:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510620:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510621:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510624:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 4/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510628:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11263 00010000:00010000:0.0:1651529344.510630:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.510634:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11265 00000100:00100000:1.0:1651529344.510635:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1472:41279:x1731746396285184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.510637:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1472:41279:x1731746396285056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.510638:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.510640:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1472 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.510640:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11264 00010000:00010000:1.0:1651529344.510644:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 3/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1471 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.510646:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11266 00000100:00100000:0.0:1651529344.510648:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1471:41278:x1731746396284992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.510649:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2762078/0xa29a79078f3bb3f6 lrc: 0/0,0 mode: --/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f1c expref: 1471 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.510650:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.510652:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 4/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1471 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510654:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510655:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 3/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510657:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 4/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510660:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fec99b9/0xa29a79078f3bb983 lrc: 0/0,0 mode: --/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d640e expref: 1470 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.510663:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.510664:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510664:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510665:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510667:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 4/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510670:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1469:41279:x1731746396285184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.510672:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11265 00010000:00010000:0.0:1651529344.510676:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.510682:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1468:41278:x1731746396284992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.510683:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11267 00000100:00100000:0.0:1651529344.510691:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11266 00000100:00100000:1.0:1651529344.510692:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1468:41278:x1731746396285120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.510695:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.510696:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1467 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.510698:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510700:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 3/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1467 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.510702:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510705:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bbbe2d/0xa29a79078f3ba26f lrc: 0/0,0 mode: --/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07c5 expref: 1467 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.510705:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510709:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510709:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510710:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510713:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 4/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510722:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.510728:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396285120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.510728:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510739:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11267 00010000:00010000:1.0:1651529344.510748:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510752:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510764:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510767:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510795:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+599:39029:x1731745946403840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 901us (1023us total) trans 30064893165 rc 0/0 00000100:00100000:0.0:1651529344.510798:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152303 00010000:00010000:0.0:1651529344.510822:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510826:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510829:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510832:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510849:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+599:39029:x1731745946404032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 895us (1023us total) trans 30064893166 rc 0/0 00000100:00100000:1.0:1651529344.510853:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152305 00010000:00010000:1.0:1651529344.510860:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510863:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.510864:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510867:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 3/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510872:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 1/0,0 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510872:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+599:39030:x1731745946404096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (1035us total) trans 30064893167 rc 0/0 00010000:00010000:1.0:1651529344.510875:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be0ce lrc: 0/0,0 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510875:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152306 00010000:00010000:1.0:1651529344.510879:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510883:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510887:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.510888:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510890:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004adc61cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.510891:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510891:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 3/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510894:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 3/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510895:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 1/0,0 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510897:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 1/0,0 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510898:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be0dc lrc: 0/0,0 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510900:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adc61cf/0xa29a79078f3be0d5 lrc: 0/0,0 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510906:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510909:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510912:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510915:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510916:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.510939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.510955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.510970:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+599:39030:x1731745946403968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1175us total) trans 30064893168 rc 0/0 00000100:00100000:1.0:1651529344.510980:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152304 00000100:00100000:1.0:1651529344.510989:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285248 00010000:00010000:1.0:1651529344.510999:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 4/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511005:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511014:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677dae30 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.511016:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511017:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285312 00010000:00010000:1.0:1651529344.511020:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 5/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1467 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511021:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 3/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511025:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285376 00010000:00010000:0.0:1651529344.511026:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 1/0,0 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511027:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1468 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511029:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677dae30/0xa29a79078f3be0c7 lrc: 0/0,0 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511031:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11268 00000100:00100000:1.0:1651529344.511033:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1468:41278:x1731746396285248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.511036:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511037:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 4/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1468 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.511037:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11269 00000100:00100000:0.0:1651529344.511039:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1468:41279:x1731746396285312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.511041:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 3/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1468 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511043:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.511045:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 5/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1468 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.511046:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001170cd69/0xa29a79078f3bb9a6 lrc: 0/0,0 mode: --/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d647e expref: 1468 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.511050:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511051:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511052:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511055:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 4/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511064:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.511068:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 4/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1467 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.511074:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1467:41278:x1731746396285248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.511077:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11268 00000100:00100000:1.0:1651529344.511082:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11270 00000100:00100000:1.0:1651529344.511084:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396285376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.511086:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511087:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511088:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511089:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511089:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511091:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 3/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511093:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 4/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511096:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d016c5e1/0xa29a79078f3bc17f lrc: 0/0,0 mode: --/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8310 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.511099:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511100:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511100:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.511101:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511106:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 4/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511108:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1465:41279:x1731746396285312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.511111:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11269 00010000:00010000:1.0:1651529344.511114:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.511119:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1465:41278:x1731746396285376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.511122:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11270 00010000:00010000:0.0:1651529344.511130:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511133:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000256adbd3/0xa29a79078f3bbf95 lrc: 0/0,0 mode: --/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b45 expref: 1463 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.511134:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511137:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966622016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.511137:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511139:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511141:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511144:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511153:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511157:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511160:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511189:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+600:39030:x1731745946404352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1036us (1077us total) trans 30064893169 rc 0/0 00000100:00100000:0.0:1651529344.511192:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152307 00000100:00100000:1.0:1651529344.511204:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+599:39030:x1731745946404480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1084us total) trans 30064893170 rc 0/0 00000100:00100000:1.0:1651529344.511207:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152308 00010000:00010000:0.0:1651529344.511212:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511214:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511218:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.511219:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511222:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 3/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511224:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511226:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 1/0,0 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511228:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511229:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be0e3 lrc: 0/0,0 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511231:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511233:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511236:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.511237:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511242:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 3/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511245:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 1/0,0 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511247:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3be0ea lrc: 0/0,0 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511251:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511253:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.511254:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511256:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 3/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511259:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 1/0,0 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511262:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be0f1 lrc: 0/0,0 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511268:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511268:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+599:39030:x1731745946404416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1062us (1141us total) trans 30064893171 rc 0/0 00000100:00100000:0.0:1651529344.511270:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152309 00010000:00010000:1.0:1651529344.511279:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511282:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511285:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.511314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.511328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511338:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+599:39029:x1731745946403904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1547us (1585us total) trans 30064893172 rc 0/0 00000100:00100000:0.0:1651529344.511339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511341:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152302 00000100:00100000:1.0:1651529344.511352:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405056 00000100:00100000:1.0:1651529344.511368:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404992 00000100:00100000:1.0:1651529344.511373:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405184 00000100:00100000:0.0:1651529344.511388:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405120 00000100:00100000:0.0:1651529344.511395:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152310 00000100:00100000:0.0:1651529344.511397:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+602:39029:x1731745946405056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.511399:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152311 00002000:00080000:0.0:1651529344.511403:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177103 count 1 00000100:00100000:1.0:1651529344.511406:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+602:39030:x1731745946404992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.511407:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.511411:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177102 count 1 00010000:00010000:0.0:1651529344.511412:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 2/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.511415:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511416:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511416:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511416:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 4/0,1 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511420:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 2/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511423:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511423:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 3/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511424:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511425:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 4/0,1 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511427:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 4/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.511431:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966622144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511432:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 3/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511436:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 4/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.511440:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966622208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.511455:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.511462:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.511463:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152312 00000100:00100000:1.0:1651529344.511464:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+602:39029:x1731745946405184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.511469:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177105 count 1 00000100:00100000:0.0:1651529344.511469:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152313 00000100:00100000:0.0:1651529344.511471:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+602:39030:x1731745946405120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.511476:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177104 count 1 00010000:00010000:1.0:1651529344.511479:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511479:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511484:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 2/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1462 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.511484:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 2/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511487:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511487:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511487:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511488:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511488:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 4/0,1 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511488:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 4/0,1 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511494:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 3/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511495:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 3/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1462 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.511498:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 4/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.511505:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966622272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511506:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 4/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1462 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.511511:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966622336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.511511:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.511519:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.511524:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511527:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf025eac already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.511528:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511531:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 3/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511536:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 1/0,0 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511539:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf025eac/0xa29a79078f3be0c0 lrc: 0/0,0 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511590:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.511603:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405312 00000100:00100000:1.0:1651529344.511609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.511618:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405248 00000100:00100000:1.0:1651529344.511620:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405440 00000100:00100000:0.0:1651529344.511623:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405376 00000100:00100000:0.0:1651529344.511627:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152314 00000100:00100000:0.0:1651529344.511628:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+606:39029:x1731745946405312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.511633:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177107 count 1 00000100:00100000:1.0:1651529344.511634:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152315 00000100:00100000:1.0:1651529344.511635:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+606:39030:x1731745946405248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.511637:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.511640:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177106 count 1 00010000:00010000:0.0:1651529344.511642:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 2/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511644:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511645:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511646:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511646:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 4/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511649:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 2/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511652:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511653:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511653:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 4/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511653:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 3/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.511657:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.511660:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 3/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.511661:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966622400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511664:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 4/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.511668:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966622464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.511672:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.511677:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.511677:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152316 00000100:00100000:0.0:1651529344.511679:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbf1080b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+606:39030:x1731745946405376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.511683:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152317 00002000:00080000:0.0:1651529344.511683:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177108 count 1 00000100:00100000:1.0:1651529344.511685:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+606:39029:x1731745946405440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.511686:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.511689:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177109 count 1 00010000:00010000:0.0:1651529344.511691:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 2/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511692:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511694:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511694:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511695:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 4/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511701:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 3/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.511704:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 4/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.511707:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 2/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1462 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.511708:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966622528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511710:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511711:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511711:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 4/0,1 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511714:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.511718:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 3/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1462 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511721:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 4/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1462 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.511725:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966622592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.511741:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.511972:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966622144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.511982:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.511992:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966622272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.511995:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.512007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.512010:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286144 00000100:00100000:1.0:1651529344.512014:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286272 00010000:00010000:0.0:1651529344.512016:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 4/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1464 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512020:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 5/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1464 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512021:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286080 00000100:00100000:1.0:1651529344.512026:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286208 00010000:00010000:1.0:1651529344.512029:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 4/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512037:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 5/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512044:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11271 00000100:00100000:0.0:1651529344.512045:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396286144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.512046:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11272 00000100:00100000:1.0:1651529344.512047:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396286272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.512048:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.512050:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.512050:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 4/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512052:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 5/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1466 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512054:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 3/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512056:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 4/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1466 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512059:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c8f77f7/0xa29a79078f3bab13 lrc: 0/0,0 mode: --/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b58 expref: 1466 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512061:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512062:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512063:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512063:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512064:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512065:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512066:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 4/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512071:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.512080:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1465:41278:x1731746396286272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.512083:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11272 00000100:00100000:1.0:1651529344.512087:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11273 00000100:00100000:1.0:1651529344.512089:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1464:41278:x1731746396286080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.512089:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 4/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512097:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.512101:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.512102:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 5/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1464 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512114:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 4/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1464 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512115:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1464:41278:x1731746396286144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.512118:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11271 00010000:00010000:1.0:1651529344.512119:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512119:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512120:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512123:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 4/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512124:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11274 00000100:00100000:0.0:1651529344.512126:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1463:41278:x1731746396286208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.512127:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.512129:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.512130:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 4/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1463 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.512134:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1463:41278:x1731746396286080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.512135:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 3/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1463 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.512137:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11273 00010000:00010000:0.0:1651529344.512140:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3ba4ad lrc: 0/0,0 mode: --/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1142 expref: 1462 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512143:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512144:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512145:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512148:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bce73b6c/0xa29a79078f3b92d2 lrc: 0/0,0 mode: --/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8da expref: 1461 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512150:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 4/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512153:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966622336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512156:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512156:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.512160:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512162:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512162:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1460:41278:x1731746396286208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.512164:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11274 00010000:00010000:0.0:1651529344.512171:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512173:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512174:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512176:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512178:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512180:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512223:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+608:39029:x1731745946405184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 758us (894us total) trans 30064893173 rc 0/0 00000100:00100000:1.0:1651529344.512226:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152312 00010000:00010000:1.0:1651529344.512237:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021701165/0xa29a79078f3bab9f lrc: 0/0,0 mode: --/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cf5 expref: 1459 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512239:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+607:39030:x1731745946405120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 767us (899us total) trans 30064893174 rc 0/0 00000100:00100000:1.0:1651529344.512242:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966622208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512242:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152313 00010000:00010000:1.0:1651529344.512245:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512248:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512250:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512251:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512253:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000152886c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.512254:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512254:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512257:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 3/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512262:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 1/0,0 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512265:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be106 lrc: 0/0,0 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512267:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512269:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512272:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.512273:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512275:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 3/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512279:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 1/0,0 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512281:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be10d lrc: 0/0,0 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512287:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512290:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.512290:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512293:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 3/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512296:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 1/0,0 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512299:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be0ff lrc: 0/0,0 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512304:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+607:39030:x1731745946404992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 898us (990us total) trans 30064893175 rc 0/0 00010000:00010000:0.0:1651529344.512304:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512307:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152311 00010000:00010000:0.0:1651529344.512307:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512310:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512313:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512356:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+607:39029:x1731745946405056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 957us (1056us total) trans 30064893176 rc 0/0 00000100:00100000:0.0:1651529344.512359:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152310 00000100:00100000:1.0:1651529344.512368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.512370:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966622400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.512374:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.512380:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512388:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.512390:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512397:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 3/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512401:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 1/0,0 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512404:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be0f8 lrc: 0/0,0 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512413:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966622528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.512416:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512422:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286336 00000100:00100000:1.0:1651529344.512426:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.512427:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1459 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512438:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286400 00010000:00010000:0.0:1651529344.512441:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 5/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512445:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286464 00010000:00010000:0.0:1651529344.512447:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 4/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1461 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512452:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11275 00000100:00100000:0.0:1651529344.512453:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1461:41279:x1731746396286336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.512456:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.512457:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1461 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.512458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.512461:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 3/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1461 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512466:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2aab0fc/0xa29a79078f3ba658 lrc: 0/0,0 mode: --/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1888 expref: 1461 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512470:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512471:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512474:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 4/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512480:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.512487:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966622464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512491:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1460:41279:x1731746396286336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.512494:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11275 00010000:00010000:1.0:1651529344.512497:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512498:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286528 00010000:00010000:0.0:1651529344.512501:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 5/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1460 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.512505:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966622592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512506:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11276 00010000:00010000:1.0:1651529344.512507:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512508:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1460:41279:x1731746396286400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.512514:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11277 00000100:00100000:1.0:1651529344.512516:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1460:41278:x1731746396286464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.512519:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.512521:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 4/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512531:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.512533:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 4/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512536:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 3/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512537:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 3/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512542:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd170f33/0xa29a79078f3baf8f lrc: 0/0,0 mode: --/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ced expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512542:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a84ca13d/0xa29a79078f3bac5c lrc: 0/0,0 mode: --/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3005 expref: 1460 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512545:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512546:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512546:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512547:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512547:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512547:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512550:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 4/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512550:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 4/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512564:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.512565:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.512571:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1458:41279:x1731746396286400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.512573:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1458:41278:x1731746396286464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.512574:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11276 00000100:00100000:1.0:1651529344.512575:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11277 00000100:00100000:0.0:1651529344.512582:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11278 00000100:00100000:0.0:1651529344.512584:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41278:x1731746396286528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.512586:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.512588:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512588:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 4/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1456 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512591:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512592:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 3/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1456 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512594:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512596:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f0f65b/0xa29a79078f3b91cf lrc: 0/0,0 mode: --/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5c3 expref: 1456 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.512600:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512600:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512601:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512607:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512625:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 4/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512635:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.512642:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1455:41278:x1731746396286528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.512644:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11278 00010000:00010000:0.0:1651529344.512652:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512655:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092586f6b already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.512656:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+607:39030:x1731745946405248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1019us (1086us total) trans 30064893177 rc 0/0 00010000:00010000:0.0:1651529344.512656:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512659:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152315 00010000:00010000:0.0:1651529344.512659:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 3/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512663:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 1/0,0 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512666:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be11b lrc: 0/0,0 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512667:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512670:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512671:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512673:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512674:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512676:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512678:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512680:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512708:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+608:39029:x1731745946405440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1118us total) trans 30064893178 rc 0/0 00000100:00100000:1.0:1651529344.512711:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152317 00010000:00010000:1.0:1651529344.512718:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512721:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b306dd91 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.512722:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512741:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 3/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512742:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbf1080b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+607:39030:x1731745946405376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1039us (1110us total) trans 30064893179 rc 0/0 00000100:00100000:0.0:1651529344.512746:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152316 00010000:00010000:1.0:1651529344.512747:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 1/0,0 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512750:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be129 lrc: 0/0,0 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512754:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512754:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512757:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.512757:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512758:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512760:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512761:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 3/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512763:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512764:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 1/0,0 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512766:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be122 lrc: 0/0,0 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512770:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512777:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.512778:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512781:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 3/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512784:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 1/0,0 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512787:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be114 lrc: 0/0,0 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512799:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+607:39029:x1731745946405312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1169us (1237us total) trans 30064893180 rc 0/0 00000100:00100000:0.0:1651529344.512802:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152314 00000100:00100000:1.0:1651529344.512836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512850:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405568 00000100:00100000:1.0:1651529344.512851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512865:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405824 00000100:00100000:0.0:1651529344.512872:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152318 00000100:00100000:0.0:1651529344.512873:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+608:39030:x1731745946405568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.512876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.512879:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177110 count 1 00010000:00010000:0.0:1651529344.512888:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512890:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.512893:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 2/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1454 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512896:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512897:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512897:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 4/0,1 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512904:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 3/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1454 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512908:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 4/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1454 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.512912:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966622656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512921:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.512927:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406144 00000100:00100000:0.0:1651529344.512933:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406208 00000100:00100000:0.0:1651529344.512941:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152319 00000100:00100000:0.0:1651529344.512943:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+610:39030:x1731745946405824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.512948:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177111 count 1 00010000:00010000:0.0:1651529344.512952:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512956:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 2/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512959:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512960:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512961:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 4/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512974:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152320 00000100:00100000:1.0:1651529344.512976:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+610:39030:x1731745946406144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.512982:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177112 count 1 00010000:00010000:0.0:1651529344.512985:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512986:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512989:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 4/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.512991:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 2/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.512993:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966622720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.513007:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.513010:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513011:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513011:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 4/0,1 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513015:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152321 00000100:00100000:0.0:1651529344.513017:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+610:39030:x1731745946406208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.513019:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 3/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.513022:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177113 count 1 00010000:00010000:1.0:1651529344.513023:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 4/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513026:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513028:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966622784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.513030:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 2/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.513036:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.513036:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513036:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513037:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 4/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513043:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 3/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.513047:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513051:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966622848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.513058:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.513124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.513157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.513167:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406272 00000100:00100000:0.0:1651529344.513167:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.513177:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.513180:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406336 00000100:00100000:1.0:1651529344.513184:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406400 00000100:00100000:0.0:1651529344.513185:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406464 00000100:00100000:1.0:1651529344.513192:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152322 00000100:00100000:1.0:1651529344.513194:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+614:39030:x1731745946406272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.513198:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177114 count 1 00000100:00100000:0.0:1651529344.513198:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152323 00000100:00100000:0.0:1651529344.513200:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+614:39029:x1731745946406336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.513203:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.513205:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177115 count 1 00010000:00010000:1.0:1651529344.513207:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 2/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513210:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513210:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513214:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 2/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513218:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513219:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 4/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513220:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513221:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513221:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 4/0,1 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513227:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 3/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.513228:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 3/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513230:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 4/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513232:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 4/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.513234:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966622912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.513236:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966622976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.513246:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.513246:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.513252:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152324 00000100:00100000:1.0:1651529344.513254:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+614:39030:x1731745946406400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.513254:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152325 00000100:00100000:0.0:1651529344.513256:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+614:39029:x1731745946406464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.513258:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177116 count 1 00002000:00080000:0.0:1651529344.513260:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177117 count 1 00010000:00010000:1.0:1651529344.513262:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513263:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513266:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 2/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.513267:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 2/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513270:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513270:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513270:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513271:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 4/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513271:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513271:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 4/0,1 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513277:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 3/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.513280:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 3/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1454 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.513283:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 4/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513287:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.513291:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513293:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.513295:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.513303:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.513375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.513385:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286784 00010000:00010000:1.0:1651529344.513391:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 5/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1455 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.513411:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286848 00010000:00010000:1.0:1651529344.513414:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 5/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1456 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513416:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966622720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.513420:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513421:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11279 00000100:00100000:1.0:1651529344.513423:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41278:x1731746396286784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.513426:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.513427:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 5/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1456 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513428:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966622656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.513430:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513431:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 3/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1456 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513437:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c00177c/0xa29a79078f3b9874 lrc: 0/0,0 mode: --/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfd2 expref: 1456 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513440:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11280 00000100:00100000:0.0:1651529344.513442:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41279:x1731746396286848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.513446:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.513447:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 4/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1456 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513451:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513452:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513453:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513454:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1455 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513456:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 4/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513459:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bac16 lrc: 0/0,0 mode: --/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2edf expref: 1455 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513463:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513465:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.513469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513470:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513474:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41278:x1731746396286784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (99us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.513474:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 4/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513477:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11279 00010000:00010000:0.0:1651529344.513480:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.513487:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1453:41279:x1731746396286848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.513490:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11280 00010000:00010000:0.0:1651529344.513498:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513501:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513504:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513509:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513524:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513528:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000019d6555c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.513529:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513533:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 3/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513537:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 1/0,0 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513540:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d6555c/0xa29a79078f3be137 lrc: 0/0,0 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513574:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+615:39030:x1731745946405824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 630us (722us total) trans 30064893181 rc 0/0 00000100:00100000:0.0:1651529344.513577:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152319 00010000:00010000:0.0:1651529344.513583:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513587:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513590:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513593:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513624:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+615:39030:x1731745946405568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 750us (788us total) trans 30064893182 rc 0/0 00000100:00100000:0.0:1651529344.513627:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152318 00010000:00010000:0.0:1651529344.513633:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513637:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.513638:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513641:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 3/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513646:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 1/0,0 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513648:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be130 lrc: 0/0,0 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513793:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.513831:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966622848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.513832:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966622784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.513836:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513836:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513844:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286976 00000100:00100000:1.0:1651529344.513845:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966622912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.513847:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513850:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 4/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513880:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11281 00000100:00100000:0.0:1651529344.513882:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1453:41279:x1731746396286976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.513885:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.513886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.513886:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 4/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513890:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 3/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.513894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.513905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.513905:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade17ffa/0xa29a79078f3ba715 lrc: 0/0,0 mode: --/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bfa expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513909:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513910:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513911:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.513914:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 4/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513927:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287104 00010000:00010000:1.0:1651529344.513933:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.513944:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287232 00010000:00010000:0.0:1651529344.513947:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.513952:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 4/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1454 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.513955:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41279:x1731746396286976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.513957:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11282 00000100:00100000:1.0:1651529344.513959:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41279:x1731746396287104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.513959:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11281 00010000:00010000:1.0:1651529344.513962:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.513965:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11283 00000100:00100000:0.0:1651529344.513967:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1453:41279:x1731746396287232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.513969:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.513971:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513971:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 4/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513975:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 3/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513975:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 3/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.513980:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3bb497 lrc: 0/0,0 mode: --/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d515a expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513981:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c094f27e/0xa29a79078f3bbed1 lrc: 0/0,0 mode: --/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7874 expref: 1453 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.513985:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513985:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513985:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513986:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513986:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513987:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513989:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 4/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513990:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 4/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514002:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.514002:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.514009:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1451:41279:x1731746396287232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.514011:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1451:41279:x1731746396287104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.514012:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11283 00000100:00100000:1.0:1651529344.514014:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11282 00000100:00100000:0.0:1651529344.514022:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966622976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514025:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514027:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514030:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514031:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514033:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514034:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514036:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514037:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514040:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514086:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+616:39030:x1731745946406144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1109us (1209us total) trans 30064893183 rc 0/0 00000100:00100000:1.0:1651529344.514089:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152320 00000100:00100000:1.0:1651529344.514094:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406656 00000100:00100000:1.0:1651529344.514100:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406720 00000100:00100000:1.0:1651529344.514109:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152326 00000100:00100000:1.0:1651529344.514111:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+617:39030:x1731745946406656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.514112:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+617:39030:x1731745946406208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1088us (1215us total) trans 30064893184 rc 0/0 00002000:00080000:1.0:1651529344.514116:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177118 count 1 00000100:00100000:0.0:1651529344.514116:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152321 00010000:00010000:1.0:1651529344.514120:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514122:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152327 00000100:00100000:0.0:1651529344.514123:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+616:39029:x1731745946406720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.514125:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 2/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1449 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514128:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.514128:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177119 count 1 00010000:00010000:1.0:1651529344.514129:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514129:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 4/0,1 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514133:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514136:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 3/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1449 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514138:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 2/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1449 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514140:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 4/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1449 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514141:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514141:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514142:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 4/0,1 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514149:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 3/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1449 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514152:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966623168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514153:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 4/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1449 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514157:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514161:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.514167:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514170:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b480d7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.514171:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514174:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 3/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514179:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 1/0,0 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514179:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.514181:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be13e lrc: 0/0,0 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514185:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514188:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.514189:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514190:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514192:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514193:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 3/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514195:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514197:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 1/0,0 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514200:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be145 lrc: 0/0,0 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514207:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.514263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.514265:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+617:39030:x1731745946406272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1151us total) trans 30064893185 rc 0/0 00000100:00100000:1.0:1651529344.514273:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152322 00000100:00100000:0.0:1651529344.514286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.514288:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514297:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514304:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287360 00010000:00010000:1.0:1651529344.514309:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 4/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1450 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514330:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514335:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3e400c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.514336:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514339:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 3/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514341:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287424 00010000:00010000:0.0:1651529344.514346:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 1/0,0 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514349:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be14c lrc: 0/0,0 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514351:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 5/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1451 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.514356:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287552 00010000:00010000:1.0:1651529344.514358:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1452 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.514363:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11284 00000100:00100000:1.0:1651529344.514364:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1452:41279:x1731746396287360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.514367:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.514372:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514377:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 4/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1452 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514380:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 3/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1452 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514385:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514386:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe770d2/0xa29a79078f3bbba5 lrc: 0/0,0 mode: --/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c6c expref: 1452 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514390:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514390:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514391:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514394:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 4/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514394:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11285 00000100:00100000:0.0:1651529344.514396:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1451:41278:x1731746396287424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.514399:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.514401:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 4/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1451 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514403:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.514411:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 3/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1451 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.514414:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1451:41279:x1731746396287360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.514416:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11284 00000100:00100000:1.0:1651529344.514421:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11286 00010000:00010000:0.0:1651529344.514421:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3ba015 lrc: 0/0,0 mode: --/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe10 expref: 1450 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.514423:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1450:41278:x1731746396287552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.514425:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514425:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514426:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.514426:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514427:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1449 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514430:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 4/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514435:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.514440:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 3/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1449 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514443:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1449:41278:x1731746396287424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (179us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.514445:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc9cc418/0xa29a79078f3bb35c lrc: 0/0,0 mode: --/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c6e expref: 1449 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514445:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11285 00010000:00010000:1.0:1651529344.514449:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514449:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514450:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514453:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 4/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514453:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514456:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514459:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.514459:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514462:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514465:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41278:x1731746396287552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.514468:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11286 00010000:00010000:1.0:1651529344.514480:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514484:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514487:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514499:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514527:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+618:39029:x1731745946406336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1326us (1370us total) trans 30064893186 rc 0/0 00000100:00100000:0.0:1651529344.514530:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152323 00010000:00010000:0.0:1651529344.514537:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514540:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+617:39030:x1731745946406400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1372us total) trans 30064893187 rc 0/0 00010000:00010000:0.0:1651529344.514541:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.514542:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514543:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152324 00010000:00010000:0.0:1651529344.514545:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 3/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514550:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 1/0,0 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514551:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514552:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be153 lrc: 0/0,0 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514554:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007d01aa6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.514555:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514558:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 3/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514558:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514561:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514562:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 1/0,0 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514564:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514565:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be15a lrc: 0/0,0 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514567:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.514601:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+617:39029:x1731745946406464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1344us (1424us total) trans 30064893188 rc 0/0 00000100:00100000:0.0:1651529344.514603:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152325 00000100:00100000:0.0:1651529344.514608:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406912 00000100:00100000:0.0:1651529344.514615:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152328 00000100:00100000:0.0:1651529344.514617:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+617:39030:x1731745946406912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.514622:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177120 count 1 00000100:00100000:1.0:1651529344.514625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.514626:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514630:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 2/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1446 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514634:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514634:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514635:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 4/0,1 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.514666:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 3/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1446 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514669:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 4/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1446 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514673:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.514682:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.514687:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514691:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.514692:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514697:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 3/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514701:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 1/0,0 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514704:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be161 lrc: 0/0,0 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514711:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406976 00000100:00100000:0.0:1651529344.514718:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407040 00000100:00100000:0.0:1651529344.514722:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152329 00000100:00100000:0.0:1651529344.514724:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+619:39029:x1731745946406976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.514729:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177121 count 1 00010000:00010000:0.0:1651529344.514743:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.514748:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 2/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1446 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514751:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514752:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514752:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 4/0,1 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514753:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287744 00010000:00010000:1.0:1651529344.514758:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 5/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1447 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514759:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 3/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1447 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514765:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287680 00010000:00010000:1.0:1651529344.514768:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 5/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1448 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.514777:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11287 00000100:00100000:1.0:1651529344.514779:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41279:x1731746396287744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.514782:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.514783:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 5/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514785:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 4/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514787:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 4/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514790:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966623360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514793:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514794:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514795:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514798:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 4/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514821:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.514829:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41279:x1731746396287744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.514831:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.514838:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152330 00000100:00100000:1.0:1651529344.514839:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11287 00000100:00100000:0.0:1651529344.514840:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+619:39030:x1731745946407040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.514845:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11288 00002000:00080000:0.0:1651529344.514845:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177122 count 1 00000100:00100000:1.0:1651529344.514847:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41278:x1731746396287680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.514849:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514850:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.514851:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 5/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1447 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514853:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 2/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1447 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514855:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 4/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1447 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.514856:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514857:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514858:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 4/0,1 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514860:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514861:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514862:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514864:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 3/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1447 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514865:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 4/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514868:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 4/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1447 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514869:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.514874:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41278:x1731746396287680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.514877:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11288 00010000:00010000:1.0:1651529344.514889:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab2ce847/0xa29a79078f3b983c lrc: 0/0,0 mode: --/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf46 expref: 1446 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.514890:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966623424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514893:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966623168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.514899:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.514903:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514907:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514909:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514911:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d21c2410/0xa29a79078f3ba364 lrc: 0/0,0 mode: --/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bb5 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.514913:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514915:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514933:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514937:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514940:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514943:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514946:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514949:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514964:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+620:39030:x1731745946406656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 852us (1069us total) trans 30064893189 rc 0/0 00000100:00100000:1.0:1651529344.514967:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152326 00010000:00010000:1.0:1651529344.514974:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514978:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fde70ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.514979:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514982:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 3/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514993:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+620:39029:x1731745946406720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 868us (1080us total) trans 30064893190 rc 0/0 00000100:00100000:0.0:1651529344.514996:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152327 00010000:00010000:1.0:1651529344.514997:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 1/0,0 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515000:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde70ff5/0xa29a79078f3be168 lrc: 0/0,0 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515004:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515007:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.515008:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515011:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 3/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515016:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 1/0,0 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515019:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be16f lrc: 0/0,0 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.515050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.515067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.515074:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407424 00000100:00100000:1.0:1651529344.515081:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407488 00000100:00100000:1.0:1651529344.515093:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152331 00000100:00100000:1.0:1651529344.515095:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+621:39030:x1731745946407424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.515096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.515101:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177123 count 1 00000100:00100000:0.0:1651529344.515104:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407552 00010000:00010000:1.0:1651529344.515105:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515110:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 2/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1444 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.515116:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152332 00000100:00100000:0.0:1651529344.515118:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+622:39029:x1731745946407488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.515120:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515121:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515121:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 4/0,1 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.515123:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177124 count 1 00010000:00010000:0.0:1651529344.515127:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515129:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 3/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1444 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515132:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 2/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1444 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515135:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515136:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515136:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 4/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515143:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 4/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515143:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 3/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1444 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.515147:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966623488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515147:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515151:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966623552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.515156:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.515160:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.515164:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152333 00000100:00100000:1.0:1651529344.515165:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+622:39030:x1731745946407552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.515169:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623296:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.515170:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177125 count 1 00010000:00010000:0.0:1651529344.515173:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515174:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515178:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 2/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1444 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.515180:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288000 00010000:00010000:1.0:1651529344.515181:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515182:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515183:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 4/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515184:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 4/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515189:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 3/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1445 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.515196:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11289 00000100:00100000:0.0:1651529344.515198:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1445:41278:x1731746396288000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.515200:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.515208:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966623616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.515215:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.515218:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515220:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 4/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515224:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 3/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515230:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d4dea5/0xa29a79078f3baea1 lrc: 0/0,0 mode: --/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3904 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.515233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.515234:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515234:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515235:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515238:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 4/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.515244:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.515258:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1444:41278:x1731746396288000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.515261:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11289 00010000:00010000:0.0:1651529344.515268:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515271:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515274:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515277:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515308:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407616 00000100:00100000:1.0:1651529344.515319:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407680 00000100:00100000:1.0:1651529344.515324:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152334 00000100:00100000:1.0:1651529344.515326:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+625:39029:x1731745946407616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.515336:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177126 count 1 00010000:00010000:1.0:1651529344.515340:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515343:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+625:39030:x1731745946406912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 711us (729us total) trans 30064893191 rc 0/0 00010000:00010000:1.0:1651529344.515345:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 2/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1443 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.515346:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152328 00010000:00010000:1.0:1651529344.515348:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515348:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515349:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 4/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515352:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152335 00000100:00100000:0.0:1651529344.515353:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+624:39030:x1731745946407680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.515355:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 3/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1443 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.515358:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177127 count 1 00010000:00010000:1.0:1651529344.515359:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1443 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515363:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515368:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 2/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1443 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515371:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515371:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515372:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 4/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515375:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515379:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1443 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515382:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.515384:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.515386:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.515395:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.515411:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515414:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.515415:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515418:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 3/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515423:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 1/0,0 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515426:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be176 lrc: 0/0,0 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.515550:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407936 00000100:00100000:0.0:1651529344.515558:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152336 00000100:00100000:0.0:1651529344.515560:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+625:39030:x1731745946407936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.515564:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177128 count 1 00010000:00010000:0.0:1651529344.515569:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515573:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 2/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1443 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515576:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515577:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515578:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 4/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515584:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 3/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1443 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515588:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515592:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.515639:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.515680:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966623360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515684:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515702:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966623424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515705:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.515717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.515717:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966623552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515720:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.515727:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288384 00000100:00100000:1.0:1651529344.515729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.515741:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 4/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.515744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.515750:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288320 00000100:00100000:1.0:1651529344.515753:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966623616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515753:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 4/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1445 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515757:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515757:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288576 00010000:00010000:0.0:1651529344.515759:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1446 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515763:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288448 00000100:00100000:1.0:1651529344.515765:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288512 00010000:00010000:0.0:1651529344.515765:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 5/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1447 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515769:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11290 00010000:00010000:1.0:1651529344.515770:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515771:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41279:x1731746396288384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.515773:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515775:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 4/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.515776:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11291 00000100:00100000:1.0:1651529344.515778:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41278:x1731746396288320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.515778:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 3/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515781:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515782:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 4/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515784:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082662408/0xa29a79078f3bb355 lrc: 0/0,0 mode: --/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c4b expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515786:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 3/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1448 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515788:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515789:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515792:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 4/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515794:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a52949/0xa29a79078f3b9d98 lrc: 0/0,0 mode: --/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf470 expref: 1447 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515798:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515798:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.515799:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515800:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515823:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 4/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515827:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1446:41279:x1731746396288384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.515832:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.515835:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11290 00000100:00100000:1.0:1651529344.515840:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1445:41278:x1731746396288320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.515843:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11291 00000100:00100000:1.0:1651529344.515849:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11292 00000100:00100000:1.0:1651529344.515851:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1444:41279:x1731746396288576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.515853:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515855:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515859:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 3/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515863:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4a8ee5/0xa29a79078f3bae69 lrc: 0/0,0 mode: --/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3816 expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.515874:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11293 00000100:00100000:0.0:1651529344.515876:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1444:41278:x1731746396288448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.515880:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515882:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 5/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1444 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515885:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515885:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515886:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515886:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 4/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515889:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 4/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515892:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515893:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515895:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.515896:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 4/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515901:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1443:41279:x1731746396288576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.515901:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515904:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11292 00000100:00100000:1.0:1651529344.515908:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11294 00000100:00100000:0.0:1651529344.515908:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1442:41278:x1731746396288448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.515910:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1442:41278:x1731746396288512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.515911:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11293 00010000:00010000:1.0:1651529344.515912:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515914:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1441 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.515917:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 3/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1441 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515918:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515922:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e3e409/0xa29a79078f3bc147 lrc: 0/0,0 mode: --/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d827d expref: 1441 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.515922:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515925:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515925:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515927:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515940:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515941:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515944:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 4/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515953:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515959:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41278:x1731746396288512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.515962:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11294 00010000:00010000:1.0:1651529344.515971:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515975:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.515976:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515979:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 3/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515983:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 1/0,0 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515986:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be184 lrc: 0/0,0 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515992:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515993:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+626:39030:x1731745946407040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1151us (1346us total) trans 30064893192 rc 0/0 00000100:00100000:0.0:1651529344.515996:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152330 00010000:00010000:0.0:1651529344.516003:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516004:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516006:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516007:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516009:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516009:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516012:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516053:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+627:39030:x1731745946407552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 886us (956us total) trans 30064893193 rc 0/0 00000100:00100000:1.0:1651529344.516056:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152333 00000100:00100000:0.0:1651529344.516056:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+627:39029:x1731745946407488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1005us total) trans 30064893194 rc 0/0 00000100:00100000:0.0:1651529344.516059:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152332 00010000:00010000:0.0:1651529344.516067:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516068:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4675417/0xa29a79078f3ba292 lrc: 0/0,0 mode: --/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0897 expref: 1439 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.516070:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004a4e8bd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516071:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516072:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966623488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516074:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 3/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516076:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516079:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516079:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 1/0,0 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516082:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516082:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a4e8bd/0xa29a79078f3be199 lrc: 0/0,0 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516086:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516088:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516089:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516095:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516095:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 3/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516098:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 2/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516098:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 1/0,0 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516100:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be192 lrc: 0/0,0 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516104:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516106:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb283dfa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516107:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 2/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516110:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 3/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516113:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 1/0,0 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516115:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb283dfa/0xa29a79078f3be18b lrc: 0/0,0 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516121:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516134:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516136:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+626:39030:x1731745946407424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1040us (1101us total) trans 30064893195 rc 0/0 00010000:00010000:0.0:1651529344.516137:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516139:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152331 00010000:00010000:0.0:1651529344.516140:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516146:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516150:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.516151:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516154:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 3/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516158:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 1/0,0 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516161:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be17d lrc: 0/0,0 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516178:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+626:39029:x1731745946406976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1453us (1553us total) trans 30064893196 rc 0/0 00000100:00100000:0.0:1651529344.516181:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152329 00000100:00100000:1.0:1651529344.516199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.516222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.516236:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966623744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516240:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.516278:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516281:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.516282:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516284:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516289:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288704 00010000:00010000:1.0:1651529344.516294:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1439 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.516304:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288768 00010000:00010000:1.0:1651529344.516307:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1440 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516310:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288832 00000100:00100000:1.0:1651529344.516312:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11295 00000100:00100000:1.0:1651529344.516313:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1441:41278:x1731746396288704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.516316:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.516316:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1441 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516318:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1441 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516321:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 3/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1441 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516327:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003acba56c/0xa29a79078f3b948b lrc: 0/0,0 mode: --/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfa2 expref: 1441 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516330:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.516335:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11296 00000100:00100000:0.0:1651529344.516337:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41279:x1731746396288768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.516338:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516339:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516340:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516342:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 4/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516342:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1440 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.516346:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1440 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516349:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.516352:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74ba2bb/0xa29a79078f3bb156 lrc: 0/0,0 mode: --/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43d8 expref: 1440 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.516356:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516357:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516357:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516358:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41278:x1731746396288704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.516361:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11295 00010000:00010000:0.0:1651529344.516361:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 4/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516366:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11297 00010000:00010000:0.0:1651529344.516367:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.516368:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1438:41279:x1731746396288832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.516370:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516372:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1438 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516374:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1438:41279:x1731746396288768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.516376:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 3/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1438 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516377:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11296 00010000:00010000:1.0:1651529344.516381:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3bb489 lrc: 0/0,0 mode: --/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d511b expref: 1437 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.516384:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516384:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516385:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516386:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516387:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516397:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 4/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516406:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.516413:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1436:41279:x1731746396288832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.516415:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11297 00010000:00010000:0.0:1651529344.516424:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516427:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516427:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516430:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516433:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516436:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516486:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+627:39029:x1731745946407616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1159us (1253us total) trans 30064893198 rc 0/0 00000100:00100000:1.0:1651529344.516489:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152334 00000100:00100000:0.0:1651529344.516490:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+627:39030:x1731745946407680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1135us (1246us total) trans 30064893197 rc 0/0 00000100:00100000:0.0:1651529344.516493:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152335 00010000:00010000:1.0:1651529344.516496:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516499:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516501:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516504:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516505:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516508:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516508:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 3/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516512:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 3/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516513:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 1/0,0 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516516:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 1/0,0 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516516:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be1a0 lrc: 0/0,0 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516520:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be1a7 lrc: 0/0,0 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516522:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516525:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516528:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516531:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.516574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516574:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+626:39030:x1731745946407936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1013us (1035us total) trans 30064893199 rc 0/0 00000100:00100000:0.0:1651529344.516577:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152336 00000100:00100000:0.0:1651529344.516582:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408320 00000100:00100000:1.0:1651529344.516586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516589:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408384 00000100:00100000:0.0:1651529344.516593:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408448 00000100:00100000:1.0:1651529344.516596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516608:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408512 00000100:00100000:0.0:1651529344.516613:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152337 00000100:00100000:0.0:1651529344.516615:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+629:39030:x1731745946408320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.516617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.516620:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177129 count 1 00010000:00010000:0.0:1651529344.516624:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516629:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 2/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1435 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516632:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516633:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516634:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 4/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516641:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 3/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1435 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516645:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1435 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516649:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516663:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.516665:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408576 00000100:00100000:0.0:1651529344.516670:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152338 00000100:00100000:0.0:1651529344.516672:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+630:39030:x1731745946408384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.516678:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152339 00000100:00100000:1.0:1651529344.516680:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+630:39030:x1731745946408448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.516682:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177130 count 1 00002000:00080000:1.0:1651529344.516686:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177131 count 1 00010000:00010000:0.0:1651529344.516686:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516690:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516691:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 2/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516694:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516695:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 2/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516698:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516706:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516707:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 4/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516708:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516709:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 4/0,1 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516715:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 3/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516717:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 3/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516719:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 4/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.516723:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516724:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 4/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516728:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966624000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.516740:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.516745:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.516747:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152340 00000100:00100000:1.0:1651529344.516749:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+630:39029:x1731745946408512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.516752:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152341 00002000:00080000:1.0:1651529344.516754:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177132 count 1 00000100:00100000:0.0:1651529344.516754:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+630:39030:x1731745946408576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.516758:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.516759:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177133 count 1 00010000:00010000:1.0:1651529344.516762:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 2/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516763:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516765:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516766:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516767:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 4/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516767:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 2/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516770:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516771:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516771:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 4/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516773:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 3/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516778:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516779:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.516781:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.516783:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966624064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516788:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966624128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.516790:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.516795:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.516800:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516821:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.516822:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516826:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 3/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516852:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 1/0,0 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516855:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be1ae lrc: 0/0,0 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516921:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408640 00000100:00100000:0.0:1651529344.516927:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408704 00000100:00100000:0.0:1651529344.516934:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408768 00000100:00100000:1.0:1651529344.516943:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152342 00000100:00100000:1.0:1651529344.516945:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+633:39029:x1731745946408640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.516945:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152343 00000100:00100000:0.0:1651529344.516947:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+633:39030:x1731745946408704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.516951:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177134 count 1 00010000:00010000:1.0:1651529344.516955:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516960:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 2/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1435 pid: 127525 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.516960:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177135 count 1 00010000:00010000:1.0:1651529344.516963:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516963:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516964:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 4/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516964:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516969:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 2/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516971:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 3/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1435 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516972:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516973:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516973:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 4/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516975:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1435 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.516980:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516984:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.516988:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966624256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.516990:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966624192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.517002:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.517006:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.517008:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152344 00000100:00100000:0.0:1651529344.517010:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+633:39029:x1731745946408768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.517015:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177136 count 1 00010000:00010000:0.0:1651529344.517019:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517023:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 2/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.517026:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517027:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517028:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 4/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517033:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 3/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.517037:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517041:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966624320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.517050:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.517188:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966623872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517198:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517206:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966624000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517209:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517225:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966624128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517228:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517229:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966623936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.517233:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517236:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966624256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517239:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517241:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966624064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.517244:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517250:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966624192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.517252:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.517424:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289408 00010000:00010000:1.0:1651529344.517435:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1436 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.517449:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.517452:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289536 00010000:00010000:1.0:1651529344.517455:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 4/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1437 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.517460:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289664 00000100:00100000:0.0:1651529344.517460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.517462:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1438 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.517471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.517475:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289792 00000100:00100000:0.0:1651529344.517476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.517478:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1439 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517482:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289472 00010000:00010000:1.0:1651529344.517484:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 4/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1440 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517484:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966624320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.517487:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289600 00010000:00010000:0.0:1651529344.517488:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517489:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1441 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517493:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289728 00010000:00010000:1.0:1651529344.517495:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1442 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517495:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289856 00000100:00100000:1.0:1651529344.517499:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11298 00010000:00010000:0.0:1651529344.517500:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517501:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1443:41279:x1731746396289408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.517504:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517505:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1443 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517507:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11299 00000100:00100000:0.0:1651529344.517508:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1443:41279:x1731746396289536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.517509:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 3/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1443 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517511:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.517513:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 4/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517514:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad22940/0xa29a79078f3b93f8 lrc: 0/0,0 mode: --/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdaa expref: 1443 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517517:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 3/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517522:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000627f4471/0xa29a79078f3bbd73 lrc: 0/0,0 mode: --/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72ee expref: 1443 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517525:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517525:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517526:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517526:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517528:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517529:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 4/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517531:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 4/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517538:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.517545:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.517548:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1441:41279:x1731746396289408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517551:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11298 00000100:00100000:0.0:1651529344.517553:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1441:41279:x1731746396289536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.517556:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11299 00000100:00100000:1.0:1651529344.517557:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11300 00000100:00100000:1.0:1651529344.517559:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41279:x1731746396289664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.517561:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11301 00010000:00010000:1.0:1651529344.517562:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517563:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1439 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.517563:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41279:x1731746396289792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.517566:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517567:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1439 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517567:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1439 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517571:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 3/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1439 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517572:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79c591a/0xa29a79078f3b9cf0 lrc: 0/0,0 mode: --/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf232 expref: 1439 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517576:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb6d4ec/0xa29a79078f3b8319 lrc: 0/0,0 mode: --/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe5a expref: 1438 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517580:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517580:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517581:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517582:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517583:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517584:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 4/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517586:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 4/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517593:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.517601:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.517604:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1437:41279:x1731746396289792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.517607:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11301 00000100:00100000:1.0:1651529344.517608:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1437:41279:x1731746396289664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517611:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11300 00000100:00100000:0.0:1651529344.517613:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11302 00000100:00100000:0.0:1651529344.517615:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1435:41279:x1731746396289472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.517616:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11303 00010000:00010000:0.0:1651529344.517617:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.517618:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1435:41279:x1731746396289600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.517619:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 4/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517620:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517622:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517622:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 3/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517626:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 3/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517627:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3ba540 lrc: 0/0,0 mode: --/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13fe expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517630:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed419c8e/0xa29a79078f3ba103 lrc: 0/0,0 mode: --/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01eb expref: 1435 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517633:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517634:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517634:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517634:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517635:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517635:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517637:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 4/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517646:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.517652:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 4/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517652:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1433:41279:x1731746396289472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.517654:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11302 00010000:00010000:1.0:1651529344.517658:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.517659:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11304 00000100:00100000:0.0:1651529344.517660:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41279:x1731746396289728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.517663:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.517664:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1432 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517665:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41279:x1731746396289600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517667:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11303 00010000:00010000:0.0:1651529344.517668:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1432 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517672:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11305 00010000:00010000:0.0:1651529344.517672:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a0fb32/0xa29a79078f3bbd8f lrc: 0/0,0 mode: --/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7342 expref: 1431 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.517674:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1431:41279:x1731746396289856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.517676:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.517676:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517677:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517677:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517678:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1430 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517680:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 4/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517682:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 3/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1430 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.517686:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a6f965c/0xa29a79078f3bb71b lrc: 0/0,0 mode: --/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ae5 expref: 1430 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.517686:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.517690:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517691:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517691:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517691:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41279:x1731746396289728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.517693:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11304 00010000:00010000:1.0:1651529344.517694:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 4/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517703:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517706:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517710:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.517715:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517717:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1428:41279:x1731746396289856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.517718:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517719:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11305 00010000:00010000:1.0:1651529344.517728:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517740:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517743:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517746:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517773:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+635:39030:x1731745946408576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1018us (1156us total) trans 30064893200 rc 0/0 00000100:00100000:0.0:1651529344.517777:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152341 00010000:00010000:0.0:1651529344.517783:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517788:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+634:39029:x1731745946408512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1038us (1191us total) trans 30064893201 rc 0/0 00010000:00010000:0.0:1651529344.517789:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b306dd91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.517790:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517791:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152340 00010000:00010000:0.0:1651529344.517793:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 3/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517798:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 1/0,0 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517799:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517800:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b306dd91/0xa29a79078f3be1d1 lrc: 0/0,0 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517819:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.517821:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517826:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517829:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517832:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517833:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 3/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517835:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517838:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 1/0,0 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517841:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be1ca lrc: 0/0,0 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517845:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517848:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.517849:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517852:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 3/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517855:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 1/0,0 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517858:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be1bc lrc: 0/0,0 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517864:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517867:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517870:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517871:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+634:39030:x1731745946408384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1198us (1296us total) trans 30064893202 rc 0/0 00010000:00010000:1.0:1651529344.517873:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517889:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152338 00010000:00010000:0.0:1651529344.517897:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517900:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.517901:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517904:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 3/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517908:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 1/0,0 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517911:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be1c3 lrc: 0/0,0 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517913:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+634:39030:x1731745946408448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1232us (1326us total) trans 30064893203 rc 0/0 00000100:00100000:1.0:1651529344.517916:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152339 00010000:00010000:0.0:1651529344.517917:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517920:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517923:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517923:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517926:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517927:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517929:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517932:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517973:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+635:39029:x1731745946408768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 962us (1058us total) trans 30064893204 rc 0/0 00000100:00100000:0.0:1651529344.517976:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152344 00000100:00100000:1.0:1651529344.517978:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+635:39029:x1731745946408640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1032us (1077us total) trans 30064893205 rc 0/0 00000100:00100000:1.0:1651529344.517982:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152342 00010000:00010000:0.0:1651529344.517983:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517987:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000152886c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.517988:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517990:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517990:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 3/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517993:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.517994:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517995:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 1/0,0 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517997:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 3/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517998:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152886c7/0xa29a79078f3be1e6 lrc: 0/0,0 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518001:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 1/0,0 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518004:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be1d8 lrc: 0/0,0 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518004:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518007:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518010:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518013:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518046:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+634:39030:x1731745946408704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1098us (1137us total) trans 30064893206 rc 0/0 00000100:00100000:0.0:1651529344.518049:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152343 00010000:00010000:0.0:1651529344.518055:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518059:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092586f6b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.518060:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518062:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 3/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518066:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 1/0,0 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518069:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092586f6b/0xa29a79078f3be1df lrc: 0/0,0 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518075:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518078:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518081:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518084:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518171:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+634:39030:x1731745946408320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1555us (1616us total) trans 30064893207 rc 0/0 00000100:00100000:0.0:1651529344.518174:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152337 00010000:00010000:0.0:1651529344.518214:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518218:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.518219:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.518222:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 3/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518232:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 1/0,0 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518235:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be1b5 lrc: 0/0,0 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518243:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409472 00000100:00100000:0.0:1651529344.518251:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152345 00000100:00100000:0.0:1651529344.518253:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+634:39030:x1731745946409472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.518258:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177137 count 1 00010000:00010000:0.0:1651529344.518289:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518294:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 2/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.518297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.518297:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518298:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518299:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 4/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518304:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409600 00010000:00010000:0.0:1651529344.518306:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 3/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518310:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 4/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518315:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152346 00000100:00100000:1.0:1651529344.518317:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ef3dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+635:39030:x1731745946409600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.518321:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966624384:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.518323:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177139 count 1 00010000:00010000:1.0:1651529344.518327:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518332:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 2/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1427 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.518336:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.518346:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518347:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518348:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 4/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518356:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 3/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1427 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518360:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1427 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518372:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966624448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518382:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.518410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.518416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.518425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.518426:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409536 00000100:00100000:0.0:1651529344.518431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.518434:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409728 00000100:00100000:0.0:1651529344.518438:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.518442:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152347 00000100:00100000:1.0:1651529344.518444:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+637:39030:x1731745946409536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.518449:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177138 count 1 00010000:00010000:1.0:1651529344.518452:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 3/0,1 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518452:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409856 00010000:00010000:1.0:1651529344.518457:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 2/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1427 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.518462:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409664 00000100:00100000:0.0:1651529344.518465:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409792 00010000:00010000:1.0:1651529344.518466:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518467:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.518467:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409920 00010000:00010000:1.0:1651529344.518468:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 4/0,1 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518475:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 3/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1427 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518478:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1427 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518482:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966624512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518484:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152348 00000100:00100000:0.0:1651529344.518486:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+641:39030:x1731745946409728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.518492:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177141 count 1 00000100:00100000:1.0:1651529344.518493:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.518498:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152349 00000100:00100000:1.0:1651529344.518500:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+641:39030:x1731745946409856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.518504:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177143 count 1 00010000:00010000:0.0:1651529344.518504:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518508:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518509:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 2/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518512:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 2/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518512:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518513:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518514:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 4/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518515:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518516:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518517:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 4/0,1 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518522:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 3/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518528:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 4/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518532:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966624576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518535:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 3/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.518538:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.518539:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518543:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152350 00000100:00100000:0.0:1651529344.518543:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966624640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518545:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+641:39030:x1731745946409664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.518548:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177140 count 1 00010000:00010000:1.0:1651529344.518551:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518552:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.518555:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 2/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518558:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518559:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518559:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 4/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518559:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152351 00000100:00100000:0.0:1651529344.518561:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+641:39030:x1731745946409792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.518565:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 3/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.518566:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177142 count 1 00010000:00010000:1.0:1651529344.518569:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.518569:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518574:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 2/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.518576:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966624704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518577:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518577:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518578:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 4/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518582:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.518584:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 3/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518587:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.518591:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966624768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518606:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518611:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152352 00000100:00100000:0.0:1651529344.518613:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+641:39030:x1731745946409920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.518617:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177144 count 1 00010000:00010000:0.0:1651529344.518621:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518625:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 2/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518629:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518629:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518630:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 4/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518635:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 3/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518639:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.518642:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966624832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518656:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518666:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966624384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518671:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.518768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.518785:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966624448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.518789:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518797:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290496 00010000:00010000:1.0:1651529344.518801:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 4/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1428 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.518825:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290560 00000100:00100000:0.0:1651529344.518827:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11306 00010000:00010000:1.0:1651529344.518829:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1429 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.518829:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41278:x1731746396290496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.518833:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.518837:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11307 00000100:00100000:1.0:1651529344.518839:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41278:x1731746396290560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.518842:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.518843:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1429 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.518847:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 3/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1429 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.518854:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 4/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.518855:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3b943e lrc: 0/0,0 mode: --/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cceb4 expref: 1429 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.518858:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 3/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.518859:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518860:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518861:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518864:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 4/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518865:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006fa98f2/0xa29a79078f3bab36 lrc: 0/0,0 mode: --/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bc1 expref: 1428 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.518868:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518869:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518870:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.518870:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518873:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 4/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518878:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1427:41278:x1731746396290560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.518879:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.518881:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11307 00000100:00100000:0.0:1651529344.518887:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41278:x1731746396290496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.518888:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518890:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11306 00010000:00010000:1.0:1651529344.518891:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518894:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518897:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518900:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518903:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518907:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518909:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518949:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ef3dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+643:39030:x1731745946409600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 631us (659us total) trans 30064893208 rc 0/0 00000100:00100000:1.0:1651529344.518952:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152346 00010000:00010000:1.0:1651529344.518959:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518963:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.518964:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518967:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 3/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518968:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+642:39030:x1731745946409472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 714us (745us total) trans 30064893209 rc 0/0 00000100:00100000:0.0:1651529344.518971:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152345 00010000:00010000:1.0:1651529344.518972:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 1/0,0 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518974:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be1f4 lrc: 0/0,0 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518979:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518981:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3e400c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.518982:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518996:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 3/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518999:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 1/0,0 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519002:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e400c5/0xa29a79078f3be1ed lrc: 0/0,0 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519019:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966624512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.519022:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 3/0,1 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.519051:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290688 00010000:00010000:0.0:1651529344.519057:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1426 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.519064:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11308 00000100:00100000:0.0:1651529344.519066:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41278:x1731746396290688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.519069:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519070:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1426 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519074:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 3/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1426 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519080:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087b4a2f1/0xa29a79078f3b77c0 lrc: 0/0,0 mode: --/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb490 expref: 1426 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519083:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519084:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519085:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519088:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 4/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519101:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 4/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519105:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 4/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519108:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 4/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519111:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 3/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519114:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.519158:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1425:41278:x1731746396290688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 91us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.519161:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11308 00000100:00100000:1.0:1651529344.519163:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+642:39030:x1731745946409536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 719us (762us total) trans 30064893210 rc 0/0 00000100:00100000:1.0:1651529344.519174:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152347 00010000:00010000:0.0:1651529344.519177:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 2/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519181:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.519182:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 2/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519185:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 3/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519190:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 1/0,0 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519193:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be1fb lrc: 0/0,0 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.519261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.519275:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966624576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.519277:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966624640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.519280:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519282:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519288:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966624704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.519291:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519292:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966624768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.519297:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410112 00000100:00100000:1.0:1651529344.519304:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410176 00000100:00100000:1.0:1651529344.519311:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152353 00000100:00100000:1.0:1651529344.519313:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+643:39030:x1731745946410112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.519313:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.519318:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177145 count 1 00000100:00100000:0.0:1651529344.519321:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152354 00010000:00010000:1.0:1651529344.519322:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519323:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+643:39029:x1731745946410176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.519327:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 2/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.519329:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177146 count 1 00010000:00010000:1.0:1651529344.519330:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519330:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519331:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 4/0,1 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519338:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 3/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519347:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519350:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 4/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1424 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519351:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 2/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.519354:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966624896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519354:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519355:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519356:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 4/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519365:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.519386:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519390:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 4/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1424 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.519401:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966624960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.519410:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.519418:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966624832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519422:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.519429:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410240 00000100:00100000:0.0:1651529344.519437:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152355 00000100:00100000:0.0:1651529344.519439:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+644:39030:x1731745946410240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.519444:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177147 count 1 00010000:00010000:0.0:1651529344.519447:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519452:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 2/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519454:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.519455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.519455:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519456:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 4/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.519473:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 3/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1424 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.519475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.519477:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1424 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.519482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.519492:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966625024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.519493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.519500:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290880 00000100:00100000:0.0:1651529344.519506:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.519511:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 4/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1425 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.519514:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291008 00000100:00100000:1.0:1651529344.519518:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290944 00010000:00010000:0.0:1651529344.519518:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519521:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1427 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.519524:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291136 00000100:00100000:1.0:1651529344.519525:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291072 00010000:00010000:1.0:1651529344.519527:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519527:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.519532:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11309 00000100:00100000:1.0:1651529344.519534:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11310 00000100:00100000:0.0:1651529344.519534:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41278:x1731746396290880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.519536:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41278:x1731746396291008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.519537:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519538:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 4/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519542:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 3/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519548:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519548:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032b5a222/0xa29a79078f3ba24c lrc: 0/0,0 mode: --/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d072b expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519549:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 4/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1429 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519551:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519552:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519552:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519553:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 3/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1428 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519555:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 4/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519559:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f538f48d/0xa29a79078f3ba0e0 lrc: 0/0,0 mode: --/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0166 expref: 1428 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519565:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.519568:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519569:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519570:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519572:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1427:41278:x1731746396290880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.519573:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 4/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519574:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11309 00000100:00100000:0.0:1651529344.519580:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11311 00010000:00010000:1.0:1651529344.519583:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519590:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41278:x1731746396291008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.519599:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11310 00000100:00100000:0.0:1651529344.519600:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41279:x1731746396290944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.519603:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.519605:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11312 00010000:00010000:0.0:1651529344.519605:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1425 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.519606:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1425:41278:x1731746396291136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.519609:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519609:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 3/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1425 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519611:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1425 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519614:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df6fa516/0xa29a79078f3bb6dc lrc: 0/0,0 mode: --/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59a3 expref: 1425 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519618:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519618:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519619:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519622:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 4/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519624:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 3/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1424 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519628:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.519629:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007965f55e/0xa29a79078f3bc186 lrc: 0/0,0 mode: --/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d831e expref: 1424 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519633:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519633:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519634:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519634:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1423:41279:x1731746396290944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.519637:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 4/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519637:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11311 00010000:00010000:1.0:1651529344.519645:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519652:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1423:41278:x1731746396291136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.519666:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11312 00000100:00100000:0.0:1651529344.519676:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11313 00000100:00100000:0.0:1651529344.519677:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1421:41279:x1731746396291072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.519680:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.519682:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519682:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519685:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519686:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 3/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.519689:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519691:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4a620d/0xa29a79078f3bbc77 lrc: 0/0,0 mode: --/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fb4 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.519695:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519695:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519696:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519699:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 4/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519701:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519716:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.519723:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41279:x1731746396291072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.519725:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11313 00010000:00010000:0.0:1651529344.519743:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519754:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.519755:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519757:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946409856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1256us (1340us total) trans 30064893211 rc 0/0 00010000:00010000:0.0:1651529344.519758:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 3/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519760:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152349 00010000:00010000:0.0:1651529344.519763:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 1/0,0 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519766:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be209 lrc: 0/0,0 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519768:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519771:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519772:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519774:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519775:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519777:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519779:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519781:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519829:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+646:39030:x1731745946409664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1403us total) trans 30064893212 rc 0/0 00000100:00100000:1.0:1651529344.519832:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152350 00010000:00010000:1.0:1651529344.519839:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519843:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.519843:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946409920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1228us (1404us total) trans 30064893213 rc 0/0 00010000:00010000:1.0:1651529344.519844:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519847:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152352 00010000:00010000:1.0:1651529344.519854:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 3/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519854:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519858:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.519859:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519860:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 1/0,0 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519862:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be210 lrc: 0/0,0 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519862:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 3/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519866:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 1/0,0 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519869:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be21e lrc: 0/0,0 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519876:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519879:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519882:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519884:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.519915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.519932:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946409792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1501us total) trans 30064893214 rc 0/0 00000100:00100000:0.0:1651529344.519935:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152351 00010000:00010000:0.0:1651529344.519942:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519946:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519949:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519951:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520011:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946409728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1510us (1586us total) trans 30064893215 rc 0/0 00000100:00100000:0.0:1651529344.520014:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152348 00000100:00100000:1.0:1651529344.520019:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966624896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520021:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520023:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520024:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b480d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.520025:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520028:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 3/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520031:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291200 00010000:00010000:0.0:1651529344.520033:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 1/0,0 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520035:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 4/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1420 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520036:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b480d7/0xa29a79078f3be217 lrc: 0/0,0 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520040:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520042:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291264 00010000:00010000:0.0:1651529344.520043:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007d01aa6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.520043:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520045:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 5/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520046:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 3/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520049:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 1/0,0 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520050:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11314 00000100:00100000:1.0:1651529344.520051:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1421:41279:x1731746396291200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.520052:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d01aa6/0xa29a79078f3be202 lrc: 0/0,0 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520061:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966624960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.520064:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520065:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 4/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520065:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520069:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 3/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520075:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c47c73d/0xa29a79078f3baacd lrc: 0/0,0 mode: --/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a40 expref: 1421 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520075:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11315 00000100:00100000:0.0:1651529344.520077:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1421:41278:x1731746396291264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.520079:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520079:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520080:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520080:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520081:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 4/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1420 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520083:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 4/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520085:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1420 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520090:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.520090:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d6444e/0xa29a79078f3bb688 lrc: 0/0,0 mode: --/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d588b expref: 1420 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520093:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520094:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520095:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520097:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1419:41279:x1731746396291200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.520098:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 4/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520100:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11314 00010000:00010000:0.0:1651529344.520104:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.520107:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520111:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520123:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520126:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520126:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41278:x1731746396291264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.520129:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11315 00010000:00010000:0.0:1651529344.520156:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520161:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.520162:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520164:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 3/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520169:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946410112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 855us (918us total) trans 30064893216 rc 0/0 00010000:00010000:0.0:1651529344.520169:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 1/0,0 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520172:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152353 00010000:00010000:0.0:1651529344.520172:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be225 lrc: 0/0,0 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520178:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520181:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520184:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520186:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520208:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.520221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.520225:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+645:39029:x1731745946410176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 901us (963us total) trans 30064893217 rc 0/0 00000100:00100000:0.0:1651529344.520236:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152354 00000100:00100000:1.0:1651529344.520238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.520248:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410752 00000100:00100000:1.0:1651529344.520250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.520264:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410880 00000100:00100000:0.0:1651529344.520270:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410816 00000100:00100000:0.0:1651529344.520275:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410944 00000100:00100000:0.0:1651529344.520281:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152356 00000100:00100000:0.0:1651529344.520282:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+648:39029:x1731745946410752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.520288:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177148 count 1 00010000:00010000:0.0:1651529344.520292:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520296:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 2/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520300:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520300:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520301:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 4/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520307:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.520311:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152357 00010000:00010000:0.0:1651529344.520311:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520313:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+648:39030:x1731745946410880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.520315:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966625088:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.520319:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177150 count 1 00010000:00010000:1.0:1651529344.520324:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520329:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.520335:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 2/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520338:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520339:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520339:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 4/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520349:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 3/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520353:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520357:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966625152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.520359:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152358 00000100:00100000:0.0:1651529344.520361:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+648:39029:x1731745946410816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.520366:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.520367:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177149 count 1 00010000:00010000:0.0:1651529344.520371:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520373:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152359 00000100:00100000:1.0:1651529344.520374:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+648:39029:x1731745946410944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.520375:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 2/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520378:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.520379:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177151 count 1 00010000:00010000:0.0:1651529344.520379:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520380:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 4/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520382:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520387:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 2/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520390:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520390:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520391:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 4/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520397:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 3/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520400:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520401:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 3/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.520404:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966625216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520404:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520409:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966625280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520410:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.520417:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.520422:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520425:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.520432:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.520449:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 3/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520455:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 1/0,0 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520457:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be22c lrc: 0/0,0 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520471:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966625024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.520474:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520487:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411072 00000100:00100000:0.0:1651529344.520495:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152360 00000100:00100000:0.0:1651529344.520497:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+649:39029:x1731745946411072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.520501:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177152 count 1 00000100:00100000:1.0:1651529344.520504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.520505:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.520515:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 2/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1417 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520518:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520518:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520519:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 4/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520522:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291712 00010000:00010000:0.0:1651529344.520526:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 3/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1418 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520528:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520539:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11316 00000100:00100000:1.0:1651529344.520541:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41279:x1731746396291712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.520543:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520545:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520548:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 3/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520548:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520552:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966625344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.520554:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca372c4/0xa29a79078f3bbce7 lrc: 0/0,0 mode: --/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7104 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520558:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520558:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520559:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520562:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 4/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520567:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.520573:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411136 00010000:00010000:1.0:1651529344.520577:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.520587:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411200 00000100:00100000:1.0:1651529344.520590:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41279:x1731746396291712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.520593:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11316 00000100:00100000:0.0:1651529344.520603:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152361 00000100:00100000:1.0:1651529344.520605:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152362 00000100:00100000:0.0:1651529344.520605:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+651:39030:x1731745946411136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.520607:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+651:39029:x1731745946411200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.520610:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177153 count 1 00002000:00080000:1.0:1651529344.520612:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177154 count 1 00010000:00010000:0.0:1651529344.520614:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520616:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520619:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 2/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1416 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520620:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 2/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1416 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520622:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520622:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520623:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 4/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520624:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520624:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520625:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 4/0,1 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520629:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 3/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1416 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520631:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 3/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1416 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520635:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 4/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1416 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520636:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1416 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520639:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966625408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520642:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966625472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.520647:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.520650:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.520655:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520658:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520661:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520664:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520710:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520717:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+652:39030:x1731745946410240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1277us (1293us total) trans 30064893218 rc 0/0 00010000:00010000:1.0:1651529344.520719:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.520720:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520720:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152355 00010000:00010000:1.0:1651529344.520723:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 3/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520728:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 1/0,0 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520740:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be233 lrc: 0/0,0 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520753:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966625088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520757:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520818:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966625280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520824:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.520827:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.520844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520845:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291840 00010000:00010000:0.0:1651529344.520850:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520855:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11317 00000100:00100000:0.0:1651529344.520857:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41279:x1731746396291840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.520860:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.520861:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966625152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.520865:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520875:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966625216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.520877:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520884:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291968 00010000:00010000:0.0:1651529344.520885:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520890:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520896:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520896:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000393aa09/0xa29a79078f3bb2b4 lrc: 0/0,0 mode: --/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4949 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520900:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520901:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.520902:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291904 00010000:00010000:0.0:1651529344.520902:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520905:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1418 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520905:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 4/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520909:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292032 00010000:00010000:1.0:1651529344.520911:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1419 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520914:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.520915:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11318 00000100:00100000:1.0:1651529344.520917:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1419:41279:x1731746396291968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.520919:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520921:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1419 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520924:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 3/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1419 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.520932:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16395d0/0xa29a79078f3ba64a lrc: 0/0,0 mode: --/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1849 expref: 1419 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520941:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41279:x1731746396291840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 83us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.520942:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520943:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520944:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520945:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11317 00010000:00010000:1.0:1651529344.520947:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 4/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520951:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11319 00000100:00100000:0.0:1651529344.520952:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41278:x1731746396291904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.520953:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.520955:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520957:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520960:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41279:x1731746396291968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.520961:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 3/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1417 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.520963:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11318 00010000:00010000:0.0:1651529344.520967:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3b9fd6 lrc: 0/0,0 mode: --/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd14 expref: 1416 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520970:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520971:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.520972:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11320 00010000:00010000:0.0:1651529344.520972:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520974:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1415:41278:x1731746396292032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.520975:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 4/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520976:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520978:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.520983:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.520988:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 3/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520991:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1415:41278:x1731746396291904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.520994:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000202ab999/0xa29a79078f3b9d75 lrc: 0/0,0 mode: --/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3f2 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.520994:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11319 00010000:00010000:1.0:1651529344.521000:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521001:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521001:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521002:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521004:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 4/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521005:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521008:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521013:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.521016:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521019:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1413:41278:x1731746396292032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.521022:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11320 00010000:00010000:1.0:1651529344.521030:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521033:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521036:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521039:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521076:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+653:39029:x1731745946410752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 792us (868us total) trans 30064893219 rc 0/0 00000100:00100000:0.0:1651529344.521078:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152356 00000100:00100000:1.0:1651529344.521081:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+652:39029:x1731745946410944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 706us (831us total) trans 30064893220 rc 0/0 00000100:00100000:1.0:1651529344.521084:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152359 00010000:00010000:0.0:1651529344.521086:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521090:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.521091:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521092:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521096:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521099:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521101:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521107:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 3/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521112:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 1/0,0 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521115:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3be23a lrc: 0/0,0 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521120:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521122:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.521123:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521126:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 3/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521133:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+652:39030:x1731745946410880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 819us (911us total) trans 30064893221 rc 0/0 00000100:00100000:1.0:1651529344.521135:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152357 00010000:00010000:0.0:1651529344.521139:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 1/0,0 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521142:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521142:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be24f lrc: 0/0,0 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521146:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.521147:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521148:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521150:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 3/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521151:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521154:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 1/0,0 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521154:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521166:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521168:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be241 lrc: 0/0,0 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521173:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521175:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.521176:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521179:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 3/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521183:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 1/0,0 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521185:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be248 lrc: 0/0,0 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521204:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+652:39029:x1731745946410816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 842us (966us total) trans 30064893222 rc 0/0 00000100:00100000:0.0:1651529344.521207:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152358 00000100:00100000:0.0:1651529344.521232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.521277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.521279:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966625408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.521283:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521291:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411264 00000100:00100000:0.0:1651529344.521302:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152363 00000100:00100000:0.0:1651529344.521303:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+652:39030:x1731745946411264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.521309:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177155 count 1 00010000:00010000:0.0:1651529344.521313:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521317:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 2/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1412 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521320:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521321:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521322:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 4/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521331:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 3/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1412 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521334:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 4/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.521338:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966625536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.521354:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.521358:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292160 00010000:00010000:1.0:1651529344.521364:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1413 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.521373:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292096 00000100:00100000:0.0:1651529344.521382:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966625344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521383:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1414 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.521386:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521388:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292288 00010000:00010000:1.0:1651529344.521390:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 5/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.521394:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11321 00000100:00100000:1.0:1651529344.521396:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11322 00000100:00100000:0.0:1651529344.521396:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1415:41278:x1731746396292160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.521398:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1415:41279:x1731746396292096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.521399:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.521401:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.521401:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521402:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.521405:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 3/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521406:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 3/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.521410:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b824e8ea/0xa29a79078f3bc393 lrc: 0/0,0 mode: --/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b52 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521412:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700741c9/0xa29a79078f3bc044 lrc: 0/0,0 mode: --/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dd7 expref: 1415 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521415:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521416:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521417:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521417:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521418:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521420:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 4/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521421:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 4/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521429:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.521435:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.521441:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1413:41279:x1731746396292096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.521443:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1413:41278:x1731746396292160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.521444:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11322 00000100:00100000:0.0:1651529344.521446:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11321 00000100:00100000:1.0:1651529344.521449:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11323 00000100:00100000:1.0:1651529344.521451:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396292288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.521454:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.521455:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 5/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1411 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521459:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 4/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1411 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.521464:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521464:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521465:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521470:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521475:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 4/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521480:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.521481:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521485:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396292288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (146us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.521485:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521488:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11323 00010000:00010000:0.0:1651529344.521488:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521506:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e9caf7e/0xa29a79078f3bac94 lrc: 0/0,0 mode: --/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3101 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.521511:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966625472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521521:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521525:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521527:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521530:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521530:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+653:39030:x1731745946411136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (1026us total) trans 30064893223 rc 0/0 00010000:00010000:1.0:1651529344.521533:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521533:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152361 00010000:00010000:0.0:1651529344.521549:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521552:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521555:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521558:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521576:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+654:39029:x1731745946411200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1060us total) trans 30064893224 rc 0/0 00000100:00100000:1.0:1651529344.521579:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152362 00010000:00010000:1.0:1651529344.521586:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521590:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.521591:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521593:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 3/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521593:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+653:39029:x1731745946411072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1096us (1127us total) trans 30064893225 rc 0/0 00000100:00100000:0.0:1651529344.521596:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152360 00010000:00010000:0.0:1651529344.521603:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521606:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.521607:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521609:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 1/0,0 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521610:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 3/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521612:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be25d lrc: 0/0,0 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521615:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 1/0,0 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521616:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521619:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.521620:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521620:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be264 lrc: 0/0,0 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521623:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 3/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521626:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 1/0,0 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521628:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be256 lrc: 0/0,0 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521705:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411840 00000100:00100000:1.0:1651529344.521709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521713:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411776 00000100:00100000:0.0:1651529344.521720:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411968 00000100:00100000:1.0:1651529344.521722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521752:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411904 00000100:00100000:1.0:1651529344.521755:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152364 00000100:00100000:1.0:1651529344.521757:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+656:39029:x1731745946411840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.521763:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152365 00000100:00100000:0.0:1651529344.521765:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+656:39030:x1731745946411776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.521770:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177156 count 1 00002000:00080000:1.0:1651529344.521772:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177157 count 1 00010000:00010000:1.0:1651529344.521777:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521782:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 2/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521785:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521786:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521786:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 4/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521787:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521792:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 2/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521793:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 3/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521796:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521796:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521797:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.521797:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 4/0,1 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521801:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966625600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521833:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.521845:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152366 00010000:00010000:0.0:1651529344.521846:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 3/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.521847:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+656:39029:x1731745946411968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.521850:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 4/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.521853:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177159 count 1 00010000:00010000:1.0:1651529344.521856:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521858:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966625664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521861:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 2/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521872:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521873:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521873:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 4/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521886:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.521888:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 3/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521892:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.521894:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152367 00000100:00100000:0.0:1651529344.521895:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+656:39030:x1731745946411904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.521896:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966625728:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.521901:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177158 count 1 00000100:00100000:1.0:1651529344.521905:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.521905:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521909:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 2/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521912:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521913:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521914:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 4/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.521920:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 3/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521924:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.521933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521955:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966625792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521985:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.521992:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412096 00000100:00100000:0.0:1651529344.522004:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412224 00000100:00100000:0.0:1651529344.522022:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412160 00000100:00100000:1.0:1651529344.522023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.522026:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152368 00000100:00100000:0.0:1651529344.522027:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+659:39029:x1731745946412096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.522032:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152369 00002000:00080000:0.0:1651529344.522032:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177160 count 1 00000100:00100000:1.0:1651529344.522034:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+659:39029:x1731745946412224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.522036:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.522040:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177162 count 1 00010000:00010000:0.0:1651529344.522041:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 2/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522044:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522044:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522044:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522045:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 4/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522048:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 2/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522051:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 3/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522055:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522059:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966625856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522062:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522063:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522063:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 4/0,1 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522074:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.522076:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 3/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522081:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 4/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522081:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152370 00000100:00100000:0.0:1651529344.522083:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+659:39030:x1731745946412160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.522085:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966625920:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.522087:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177161 count 1 00010000:00010000:0.0:1651529344.522092:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522094:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.522096:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 2/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1409 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522099:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522100:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522100:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 4/0,1 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522101:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292800 00010000:00010000:1.0:1651529344.522105:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 5/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522107:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 3/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522110:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 4/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.522118:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11324 00000100:00100000:1.0:1651529344.522119:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1410:41278:x1731746396292800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.522121:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966625984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522122:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522123:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 5/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522127:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 4/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522129:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.522136:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966625536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522142:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bb4ac lrc: 0/0,0 mode: --/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51b5 expref: 1410 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522143:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522146:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522147:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522148:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522151:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 4/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522159:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.522166:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1409:41278:x1731746396292800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522169:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11324 00010000:00010000:0.0:1651529344.522186:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522190:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522196:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522198:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522289:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+660:39030:x1731745946411264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 984us (1056us total) trans 30064893226 rc 0/0 00000100:00100000:0.0:1651529344.522292:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152363 00010000:00010000:0.0:1651529344.522305:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522309:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.522310:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522313:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 3/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.522324:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 1/0,0 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522327:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be26b lrc: 0/0,0 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.522337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.522344:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.522378:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966625600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.522386:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966625792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522388:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522391:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522396:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966625728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522399:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522400:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966625856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.522403:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522414:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292928 00010000:00010000:1.0:1651529344.522418:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 5/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522421:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292864 00000100:00100000:1.0:1651529344.522424:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293056 00010000:00010000:1.0:1651529344.522426:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1411 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522426:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1411 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.522430:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292992 00010000:00010000:1.0:1651529344.522432:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1412 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.522437:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11325 00000100:00100000:1.0:1651529344.522438:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1412:41278:x1731746396292928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.522441:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522442:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 5/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522445:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11326 00010000:00010000:1.0:1651529344.522446:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 4/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522447:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1412:41278:x1731746396293056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.522450:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522452:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522452:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522452:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522453:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522456:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 3/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522461:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9750719/0xa29a79078f3ba6dd lrc: 0/0,0 mode: --/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1afe expref: 1412 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522464:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 4/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522465:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522466:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522467:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522469:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.522470:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 4/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522477:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396292928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.522477:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.522479:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11325 00000100:00100000:0.0:1651529344.522484:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1410:41278:x1731746396293056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.522487:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11326 00000100:00100000:1.0:1651529344.522489:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11327 00000100:00100000:1.0:1651529344.522490:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1409:41279:x1731746396292992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.522492:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11328 00010000:00010000:1.0:1651529344.522493:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522494:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522494:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1409:41279:x1731746396292864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.522496:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522498:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 3/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522498:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522501:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 3/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1409 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522503:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008616d8ef/0xa29a79078f3b96de lrc: 0/0,0 mode: --/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd91f expref: 1409 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522506:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17ce2d4/0xa29a79078f3bb618 lrc: 0/0,0 mode: --/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56af expref: 1408 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522507:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522507:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522508:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522510:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522510:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522511:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 4/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522511:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522514:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 4/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522525:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.522532:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.522537:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1407:41279:x1731746396292992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.522539:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1407:41279:x1731746396292864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522540:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11327 00000100:00100000:0.0:1651529344.522542:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11328 00010000:00010000:1.0:1651529344.522547:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522550:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522551:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522553:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522554:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522556:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522557:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522559:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522611:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+661:39029:x1731745946411968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 762us (901us total) trans 30064893227 rc 0/0 00000100:00100000:1.0:1651529344.522614:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152366 00000100:00100000:0.0:1651529344.522621:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+660:39030:x1731745946411904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 725us (904us total) trans 30064893228 rc 0/0 00010000:00010000:1.0:1651529344.522622:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522624:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152367 00010000:00010000:1.0:1651529344.522626:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.522627:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522632:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522636:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.522637:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522640:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 3/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522642:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 3/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522645:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 1/0,0 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522647:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 1/0,0 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522648:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be280 lrc: 0/0,0 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522649:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3be287 lrc: 0/0,0 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522654:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522657:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522660:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522660:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3ba428 lrc: 0/0,0 mode: --/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ec5 expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.522663:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522663:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966625664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.522667:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522677:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522680:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522683:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522686:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522709:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+661:39029:x1731745946411840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1051us total) trans 30064893229 rc 0/0 00000100:00100000:1.0:1651529344.522712:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152364 00010000:00010000:1.0:1651529344.522719:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522727:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+660:39030:x1731745946411776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1050us total) trans 30064893230 rc 0/0 00000100:00100000:0.0:1651529344.522730:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152365 00010000:00010000:1.0:1651529344.522740:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.522741:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522745:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 3/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522747:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522750:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 1/0,0 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522751:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.522752:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be279 lrc: 0/0,0 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522752:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522754:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 3/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522759:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 1/0,0 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522762:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3be272 lrc: 0/0,0 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.522800:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966625920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522818:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.522843:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966625984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.522854:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522863:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412544 00000100:00100000:0.0:1651529344.522875:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152371 00000100:00100000:0.0:1651529344.522876:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+660:39030:x1731745946412544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.522882:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177163 count 1 00010000:00010000:0.0:1651529344.522886:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522890:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 2/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1404 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522893:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522894:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522894:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 4/0,1 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522901:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 3/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1404 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522904:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 4/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1404 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522908:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966626048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.522922:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.522927:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293120 00010000:00010000:0.0:1651529344.522932:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.522958:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11329 00000100:00100000:0.0:1651529344.522959:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1405:41279:x1731746396293120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.522963:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.522964:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522980:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 3/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522986:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0978a80/0xa29a79078f3bb5d2 lrc: 0/0,0 mode: --/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55dd expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.522990:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522990:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522991:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522994:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 4/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523001:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.523013:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1404:41279:x1731746396293120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523016:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11329 00010000:00010000:0.0:1651529344.523023:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523026:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523032:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523034:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523107:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+661:39029:x1731745946412096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1078us (1187us total) trans 30064893231 rc 0/0 00000100:00100000:0.0:1651529344.523110:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152368 00000100:00100000:1.0:1651529344.523115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.523118:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523121:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.523122:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523131:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 3/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523136:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 1/0,0 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523139:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be28e lrc: 0/0,0 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523147:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412800 00000100:00100000:1.0:1651529344.523151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.523164:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412928 00000100:00100000:0.0:1651529344.523172:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152372 00000100:00100000:1.0:1651529344.523174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.523174:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+662:39030:x1731745946412800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.523184:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177164 count 1 00000100:00100000:1.0:1651529344.523186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.523188:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523195:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412864 00010000:00010000:0.0:1651529344.523197:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 2/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.523204:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412992 00000100:00100000:1.0:1651529344.523209:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152373 00000100:00100000:1.0:1651529344.523210:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946412928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.523221:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523222:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523223:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 4/0,1 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.523224:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177166 count 1 00010000:00010000:1.0:1651529344.523228:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523231:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 3/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523233:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 2/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1403 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.523235:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 4/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.523236:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523237:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523238:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 4/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523239:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966626112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.523245:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 3/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1403 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523248:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1403 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.523260:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.523266:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.523269:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.523273:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152374 00000100:00100000:0.0:1651529344.523275:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+664:39029:x1731745946412864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.523276:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152375 00000100:00100000:1.0:1651529344.523277:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041385506 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+664:39029:x1731745946412992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.523280:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177165 count 1 00002000:00080000:1.0:1651529344.523282:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177167 count 1 00010000:00010000:0.0:1651529344.523284:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523286:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523289:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 2/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523290:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 2/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.523292:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523293:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523293:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 4/0,1 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523299:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 3/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523301:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523302:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523303:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 4/0,1 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523303:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 4/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523307:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966626240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.523310:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 3/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1403 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523314:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 4/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523314:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.523318:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966626304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.523325:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.523329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.523341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.523343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.523357:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293248 00010000:00010000:0.0:1651529344.523362:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 4/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1404 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523373:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293184 00010000:00010000:0.0:1651529344.523376:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 4/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523384:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11330 00000100:00100000:1.0:1651529344.523394:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413120 00000100:00100000:0.0:1651529344.523394:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1405:41279:x1731746396293248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.523396:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523398:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 4/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.523406:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152376 00000100:00100000:1.0:1651529344.523407:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+665:39030:x1731745946413120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.523407:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 3/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.523412:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177168 count 1 00010000:00010000:1.0:1651529344.523417:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523422:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 2/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1405 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523425:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523425:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523427:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b6b8bc1/0xa29a79078f3bb8d4 lrc: 0/0,0 mode: --/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6175 expref: 1405 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523432:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523433:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 4/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523433:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523436:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 4/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523440:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 3/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1404 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.523442:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.523444:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 4/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1404 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.523448:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966626368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.523456:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1404:41279:x1731746396293248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523458:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11330 00000100:00100000:1.0:1651529344.523463:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.523464:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11331 00000100:00100000:0.0:1651529344.523465:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41278:x1731746396293184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.523468:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523469:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 4/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523474:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 3/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523478:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052744231/0xa29a79078f3bc052 lrc: 0/0,0 mode: --/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e39 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523482:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523482:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523483:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523486:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 4/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523494:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.523500:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41278:x1731746396293184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523503:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11331 00010000:00010000:1.0:1651529344.523507:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523509:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523511:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523512:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523515:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523515:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523517:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523528:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523570:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+667:39029:x1731745946412224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1535us (1636us total) trans 30064893232 rc 0/0 00000100:00100000:0.0:1651529344.523571:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+667:39030:x1731745946412160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1487us (1604us total) trans 30064893233 rc 0/0 00000100:00100000:1.0:1651529344.523573:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152369 00000100:00100000:0.0:1651529344.523575:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152370 00010000:00010000:1.0:1651529344.523581:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523582:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523586:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c7ba89e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.523587:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523589:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 3/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523594:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.523594:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 1/0,0 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523595:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523597:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be29c lrc: 0/0,0 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523598:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 3/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523603:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 1/0,0 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523606:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be295 lrc: 0/0,0 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523625:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966626048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523629:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.523661:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293632 00010000:00010000:0.0:1651529344.523666:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 4/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1402 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523673:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11332 00000100:00100000:0.0:1651529344.523675:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41279:x1731746396293632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.523677:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523679:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 4/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1402 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523682:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 3/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1402 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523727:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3bafc0 lrc: 0/0,0 mode: --/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d95 expref: 1402 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523759:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523760:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.523761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.523761:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523764:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 4/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.523770:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.523773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.523786:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.523790:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523818:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293952 00000100:00100000:0.0:1651529344.523820:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41279:x1731746396293632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 144us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.523824:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 5/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1402 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523824:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11332 00000100:00100000:1.0:1651529344.523830:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294016 00010000:00010000:1.0:1651529344.523832:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1402 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523835:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294080 00010000:00010000:0.0:1651529344.523839:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 5/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523844:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11333 00000100:00100000:1.0:1651529344.523847:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11334 00000100:00100000:0.0:1651529344.523847:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41279:x1731746396293952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.523848:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41278:x1731746396294080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.523849:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523851:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 5/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.523852:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523853:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 5/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523854:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 4/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.523857:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 4/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1403 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523860:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523860:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523861:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523863:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523864:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523864:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523864:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 4/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523868:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 4/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523869:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.523872:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.523875:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41279:x1731746396293952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523878:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11333 00000100:00100000:1.0:1651529344.523879:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41278:x1731746396294080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523882:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11335 00000100:00100000:1.0:1651529344.523884:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11334 00000100:00100000:0.0:1651529344.523884:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41279:x1731746396294016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.523895:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966626304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.523899:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523911:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523913:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1401 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523917:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 3/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1401 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523923:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d4565d/0xa29a79078f3b94c3 lrc: 0/0,0 mode: --/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd089 expref: 1401 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.523926:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523927:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523928:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523931:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 4/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523939:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.523955:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41279:x1731746396294016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.523956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.523958:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11335 00010000:00010000:0.0:1651529344.523975:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3ba1b2 lrc: 0/0,0 mode: --/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0492 expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.523982:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966626240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.523983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.523985:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523995:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.523995:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524001:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524005:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524008:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.524031:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524035:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524038:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524041:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524068:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+667:39029:x1731745946412864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 791us (897us total) trans 30064893234 rc 0/0 00000100:00100000:0.0:1651529344.524071:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152374 00000100:00100000:0.0:1651529344.524076:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413248 00000100:00100000:0.0:1651529344.524084:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413312 00000100:00100000:0.0:1651529344.524089:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152377 00000100:00100000:0.0:1651529344.524091:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+668:39029:x1731745946413248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.524096:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+668:39030:x1731745946412928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 885us (944us total) trans 30064893235 rc 0/0 00002000:00080000:0.0:1651529344.524096:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177169 count 1 00000100:00100000:1.0:1651529344.524100:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152373 00010000:00010000:0.0:1651529344.524100:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524106:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152378 00000100:00100000:1.0:1651529344.524107:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+667:39030:x1731745946413312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.524112:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177170 count 1 00010000:00010000:0.0:1651529344.524112:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 2/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1398 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524115:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524115:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524116:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524116:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 4/0,1 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524121:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 2/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1398 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524123:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 3/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1398 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524127:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 4/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1398 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.524131:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966626432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.524134:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524134:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524135:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 4/0,1 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524139:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.524143:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 3/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1398 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524145:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524147:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 4/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1398 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524148:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.524149:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524151:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524152:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 3/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524159:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.524166:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 1/0,0 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524168:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966626368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524169:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be2b8 lrc: 0/0,0 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524171:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524174:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524176:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.524177:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524178:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294144 00010000:00010000:0.0:1651529344.524180:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 3/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524182:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 4/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524183:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 1/0,0 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524185:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be2b1 lrc: 0/0,0 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524189:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294208 00010000:00010000:1.0:1651529344.524192:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 4/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1400 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.524197:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11336 00010000:00010000:0.0:1651529344.524197:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001878ea10/0xa29a79078f3b9a3b lrc: 0/0,0 mode: --/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6e0 expref: 1400 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.524201:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966626112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524204:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524206:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1399:41279:x1731746396294144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.524208:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524209:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.524210:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 4/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524210:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524213:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524214:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 3/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524216:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524220:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aebf359/0xa29a79078f3bbdb9 lrc: 0/0,0 mode: --/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73dc expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.524231:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524231:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524232:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524235:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 4/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524241:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.524248:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1398:41279:x1731746396294144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.524250:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11336 00000100:00100000:1.0:1651529344.524255:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11337 00000100:00100000:1.0:1651529344.524256:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1397:41278:x1731746396294208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.524257:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+668:39030:x1731745946412800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1082us (1142us total) trans 30064893236 rc 0/0 00010000:00010000:1.0:1651529344.524259:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.524260:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 4/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.524260:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152372 00010000:00010000:0.0:1651529344.524268:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524271:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524272:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 3/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524274:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524277:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3ba2ca lrc: 0/0,0 mode: --/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d093f expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524277:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524280:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524281:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524282:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524284:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 4/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524290:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.524296:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41278:x1731746396294208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.524299:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11337 00010000:00010000:1.0:1651529344.524307:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524310:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.524310:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+668:39030:x1731745946412544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1432us (1531us total) trans 30064893237 rc 0/0 00010000:00010000:1.0:1651529344.524311:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524313:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152371 00010000:00010000:1.0:1651529344.524314:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 3/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524319:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524323:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.524324:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524325:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 1/0,0 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524326:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 3/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524328:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be2aa lrc: 0/0,0 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524331:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 1/0,0 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524334:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524334:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be2a3 lrc: 0/0,0 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524337:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524340:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524343:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524394:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041385506 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+668:39029:x1731745946412992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1115us (1208us total) trans 30064893238 rc 0/0 00000100:00100000:1.0:1651529344.524397:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152375 00010000:00010000:0.0:1651529344.524419:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524424:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.524425:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524429:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524430:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 3/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524432:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524434:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 1/0,0 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524437:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3be2bf lrc: 0/0,0 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524438:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524441:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524482:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+668:39030:x1731745946413120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1141us total) trans 30064893239 rc 0/0 00000100:00100000:1.0:1651529344.524485:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152376 00010000:00010000:1.0:1651529344.524493:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524496:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a207f8b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.524497:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524500:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 3/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524504:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 1/0,0 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524516:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be2c6 lrc: 0/0,0 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524685:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413824 00000100:00100000:0.0:1651529344.524686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524700:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413952 00000100:00100000:0.0:1651529344.524700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524713:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413888 00000100:00100000:0.0:1651529344.524715:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524725:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414080 00000100:00100000:1.0:1651529344.524738:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152379 00000100:00100000:1.0:1651529344.524740:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+671:39030:x1731745946413824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.524745:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177171 count 1 00000100:00100000:0.0:1651529344.524745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.524749:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524753:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 2/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.524753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.524756:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524757:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524757:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 4/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524759:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414016 00010000:00010000:1.0:1651529344.524764:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 3/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.524765:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414144 00010000:00010000:1.0:1651529344.524768:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 4/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.524768:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152380 00000100:00100000:0.0:1651529344.524769:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+673:39030:x1731745946413952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.524772:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966626560:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.524775:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177173 count 1 00010000:00010000:0.0:1651529344.524779:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524784:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.524784:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 2/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524787:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524788:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524789:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 4/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524790:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152381 00000100:00100000:1.0:1651529344.524792:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+673:39029:x1731745946413888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.524796:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177172 count 1 00010000:00010000:0.0:1651529344.524796:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 3/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524799:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524800:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.524820:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 2/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524823:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524824:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524825:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 4/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524831:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 3/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524835:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 4/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.524839:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966626688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524841:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966626624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.524846:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.524850:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524853:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152382 00000100:00100000:1.0:1651529344.524854:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+673:39030:x1731745946414080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.524857:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152383 00002000:00080000:1.0:1651529344.524859:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177175 count 1 00000100:00100000:0.0:1651529344.524859:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+673:39029:x1731745946414016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.524862:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.524864:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177174 count 1 00010000:00010000:1.0:1651529344.524867:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 2/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524868:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524872:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524872:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 2/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524873:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524873:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 4/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524876:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524876:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524877:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 4/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524879:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 3/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524882:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.524883:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 3/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.524886:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966626752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524890:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 4/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.524892:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.524894:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966626816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524900:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.524906:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152384 00000100:00100000:0.0:1651529344.524907:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+673:39030:x1731745946414144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.524911:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177176 count 1 00010000:00010000:0.0:1651529344.524914:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524918:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 2/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524921:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524922:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524922:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 4/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524936:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1395 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524940:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.524947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.524947:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966626880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524954:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.524972:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966626432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524976:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524984:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294336 00010000:00010000:0.0:1651529344.524988:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 4/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.524995:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294464 00010000:00010000:0.0:1651529344.524998:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 5/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.525008:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11338 00000100:00100000:0.0:1651529344.525010:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1397:41279:x1731746396294336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.525013:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525014:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 4/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525018:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 3/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525023:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bab44 lrc: 0/0,0 mode: --/PR res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bf9 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525040:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11339 00000100:00100000:1.0:1651529344.525043:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396294464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.525043:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525044:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525045:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525046:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.525048:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 5/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525048:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 4/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525052:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 4/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525055:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.525058:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.525068:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396294336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.525069:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525070:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525071:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11338 00010000:00010000:1.0:1651529344.525074:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 4/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525078:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525079:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.525086:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41279:x1731746396294464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.525089:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11339 00010000:00010000:0.0:1651529344.525095:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525098:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525100:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525106:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000636af4d6/0xa29a79078f3bbd9d lrc: 0/0,0 mode: --/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d737a expref: 1394 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525110:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.525114:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525117:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525120:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525123:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525125:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525150:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+674:39029:x1731745946413248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1058us (1194us total) trans 30064893240 rc 0/0 00000100:00100000:0.0:1651529344.525153:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152377 00010000:00010000:0.0:1651529344.525161:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525164:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.525165:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525168:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 3/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525173:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 1/0,0 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525176:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be2cd lrc: 0/0,0 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525177:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+674:39030:x1731745946413312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1069us (1194us total) trans 30064893241 rc 0/0 00010000:00010000:0.0:1651529344.525180:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525181:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152378 00010000:00010000:0.0:1651529344.525183:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000511d1ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.525184:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525187:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 3/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525190:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 1/0,0 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525195:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be2d4 lrc: 0/0,0 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.525434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.525444:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966626624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525449:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.525464:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966626880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.525472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.525472:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.525479:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966626816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525482:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.525494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.525496:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294656 00000100:00100000:1.0:1651529344.525500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.525501:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 5/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1394 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.525507:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294784 00000100:00100000:1.0:1651529344.525508:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966626560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525509:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525513:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525516:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294720 00010000:00010000:0.0:1651529344.525518:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 5/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525520:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966626688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.525522:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294912 00010000:00010000:1.0:1651529344.525523:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525524:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 4/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.525528:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294848 00000100:00100000:1.0:1651529344.525530:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966626752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525530:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1398 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525532:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525534:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294976 00010000:00010000:0.0:1651529344.525536:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525539:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414336 00000100:00100000:0.0:1651529344.525540:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11340 00000100:00100000:0.0:1651529344.525542:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1399:41279:x1731746396294656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.525545:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.525548:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414272 00000100:00100000:1.0:1651529344.525555:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152385 00010000:00010000:0.0:1651529344.525555:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 4/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525556:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+675:39030:x1731745946414336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.525560:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 3/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525565:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000836f3853/0xa29a79078f3bb21a lrc: 0/0,0 mode: --/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46ef expref: 1399 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.525568:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177178 count 1 00010000:00010000:0.0:1651529344.525570:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525570:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525571:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525574:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 4/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525577:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525584:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.525588:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 2/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1398 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525592:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525592:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525593:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 4/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525593:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1398:41279:x1731746396294656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525596:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11340 00010000:00010000:1.0:1651529344.525600:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1397 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.525601:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11341 00000100:00100000:0.0:1651529344.525603:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1397:41279:x1731746396294784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.525604:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 4/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525605:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525607:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525608:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525611:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 3/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525615:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095672ac7/0xa29a79078f3bbc46 lrc: 0/0,0 mode: --/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ed4 expref: 1397 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.525617:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.525619:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525619:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525620:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525623:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 4/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525624:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11342 00000100:00100000:1.0:1651529344.525625:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396294720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.525628:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525629:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.525630:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 4/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525634:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 3/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1396 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.525634:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396294784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525636:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11341 00000100:00100000:0.0:1651529344.525640:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11343 00000100:00100000:0.0:1651529344.525641:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41279:x1731746396294912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.525644:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525645:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 4/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525648:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59f6301/0xa29a79078f3b997e lrc: 0/0,0 mode: --/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3c9 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525649:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 3/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1395 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525652:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525653:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525654:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525654:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0e2e6e7/0xa29a79078f3b9a96 lrc: 0/0,0 mode: --/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce884 expref: 1394 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525657:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 4/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525657:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525657:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525658:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525663:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 4/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525664:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.525669:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.525670:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1393:41279:x1731746396294720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.525673:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11342 00000100:00100000:0.0:1651529344.525674:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1393:41279:x1731746396294912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525676:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11343 00000100:00100000:1.0:1651529344.525679:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11344 00000100:00100000:1.0:1651529344.525680:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1391:41279:x1731746396294848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.525680:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11345 00000100:00100000:0.0:1651529344.525682:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1391:41279:x1731746396294976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.525683:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.525684:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525684:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525685:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525688:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 3/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525689:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.525693:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b92271/0xa29a79078f3ba697 lrc: 0/0,0 mode: --/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19b5 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525694:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c2f476f/0xa29a79078f3bbfe9 lrc: 0/0,0 mode: --/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c79 expref: 1391 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.525697:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525697:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525698:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525701:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 4/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525707:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525707:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525707:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.525708:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525711:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 4/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525711:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41279:x1731746396294976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525714:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11345 00010000:00010000:1.0:1651529344.525717:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.525720:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152386 00000100:00100000:0.0:1651529344.525722:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+675:39030:x1731745946414272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.525723:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1388:41279:x1731746396294848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.525726:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11344 00002000:00080000:0.0:1651529344.525727:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177177 count 1 00010000:00010000:0.0:1651529344.525741:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525742:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525745:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525746:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 2/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1387 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525749:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525749:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525749:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525750:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 4/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525751:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525757:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 3/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1387 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.525760:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1387 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.525764:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966627008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.525772:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.525777:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525781:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525784:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525786:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525793:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+676:39030:x1731745946414080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1077us total) trans 30064893242 rc 0/0 00000100:00100000:1.0:1651529344.525796:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152382 00010000:00010000:1.0:1651529344.525828:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525832:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ba1b787 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.525833:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525836:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 3/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525841:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 1/0,0 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525844:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be2f0 lrc: 0/0,0 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525848:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525849:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+676:39029:x1731745946414016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 988us (1103us total) trans 30064893243 rc 0/0 00010000:00010000:1.0:1651529344.525851:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.525852:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525852:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152383 00010000:00010000:1.0:1651529344.525854:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 3/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525858:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 1/0,0 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525861:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525865:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525868:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525869:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3be2f7 lrc: 0/0,0 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525870:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525875:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525878:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525881:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525884:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525913:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+677:39030:x1731745946414144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1159us total) trans 30064893244 rc 0/0 00000100:00100000:0.0:1651529344.525916:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152384 00010000:00010000:0.0:1651529344.525923:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525924:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+676:39029:x1731745946413888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1131us (1229us total) trans 30064893245 rc 0/0 00010000:00010000:0.0:1651529344.525926:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.525927:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152381 00010000:00010000:0.0:1651529344.525927:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525930:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 3/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525935:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525935:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 1/0,0 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525938:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525938:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3be2fe lrc: 0/0,0 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525941:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525942:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525944:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e471716 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.525945:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525948:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 3/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525953:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525954:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 1/0,0 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525956:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be2e9 lrc: 0/0,0 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525960:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525962:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d26bd014 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.525963:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525966:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 3/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525969:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 1/0,0 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525971:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be2db lrc: 0/0,0 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525977:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525980:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525983:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525986:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525987:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+676:39030:x1731745946413824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1247us (1313us total) trans 30064893246 rc 0/0 00000100:00100000:1.0:1651529344.525990:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152379 00010000:00010000:1.0:1651529344.525997:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526000:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.526001:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526004:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 3/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526008:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 1/0,0 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526011:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3be2e2 lrc: 0/0,0 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526020:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+676:39030:x1731745946413952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1333us total) trans 30064893247 rc 0/0 00000100:00100000:0.0:1651529344.526023:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152380 00000100:00100000:1.0:1651529344.526253:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966626944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.526258:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.526324:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414656 00000100:00100000:0.0:1651529344.526330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.526332:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414592 00000100:00100000:1.0:1651529344.526338:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414784 00000100:00100000:1.0:1651529344.526344:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414720 00000100:00100000:0.0:1651529344.526347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.526349:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414848 00000100:00100000:1.0:1651529344.526352:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152387 00000100:00100000:1.0:1651529344.526354:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+680:39029:x1731745946414656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.526355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.526364:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177180 count 1 00000100:00100000:0.0:1651529344.526365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.526369:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526371:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414912 00010000:00010000:1.0:1651529344.526374:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 2/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526377:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526377:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526378:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 4/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526378:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152388 00000100:00100000:0.0:1651529344.526380:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+681:39030:x1731745946414592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.526385:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 3/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.526385:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177179 count 1 00010000:00010000:1.0:1651529344.526388:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1387 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526390:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526392:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966627072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.526395:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 2/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526400:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526401:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526402:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 4/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526407:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.526416:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 3/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.526421:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152389 00000100:00100000:1.0:1651529344.526423:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+681:39029:x1731745946414784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.526428:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177182 count 1 00010000:00010000:0.0:1651529344.526431:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 4/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1387 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.526432:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526436:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966627136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.526437:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 2/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1387 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526440:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526440:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526441:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 4/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526445:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.526447:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 3/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1387 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526451:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 4/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1387 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.526452:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152390 00000100:00100000:0.0:1651529344.526454:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+681:39030:x1731745946414720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.526455:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966627200:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.526459:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177181 count 1 00000100:00100000:1.0:1651529344.526463:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.526463:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526467:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 2/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.526469:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152391 00010000:00010000:0.0:1651529344.526470:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.526471:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+681:39030:x1731745946414848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.526471:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526471:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 4/0,1 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.526475:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177183 count 1 00010000:00010000:1.0:1651529344.526478:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526480:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 3/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526484:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 4/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1387 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.526487:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966627264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.526492:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 2/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.526494:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.526495:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526496:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526497:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 4/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526501:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966627008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.526504:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 3/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526505:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526507:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1387 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.526511:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966627328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.526512:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152392 00000100:00100000:0.0:1651529344.526513:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+681:39029:x1731745946414912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.526518:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177184 count 1 00000100:00100000:1.0:1651529344.526519:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.526521:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526525:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295552 00010000:00010000:0.0:1651529344.526525:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 2/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1387 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526528:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526528:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526529:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 4/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1388 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526529:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 4/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526537:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295616 00010000:00010000:0.0:1651529344.526537:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1388 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526539:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1389 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526541:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1389 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.526545:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966627392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.526549:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11346 00000100:00100000:1.0:1651529344.526551:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41278:x1731746396295552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.526560:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.526560:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.526561:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 4/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.526565:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.526569:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11347 00000100:00100000:0.0:1651529344.526570:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41278:x1731746396295616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.526571:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007349d406/0xa29a79078f3bbb90 lrc: 0/0,0 mode: --/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6be0 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526573:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.526575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526575:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1388 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.526576:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526579:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 4/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526579:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 3/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1388 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526585:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034e7933c/0xa29a79078f3b94b5 lrc: 0/0,0 mode: --/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd04a expref: 1388 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.526586:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.526588:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526589:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526590:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526593:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1387:41278:x1731746396295552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.526595:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11346 00010000:00010000:0.0:1651529344.526595:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 4/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526601:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.526607:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526607:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1386:41278:x1731746396295616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.526610:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11347 00010000:00010000:1.0:1651529344.526611:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526616:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526617:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526619:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526620:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526623:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526633:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526679:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+683:39030:x1731745946414336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1256us total) trans 30064893248 rc 0/0 00000100:00100000:0.0:1651529344.526680:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+683:39030:x1731745946414272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 957us (1246us total) trans 30064893249 rc 0/0 00000100:00100000:1.0:1651529344.526682:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152385 00000100:00100000:0.0:1651529344.526684:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152386 00010000:00010000:1.0:1651529344.526690:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526692:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526693:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df1d0290 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.526694:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526695:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.526696:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526697:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 3/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526699:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 3/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526702:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 1/0,0 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526704:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 1/0,0 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526705:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be305 lrc: 0/0,0 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526707:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be30c lrc: 0/0,0 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.526912:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415488 00000100:00100000:0.0:1651529344.526912:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415552 00000100:00100000:1.0:1651529344.526924:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152393 00000100:00100000:1.0:1651529344.526925:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+683:39029:x1731745946415488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.526930:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152394 00002000:00080000:1.0:1651529344.526931:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177185 count 1 00000100:00100000:0.0:1651529344.526932:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+683:39030:x1731745946415552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.526935:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.526937:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177186 count 1 00010000:00010000:1.0:1651529344.526940:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 2/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1385 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526943:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526944:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526945:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 4/0,1 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526950:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526951:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 3/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1385 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526955:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 4/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1385 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.526955:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 2/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1385 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526958:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.526959:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966627456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.526959:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526959:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 4/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526969:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 3/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1385 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.526970:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.526973:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1385 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.526977:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966627520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.526986:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.527079:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966627072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527088:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527096:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966627200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.527098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.527099:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527103:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527111:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295744 00000100:00100000:0.0:1651529344.527113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.527121:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 5/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1386 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.527124:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966627136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.527128:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295680 00010000:00010000:0.0:1651529344.527129:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527130:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1387 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.527134:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295872 00010000:00010000:1.0:1651529344.527136:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 4/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1388 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.527136:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966627264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.527138:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527140:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295808 00010000:00010000:1.0:1651529344.527142:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 4/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.527145:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11348 00000100:00100000:0.0:1651529344.527147:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41278:x1731746396295744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.527148:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11349 00000100:00100000:1.0:1651529344.527149:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41279:x1731746396295680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.527150:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527152:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.527152:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 4/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527153:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527156:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 3/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527157:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 3/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527161:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3ba031 lrc: 0/0,0 mode: --/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe8e expref: 1389 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527165:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bad5f lrc: 0/0,0 mode: --/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34a4 expref: 1388 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527165:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527166:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527167:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527169:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527170:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527170:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 4/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527171:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527174:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 4/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527176:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.527180:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.527187:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1387:41278:x1731746396295744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.527191:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11348 00000100:00100000:1.0:1651529344.527194:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1386:41279:x1731746396295680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.527197:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11350 00000100:00100000:1.0:1651529344.527199:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11349 00000100:00100000:0.0:1651529344.527199:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1386:41278:x1731746396295872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.527202:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.527204:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11351 00010000:00010000:0.0:1651529344.527204:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 4/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1385 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.527206:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1385:41279:x1731746396295808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527208:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527210:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 4/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1385 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527210:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 3/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1385 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527214:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 3/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1385 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527215:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b6899d4/0xa29a79078f3b9882 lrc: 0/0,0 mode: --/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfee expref: 1385 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527218:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527219:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000914e0c32/0xa29a79078f3bb880 lrc: 0/0,0 mode: --/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6025 expref: 1384 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527219:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527220:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527223:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 4/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527225:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527226:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527226:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527230:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.527235:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 4/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527236:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396295872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.527239:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11350 00010000:00010000:1.0:1651529344.527244:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.527250:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1382:41279:x1731746396295808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.527251:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527253:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11351 00010000:00010000:0.0:1651529344.527255:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527258:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527260:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527264:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527267:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527269:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 2/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527271:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527321:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+685:39029:x1731745946414784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 897us (1027us total) trans 30064893250 rc 0/0 00000100:00100000:1.0:1651529344.527324:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152389 00000100:00100000:0.0:1651529344.527328:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+684:39030:x1731745946414720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 872us (1028us total) trans 30064893251 rc 0/0 00000100:00100000:0.0:1651529344.527331:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152390 00010000:00010000:1.0:1651529344.527332:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 2/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527336:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000213da448 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.527337:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 2/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527338:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527340:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 3/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527342:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.527343:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527345:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 1/0,0 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527346:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 3/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527347:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be321 lrc: 0/0,0 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527351:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 1/0,0 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527353:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527353:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be328 lrc: 0/0,0 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527356:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527359:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527360:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527362:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527363:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527366:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527375:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527406:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+685:39029:x1731745946414656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1050us (1127us total) trans 30064893252 rc 0/0 00000100:00100000:1.0:1651529344.527409:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152387 00000100:00100000:0.0:1651529344.527415:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+684:39030:x1731745946414592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1034us (1126us total) trans 30064893253 rc 0/0 00010000:00010000:1.0:1651529344.527416:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527418:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152388 00010000:00010000:1.0:1651529344.527419:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db78a802 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.527420:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527423:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 3/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527426:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527427:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 1/0,0 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527429:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.527430:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be313 lrc: 0/0,0 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527430:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527433:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 3/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527437:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 1/0,0 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527440:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be31a lrc: 0/0,0 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527510:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966627392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.527515:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.527552:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966627520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.527556:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527570:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966627328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.527570:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295936 00010000:00010000:1.0:1651529344.527575:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527575:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1382 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.527581:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296128 00000100:00100000:1.0:1651529344.527582:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296448 00010000:00010000:0.0:1651529344.527583:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1384 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527586:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 5/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1384 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.527588:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296576 00010000:00010000:0.0:1651529344.527590:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1385 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.527592:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11352 00000100:00100000:1.0:1651529344.527594:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1385:41279:x1731746396295936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.527595:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11353 00010000:00010000:1.0:1651529344.527597:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.527597:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1385:41279:x1731746396296128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527599:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1385 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527600:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.527601:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1385 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527603:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 3/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1385 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527605:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1385 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527608:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000970affc/0xa29a79078f3bb347 lrc: 0/0,0 mode: --/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c1a expref: 1385 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527611:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3b8d8b lrc: 0/0,0 mode: --/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc39a expref: 1384 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527612:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527612:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527613:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527615:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527615:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527616:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 4/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527616:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527619:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 4/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527622:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.527626:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.527634:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41279:x1731746396295936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527637:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11352 00000100:00100000:1.0:1651529344.527642:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11354 00000100:00100000:1.0:1651529344.527657:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1382:41279:x1731746396296448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.527657:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1382:41279:x1731746396296128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.527660:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.527660:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11353 00010000:00010000:1.0:1651529344.527662:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 5/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1382 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527666:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 4/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1382 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527671:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527672:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527673:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527676:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 4/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527680:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.527680:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11355 00000100:00100000:0.0:1651529344.527682:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1381:41279:x1731746396296576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.527684:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.527686:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1381:41279:x1731746396296448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.527686:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1381 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.527688:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11354 00010000:00010000:0.0:1651529344.527690:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 3/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1381 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.527695:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd13c23/0xa29a79078f3b8c65 lrc: 0/0,0 mode: --/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc30e expref: 1380 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.527698:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d4a516b/0xa29a79078f3b9468 lrc: 0/0,0 mode: --/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf24 expref: 1380 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.527702:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966627456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.527702:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527702:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527703:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527705:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527706:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 4/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527713:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.527719:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527719:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1378:41279:x1731746396296576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.527722:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527722:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11355 00010000:00010000:1.0:1651529344.527725:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527728:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527728:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527747:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527750:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527753:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527786:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+685:39029:x1731745946415488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 859us (892us total) trans 30064893254 rc 0/0 00000100:00100000:1.0:1651529344.527789:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152393 00010000:00010000:1.0:1651529344.527797:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527797:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+684:39030:x1731745946415552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 864us (894us total) trans 30064893255 rc 0/0 00010000:00010000:1.0:1651529344.527800:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e76bff1f already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.527800:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152394 00010000:00010000:1.0:1651529344.527801:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527820:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 3/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527824:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 1/0,0 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527826:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527830:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.527831:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527834:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be33d lrc: 0/0,0 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527834:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 3/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527839:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 1/0,0 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527841:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527841:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be344 lrc: 0/0,0 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527844:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527847:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527847:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527850:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527850:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527853:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527862:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527895:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+685:39030:x1731745946414848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1423us (1552us total) trans 30064893256 rc 0/0 00000100:00100000:1.0:1651529344.527898:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152391 00000100:00100000:0.0:1651529344.527902:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+684:39029:x1731745946414912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1388us (1537us total) trans 30064893257 rc 0/0 00010000:00010000:1.0:1651529344.527905:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527906:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152392 00010000:00010000:1.0:1651529344.527908:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349b2dd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.527909:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527912:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 3/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527913:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.527917:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527920:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 3/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527925:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 1/0,0 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527926:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 1/0,0 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527927:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be336 lrc: 0/0,0 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527929:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be32f lrc: 0/0,0 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.527975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.527987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528000:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415680 00000100:00100000:0.0:1651529344.528016:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415616 00000100:00100000:0.0:1651529344.528020:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415744 00000100:00100000:0.0:1651529344.528026:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152395 00000100:00100000:0.0:1651529344.528028:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+686:39029:x1731745946415680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.528034:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177188 count 1 00000100:00100000:1.0:1651529344.528038:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152396 00010000:00010000:0.0:1651529344.528038:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528041:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+686:39030:x1731745946415616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.528043:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 2/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.528046:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177187 count 1 00010000:00010000:0.0:1651529344.528046:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528047:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528047:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 4/0,1 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528050:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528055:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 2/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1377 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528058:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528059:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528059:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 4/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528066:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 3/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1377 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528070:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1377 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528072:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 3/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528076:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 4/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.528081:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966627648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528086:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966627584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528096:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528102:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528103:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152397 00000100:00100000:0.0:1651529344.528105:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+686:39030:x1731745946415744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.528110:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177189 count 1 00010000:00010000:0.0:1651529344.528114:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528118:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 2/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528121:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528129:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528130:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 4/0,1 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528152:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 3/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528156:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 4/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.528160:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966627712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528174:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528229:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415808 00000100:00100000:0.0:1651529344.528229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528243:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415936 00000100:00100000:0.0:1651529344.528244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528267:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415872 00000100:00100000:1.0:1651529344.528273:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416000 00000100:00100000:1.0:1651529344.528276:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416064 00000100:00100000:1.0:1651529344.528279:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152398 00000100:00100000:1.0:1651529344.528281:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+691:39029:x1731745946415808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.528282:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152399 00000100:00100000:0.0:1651529344.528284:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+691:39029:x1731745946415936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.528286:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177190 count 1 00010000:00010000:1.0:1651529344.528290:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.528290:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177192 count 1 00010000:00010000:0.0:1651529344.528294:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528295:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 2/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528298:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528299:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528299:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 4/0,1 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528299:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 2/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528302:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528302:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528303:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 4/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528306:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 3/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528309:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 4/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528310:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 3/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528314:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.528324:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966627776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528334:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966627840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528344:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528350:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528351:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152400 00000100:00100000:1.0:1651529344.528353:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+691:39030:x1731745946415872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.528356:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152401 00002000:00080000:1.0:1651529344.528357:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177191 count 1 00000100:00100000:0.0:1651529344.528358:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+691:39029:x1731745946416000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.528361:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.528362:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177193 count 1 00010000:00010000:1.0:1651529344.528365:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 2/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528366:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528368:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528369:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528370:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 4/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528370:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 2/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528373:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528374:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528375:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 4/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528376:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 3/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528379:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528381:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 3/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1377 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.528383:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966627904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.528387:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.528390:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528391:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966627968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528396:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152402 00000100:00100000:0.0:1651529344.528398:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528405:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+691:39030:x1731745946416064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.528410:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177194 count 1 00010000:00010000:1.0:1651529344.528413:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528417:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 2/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1377 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528421:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528421:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528422:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 4/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528428:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 3/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1377 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528432:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1377 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.528436:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528443:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.528476:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966627584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.528481:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.528488:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296768 00010000:00010000:1.0:1651529344.528492:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1378 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.528492:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966627712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.528497:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528504:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296704 00000100:00100000:1.0:1651529344.528509:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296832 00010000:00010000:0.0:1651529344.528509:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 5/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1379 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.528512:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 4/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1380 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.528515:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11356 00000100:00100000:0.0:1651529344.528517:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396296768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.528518:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11357 00000100:00100000:1.0:1651529344.528520:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396296704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.528520:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.528521:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1380 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.528523:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.528524:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 5/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1380 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528525:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 3/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1380 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.528528:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 4/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1380 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528533:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3b9652 lrc: 0/0,0 mode: --/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd751 expref: 1380 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.528534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528535:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528537:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528538:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 4/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528538:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528539:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528542:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 4/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528543:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.528551:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.528556:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1379:41278:x1731746396296704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.528559:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11357 00000100:00100000:0.0:1651529344.528559:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1379:41278:x1731746396296768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.528562:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11356 00000100:00100000:1.0:1651529344.528565:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11358 00000100:00100000:1.0:1651529344.528574:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1377:41279:x1731746396296832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.528577:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.528578:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 4/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528580:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a9ba12/0xa29a79078f3bba71 lrc: 0/0,0 mode: --/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6780 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.528582:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 3/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.528584:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966627648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.528587:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070aadaeb/0xa29a79078f3b9ca3 lrc: 0/0,0 mode: --/PR res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0b8 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528587:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528590:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528591:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528592:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528593:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528593:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528595:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 4/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528597:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528599:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528604:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.528611:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41279:x1731746396296832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.528614:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11358 00010000:00010000:1.0:1651529344.528621:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528624:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528636:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528639:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528653:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+692:39029:x1731745946415680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 624us (694us total) trans 30064893258 rc 0/0 00000100:00100000:0.0:1651529344.528656:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152395 00010000:00010000:0.0:1651529344.528663:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528666:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.528667:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528670:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 3/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528675:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 1/0,0 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528678:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be34b lrc: 0/0,0 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528681:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+692:39030:x1731745946415616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 640us (706us total) trans 30064893259 rc 0/0 00010000:00010000:0.0:1651529344.528682:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528685:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152396 00010000:00010000:0.0:1651529344.528686:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a207f8b0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.528686:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528689:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 3/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528692:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 1/0,0 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528695:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be352 lrc: 0/0,0 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528701:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528704:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528706:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528709:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528759:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+692:39030:x1731745946415744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 652us (771us total) trans 30064893260 rc 0/0 00000100:00100000:0.0:1651529344.528770:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152397 00010000:00010000:1.0:1651529344.528798:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528823:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.528825:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528828:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 3/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528833:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 1/0,0 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528836:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be359 lrc: 0/0,0 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528906:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416640 00000100:00100000:1.0:1651529344.528914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528927:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416704 00000100:00100000:1.0:1651529344.528930:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152403 00000100:00100000:1.0:1651529344.528932:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+693:39030:x1731745946416640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.528938:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177195 count 1 00000100:00100000:0.0:1651529344.528945:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152404 00010000:00010000:1.0:1651529344.528949:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528954:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 2/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.528956:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000056f5674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+693:39030:x1731745946416704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.528957:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528958:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528958:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 4/0,1 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.528962:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177196 count 1 00010000:00010000:1.0:1651529344.528966:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 3/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528966:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528969:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 4/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1374 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.528971:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 2/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.528973:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966628096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528982:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.528985:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528985:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528986:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 4/0,1 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528990:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966627776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.528994:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528994:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 3/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528998:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 4/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1374 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529002:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966628160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.529011:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.529035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.529069:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966627840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.529086:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529087:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966627904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.529092:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529095:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966627968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.529098:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529104:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416768 00000100:00100000:0.0:1651529344.529112:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152405 00000100:00100000:0.0:1651529344.529113:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+694:39030:x1731745946416768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.529118:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177197 count 1 00010000:00010000:0.0:1651529344.529122:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529126:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 2/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.529129:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529130:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529131:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 4/0,1 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529137:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 3/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1374 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.529140:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 4/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1374 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529147:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.529158:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.529622:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.529635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.529646:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.529650:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529652:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297088 00000100:00100000:1.0:1651529344.529657:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297024 00010000:00010000:1.0:1651529344.529662:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 4/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529667:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.529669:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11359 00000100:00100000:1.0:1651529344.529671:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41279:x1731746396297024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.529674:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.529675:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 4/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529676:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11360 00000100:00100000:0.0:1651529344.529678:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41279:x1731746396297088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.529679:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 3/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529681:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.529683:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.529684:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b223a61e/0xa29a79078f3bab21 lrc: 0/0,0 mode: --/PR res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b97 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529687:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 3/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.529689:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529689:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529690:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529693:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 4/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529693:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529f6375/0xa29a79078f3baebd lrc: 0/0,0 mode: --/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3974 expref: 1375 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529696:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529697:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529698:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529699:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.529701:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 4/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529707:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41279:x1731746396297024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.529710:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11359 00010000:00010000:0.0:1651529344.529710:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.529716:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529717:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1373:41279:x1731746396297088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.529720:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529720:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11360 00010000:00010000:1.0:1651529344.529723:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529725:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529748:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529752:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529755:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529758:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529775:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+695:39029:x1731745946415808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1493us (1562us total) trans 30064893261 rc 0/0 00000100:00100000:1.0:1651529344.529778:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152398 00000100:00100000:0.0:1651529344.529799:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+695:39029:x1731745946415936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1515us (1578us total) trans 30064893262 rc 0/0 00000100:00100000:1.0:1651529344.529802:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.529822:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152399 00010000:00010000:0.0:1651529344.529836:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529839:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.529841:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529843:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529850:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 3/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529856:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 1/0,0 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529859:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be360 lrc: 0/0,0 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529863:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529866:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.529866:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529869:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 3/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529872:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 1/0,0 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529875:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be367 lrc: 0/0,0 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529883:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297152 00010000:00010000:0.0:1651529344.529896:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1373 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529906:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297216 00010000:00010000:0.0:1651529344.529909:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1374 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529913:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297280 00010000:00010000:0.0:1651529344.529915:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1375 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529930:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11361 00000100:00100000:1.0:1651529344.529931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.529932:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41279:x1731746396297152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.529935:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.529936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529937:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1375 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529940:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 3/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1375 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.529941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529946:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6cfa98c/0xa29a79078f3b9d36 lrc: 0/0,0 mode: --/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2fd expref: 1375 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.529948:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297728 00010000:00010000:0.0:1651529344.529950:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529950:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529951:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529953:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 5/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1375 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.529959:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297792 00010000:00010000:1.0:1651529344.529961:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 5/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529963:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 4/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529965:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297856 00010000:00010000:1.0:1651529344.529967:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 5/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1377 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529972:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.529978:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11362 00000100:00100000:1.0:1651529344.529980:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1377:41279:x1731746396297216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.529983:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1377:41279:x1731746396297152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.529986:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11361 00010000:00010000:1.0:1651529344.529988:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.529990:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.529991:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11363 00000100:00100000:0.0:1651529344.529993:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41278:x1731746396297280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.529994:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 3/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.529996:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.529997:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1376 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530000:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084a87ee/0xa29a79078f3b9e2b lrc: 0/0,0 mode: --/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf72c expref: 1376 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.530001:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 3/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1376 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530004:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530005:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530006:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530006:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3b961a lrc: 0/0,0 mode: --/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd69b expref: 1375 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530009:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 4/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530010:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530010:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530011:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530014:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 4/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530018:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.530026:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41279:x1731746396297216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.530029:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.530035:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11362 00000100:00100000:0.0:1651529344.530035:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41278:x1731746396297280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.530038:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11363 00000100:00100000:1.0:1651529344.530040:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11364 00000100:00100000:1.0:1651529344.530042:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396297728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.530043:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11365 00010000:00010000:1.0:1651529344.530044:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.530045:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396297792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.530046:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 5/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1372 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.530047:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.530049:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 5/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1372 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530050:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 4/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1372 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.530053:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 4/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1372 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530055:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530055:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530056:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530058:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530058:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530059:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530061:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 4/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530062:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 4/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530066:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.530066:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.530070:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396297792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.530072:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396297728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.530072:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11365 00000100:00100000:1.0:1651529344.530074:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11364 00000100:00100000:0.0:1651529344.530076:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11366 00000100:00100000:0.0:1651529344.530078:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1370:41279:x1731746396297856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.530080:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.530081:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 5/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1370 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530084:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba27647/0xa29a79078f3baba6 lrc: 0/0,0 mode: --/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d2d expref: 1370 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.530085:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 4/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1370 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.530088:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966628096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530089:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530090:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530091:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530091:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530093:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 4/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530095:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530097:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530097:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.530100:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530103:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530119:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41279:x1731746396297856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.530122:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11366 00010000:00010000:0.0:1651529344.530130:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530133:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530136:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530142:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530157:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+695:39030:x1731745946416640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1224us (1281us total) trans 30064893263 rc 0/0 00000100:00100000:1.0:1651529344.530160:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152403 00010000:00010000:1.0:1651529344.530168:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530172:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530175:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530178:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530182:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+695:39029:x1731745946416000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1824us (1944us total) trans 30064893264 rc 0/0 00000100:00100000:0.0:1651529344.530194:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152401 00010000:00010000:0.0:1651529344.530201:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530204:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.530205:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530208:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 3/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530213:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 1/0,0 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530216:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+695:39030:x1731745946415872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1862us (1986us total) trans 30064893265 rc 0/0 00010000:00010000:0.0:1651529344.530216:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be383 lrc: 0/0,0 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530219:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152400 00010000:00010000:0.0:1651529344.530220:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530223:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.530224:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530226:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530227:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 3/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530230:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530230:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 1/0,0 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530232:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be375 lrc: 0/0,0 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530233:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530236:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530238:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.530239:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530242:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 3/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530245:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 1/0,0 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530246:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530248:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be36e lrc: 0/0,0 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530262:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530265:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c7ba89e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.530266:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530269:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 3/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530272:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 1/0,0 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530274:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be37c lrc: 0/0,0 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530278:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+695:39030:x1731745946416064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1872us (2033us total) trans 30064893266 rc 0/0 00000100:00100000:1.0:1651529344.530281:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152402 00010000:00010000:0.0:1651529344.530284:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e5f812/0xa29a79078f3ba7a8 lrc: 0/0,0 mode: --/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e5b expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.530288:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530291:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530294:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.530305:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530308:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.530311:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530349:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+695:39030:x1731745946416768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1235us (1314us total) trans 30064893267 rc 0/0 00000100:00100000:0.0:1651529344.530352:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152405 00000100:00100000:0.0:1651529344.530358:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417024 00000100:00100000:0.0:1651529344.530364:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416960 00000100:00100000:0.0:1651529344.530372:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152406 00000100:00100000:0.0:1651529344.530374:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+696:39030:x1731745946417024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.530378:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177199 count 1 00010000:00010000:0.0:1651529344.530383:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530387:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 2/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530391:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530391:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530392:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 4/0,1 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530420:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152407 00000100:00100000:1.0:1651529344.530422:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+696:39030:x1731745946416960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.530427:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177198 count 1 00010000:00010000:1.0:1651529344.530432:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530433:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 3/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530436:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 2/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530438:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 4/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1367 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530440:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530440:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530441:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 4/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530442:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.530448:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530451:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1367 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.530456:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.530465:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a662577/0xa29a79078f3bb88e lrc: 0/0,0 mode: --/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6041 expref: 1367 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.530468:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530469:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966628160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530473:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530476:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530478:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.530479:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530482:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530484:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530522:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530529:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000056f5674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+697:39030:x1731745946416704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1572us (1615us total) trans 30064893268 rc 0/0 00010000:00010000:1.0:1651529344.530531:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.530532:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530532:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152404 00010000:00010000:1.0:1651529344.530535:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 3/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530540:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 1/0,0 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530543:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be391 lrc: 0/0,0 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530547:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530550:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.530551:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530554:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 3/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530565:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 1/0,0 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530568:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be38a lrc: 0/0,0 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530645:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.530656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.530665:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.530671:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.530678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.530680:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417472 00000100:00100000:1.0:1651529344.530695:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417600 00000100:00100000:0.0:1651529344.530700:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417536 00000100:00100000:0.0:1651529344.530705:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417728 00000100:00100000:1.0:1651529344.530710:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417664 00000100:00100000:0.0:1651529344.530738:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152408 00000100:00100000:1.0:1651529344.530741:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152409 00000100:00100000:0.0:1651529344.530741:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+701:39029:x1731745946417472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.530743:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+701:39030:x1731745946417536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.530746:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177200 count 1 00002000:00080000:1.0:1651529344.530749:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177201 count 1 00010000:00010000:0.0:1651529344.530751:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530753:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530756:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 2/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530758:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 2/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530759:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530759:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530760:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 4/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530761:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530761:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530762:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 4/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530767:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 3/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530771:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.530772:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 3/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530776:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 4/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.530778:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966628416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.530780:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966628480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530787:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.530789:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.530794:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152410 00000100:00100000:1.0:1651529344.530796:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152411 00000100:00100000:0.0:1651529344.530796:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+701:39029:x1731745946417600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.530798:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+701:39029:x1731745946417728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.530800:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177202 count 1 00002000:00080000:1.0:1651529344.530818:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177204 count 1 00010000:00010000:1.0:1651529344.530822:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530822:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530827:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 2/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530830:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530831:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530831:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 4/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530838:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 3/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530841:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 4/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.530845:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966628544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530848:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 2/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530852:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530852:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530853:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 4/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530860:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 3/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.530861:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.530864:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.530868:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152412 00000100:00100000:0.0:1651529344.530868:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966628608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.530869:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+701:39030:x1731745946417664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.530874:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177203 count 1 00000100:00100000:0.0:1651529344.530876:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.530877:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530882:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 2/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1366 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530884:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530885:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530886:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 4/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530890:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.530892:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 3/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1366 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530894:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530895:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 4/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1366 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.530899:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966628672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.530906:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.530911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.530931:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.530936:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530954:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417920 00000100:00100000:0.0:1651529344.530962:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152413 00000100:00100000:0.0:1651529344.530964:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+702:39030:x1731745946417920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.530969:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177205 count 1 00010000:00010000:0.0:1651529344.530974:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530978:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 2/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530981:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530982:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530983:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 4/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.530989:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1366 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530992:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.531001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531004:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966628736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531008:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298112 00010000:00010000:1.0:1651529344.531014:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 4/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1367 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.531014:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.531024:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298176 00010000:00010000:1.0:1651529344.531027:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.531030:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11367 00000100:00100000:0.0:1651529344.531032:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1368:41279:x1731746396298112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.531034:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11368 00010000:00010000:0.0:1651529344.531035:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.531036:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1368:41278:x1731746396298176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.531037:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 4/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531039:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.531040:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531041:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 3/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531044:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531047:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5bfb8a3/0xa29a79078f3b9b06 lrc: 0/0,0 mode: --/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea60 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531049:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3bafc7 lrc: 0/0,0 mode: --/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ddb expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531050:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531051:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531052:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531053:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531054:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531055:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531055:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 4/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531058:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 4/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531061:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.531064:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531067:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1366:41279:x1731746396298112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531070:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11367 00000100:00100000:1.0:1651529344.531071:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1366:41278:x1731746396298176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.531074:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11368 00010000:00010000:1.0:1651529344.531081:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531081:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531084:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531085:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531087:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531088:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531090:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531091:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531140:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+704:39030:x1731745946416960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 718us (830us total) trans 30064893269 rc 0/0 00000100:00100000:1.0:1651529344.531144:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152407 00010000:00010000:1.0:1651529344.531150:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531156:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.531158:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531160:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 3/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531160:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+703:39030:x1731745946417024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 786us (863us total) trans 30064893270 rc 0/0 00000100:00100000:0.0:1651529344.531164:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152406 00010000:00010000:1.0:1651529344.531165:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 1/0,0 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531168:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be39f lrc: 0/0,0 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531171:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531175:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.531176:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531179:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 3/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531184:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 1/0,0 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531186:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be398 lrc: 0/0,0 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531303:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966628416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531308:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531324:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966628480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.531329:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.531360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.531373:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418048 00000100:00100000:1.0:1651529344.531378:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418112 00000100:00100000:0.0:1651529344.531381:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152414 00000100:00100000:0.0:1651529344.531382:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+704:39030:x1731745946418048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.531390:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152415 00000100:00100000:1.0:1651529344.531392:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+704:39029:x1731745946418112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.531393:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177206 count 1 00002000:00080000:1.0:1651529344.531397:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177207 count 1 00010000:00010000:0.0:1651529344.531398:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531401:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531403:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 2/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.531406:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 2/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.531406:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531406:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531407:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 4/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531409:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531410:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531410:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 4/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531414:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.531417:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 3/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.531417:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1364 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531421:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1364 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.531421:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531425:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531443:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.531450:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.531501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531512:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966628608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.531517:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.531529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531532:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298688 00010000:00010000:0.0:1651529344.531537:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1365 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.531542:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298816 00010000:00010000:0.0:1651529344.531545:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 5/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1366 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.531546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531549:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298944 00010000:00010000:0.0:1651529344.531551:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 5/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1367 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.531555:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298752 00010000:00010000:0.0:1651529344.531557:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 4/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.531561:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966628544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.531561:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298880 00010000:00010000:0.0:1651529344.531563:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1369 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531566:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531567:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11369 00000100:00100000:0.0:1651529344.531569:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41279:x1731746396298688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.531573:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966628672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531573:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531574:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1369 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531576:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531578:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 3/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1369 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531583:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e27128/0xa29a79078f3ba79a lrc: 0/0,0 mode: --/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e1c expref: 1369 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.531585:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11370 00000100:00100000:1.0:1651529344.531587:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1368:41278:x1731746396298816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.531587:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531588:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531588:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531590:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531591:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 4/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531592:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 4/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531596:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 3/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531602:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e2efc6e/0xa29a79078f3baefc lrc: 0/0,0 mode: --/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a62 expref: 1368 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531606:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531606:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531607:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531615:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.531617:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 4/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531623:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1367:41279:x1731746396298688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.531624:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531626:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11369 00000100:00100000:1.0:1651529344.531631:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1366:41278:x1731746396298816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531631:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11371 00000100:00100000:0.0:1651529344.531633:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1366:41278:x1731746396298944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.531634:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11370 00010000:00010000:0.0:1651529344.531636:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531637:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 4/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1365 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.531640:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11372 00000100:00100000:1.0:1651529344.531641:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1365:41278:x1731746396298752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.531644:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531644:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 3/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1365 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531646:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 4/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1365 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531649:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 3/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1365 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531649:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a37f5cf/0xa29a79078f3bc426 lrc: 0/0,0 mode: --/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d9e expref: 1365 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531652:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531654:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088254477/0xa29a79078f3b9bed lrc: 0/0,0 mode: --/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced8c expref: 1364 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531654:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531657:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 4/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531658:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531659:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531659:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531662:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 4/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531665:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531671:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1363:41278:x1731746396298944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.531674:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531674:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11371 00000100:00100000:0.0:1651529344.531678:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11373 00000100:00100000:0.0:1651529344.531679:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41278:x1731746396298880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.531680:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41278:x1731746396298752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.531682:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.531683:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11372 00010000:00010000:0.0:1651529344.531683:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1362 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531687:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 3/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1361 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.531690:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531694:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531701:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f8baf06/0xa29a79078f3bb626 lrc: 0/0,0 mode: --/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5718 expref: 1361 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.531704:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531705:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531706:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531708:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531711:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531727:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 4/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531744:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531751:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41278:x1731746396298880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531754:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11373 00010000:00010000:0.0:1651529344.531762:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531765:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.531766:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531768:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+705:39030:x1731745946417536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1024us (1103us total) trans 30064893271 rc 0/0 00010000:00010000:0.0:1651529344.531769:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 3/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531771:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152409 00010000:00010000:0.0:1651529344.531774:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 1/0,0 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531779:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531779:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be3ad lrc: 0/0,0 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531783:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531785:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531786:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531788:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531788:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531791:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531794:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531844:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+706:39030:x1731745946417664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 974us (1165us total) trans 30064893272 rc 0/0 00000100:00100000:1.0:1651529344.531847:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152412 00010000:00010000:1.0:1651529344.531855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531865:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+705:39029:x1731745946417600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1068us (1208us total) trans 30064893273 rc 0/0 00010000:00010000:1.0:1651529344.531868:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.531868:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152410 00010000:00010000:1.0:1651529344.531869:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531872:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 3/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531876:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531877:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 1/0,0 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531879:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.531880:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be3c2 lrc: 0/0,0 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531880:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531883:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 3/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531886:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531889:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531892:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531895:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531896:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 1/0,0 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531899:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be3b4 lrc: 0/0,0 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531910:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531912:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.531913:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531916:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 3/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531920:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 1/0,0 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531922:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be3bb lrc: 0/0,0 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531928:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531931:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531935:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531937:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531940:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+705:39029:x1731745946417728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1268us total) trans 30064893274 rc 0/0 00000100:00100000:1.0:1651529344.531952:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152411 00010000:00010000:1.0:1651529344.531959:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531963:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.531964:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531966:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 3/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531971:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 1/0,0 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531974:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be3a6 lrc: 0/0,0 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531977:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+705:39029:x1731745946417472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1333us total) trans 30064893275 rc 0/0 00000100:00100000:0.0:1651529344.531980:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152408 00000100:00100000:0.0:1651529344.532011:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966628736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532015:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.532052:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299072 00010000:00010000:0.0:1651529344.532058:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.532066:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11374 00000100:00100000:0.0:1651529344.532067:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41278:x1731746396299072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.532070:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.532071:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532075:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532081:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040b3c57b/0xa29a79078f3bb562 lrc: 0/0,0 mode: --/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54a9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532085:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532085:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532086:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532089:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 4/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532095:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.532108:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1359:41278:x1731746396299072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.532110:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11374 00010000:00010000:0.0:1651529344.532122:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532125:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532148:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532151:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532223:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+705:39030:x1731745946417920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1258us (1312us total) trans 30064893276 rc 0/0 00000100:00100000:0.0:1651529344.532226:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152413 00010000:00010000:0.0:1651529344.532234:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532237:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df1d0290 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.532238:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532241:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 3/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532246:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 1/0,0 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532263:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be3c9 lrc: 0/0,0 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.532347:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532350:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.532357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.532364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.532373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.532382:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966628864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532385:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418688 00010000:00010000:1.0:1651529344.532387:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532396:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418624 00000100:00100000:0.0:1651529344.532400:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418816 00000100:00100000:0.0:1651529344.532403:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418752 00000100:00100000:0.0:1651529344.532407:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418880 00000100:00100000:1.0:1651529344.532409:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152416 00000100:00100000:1.0:1651529344.532411:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+709:39030:x1731745946418688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.532412:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152417 00000100:00100000:0.0:1651529344.532414:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+709:39029:x1731745946418624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.532417:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177209 count 1 00002000:00080000:0.0:1651529344.532420:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177208 count 1 00010000:00010000:1.0:1651529344.532421:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532424:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532425:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 2/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532428:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532429:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532429:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 4/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532429:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 2/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1358 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532432:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532433:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532433:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 4/0,1 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532436:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 3/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532440:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532440:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 3/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1358 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.532444:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966628928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532444:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 4/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1358 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.532448:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966628992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.532455:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532457:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.532461:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152418 00000100:00100000:1.0:1651529344.532462:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+709:39030:x1731745946418816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.532464:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152419 00000100:00100000:0.0:1651529344.532465:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+709:39029:x1731745946418752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.532467:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177211 count 1 00002000:00080000:0.0:1651529344.532470:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177210 count 1 00010000:00010000:0.0:1651529344.532473:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532480:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532480:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 2/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532483:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532483:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532484:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 2/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532484:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 4/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532488:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532488:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532489:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 4/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532490:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 3/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532493:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.532495:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 3/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.532497:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966629056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.532499:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.532503:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966629120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532503:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532508:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152420 00000100:00100000:0.0:1651529344.532510:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+709:39029:x1731745946418880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.532511:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.532514:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177212 count 1 00010000:00010000:0.0:1651529344.532517:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532521:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 2/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532524:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.532525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.532525:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532525:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 4/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532531:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 3/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532535:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.532539:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966629184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532545:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532550:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418944 00000100:00100000:0.0:1651529344.532555:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152421 00000100:00100000:0.0:1651529344.532557:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946418944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.532561:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177213 count 1 00010000:00010000:0.0:1651529344.532572:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532577:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 2/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532580:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532580:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532581:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 4/0,1 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532587:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 3/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1358 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532592:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 4/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.532596:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966629248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532608:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532618:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966628800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532622:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532629:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299136 00010000:00010000:0.0:1651529344.532633:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1359 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.532642:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299200 00010000:00010000:0.0:1651529344.532645:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.532647:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11375 00000100:00100000:1.0:1651529344.532649:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41278:x1731746396299136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.532654:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11376 00000100:00100000:0.0:1651529344.532655:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41278:x1731746396299200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.532657:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.532658:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.532659:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532660:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532663:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 3/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.532664:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532669:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b3b049/0xa29a79078f3bc354 lrc: 0/0,0 mode: --/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a87 expref: 1360 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532673:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532673:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532674:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532677:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078de61f5/0xa29a79078f3bc067 lrc: 0/0,0 mode: --/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ea9 expref: 1359 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.532677:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 4/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532681:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532682:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532683:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532685:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.532691:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 4/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532695:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1358:41278:x1731746396299200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.532697:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11376 00010000:00010000:1.0:1651529344.532705:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.532713:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1357:41278:x1731746396299136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.532716:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11375 00010000:00010000:1.0:1651529344.532725:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532726:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532728:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532738:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532740:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532742:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532743:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532745:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532788:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+712:39030:x1731745946418048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1405us (1436us total) trans 30064893277 rc 0/0 00000100:00100000:0.0:1651529344.532791:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152414 00000100:00100000:1.0:1651529344.532794:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+711:39029:x1731745946418112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1401us (1434us total) trans 30064893278 rc 0/0 00000100:00100000:1.0:1651529344.532797:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152415 00010000:00010000:0.0:1651529344.532798:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532802:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ba1b787 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.532816:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532819:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 3/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532822:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532826:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.532827:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532829:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 1/0,0 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532830:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 3/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532832:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be3d0 lrc: 0/0,0 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532835:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 1/0,0 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532838:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be3d7 lrc: 0/0,0 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532968:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966628928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.532972:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532995:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966628992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533000:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.533058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.533076:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419072 00000100:00100000:0.0:1651529344.533077:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419136 00000100:00100000:1.0:1651529344.533087:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152422 00000100:00100000:1.0:1651529344.533088:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+712:39030:x1731745946419072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.533094:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177214 count 1 00000100:00100000:0.0:1651529344.533094:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152423 00000100:00100000:0.0:1651529344.533095:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+712:39029:x1731745946419136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.533098:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.533101:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177215 count 1 00010000:00010000:1.0:1651529344.533103:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 2/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1356 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.533106:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533106:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533106:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533107:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 4/0,1 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533110:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 2/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1356 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.533114:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 3/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1356 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533114:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533114:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533115:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 4/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533117:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 4/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1356 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.533121:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966629312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533122:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 3/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1356 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533125:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1356 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533129:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966629376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.533135:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.533145:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.533253:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966629120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.533257:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533272:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966629056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533278:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533287:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966629184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533290:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533297:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966629248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533300:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533309:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.533318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.533327:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299648 00000100:00100000:0.0:1651529344.533328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.533336:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.533337:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1357 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.533344:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299776 00010000:00010000:1.0:1651529344.533346:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 4/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1358 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.533350:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299904 00010000:00010000:1.0:1651529344.533352:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1359 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533355:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300032 00000100:00100000:1.0:1651529344.533356:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299968 00010000:00010000:1.0:1651529344.533358:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1361 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533360:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1361 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.533362:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300096 00010000:00010000:1.0:1651529344.533364:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 4/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1362 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533367:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11377 00000100:00100000:0.0:1651529344.533369:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41279:x1731746396299648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.533370:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11378 00000100:00100000:1.0:1651529344.533372:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41279:x1731746396299776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.533372:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.533373:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1362 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533375:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533376:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 4/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1362 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533377:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 3/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1362 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533383:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a30131f0/0xa29a79078f3bb841 lrc: 0/0,0 mode: --/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f37 expref: 1362 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533389:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 3/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1362 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533395:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc44f07c/0xa29a79078f3b9254 lrc: 0/0,0 mode: --/PR res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc744 expref: 1362 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533399:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533399:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533406:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533408:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533409:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 4/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533409:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533410:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533413:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 4/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533418:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.533427:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.533435:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41279:x1731746396299776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533438:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11378 00000100:00100000:0.0:1651529344.533439:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41279:x1731746396299648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.533442:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11377 00000100:00100000:1.0:1651529344.533444:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11379 00000100:00100000:1.0:1651529344.533446:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1358:41279:x1731746396299904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.533448:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.533448:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11380 00010000:00010000:1.0:1651529344.533450:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533450:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1358:41278:x1731746396299968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.533453:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533454:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 3/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533454:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533458:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 3/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533463:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3ba82d lrc: 0/0,0 mode: --/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d204c expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533465:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3ba7e7 lrc: 0/0,0 mode: --/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f42 expref: 1358 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533466:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533467:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533468:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533469:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533469:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533470:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533471:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 4/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533473:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 4/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533485:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.533486:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.533491:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1356:41278:x1731746396299968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533493:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1356:41279:x1731746396299904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.533493:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11380 00000100:00100000:1.0:1651529344.533495:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11379 00000100:00100000:0.0:1651529344.533498:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11381 00000100:00100000:0.0:1651529344.533499:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41279:x1731746396300032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.533500:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11382 00000100:00100000:1.0:1651529344.533502:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41278:x1731746396300096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.533502:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.533503:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1354 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533505:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533506:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 4/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1354 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533507:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 3/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1354 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533510:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 3/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1354 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533512:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feefbf93/0xa29a79078f3bbbba lrc: 0/0,0 mode: --/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cb2 expref: 1354 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533515:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca8f023c/0xa29a79078f3ba372 lrc: 0/0,0 mode: --/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bdf expref: 1353 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533515:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533516:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533516:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533528:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533529:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533530:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533531:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 4/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533532:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 4/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533538:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.533540:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.533547:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41278:x1731746396300096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533549:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11382 00000100:00100000:0.0:1651529344.533549:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41279:x1731746396300032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.533552:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11381 00010000:00010000:1.0:1651529344.533556:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533559:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533562:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533563:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533565:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533566:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533569:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533578:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533607:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+714:39030:x1731745946418688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1195us (1298us total) trans 30064893279 rc 0/0 00000100:00100000:1.0:1651529344.533610:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152416 00000100:00100000:0.0:1651529344.533620:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+714:39030:x1731745946418944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1062us (1094us total) trans 30064893280 rc 0/0 00000100:00100000:0.0:1651529344.533623:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152421 00010000:00010000:1.0:1651529344.533627:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533631:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533631:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533634:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533634:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.533636:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533636:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533639:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 3/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533644:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 1/0,0 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533646:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be3de lrc: 0/0,0 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533650:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533653:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000511d1ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.533654:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533657:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 3/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533660:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 1/0,0 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533663:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be401 lrc: 0/0,0 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533669:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533671:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+713:39030:x1731745946418816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1313us total) trans 30064893281 rc 0/0 00010000:00010000:0.0:1651529344.533671:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.533672:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533674:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152418 00010000:00010000:0.0:1651529344.533675:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 3/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533678:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 1/0,0 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533680:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be3f3 lrc: 0/0,0 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533686:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533689:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533692:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533694:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.533751:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+713:39029:x1731745946418880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1240us (1377us total) trans 30064893282 rc 0/0 00000100:00100000:0.0:1651529344.533754:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152420 00000100:00100000:1.0:1651529344.533759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.533762:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533771:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533774:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533777:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533836:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+713:39029:x1731745946418752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1471us total) trans 30064893283 rc 0/0 00000100:00100000:0.0:1651529344.533839:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152419 00010000:00010000:0.0:1651529344.533846:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533849:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533852:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533858:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533879:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533884:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e471716 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.533885:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533888:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 3/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533893:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 1/0,0 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533907:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be3fa lrc: 0/0,0 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533912:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533914:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d26bd014 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.533915:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533918:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 3/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533922:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 1/0,0 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533924:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be3ec lrc: 0/0,0 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533930:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+713:39029:x1731745946418624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1515us (1582us total) trans 30064893284 rc 0/0 00010000:00010000:1.0:1651529344.533933:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533933:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152417 00010000:00010000:1.0:1651529344.533936:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a207f8b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.533937:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533946:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966629376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.533947:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 3/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533950:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533951:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 1/0,0 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533953:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be3e5 lrc: 0/0,0 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533957:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300160 00000100:00100000:1.0:1651529344.533962:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300224 00010000:00010000:0.0:1651529344.533962:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 5/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1351 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533967:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.533972:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11383 00000100:00100000:0.0:1651529344.533974:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41278:x1731746396300160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.533977:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.533978:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 5/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.533980:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11384 00000100:00100000:1.0:1651529344.533981:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41278:x1731746396300224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.533982:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 4/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.533984:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533986:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533988:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533989:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 3/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533990:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533993:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 4/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533994:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ffc40bc/0xa29a79078f3bc013 lrc: 0/0,0 mode: --/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cdb expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.533997:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.534004:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41278:x1731746396300160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.534006:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11383 00010000:00010000:1.0:1651529344.534013:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534014:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534015:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534018:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 4/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534026:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.534042:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1350:41278:x1731746396300224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534045:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11384 00010000:00010000:1.0:1651529344.534062:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e285a16b/0xa29a79078f3b9c48 lrc: 0/0,0 mode: --/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef5a expref: 1349 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.534066:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966629312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534070:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534073:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534076:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534079:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.534094:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534123:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.534139:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534143:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.534144:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534147:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 3/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534153:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+713:39030:x1731745946419072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1064us (1103us total) trans 30064893285 rc 0/0 00000100:00100000:1.0:1651529344.534156:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152422 00000100:00100000:1.0:1651529344.534161:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419520 00000100:00100000:1.0:1651529344.534167:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419648 00010000:00010000:0.0:1651529344.534169:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 1/0,0 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534173:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419776 00000100:00100000:1.0:1651529344.534176:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419840 00000100:00100000:1.0:1651529344.534179:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419968 00000100:00100000:1.0:1651529344.534182:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152424 00000100:00100000:1.0:1651529344.534184:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+717:39029:x1731745946419520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.534189:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177216 count 1 00010000:00010000:0.0:1651529344.534191:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be408 lrc: 0/0,0 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534193:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534198:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 2/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1348 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.534200:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152425 00010000:00010000:1.0:1651529344.534201:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534202:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.534202:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+717:39029:x1731745946419648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.534203:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 4/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.534208:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177217 count 1 00010000:00010000:1.0:1651529344.534209:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1348 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534211:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534216:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 2/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534219:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534219:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534220:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 4/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534224:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1348 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.534227:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 3/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.534228:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966629440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.534231:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534235:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966629504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534237:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534244:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152426 00000100:00100000:0.0:1651529344.534244:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534246:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+717:39029:x1731745946419776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.534250:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177218 count 1 00000100:00100000:0.0:1651529344.534250:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152427 00000100:00100000:0.0:1651529344.534252:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+717:39030:x1731745946419840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.534254:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.534256:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177219 count 1 00010000:00010000:1.0:1651529344.534258:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 2/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534260:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534261:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534261:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534262:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 4/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534264:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 2/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534267:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534267:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534268:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 3/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534268:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 4/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534272:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.534274:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 3/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534277:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534281:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966629632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534286:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966629568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.534287:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.534293:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152428 00000100:00100000:1.0:1651529344.534294:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.534294:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+717:39030:x1731745946419968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.534298:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177220 count 1 00010000:00010000:0.0:1651529344.534301:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.534318:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 2/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534321:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534321:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534322:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 4/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534328:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 3/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534332:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 4/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534336:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966629696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.534343:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.534350:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420032 00000100:00100000:0.0:1651529344.534361:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152429 00000100:00100000:0.0:1651529344.534363:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+718:39030:x1731745946420032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.534368:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177221 count 1 00010000:00010000:0.0:1651529344.534372:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534376:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 2/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1348 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534382:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534382:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534383:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 4/0,1 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534389:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 3/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1348 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534392:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 4/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1348 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534396:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966629760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.534408:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.534415:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534418:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534421:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534424:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534506:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+719:39029:x1731745946419136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1409us (1447us total) trans 30064893286 rc 0/0 00000100:00100000:0.0:1651529344.534517:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152423 00000100:00100000:0.0:1651529344.534522:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420096 00000100:00100000:0.0:1651529344.534529:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152430 00000100:00100000:0.0:1651529344.534531:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+719:39030:x1731745946420096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.534535:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177222 count 1 00010000:00010000:0.0:1651529344.534540:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534545:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 2/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534548:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534548:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534549:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 4/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534577:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 3/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534581:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534585:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966629824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534588:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966629440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534593:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534607:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.534612:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534634:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349b2dd6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.534635:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534661:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 3/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534667:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 1/0,0 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.534670:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be40f lrc: 0/0,0 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534676:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420160 00000100:00100000:0.0:1651529344.534683:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966629632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534688:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152431 00000100:00100000:1.0:1651529344.534689:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+720:39030:x1731745946420160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.534693:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.534695:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177223 count 1 00010000:00010000:1.0:1651529344.534699:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534701:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966629504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534703:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 2/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.534703:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534707:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534707:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534708:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 4/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534715:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 3/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1348 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534719:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.534723:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966629888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534742:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534931:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966629568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534935:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.534989:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300800 00000100:00100000:0.0:1651529344.534990:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.534999:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1349 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.534999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.535010:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300928 00000100:00100000:0.0:1651529344.535012:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.535013:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1350 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535018:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301056 00000100:00100000:0.0:1651529344.535018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.535020:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 5/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1351 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.535023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.535024:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300864 00010000:00010000:1.0:1651529344.535026:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1352 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535032:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300992 00010000:00010000:1.0:1651529344.535040:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1353 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535045:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301120 00010000:00010000:1.0:1651529344.535047:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 5/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1354 pid: 127523 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535057:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11385 00000100:00100000:0.0:1651529344.535057:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966629696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.535059:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41279:x1731746396300800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.535062:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.535062:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535063:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1354 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535067:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1354 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.535071:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966629760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535073:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487b52cc/0xa29a79078f3b9778 lrc: 0/0,0 mode: --/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbf7 expref: 1354 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535073:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535076:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535077:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535077:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535080:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966629824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535081:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 4/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535082:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535087:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.535089:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11386 00000100:00100000:0.0:1651529344.535091:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1353:41279:x1731746396300928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.535094:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.535096:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1353 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535100:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1353:41279:x1731746396300800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.535103:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11385 00010000:00010000:0.0:1651529344.535106:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 3/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535108:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11387 00000100:00100000:1.0:1651529344.535110:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41279:x1731746396301056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.535112:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e054b7d/0xa29a79078f3ba0fc lrc: 0/0,0 mode: --/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01d6 expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535113:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535114:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 4/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1352 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535118:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 3/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1351 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535119:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535119:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535120:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535123:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bad27 lrc: 0/0,0 mode: --/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33bd expref: 1351 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535123:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 4/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535127:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535127:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535128:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535129:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.535131:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 4/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535136:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1350:41279:x1731746396300928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.535139:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.535145:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1350:41279:x1731746396301056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.535146:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11386 00000100:00100000:1.0:1651529344.535148:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11387 00000100:00100000:1.0:1651529344.535152:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11388 00000100:00100000:1.0:1651529344.535154:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1348:41278:x1731746396300864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.535154:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11389 00000100:00100000:0.0:1651529344.535155:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1348:41278:x1731746396300992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.535156:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535157:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535158:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.535160:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535161:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 3/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535164:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 3/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1348 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535165:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3b97be lrc: 0/0,0 mode: --/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcc9 expref: 1348 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535168:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535169:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535169:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006872a34b/0xa29a79078f3bbe53 lrc: 0/0,0 mode: --/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d769f expref: 1347 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535170:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535172:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535173:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 4/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535180:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.535183:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535184:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535185:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1346:41278:x1731746396300864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.535187:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11388 00010000:00010000:0.0:1651529344.535187:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 4/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535196:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.535203:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11390 00000100:00100000:0.0:1651529344.535204:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1345:41278:x1731746396300992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.535212:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11389 00000100:00100000:1.0:1651529344.535213:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1345:41278:x1731746396301120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.535216:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535218:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 4/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1344 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535219:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535222:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 3/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1344 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535223:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535226:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535227:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3b8ba8 lrc: 0/0,0 mode: --/PR res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ac expref: 1344 pid: 127523 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535229:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535230:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535231:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535232:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535240:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 4/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535249:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.535256:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1343:41278:x1731746396301120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.535259:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11390 00010000:00010000:1.0:1651529344.535267:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535270:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535279:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+721:39029:x1731745946419648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1076us (1168us total) trans 30064893287 rc 0/0 00010000:00010000:1.0:1651529344.535282:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535282:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152425 00010000:00010000:1.0:1651529344.535285:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535290:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535302:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535306:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535308:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535327:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+722:39029:x1731745946419520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1142us (1245us total) trans 30064893288 rc 0/0 00000100:00100000:1.0:1651529344.535330:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152424 00010000:00010000:1.0:1651529344.535338:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535341:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e76bff1f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.535342:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535345:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 3/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535345:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+721:39030:x1731745946419840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1091us (1221us total) trans 30064893289 rc 0/0 00000100:00100000:0.0:1651529344.535348:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152427 00010000:00010000:1.0:1651529344.535350:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 1/0,0 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535353:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be41d lrc: 0/0,0 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535355:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535357:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535358:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.535359:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535362:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 3/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535367:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 1/0,0 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535368:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db78a802 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.535369:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535370:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be416 lrc: 0/0,0 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535371:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 3/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535375:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 1/0,0 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535376:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535378:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be42b lrc: 0/0,0 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535379:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535382:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535384:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535385:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535386:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535390:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535393:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535427:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+722:39030:x1731745946420032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1063us (1116us total) trans 30064893290 rc 0/0 00000100:00100000:0.0:1651529344.535430:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152429 00000100:00100000:1.0:1651529344.535434:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+721:39029:x1731745946419776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1187us (1316us total) trans 30064893291 rc 0/0 00010000:00010000:0.0:1651529344.535437:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535440:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c7ba89e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.535441:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535444:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152426 00010000:00010000:0.0:1651529344.535444:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 3/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535449:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 1/0,0 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535452:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be439 lrc: 0/0,0 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535455:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966629888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535456:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535459:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535459:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.535459:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535462:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 3/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535465:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 1/0,0 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535468:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be424 lrc: 0/0,0 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535473:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.535476:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535479:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535482:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535497:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.535521:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+721:39030:x1731745946419968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1226us (1387us total) trans 30064893292 rc 0/0 00000100:00100000:0.0:1651529344.535524:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152428 00010000:00010000:0.0:1651529344.535530:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535534:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000213da448 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.535535:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535538:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 3/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535542:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 1/0,0 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535544:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be432 lrc: 0/0,0 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535552:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301184 00010000:00010000:0.0:1651529344.535556:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1343 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.535565:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301248 00010000:00010000:0.0:1651529344.535568:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1344 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.535573:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11391 00000100:00100000:0.0:1651529344.535574:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1344:41279:x1731746396301184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.535577:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.535578:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1344 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535581:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 3/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1344 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535586:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11392 00010000:00010000:0.0:1651529344.535586:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086d071c9/0xa29a79078f3b9b29 lrc: 0/0,0 mode: --/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cead0 expref: 1344 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.535589:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1344:41279:x1731746396301248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.535590:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535591:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535591:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535592:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535594:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1343 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535594:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 4/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535598:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 3/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1343 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535600:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.535604:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ea7ba0/0xa29a79078f3bb657 lrc: 0/0,0 mode: --/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5788 expref: 1343 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.535608:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535608:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.535612:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41279:x1731746396301184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (138us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.535615:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535615:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11391 00010000:00010000:1.0:1651529344.535618:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 4/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535622:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535625:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535627:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.535628:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535631:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535634:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1341:41279:x1731746396301248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.535637:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11392 00010000:00010000:1.0:1651529344.535645:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535648:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.535649:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535652:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 3/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535656:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 1/0,0 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535659:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be440 lrc: 0/0,0 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535664:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535668:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535673:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535676:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535714:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+722:39030:x1731745946420096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1231us total) trans 30064893293 rc 0/0 00000100:00100000:0.0:1651529344.535717:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152430 00000100:00100000:1.0:1651529344.535720:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+721:39030:x1731745946420160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1050us total) trans 30064893294 rc 0/0 00000100:00100000:1.0:1651529344.535723:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152431 00010000:00010000:0.0:1651529344.535725:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535728:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.535729:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535748:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 3/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535753:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 1/0,0 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535756:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be447 lrc: 0/0,0 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.535784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535802:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420736 00000100:00100000:1.0:1651529344.535833:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420800 00000100:00100000:1.0:1651529344.535839:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152432 00000100:00100000:1.0:1651529344.535845:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+722:39030:x1731745946420736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.535849:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152433 00002000:00080000:1.0:1651529344.535851:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177224 count 1 00000100:00100000:0.0:1651529344.535851:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ed9bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+722:39030:x1731745946420800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.535855:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.535858:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177225 count 1 00010000:00010000:1.0:1651529344.535860:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 2/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1340 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535862:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535863:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535864:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535864:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 4/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535867:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 2/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1340 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535870:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535871:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 3/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1340 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535871:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535871:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 4/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535876:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1340 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.535879:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 3/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1340 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.535880:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966629952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535882:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1340 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.535886:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.535895:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.535903:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.535934:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420864 00000100:00100000:1.0:1651529344.535939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.535949:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420928 00000100:00100000:0.0:1651529344.535958:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152434 00000100:00100000:0.0:1651529344.535960:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+724:39030:x1731745946420864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.535965:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177226 count 1 00010000:00010000:0.0:1651529344.535969:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.535974:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 2/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535977:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535977:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535983:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 4/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.536006:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420992 00010000:00010000:0.0:1651529344.536011:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 3/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536012:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421056 00000100:00100000:1.0:1651529344.536014:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421120 00010000:00010000:0.0:1651529344.536015:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.536016:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421184 00000100:00100000:1.0:1651529344.536019:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152435 00000100:00100000:1.0:1651529344.536020:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+728:39029:x1731745946420928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.536020:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966630080:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.536025:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177227 count 1 00010000:00010000:1.0:1651529344.536029:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536034:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.536040:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 2/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.536042:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152436 00010000:00010000:1.0:1651529344.536044:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536044:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.536044:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+728:39030:x1731745946420992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.536045:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 4/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.536048:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177228 count 1 00010000:00010000:1.0:1651529344.536052:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 3/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536053:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536056:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536057:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 2/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536060:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536060:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536061:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536061:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 4/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536068:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.536068:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 3/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536071:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.536075:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152437 00000100:00100000:1.0:1651529344.536076:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+728:39029:x1731745946421056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.536081:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177229 count 1 00010000:00010000:1.0:1651529344.536084:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536088:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 2/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.536088:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966630208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.536091:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536092:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536093:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 4/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536097:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.536099:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 3/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.536103:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152438 00010000:00010000:1.0:1651529344.536105:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.536105:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+728:39030:x1731745946421120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.536109:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966630272:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.536110:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177230 count 1 00010000:00010000:0.0:1651529344.536113:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536115:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.536117:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 2/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1340 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536121:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152439 00000100:00100000:1.0:1651529344.536122:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+728:39029:x1731745946421184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.536126:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177231 count 1 00010000:00010000:1.0:1651529344.536129:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536132:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536133:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536133:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 4/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536134:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 2/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536136:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536137:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536138:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 4/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536141:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 3/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1340 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536143:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 3/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1340 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536145:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1340 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536147:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.536148:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966630336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536154:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966630400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.536156:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.536160:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.536182:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966629952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.536193:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.536250:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.536255:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536259:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301824 00000100:00100000:0.0:1651529344.536262:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301888 00010000:00010000:1.0:1651529344.536264:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536267:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.536272:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11393 00000100:00100000:1.0:1651529344.536274:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41279:x1731746396301824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.536275:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11394 00010000:00010000:1.0:1651529344.536277:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.536277:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396301888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.536278:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536279:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.536281:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536282:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 3/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536285:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 3/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536287:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cccb62d4/0xa29a79078f3b9349 lrc: 0/0,0 mode: --/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccae7 expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536290:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa06f29/0xa29a79078f3b9675 lrc: 0/0,0 mode: --/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7cf expref: 1342 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536294:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536294:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536294:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536294:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536295:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536295:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536298:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 4/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536298:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 4/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536304:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.536304:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.536311:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1340:41278:x1731746396301888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.536313:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1340:41279:x1731746396301824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.536314:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11394 00000100:00100000:1.0:1651529344.536316:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11393 00010000:00010000:0.0:1651529344.536320:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536323:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536323:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536326:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536326:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536329:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536329:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536332:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536386:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ed9bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946420800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 534us (602us total) trans 30064893295 rc 0/0 00000100:00100000:0.0:1651529344.536389:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152433 00000100:00100000:1.0:1651529344.536392:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946420736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 545us (620us total) trans 30064893296 rc 0/0 00000100:00100000:1.0:1651529344.536395:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152432 00010000:00010000:0.0:1651529344.536397:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536400:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.536401:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536404:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 3/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536409:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 1/0,0 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536412:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be455 lrc: 0/0,0 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536416:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536419:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.536420:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536423:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 3/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536428:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 1/0,0 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536431:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be44e lrc: 0/0,0 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.536632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.536642:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421632 00000100:00100000:0.0:1651529344.536643:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421568 00000100:00100000:1.0:1651529344.536652:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152440 00000100:00100000:1.0:1651529344.536654:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946421632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.536659:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177233 count 1 00000100:00100000:0.0:1651529344.536660:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152441 00000100:00100000:0.0:1651529344.536661:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946421568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.536663:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.536667:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177232 count 1 00010000:00010000:1.0:1651529344.536668:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 2/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536671:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536674:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536674:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536675:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 4/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536676:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 2/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536679:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536680:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536680:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 4/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536682:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 3/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536685:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536687:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 3/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1338 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536689:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966630464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536691:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.536695:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536703:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.536745:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.536795:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.536800:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536825:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966630080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536829:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.536854:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.536860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.536861:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966630208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.536865:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536884:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966630336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536886:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966630272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536887:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536890:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536893:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301952 00000100:00100000:1.0:1651529344.536899:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302016 00010000:00010000:1.0:1651529344.536904:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1340 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.536910:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302080 00010000:00010000:1.0:1651529344.536912:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1341 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536913:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1341 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.536916:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302144 00010000:00010000:1.0:1651529344.536918:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.536921:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11395 00000100:00100000:0.0:1651529344.536922:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396302016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.536923:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11396 00000100:00100000:1.0:1651529344.536925:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41279:x1731746396302080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.536925:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.536927:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536928:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.536929:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536931:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 3/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536933:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 3/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536936:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f09c256e/0xa29a79078f3b9c87 lrc: 0/0,0 mode: --/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf056 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536938:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3ba421 lrc: 0/0,0 mode: --/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea9 expref: 1342 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536940:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536940:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536941:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536942:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536943:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536943:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536947:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 4/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536947:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 4/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536961:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.536963:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.536973:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1340:41278:x1731746396302016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.536975:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11395 00000100:00100000:1.0:1651529344.536977:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1340:41279:x1731746396302080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.536980:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11396 00000100:00100000:0.0:1651529344.536981:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11397 00000100:00100000:0.0:1651529344.536983:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1338:41279:x1731746396301952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.536985:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11398 00000100:00100000:1.0:1651529344.536986:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1338:41278:x1731746396302144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.536986:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.536987:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536989:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.536990:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536991:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 3/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536994:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 3/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.536996:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084986c0b/0xa29a79078f3badd6 lrc: 0/0,0 mode: --/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d362c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.536999:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5299f8/0xa29a79078f3bbafd lrc: 0/0,0 mode: --/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d695c expref: 1338 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.537003:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537003:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537004:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537009:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 4/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537015:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.537020:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1337:41278:x1731746396302144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.537022:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537023:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537024:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537031:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11398 00010000:00010000:0.0:1651529344.537037:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 4/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537042:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966630400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537045:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537045:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.537051:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537053:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1335:41279:x1731746396301952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 69us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.537054:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537055:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11397 00010000:00010000:1.0:1651529344.537057:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537060:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537075:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537079:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537082:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537085:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537104:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+732:39029:x1731745946420928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1083us (1165us total) trans 30064893297 rc 0/0 00000100:00100000:1.0:1651529344.537107:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152435 00010000:00010000:1.0:1651529344.537124:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537125:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+731:39030:x1731745946420992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1151us total) trans 30064893298 rc 0/0 00010000:00010000:1.0:1651529344.537127:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537129:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152436 00010000:00010000:1.0:1651529344.537130:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537133:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537136:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537140:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.537141:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537146:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 3/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537151:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 1/0,0 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537154:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be463 lrc: 0/0,0 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537159:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537161:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.537162:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537165:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 3/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537168:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 1/0,0 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537169:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+731:39029:x1731745946421056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1184us total) trans 30064893299 rc 0/0 00010000:00010000:0.0:1651529344.537171:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be46a lrc: 0/0,0 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537173:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152437 00010000:00010000:0.0:1651529344.537174:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537177:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.537178:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537180:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 3/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537183:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 1/0,0 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537186:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be471 lrc: 0/0,0 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.537192:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537202:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537205:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.537208:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537254:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+731:39030:x1731745946420864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1293us (1336us total) trans 30064893300 rc 0/0 00000100:00100000:0.0:1651529344.537257:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152434 00000100:00100000:0.0:1651529344.537268:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.537272:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537279:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302208 00010000:00010000:0.0:1651529344.537283:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1335 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.537297:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302272 00010000:00010000:1.0:1651529344.537308:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1336 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.537313:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11399 00000100:00100000:0.0:1651529344.537315:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1336:41278:x1731746396302208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.537318:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.537320:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11400 00010000:00010000:0.0:1651529344.537320:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1336 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.537322:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1336:41278:x1731746396302272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.537325:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.537326:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1336 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537335:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 3/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1336 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.537341:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 3/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1336 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537341:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3b784c lrc: 0/0,0 mode: --/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6c0 expref: 1336 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537345:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537346:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537347:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001467c017/0xa29a79078f3bc3bd lrc: 0/0,0 mode: --/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bfa expref: 1335 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537347:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537351:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537351:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537352:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537352:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 4/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537355:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 4/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537359:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.537362:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.537367:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1334:41278:x1731746396302208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.537369:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11399 00000100:00100000:1.0:1651529344.537370:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1334:41278:x1731746396302272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.537373:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11400 00010000:00010000:0.0:1651529344.537376:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537379:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537379:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537382:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537383:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.537384:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537385:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537387:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 3/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537399:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 1/0,0 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537401:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be45c lrc: 0/0,0 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537406:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537409:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ba1b787 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.537410:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537413:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 3/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537416:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 1/0,0 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537418:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be478 lrc: 0/0,0 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537421:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+731:39030:x1731745946421120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1315us (1428us total) trans 30064893301 rc 0/0 00000100:00100000:0.0:1651529344.537424:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152438 00000100:00100000:1.0:1651529344.537428:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966630464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537431:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537445:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537448:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537451:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537454:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.537498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.537505:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+731:39029:x1731745946421184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1381us (1505us total) trans 30064893302 rc 0/0 00000100:00100000:1.0:1651529344.537508:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152439 00000100:00100000:1.0:1651529344.537513:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421952 00000100:00100000:0.0:1651529344.537513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.537529:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152442 00000100:00100000:1.0:1651529344.537531:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+731:39029:x1731745946421952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.537536:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177235 count 1 00000100:00100000:0.0:1651529344.537543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.537551:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537556:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 2/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537559:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537560:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537561:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 4/0,1 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537574:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 3/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537577:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 4/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.537578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.537581:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966630592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.537588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.537590:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.537602:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421888 00000100:00100000:1.0:1651529344.537618:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422080 00010000:00010000:0.0:1651529344.537618:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537622:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ae36632 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.537625:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422016 00010000:00010000:0.0:1651529344.537628:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537631:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152443 00000100:00100000:1.0:1651529344.537633:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+734:39030:x1731745946421888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.537635:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 3/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.537637:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177234 count 1 00010000:00010000:0.0:1651529344.537640:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 1/0,0 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537641:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537643:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be47f lrc: 0/0,0 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537645:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 2/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537649:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537649:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537650:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 4/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537651:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152444 00000100:00100000:0.0:1651529344.537653:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+734:39029:x1731745946422080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.537659:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 3/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.537659:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177237 count 1 00010000:00010000:1.0:1651529344.537662:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537663:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537666:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966630656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.537667:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 2/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.537671:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537671:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537672:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 4/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537678:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.537685:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152445 00010000:00010000:0.0:1651529344.537686:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 3/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.537687:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+734:39030:x1731745946422016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.537690:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.537691:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177236 count 1 00010000:00010000:1.0:1651529344.537695:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537699:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 2/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537702:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537702:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537703:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 4/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537708:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966630720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537709:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 3/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537713:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.537717:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.537718:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.537725:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.537728:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302336 00000100:00100000:1.0:1651529344.537739:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302400 00010000:00010000:1.0:1651529344.537744:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537744:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.537755:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11401 00000100:00100000:1.0:1651529344.537756:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1334:41278:x1731746396302400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.537759:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.537760:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.537760:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11402 00000100:00100000:0.0:1651529344.537762:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1334:41279:x1731746396302336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.537764:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 3/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537765:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.537767:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.537770:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075acb305/0xa29a79078f3bb784 lrc: 0/0,0 mode: --/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bfd expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.537771:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 3/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1334 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.537773:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537774:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537775:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537776:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e1300e/0xa29a79078f3bb5a8 lrc: 0/0,0 mode: --/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d556d expref: 1333 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.537778:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 4/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537789:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.537795:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41278:x1731746396302400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.537798:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11401 00010000:00010000:0.0:1651529344.537828:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537829:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537830:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537832:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.537833:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 4/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537848:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.537856:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1331:41279:x1731746396302336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.537859:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11402 00000100:00100000:1.0:1651529344.537866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.537879:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.537883:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537890:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537893:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537939:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+735:39030:x1731745946421568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1277us (1312us total) trans 30064893303 rc 0/0 00010000:00010000:1.0:1651529344.537940:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537942:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152441 00010000:00010000:1.0:1651529344.537944:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537948:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537948:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422144 00010000:00010000:1.0:1651529344.537951:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537954:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422208 00000100:00100000:0.0:1651529344.537979:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152446 00000100:00100000:0.0:1651529344.537981:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+737:39030:x1731745946422144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.537986:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177238 count 1 00010000:00010000:0.0:1651529344.537990:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537994:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+737:39030:x1731745946421632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1383us total) trans 30064893304 rc 0/0 00010000:00010000:0.0:1651529344.537995:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 2/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1330 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.537998:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152440 00010000:00010000:0.0:1651529344.537998:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537999:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538000:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 4/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538003:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152447 00000100:00100000:1.0:1651529344.538005:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+736:39029:x1731745946422208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.538006:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 3/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1330 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.538009:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177239 count 1 00010000:00010000:0.0:1651529344.538010:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.538014:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.538022:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538027:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 2/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1330 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538030:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538031:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538032:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 4/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538036:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.538039:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 3/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1330 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538043:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 4/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1330 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538043:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538046:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df1d0290 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.538047:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966630912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538047:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538051:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 3/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538055:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.538055:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 1/0,0 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538058:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be48d lrc: 0/0,0 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538061:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538065:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7db30c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.538066:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538067:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302976 00010000:00010000:1.0:1651529344.538069:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 3/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538072:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 5/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1331 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.538084:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11403 00000100:00100000:0.0:1651529344.538086:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1331:41279:x1731746396302976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.538089:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 1/0,0 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538089:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.538091:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 5/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1331 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538092:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be486 lrc: 0/0,0 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538094:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 4/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1331 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538099:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538100:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538101:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538104:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c34093e/0xa29a79078f3b9e08 lrc: 0/0,0 mode: --/PR res: [0x2b453:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf63e expref: 1331 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538104:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 4/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538107:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966630592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538109:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.538111:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538114:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538115:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396302976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.538116:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538118:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11403 00010000:00010000:1.0:1651529344.538119:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538122:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538146:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538158:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b199f4f9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.538159:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538162:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 3/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538167:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 1/0,0 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538169:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+737:39029:x1731745946421952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 637us (671us total) trans 30064893305 rc 0/0 00010000:00010000:0.0:1651529344.538170:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be494 lrc: 0/0,0 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538179:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152442 00000100:00100000:1.0:1651529344.538234:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966630656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.538238:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538276:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966630720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538281:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.538298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.538298:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303040 00000100:00100000:1.0:1651529344.538307:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.538315:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.538319:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538323:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.538326:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303104 00000100:00100000:0.0:1651529344.538335:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303168 00010000:00010000:1.0:1651529344.538337:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538338:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.538344:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11404 00000100:00100000:1.0:1651529344.538345:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11405 00000100:00100000:0.0:1651529344.538345:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1332:41279:x1731746396303040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.538347:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1332:41279:x1731746396303104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.538348:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.538349:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538350:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.538352:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538353:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 3/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538355:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 3/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538359:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3ba9bc lrc: 0/0,0 mode: --/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25b6 expref: 1332 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538362:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538363:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538364:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538367:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 4/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538372:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7f7d44/0xa29a79078f3bb872 lrc: 0/0,0 mode: --/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ffb expref: 1331 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538376:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.538381:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538382:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538383:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538385:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396303040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.538386:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 4/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538388:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11404 00010000:00010000:1.0:1651529344.538395:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.538399:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11406 00000100:00100000:0.0:1651529344.538401:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1329:41278:x1731746396303168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.538403:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1329:41279:x1731746396303104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.538406:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11405 00010000:00010000:1.0:1651529344.538414:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538423:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538426:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.538427:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538428:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538429:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538453:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 3/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538459:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf2b821/0xa29a79078f3ba12d lrc: 0/0,0 mode: --/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02a8 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538463:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538464:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538465:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538467:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 4/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538477:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.538484:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1327:41278:x1731746396303168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 82us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.538487:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11406 00000100:00100000:1.0:1651529344.538495:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+737:39030:x1731745946421888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 861us (952us total) trans 30064893306 rc 0/0 00010000:00010000:0.0:1651529344.538495:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538498:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152443 00010000:00010000:0.0:1651529344.538498:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052f453be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.538499:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538502:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 3/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538505:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538506:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 1/0,0 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538509:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538509:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be49b lrc: 0/0,0 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538512:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538514:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538515:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538518:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538521:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538523:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538547:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+738:39030:x1731745946422016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 859us (959us total) trans 30064893307 rc 0/0 00000100:00100000:1.0:1651529344.538550:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152445 00010000:00010000:1.0:1651529344.538556:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538559:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002801aa2b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.538561:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538563:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 3/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538574:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+737:39029:x1731745946422080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 919us (1008us total) trans 30064893308 rc 0/0 00000100:00100000:0.0:1651529344.538577:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152444 00010000:00010000:1.0:1651529344.538578:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 1/0,0 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538581:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be4a9 lrc: 0/0,0 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538585:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538588:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.538589:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538592:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 3/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538597:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 1/0,0 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538599:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be4a2 lrc: 0/0,0 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.538635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.538648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.538651:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.538673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.538684:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966630848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538687:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966630912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538688:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538691:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538698:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422720 00000100:00100000:0.0:1651529344.538698:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422784 00000100:00100000:0.0:1651529344.538707:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422848 00000100:00100000:1.0:1651529344.538718:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152448 00000100:00100000:1.0:1651529344.538720:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946422784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.538725:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177241 count 1 00010000:00010000:1.0:1651529344.538729:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538742:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 2/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1326 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538745:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538745:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.538745:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152449 00010000:00010000:1.0:1651529344.538746:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 4/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538747:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946422720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.538752:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177240 count 1 00010000:00010000:0.0:1651529344.538756:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538761:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 2/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538762:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 3/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1326 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538764:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538765:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538766:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538766:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 4/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538770:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538773:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 3/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538776:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.538781:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966631040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538782:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.538788:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152450 00000100:00100000:1.0:1651529344.538790:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946422848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.538790:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.538794:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177242 count 1 00010000:00010000:1.0:1651529344.538798:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538798:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303232 00010000:00010000:0.0:1651529344.538816:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1327 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538818:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 2/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1327 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538822:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538823:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538823:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 4/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538832:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303296 00010000:00010000:0.0:1651529344.538835:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 4/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1328 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538836:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 3/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1328 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538840:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.538854:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966631104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.538858:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11407 00000100:00100000:0.0:1651529344.538860:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1328:41279:x1731746396303232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.538862:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.538863:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.538864:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538868:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 3/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.538869:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11408 00000100:00100000:1.0:1651529344.538871:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1328:41278:x1731746396303296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.538874:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.538874:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d96f25c/0xa29a79078f3bc227 lrc: 0/0,0 mode: --/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85d3 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538875:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 4/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1328 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538878:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538878:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538879:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 3/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1327 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.538879:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538882:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 4/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538885:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000888ff3a6/0xa29a79078f3b9819 lrc: 0/0,0 mode: --/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdec8 expref: 1327 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.538889:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538889:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.538890:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538890:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538893:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 4/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538896:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1326:41279:x1731746396303232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.538899:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11407 00010000:00010000:1.0:1651529344.538900:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.538905:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1325:41278:x1731746396303296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.538908:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538911:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538915:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538917:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538918:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11408 00010000:00010000:1.0:1651529344.538927:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538931:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538934:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538936:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538956:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+741:39030:x1731745946422144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 974us (1124us total) trans 30064893309 rc 0/0 00000100:00100000:0.0:1651529344.538959:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152446 00010000:00010000:0.0:1651529344.538966:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538969:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.538970:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538973:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 3/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538977:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 1/0,0 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538980:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be4b0 lrc: 0/0,0 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538984:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538985:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+740:39029:x1731745946422208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 979us (1119us total) trans 30064893310 rc 0/0 00010000:00010000:0.0:1651529344.538987:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bac242b4 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.538988:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152447 00010000:00010000:0.0:1651529344.538988:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538991:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 3/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538994:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 1/0,0 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538996:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be4b7 lrc: 0/0,0 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539054:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422976 00000100:00100000:0.0:1651529344.539072:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152451 00000100:00100000:0.0:1651529344.539074:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+740:39029:x1731745946422976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.539080:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177243 count 1 00010000:00010000:0.0:1651529344.539085:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539089:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 2/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.539096:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.539108:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539108:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539109:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 4/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539111:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423040 00010000:00010000:0.0:1651529344.539117:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 3/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.539121:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423104 00000100:00100000:1.0:1651529344.539128:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152452 00000100:00100000:1.0:1651529344.539130:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+742:39030:x1731745946423040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.539132:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 4/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1324 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.539135:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177244 count 1 00000100:00100000:0.0:1651529344.539136:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966631168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539139:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539147:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.539153:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 2/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1324 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.539154:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152453 00000100:00100000:0.0:1651529344.539156:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+742:39029:x1731745946423104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.539157:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539157:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539158:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 4/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.539160:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177245 count 1 00010000:00010000:1.0:1651529344.539165:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 3/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1324 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539169:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1324 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.539173:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966631232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539188:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539189:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.539193:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 2/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.539196:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539196:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539197:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 4/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.539207:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 3/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.539220:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1324 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539224:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966631296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.539233:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.539239:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423168 00000100:00100000:1.0:1651529344.539246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.539262:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423232 00000100:00100000:0.0:1651529344.539267:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152454 00000100:00100000:0.0:1651529344.539268:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+744:39030:x1731745946423168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.539273:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177246 count 1 00010000:00010000:0.0:1651529344.539277:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539282:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 2/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.539291:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539292:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539293:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 4/0,1 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539296:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152455 00000100:00100000:1.0:1651529344.539299:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+744:39029:x1731745946423232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.539299:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 3/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1324 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.539304:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177247 count 1 00010000:00010000:0.0:1651529344.539305:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 4/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1324 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539308:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539309:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966631360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539313:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 2/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1324 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.539322:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.539330:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 2/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1324 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539333:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539333:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539334:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 5/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539341:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1324 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539345:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1324 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539346:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966631040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.539349:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966631424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539350:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539360:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1324 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539363:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1324 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.539367:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966631488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.539372:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.539380:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966630976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539415:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539425:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966631104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539428:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539570:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966631232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539573:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.539612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539622:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303872 00000100:00100000:0.0:1651529344.539622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.539630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.539633:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1325 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539637:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539639:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304000 00010000:00010000:1.0:1651529344.539641:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539645:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303936 00010000:00010000:1.0:1651529344.539647:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1327 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.539651:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304064 00000100:00100000:0.0:1651529344.539651:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966631296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539654:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 5/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1328 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539655:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539660:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304192 00010000:00010000:1.0:1651529344.539662:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1329 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539662:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966631168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539665:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539666:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304128 00010000:00010000:1.0:1651529344.539668:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1330 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.539672:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11409 00000100:00100000:1.0:1651529344.539674:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11410 00000100:00100000:0.0:1651529344.539674:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396303872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.539675:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396304000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.539677:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.539678:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.539679:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539680:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539682:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 3/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539684:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 3/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539688:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9ec8d9/0xa29a79078f3bb5a1 lrc: 0/0,0 mode: --/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d555f expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539689:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009560a117/0xa29a79078f3bc3cb lrc: 0/0,0 mode: --/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c39 expref: 1330 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539692:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539693:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539693:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539693:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539694:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539694:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539697:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 4/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539697:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 4/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539704:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.539706:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.539717:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1328:41279:x1731746396303872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.539720:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11409 00000100:00100000:1.0:1651529344.539722:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1328:41279:x1731746396304000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539725:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11410 00000100:00100000:0.0:1651529344.539738:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11411 00000100:00100000:1.0:1651529344.539741:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11412 00000100:00100000:0.0:1651529344.539741:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1326:41279:x1731746396303936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.539743:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1326:41279:x1731746396304064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.539743:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.539745:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539746:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.539747:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 4/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539749:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 3/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539751:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 3/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539754:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bb4c8 lrc: 0/0,0 mode: --/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51fb expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539756:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0005c1/0xa29a79078f3bc1fd lrc: 0/0,0 mode: --/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8516 expref: 1326 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.539757:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539758:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539759:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539760:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539761:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539761:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539762:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 4/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539764:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 4/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539768:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.539773:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.539781:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1324:41279:x1731746396303936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539782:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1324:41279:x1731746396304064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.539784:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11411 00000100:00100000:1.0:1651529344.539785:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11412 00000100:00100000:1.0:1651529344.539790:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11413 00000100:00100000:1.0:1651529344.539791:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1322:41278:x1731746396304192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.539794:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.539795:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1322 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539799:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 3/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1322 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539817:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa3edcd/0xa29a79078f3baab1 lrc: 0/0,0 mode: --/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2960 expref: 1322 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539820:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539821:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539822:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539825:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 4/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539826:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11414 00000100:00100000:0.0:1651529344.539828:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41279:x1731746396304128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.539832:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.539837:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.539838:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41278:x1731746396304192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.539839:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1321 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.539841:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11413 00010000:00010000:0.0:1651529344.539843:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 3/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1320 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539848:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539848:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd060c31/0xa29a79078f3b95aa lrc: 0/0,0 mode: --/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4e2 expref: 1320 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.539852:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539852:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539853:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539853:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539855:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539856:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 4/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539858:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539891:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.539898:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1319:41279:x1731746396304128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.539901:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11414 00010000:00010000:0.0:1651529344.539909:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539913:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349b2dd6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.539914:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539917:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 3/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539921:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 1/0,0 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539926:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be4cc lrc: 0/0,0 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539932:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539933:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946422848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1143us (1282us total) trans 30064893311 rc 0/0 00010000:00010000:0.0:1651529344.539935:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539936:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152450 00010000:00010000:0.0:1651529344.539938:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539941:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539944:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539954:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539957:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539960:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539991:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+746:39030:x1731745946422720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1355us total) trans 30064893312 rc 0/0 00000100:00100000:0.0:1651529344.539994:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152449 00000100:00100000:1.0:1651529344.539999:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946422784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1279us (1384us total) trans 30064893313 rc 0/0 00010000:00010000:0.0:1651529344.540001:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540005:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.540006:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540008:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 3/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540011:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152448 00010000:00010000:0.0:1651529344.540013:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 1/0,0 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540016:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be4c5 lrc: 0/0,0 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540019:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540022:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540023:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a98cab06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.540024:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540025:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540027:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 3/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540028:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540031:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540032:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 1/0,0 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540035:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be4be lrc: 0/0,0 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540039:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540042:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.540043:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540046:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 3/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540057:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 1/0,0 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540060:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be4e1 lrc: 0/0,0 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540066:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540066:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+745:39029:x1731745946423104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (960us total) trans 30064893314 rc 0/0 00010000:00010000:1.0:1651529344.540068:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540069:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152453 00010000:00010000:1.0:1651529344.540071:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540074:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540076:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540079:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540093:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540095:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540122:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+746:39030:x1731745946423040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 991us (1025us total) trans 30064893315 rc 0/0 00000100:00100000:1.0:1651529344.540125:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152452 00010000:00010000:1.0:1651529344.540132:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540133:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+745:39029:x1731745946422976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1058us (1103us total) trans 30064893316 rc 0/0 00010000:00010000:1.0:1651529344.540135:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000511d1ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.540136:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540136:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152451 00010000:00010000:0.0:1651529344.540144:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540147:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 3/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540147:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.540148:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540151:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 3/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540152:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 1/0,0 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540155:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be4da lrc: 0/0,0 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540155:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 1/0,0 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540158:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be4d3 lrc: 0/0,0 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540210:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966631360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540223:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540298:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966631424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.540301:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966631488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540306:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.540323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540333:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304256 00000100:00100000:0.0:1651529344.540334:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304320 00010000:00010000:1.0:1651529344.540338:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 4/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1320 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.540339:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1320 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540345:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304384 00000100:00100000:0.0:1651529344.540346:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11415 00010000:00010000:1.0:1651529344.540348:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1321 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.540348:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41279:x1731746396304256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.540351:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.540352:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 4/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1321 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540353:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11416 00000100:00100000:1.0:1651529344.540355:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41278:x1731746396304320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.540356:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 3/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1321 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540358:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.540367:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1321 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540371:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1321 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.540375:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6951ce/0xa29a79078f3bb7ae lrc: 0/0,0 mode: --/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cdd expref: 1321 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540376:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae534a18/0xa29a79078f3b77a4 lrc: 0/0,0 mode: --/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb38d expref: 1321 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540380:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.540380:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540380:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540381:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540387:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 4/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540390:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1319:41278:x1731746396304320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.540393:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11416 00010000:00010000:0.0:1651529344.540394:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.540398:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11417 00000100:00100000:1.0:1651529344.540399:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41278:x1731746396304384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.540402:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.540402:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41279:x1731746396304256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.540403:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1318 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.540404:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11415 00010000:00010000:1.0:1651529344.540407:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1318 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540412:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000752c983d/0xa29a79078f3b779d lrc: 0/0,0 mode: --/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb37f expref: 1317 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540415:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540416:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540417:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540420:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 4/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540425:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.540430:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1316:41278:x1731746396304384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.540433:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11417 00010000:00010000:0.0:1651529344.540434:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540438:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540438:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540441:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540442:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540445:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540447:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540453:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540502:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+746:39029:x1731745946423232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1202us (1255us total) trans 30064893317 rc 0/0 00000100:00100000:1.0:1651529344.540505:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152455 00000100:00100000:0.0:1651529344.540509:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946423168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1240us (1306us total) trans 30064893318 rc 0/0 00010000:00010000:1.0:1651529344.540512:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540513:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152454 00010000:00010000:1.0:1651529344.540518:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a207f8b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.540519:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540520:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540522:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 3/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540524:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.540525:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540526:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 1/0,0 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540528:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 3/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540529:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be4ef lrc: 0/0,0 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540533:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 1/0,0 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540536:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be4e8 lrc: 0/0,0 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540597:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.540609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540609:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423744 00000100:00100000:1.0:1651529344.540615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540616:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423872 00000100:00100000:0.0:1651529344.540620:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424000 00000100:00100000:1.0:1651529344.540621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540634:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423808 00000100:00100000:0.0:1651529344.540642:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152456 00000100:00100000:1.0:1651529344.540644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540644:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+748:39029:x1731745946423744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.540654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.540654:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177248 count 1 00000100:00100000:1.0:1651529344.540663:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423936 00010000:00010000:0.0:1651529344.540663:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540668:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 2/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.540672:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424064 00000100:00100000:1.0:1651529344.540676:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152457 00010000:00010000:0.0:1651529344.540676:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.540677:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+750:39029:x1731745946423872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.540677:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540677:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 4/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.540682:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177250 count 1 00010000:00010000:1.0:1651529344.540687:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540694:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 2/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540697:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540697:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540698:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 4/0,1 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540704:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 3/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540705:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 3/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540708:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540709:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 4/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540713:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966631616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.540713:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966631552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.540725:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540740:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152458 00000100:00100000:1.0:1651529344.540742:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+750:39029:x1731745946424000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.540746:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177252 count 1 00000100:00100000:0.0:1651529344.540754:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.540762:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152459 00010000:00010000:1.0:1651529344.540763:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540764:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+750:39030:x1731745946423808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.540768:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 2/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.540770:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177249 count 1 00010000:00010000:1.0:1651529344.540771:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540772:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540773:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 4/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540774:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540778:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 2/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540780:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 3/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540782:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540782:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540783:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 4/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540784:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 4/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540788:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966631680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540789:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 3/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540793:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1315 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540795:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.540797:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966631744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.540819:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540821:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152460 00000100:00100000:1.0:1651529344.540823:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+750:39030:x1731745946423936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.540826:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152461 00000100:00100000:0.0:1651529344.540827:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+750:39030:x1731745946424064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.540828:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177251 count 1 00010000:00010000:1.0:1651529344.540832:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.540832:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177253 count 1 00010000:00010000:1.0:1651529344.540836:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 2/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540836:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540839:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540840:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540841:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 4/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540841:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 2/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540843:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540844:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540845:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 4/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540847:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 3/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540851:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 3/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1315 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540854:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1315 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.540858:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966631872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540861:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1315 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.540865:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966631808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.540865:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540874:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.540881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540911:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424192 00000100:00100000:0.0:1651529344.540918:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424256 00000100:00100000:0.0:1651529344.540922:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152462 00000100:00100000:0.0:1651529344.540923:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+752:39030:x1731745946424192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.540928:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177254 count 1 00010000:00010000:0.0:1651529344.540932:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540937:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 2/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540940:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540940:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540941:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 4/0,1 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540944:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152463 00000100:00100000:1.0:1651529344.540946:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+752:39030:x1731745946424256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.540951:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177255 count 1 00010000:00010000:1.0:1651529344.540956:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540960:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 2/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1315 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540963:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540964:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540964:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 4/0,1 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540966:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 3/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1315 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540969:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 4/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.540971:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 3/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1315 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.540974:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966631936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540975:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 4/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1315 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.540986:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540990:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.540999:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.541343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.541343:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966631552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.541352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.541353:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541361:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966631872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.541364:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.541370:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966631744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.541372:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541379:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304960 00000100:00100000:1.0:1651529344.541385:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966631616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541389:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541397:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966631680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.541397:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1316 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541400:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541406:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966631808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541409:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541414:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304896 00000100:00100000:1.0:1651529344.541415:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305088 00010000:00010000:0.0:1651529344.541418:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 4/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1318 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541420:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1318 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541423:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11418 00000100:00100000:0.0:1651529344.541425:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41278:x1731746396304960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.541427:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11419 00000100:00100000:1.0:1651529344.541428:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41279:x1731746396304896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.541428:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541429:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1318 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541433:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 3/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1318 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541441:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541441:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bb07d lrc: 0/0,0 mode: --/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40dd expref: 1318 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541443:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 4/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1318 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541445:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541446:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541447:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 3/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1317 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541447:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541453:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092789d3e/0xa29a79078f3bae70 lrc: 0/0,0 mode: --/PR res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3832 expref: 1317 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541456:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541457:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541458:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541461:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 4/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541461:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 4/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541468:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.541468:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541477:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1316:41279:x1731746396304896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.541478:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1316:41278:x1731746396304960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541480:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11419 00000100:00100000:0.0:1651529344.541481:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11418 00000100:00100000:1.0:1651529344.541485:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11420 00000100:00100000:1.0:1651529344.541486:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41278:x1731746396305088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.541489:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541489:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541490:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541493:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541496:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541498:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541504:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 3/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541509:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81530b8/0xa29a79078f3b94ae lrc: 0/0,0 mode: --/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd02e expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541512:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541513:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541514:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541517:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 4/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541525:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541532:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1313:41278:x1731746396305088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541534:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11420 00010000:00010000:1.0:1651529344.541542:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541545:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541549:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541549:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+753:39029:x1731745946423744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 905us (959us total) trans 30064893319 rc 0/0 00000100:00100000:0.0:1651529344.541553:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152456 00010000:00010000:1.0:1651529344.541560:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541560:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541563:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.541564:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541567:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 3/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541572:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 1/0,0 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541575:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be4f6 lrc: 0/0,0 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541582:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d26bd014 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.541583:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541588:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 3/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541591:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 1/0,0 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541594:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be4fd lrc: 0/0,0 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541599:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541601:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541603:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+753:39029:x1731745946423872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 925us (994us total) trans 30064893320 rc 0/0 00010000:00010000:0.0:1651529344.541604:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541606:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152457 00010000:00010000:0.0:1651529344.541607:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541613:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541617:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.541618:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541621:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 3/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541626:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 1/0,0 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541629:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be519 lrc: 0/0,0 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541643:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946424064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 815us (989us total) trans 30064893321 rc 0/0 00000100:00100000:0.0:1651529344.541646:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152461 00000100:00100000:1.0:1651529344.541664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.541673:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305024 00000100:00100000:1.0:1651529344.541677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.541678:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 4/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1313 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541686:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305216 00010000:00010000:0.0:1651529344.541688:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.541689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.541692:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305152 00010000:00010000:0.0:1651529344.541694:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1315 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541705:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11421 00000100:00100000:0.0:1651529344.541706:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1315:41279:x1731746396305024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.541709:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541711:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 4/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541715:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 3/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541720:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002110ab4a/0xa29a79078f3bb3ef lrc: 0/0,0 mode: --/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f0e expref: 1315 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541724:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541724:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541725:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541728:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 4/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541742:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.541748:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.541755:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41279:x1731746396305024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.541759:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11421 00000100:00100000:0.0:1651529344.541763:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305344 00010000:00010000:0.0:1651529344.541767:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 5/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1314 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541772:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11422 00000100:00100000:0.0:1651529344.541773:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41278:x1731746396305216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.541776:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541777:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541780:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 3/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.541783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.541785:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c49383b/0xa29a79078f3b9396 lrc: 0/0,0 mode: --/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc1b expref: 1314 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541789:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541789:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541790:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541793:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 4/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541802:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541834:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305280 00010000:00010000:1.0:1651529344.541841:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 5/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1314 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541843:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41278:x1731746396305216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.541846:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11422 00000100:00100000:1.0:1651529344.541848:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11423 00000100:00100000:1.0:1651529344.541850:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1313:41279:x1731746396305152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.541852:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11424 00010000:00010000:1.0:1651529344.541853:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.541854:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1313 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.541854:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1313:41278:x1731746396305344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.541857:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.541858:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 3/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1313 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541858:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 5/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1313 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541862:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 4/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1313 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541864:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7487da1/0xa29a79078f3b989e lrc: 0/0,0 mode: --/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce07a expref: 1313 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.541868:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541868:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541868:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541869:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541869:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541870:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541872:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 4/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541873:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 4/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541876:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.541882:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.541890:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1312:41278:x1731746396305344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541893:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1312:41279:x1731746396305152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.541893:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11424 00000100:00100000:0.0:1651529344.541898:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11425 00000100:00100000:0.0:1651529344.541900:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1311:41278:x1731746396305280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.541902:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541903:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 5/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1311 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.541904:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11423 00010000:00010000:0.0:1651529344.541907:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 4/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.541912:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541912:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541913:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541916:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 4/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541920:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.541921:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3b9143 lrc: 0/0,0 mode: --/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc584 expref: 1310 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.541925:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.541925:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1309:41278:x1731746396305280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.541928:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541932:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541934:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541937:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541940:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541944:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11425 00010000:00010000:0.0:1651529344.541959:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541962:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541966:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541971:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541990:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946424256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1043us (1086us total) trans 30064893322 rc 0/0 00000100:00100000:1.0:1651529344.541994:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152463 00010000:00010000:1.0:1651529344.542001:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542014:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542014:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946423808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1392us total) trans 30064893323 rc 0/0 00010000:00010000:1.0:1651529344.542017:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542017:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152459 00010000:00010000:1.0:1651529344.542020:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542035:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c51f16/0xa29a79078f3bb3cc lrc: 0/0,0 mode: --/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e20 expref: 1308 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.542040:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966631936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.542044:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542047:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542050:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542053:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542055:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542059:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+753:39029:x1731745946424000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1316us (1443us total) trans 30064893324 rc 0/0 00000100:00100000:1.0:1651529344.542062:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152458 00010000:00010000:1.0:1651529344.542069:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542072:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542075:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542078:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542092:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+754:39030:x1731745946424192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1211us total) trans 30064893325 rc 0/0 00000100:00100000:0.0:1651529344.542095:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152462 00010000:00010000:0.0:1651529344.542103:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542106:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e76bff1f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.542107:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542108:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946423936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1284us (1469us total) trans 30064893326 rc 0/0 00010000:00010000:0.0:1651529344.542110:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 3/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542115:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 1/0,0 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542118:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be527 lrc: 0/0,0 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542120:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152460 00010000:00010000:0.0:1651529344.542122:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542125:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.542126:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542131:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 3/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542134:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 1/0,0 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542136:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be50b lrc: 0/0,0 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542140:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542141:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542142:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e471716 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.542143:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542144:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.542146:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542146:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 3/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542149:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 3/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542149:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 1/0,0 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542151:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be504 lrc: 0/0,0 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542153:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 1/0,0 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542155:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542156:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be520 lrc: 0/0,0 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542158:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db78a802 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.542159:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542161:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 3/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542164:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 1/0,0 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542167:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be512 lrc: 0/0,0 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542207:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424832 00000100:00100000:1.0:1651529344.542247:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152464 00000100:00100000:1.0:1651529344.542249:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946424832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.542254:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177257 count 1 00010000:00010000:1.0:1651529344.542258:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542263:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 2/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542276:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542276:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542277:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 4/0,1 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542284:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 3/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542288:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 4/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.542292:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966632064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542306:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.542319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542353:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424768 00000100:00100000:1.0:1651529344.542364:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424896 00000100:00100000:1.0:1651529344.542376:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425152 00000100:00100000:1.0:1651529344.542381:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152465 00000100:00100000:1.0:1651529344.542383:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+756:39029:x1731745946424768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.542387:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177256 count 1 00000100:00100000:0.0:1651529344.542391:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.542392:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542396:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 2/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542407:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542408:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542409:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 4/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542411:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425216 00010000:00010000:1.0:1651529344.542416:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 3/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542420:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 4/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.542423:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966632128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542428:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152466 00000100:00100000:0.0:1651529344.542430:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+757:39029:x1731745946424896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.542433:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.542436:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177258 count 1 00000100:00100000:1.0:1651529344.542440:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152467 00010000:00010000:0.0:1651529344.542440:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542442:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946425152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.542445:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 2/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.542446:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177259 count 1 00010000:00010000:0.0:1651529344.542448:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542449:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542450:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542450:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 4/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542454:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 2/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542457:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542457:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542457:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 3/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542458:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 4/0,1 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542461:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.542465:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966632192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542474:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 3/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.542475:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.542478:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 4/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.542482:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542482:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152468 00000100:00100000:0.0:1651529344.542483:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946425216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.542487:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177260 count 1 00000100:00100000:1.0:1651529344.542490:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.542490:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542495:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 2/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542512:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542513:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542514:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 4/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542521:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 3/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.542522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.542528:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.542532:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966632320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542540:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.542546:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425280 00000100:00100000:0.0:1651529344.542553:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152469 00000100:00100000:0.0:1651529344.542555:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+758:39030:x1731745946425280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.542557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.542559:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177261 count 1 00010000:00010000:0.0:1651529344.542570:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.542575:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 2/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542583:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542584:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542584:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 4/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542590:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 3/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542594:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.542601:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966632384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542620:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425344 00000100:00100000:0.0:1651529344.542622:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.542631:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425408 00000100:00100000:1.0:1651529344.542634:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152470 00000100:00100000:1.0:1651529344.542635:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+760:39030:x1731745946425344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.542640:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177262 count 1 00010000:00010000:1.0:1651529344.542645:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542645:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152471 00000100:00100000:0.0:1651529344.542647:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+760:39030:x1731745946425408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.542649:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 2/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542652:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542653:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.542653:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177263 count 1 00010000:00010000:1.0:1651529344.542654:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 4/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542657:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542661:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 2/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542664:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542665:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542666:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 4/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542669:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 3/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542672:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 3/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1307 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542673:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.542676:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.542677:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966632448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542680:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966632512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542697:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.542698:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.542705:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966632064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542707:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305920 00010000:00010000:1.0:1651529344.542709:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542712:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 4/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1308 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.542724:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11426 00000100:00100000:0.0:1651529344.542725:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1308:41279:x1731746396305920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.542728:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.542737:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 4/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1308 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.542742:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 3/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1308 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.542748:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bb4b3 lrc: 0/0,0 mode: --/PR res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51d8 expref: 1308 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.542752:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542752:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542753:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542756:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 4/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542765:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.542770:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542775:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396305920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.542778:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542778:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11426 00010000:00010000:1.0:1651529344.542782:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542784:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542858:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+761:39030:x1731745946424832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 608us (667us total) trans 30064893327 rc 0/0 00000100:00100000:1.0:1651529344.542868:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152464 00010000:00010000:1.0:1651529344.542876:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542887:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000213da448 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.542889:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542892:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 3/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542897:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 1/0,0 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542899:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be52e lrc: 0/0,0 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542959:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966632128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542963:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542977:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542980:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543024:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.543036:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966632192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.543038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.543041:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543049:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966632320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543051:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.543065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543066:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306048 00010000:00010000:0.0:1651529344.543071:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543082:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306176 00000100:00100000:1.0:1651529344.543083:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305984 00010000:00010000:0.0:1651529344.543085:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1309 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543089:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 4/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1309 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543089:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306112 00010000:00010000:0.0:1651529344.543091:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 4/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.543096:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11427 00000100:00100000:1.0:1651529344.543098:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1310:41279:x1731746396306048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.543098:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11428 00000100:00100000:0.0:1651529344.543100:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1310:41279:x1731746396306176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.543101:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543103:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.543103:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.543104:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543107:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 3/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.543111:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 3/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543112:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f2eb16/0xa29a79078f3bbfc6 lrc: 0/0,0 mode: --/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c25 expref: 1310 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543116:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543116:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb377362/0xa29a79078f3bb2d7 lrc: 0/0,0 mode: --/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a30 expref: 1309 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543117:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543118:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543120:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543120:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543121:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 4/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543121:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543130:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543141:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1308:41279:x1731746396306048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543150:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11427 00010000:00010000:0.0:1651529344.543158:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 4/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543166:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543171:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11429 00000100:00100000:1.0:1651529344.543172:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41278:x1731746396305984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.543174:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396306176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 74us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.543176:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543177:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 4/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1307 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543177:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11428 00010000:00010000:1.0:1651529344.543181:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 3/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1306 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543183:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11430 00000100:00100000:0.0:1651529344.543185:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1306:41278:x1731746396306112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.543187:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000892044cd/0xa29a79078f3bbcfc lrc: 0/0,0 mode: --/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d714a expref: 1306 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.543188:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.543189:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 4/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1306 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543190:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543191:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543192:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543193:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 3/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543195:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 4/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543198:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4c5802/0xa29a79078f3bb570 lrc: 0/0,0 mode: --/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54e1 expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543201:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.543202:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543202:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543203:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543206:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 4/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543208:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1304:41278:x1731746396305984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543211:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11429 00010000:00010000:0.0:1651529344.543214:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.543220:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1303:41278:x1731746396306112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.543222:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11430 00000100:00100000:1.0:1651529344.543228:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966632448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.543237:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966632384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.543239:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543241:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543246:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543246:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543249:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543249:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543252:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543252:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543255:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543256:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543297:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+762:39030:x1731745946425152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 854us (960us total) trans 30064893328 rc 0/0 00000100:00100000:1.0:1651529344.543300:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152467 00000100:00100000:1.0:1651529344.543305:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425792 00000100:00100000:0.0:1651529344.543307:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+762:39030:x1731745946425216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 823us (916us total) trans 30064893329 rc 0/0 00000100:00100000:0.0:1651529344.543311:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152468 00000100:00100000:1.0:1651529344.543320:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152472 00000100:00100000:1.0:1651529344.543322:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+761:39030:x1731745946425792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.543326:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177264 count 1 00010000:00010000:0.0:1651529344.543326:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543329:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.543330:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543330:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543333:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 3/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543335:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 2/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1302 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.543338:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 1/0,0 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543341:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be543 lrc: 0/0,0 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543345:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543348:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543348:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543348:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.543349:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 4/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543349:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543352:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 3/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543355:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 1/0,0 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543357:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 3/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1302 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.543358:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be54a lrc: 0/0,0 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543360:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 4/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.543364:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543364:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543367:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543370:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543372:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543373:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.543378:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543388:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543391:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543394:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543421:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+763:39029:x1731745946424896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 990us (1092us total) trans 30064893330 rc 0/0 00000100:00100000:0.0:1651529344.543424:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152466 00010000:00010000:0.0:1651529344.543432:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543437:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+762:39029:x1731745946424768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1053us (1117us total) trans 30064893331 rc 0/0 00010000:00010000:0.0:1651529344.543444:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.543445:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543447:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152465 00010000:00010000:0.0:1651529344.543448:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 3/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543453:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 1/0,0 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543456:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543456:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be53c lrc: 0/0,0 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543459:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.543460:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543463:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 3/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543468:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 1/0,0 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543471:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be535 lrc: 0/0,0 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.543504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543546:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966632512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543550:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543555:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306304 00010000:00010000:1.0:1651529344.543561:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1303 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.543569:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306432 00010000:00010000:1.0:1651529344.543571:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1304 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543571:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306368 00010000:00010000:0.0:1651529344.543577:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.543588:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11431 00000100:00100000:1.0:1651529344.543589:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1305:41279:x1731746396306304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.543592:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543594:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543597:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 3/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543597:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11432 00000100:00100000:0.0:1651529344.543599:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1305:41279:x1731746396306368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.543602:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543603:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b2f921/0xa29a79078f3babb4 lrc: 0/0,0 mode: --/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d57 expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.543604:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1305 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543607:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543607:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543608:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543608:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 3/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1304 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543611:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 4/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543614:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bacfd lrc: 0/0,0 mode: --/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d333f expref: 1304 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.543618:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543620:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.543625:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543626:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543630:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1303:41279:x1731746396306304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543633:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11431 00010000:00010000:0.0:1651529344.543633:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 4/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543638:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11433 00010000:00010000:0.0:1651529344.543642:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543650:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1302:41278:x1731746396306432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.543653:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543654:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543658:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 3/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.543669:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085d977d7/0xa29a79078f3ba5a9 lrc: 0/0,0 mode: --/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15be expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.543669:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1302:41279:x1731746396306368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 69us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.543672:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.543672:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11432 00010000:00010000:1.0:1651529344.543673:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543674:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543677:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 4/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543685:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543692:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41278:x1731746396306432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543695:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11433 00010000:00010000:0.0:1651529344.543699:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543702:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543703:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543705:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543706:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543717:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543719:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543722:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543772:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+763:39030:x1731745946425344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1215us total) trans 30064893332 rc 0/0 00000100:00100000:1.0:1651529344.543775:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152470 00000100:00100000:0.0:1651529344.543786:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+762:39030:x1731745946425280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1230us (1264us total) trans 30064893333 rc 0/0 00000100:00100000:0.0:1651529344.543789:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152469 00010000:00010000:0.0:1651529344.543797:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543800:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.543801:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543818:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 3/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543828:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 1/0,0 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543831:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be551 lrc: 0/0,0 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543836:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.543838:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.543839:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543847:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 3/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543851:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 1/0,0 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543853:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be558 lrc: 0/0,0 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.543862:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543865:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543868:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543871:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.543911:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+762:39030:x1731745946425408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1263us (1306us total) trans 30064893334 rc 0/0 00000100:00100000:0.0:1651529344.543914:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152471 00000100:00100000:0.0:1651529344.543920:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425920 00000100:00100000:1.0:1651529344.543931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.543942:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425984 00000100:00100000:0.0:1651529344.543948:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426048 00000100:00100000:0.0:1651529344.543952:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152473 00000100:00100000:0.0:1651529344.543953:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+764:39030:x1731745946425920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.543959:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177265 count 1 00010000:00010000:0.0:1651529344.543963:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.543968:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 2/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.543978:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543978:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543979:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543979:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 4/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543982:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000864924c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.543983:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543986:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 3/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543987:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 3/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.543991:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 1/0,0 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543991:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544003:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864924c7/0xa29a79078f3be55f lrc: 0/0,0 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544010:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966632640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544012:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426112 00000100:00100000:1.0:1651529344.544022:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152474 00000100:00100000:1.0:1651529344.544024:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+765:39030:x1731745946425984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.544031:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.544035:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177266 count 1 00000100:00100000:0.0:1651529344.544038:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152475 00010000:00010000:1.0:1651529344.544039:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544040:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+765:39029:x1731745946426048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.544044:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 2/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.544045:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177267 count 1 00010000:00010000:1.0:1651529344.544047:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544047:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544048:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 4/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544049:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544053:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 2/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544055:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 3/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544058:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544062:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966632704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544069:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544070:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544070:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 4/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544072:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.544078:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 3/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544081:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 4/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.544085:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966632768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544087:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152476 00000100:00100000:1.0:1651529344.544089:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+765:39030:x1731745946426112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.544093:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177268 count 1 00000100:00100000:0.0:1651529344.544094:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.544097:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544101:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 2/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1299 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.544103:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306944 00010000:00010000:1.0:1651529344.544104:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544105:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544106:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 4/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544108:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 5/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544112:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 3/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1300 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544116:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544120:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966632832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544127:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.544143:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11434 00000100:00100000:0.0:1651529344.544145:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41279:x1731746396306944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.544148:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.544150:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 4/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544152:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544157:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 3/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544160:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544163:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3b9fcf lrc: 0/0,0 mode: --/PR res: [0x2b470:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd06 expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.544166:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544167:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544168:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544171:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 4/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544179:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.544183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.544187:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41279:x1731746396306944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.544190:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11434 00000100:00100000:1.0:1651529344.544206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.544218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.544225:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544235:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426240 00000100:00100000:0.0:1651529344.544242:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426176 00000100:00100000:0.0:1651529344.544246:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426304 00010000:00010000:1.0:1651529344.544248:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544249:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152477 00000100:00100000:0.0:1651529344.544251:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+768:39030:x1731745946426240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.544256:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177270 count 1 00010000:00010000:1.0:1651529344.544257:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544260:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544280:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544288:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 2/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544291:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544291:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544292:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 4/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544299:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 3/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544302:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 4/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1298 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544304:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+769:39030:x1731745946425792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 982us (1281us total) trans 30064893335 rc 0/0 00000100:00100000:0.0:1651529344.544306:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966632896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544308:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152472 00000100:00100000:1.0:1651529344.544313:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152478 00000100:00100000:1.0:1651529344.544315:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+768:39029:x1731745946426176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.544318:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.544320:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177269 count 1 00010000:00010000:1.0:1651529344.544324:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544324:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152479 00000100:00100000:0.0:1651529344.544325:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+768:39030:x1731745946426304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.544328:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 2/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.544330:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177271 count 1 00010000:00010000:1.0:1651529344.544331:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544332:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544333:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 4/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544340:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544344:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1298 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544348:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544350:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544355:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 2/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1298 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.544356:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.544358:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544359:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544360:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 4/0,1 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544367:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 3/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1298 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544387:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 4/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1298 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.544392:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966633024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544400:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.544407:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544410:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.544412:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544415:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 3/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544419:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 1/0,0 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544422:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be566 lrc: 0/0,0 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544434:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966632640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544438:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544451:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966632704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.544456:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.544567:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426816 00000100:00100000:0.0:1651529344.544575:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152480 00000100:00100000:0.0:1651529344.544577:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+769:39030:x1731745946426816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.544582:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177272 count 1 00010000:00010000:0.0:1651529344.544587:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544592:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 2/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544595:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544595:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544596:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 4/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544603:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 3/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1298 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544606:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 4/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1298 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.544610:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966633088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544644:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.544726:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.544741:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966632832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.544745:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.544761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.544765:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307200 00010000:00010000:1.0:1651529344.544771:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 5/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544776:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307072 00010000:00010000:1.0:1651529344.544779:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1300 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544783:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307264 00010000:00010000:1.0:1651529344.544785:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1301 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544788:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307136 00010000:00010000:1.0:1651529344.544796:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.544801:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.544802:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11435 00000100:00100000:1.0:1651529344.544821:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1302:41278:x1731746396307200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.544824:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.544826:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 5/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.544829:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966632768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.544830:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 3/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544836:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009606e2c3/0xa29a79078f3bbc3f lrc: 0/0,0 mode: --/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e8e expref: 1302 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.544838:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544839:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544840:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544841:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544844:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 4/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544850:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.544850:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544853:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544856:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544859:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1301:41278:x1731746396307200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.544859:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544862:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11435 00000100:00100000:1.0:1651529344.544867:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307328 00010000:00010000:1.0:1651529344.544870:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 5/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1301 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.544875:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11436 00000100:00100000:1.0:1651529344.544877:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1301:41279:x1731746396307072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.544879:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.544881:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1301 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544884:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 3/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1301 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544889:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bb4a5 lrc: 0/0,0 mode: --/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a7 expref: 1301 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544892:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544892:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544893:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544896:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 4/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544905:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+770:39029:x1731745946426048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 864us (974us total) trans 30064893336 rc 0/0 00000100:00100000:0.0:1651529344.544908:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152475 00010000:00010000:1.0:1651529344.544913:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.544920:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41279:x1731746396307072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.544923:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11436 00010000:00010000:0.0:1651529344.544924:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544927:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11437 00000100:00100000:1.0:1651529344.544929:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41278:x1731746396307264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.544930:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c7ba89e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.544931:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544932:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.544933:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.544934:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 3/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544937:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 3/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.544939:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 1/0,0 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544941:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce4110f/0xa29a79078f3bb809 lrc: 0/0,0 mode: --/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e1f expref: 1299 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.544942:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba89e/0xa29a79078f3be57b lrc: 0/0,0 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544945:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544945:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544946:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544949:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 4/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544952:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966633024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.544955:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.544955:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544960:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1298:41278:x1731746396307264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.544962:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966632896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544965:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544969:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11437 00010000:00010000:0.0:1651529344.544970:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544973:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544976:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544978:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11438 00010000:00010000:0.0:1651529344.544979:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544980:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1297:41279:x1731746396307136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.544982:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.544984:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1297 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.544995:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 3/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1297 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545000:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a43372/0xa29a79078f3ba762 lrc: 0/0,0 mode: --/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d35 expref: 1297 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545004:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545004:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545005:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545008:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 4/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545014:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.545019:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+770:39030:x1731745946425920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1065us (1182us total) trans 30064893337 rc 0/0 00000100:00100000:1.0:1651529344.545020:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1296:41279:x1731746396307136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545023:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11438 00000100:00100000:0.0:1651529344.545023:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152473 00000100:00100000:1.0:1651529344.545027:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11439 00000100:00100000:1.0:1651529344.545036:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41279:x1731746396307328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545039:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545040:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 4/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1295 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545044:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 3/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1295 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545049:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e9bc3e9/0xa29a79078f3ba690 lrc: 0/0,0 mode: --/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19a0 expref: 1295 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545052:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545053:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545054:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545056:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 4/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545064:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545082:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1294:41279:x1731746396307328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545086:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11439 00010000:00010000:0.0:1651529344.545096:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545097:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966632960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545109:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545114:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545118:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545121:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545125:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545128:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000781ba0b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.545129:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545132:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 3/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545136:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 1/0,0 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545139:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781ba0b1/0xa29a79078f3be56d lrc: 0/0,0 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545143:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545146:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5997f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.545147:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545150:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 3/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545156:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 1/0,0 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545158:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5997f3/0xa29a79078f3be589 lrc: 0/0,0 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545163:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545166:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545169:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545172:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545173:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+770:39030:x1731745946426240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (995us total) trans 30064893338 rc 0/0 00000100:00100000:0.0:1651529344.545176:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152477 00010000:00010000:0.0:1651529344.545200:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545215:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+770:39030:x1731745946425984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1326us total) trans 30064893339 rc 0/0 00000100:00100000:1.0:1651529344.545218:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152474 00010000:00010000:0.0:1651529344.545221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.545223:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545226:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545226:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 3/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545229:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545231:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 1/0,0 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545234:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be574 lrc: 0/0,0 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545235:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545237:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.545287:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.545302:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+770:39030:x1731745946426112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1212us (1334us total) trans 30064893340 rc 0/0 00000100:00100000:1.0:1651529344.545305:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152476 00000100:00100000:0.0:1651529344.545307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.545315:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426944 00000100:00100000:1.0:1651529344.545325:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152481 00000100:00100000:1.0:1651529344.545333:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+770:39029:x1731745946426944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.545335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.545338:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177273 count 1 00010000:00010000:1.0:1651529344.545342:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545347:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 2/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.545347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545350:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545351:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545351:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 4/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545353:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427008 00010000:00010000:1.0:1651529344.545358:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 3/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.545360:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152482 00000100:00100000:0.0:1651529344.545362:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+771:39030:x1731745946427008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.545364:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.545368:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966633152:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.545368:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177274 count 1 00000100:00100000:1.0:1651529344.545383:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.545390:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307392 00010000:00010000:0.0:1651529344.545391:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545395:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1294 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545397:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 2/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1294 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.545400:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545401:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.545404:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307456 00010000:00010000:1.0:1651529344.545406:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 4/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1295 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545406:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 4/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545410:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307648 00010000:00010000:1.0:1651529344.545413:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 5/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1296 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545415:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 3/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1296 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.545417:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11440 00000100:00100000:1.0:1651529344.545419:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1296:41278:x1731746396307392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.545419:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1296 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545422:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545423:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1296 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.545423:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966633216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545427:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1296 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.545432:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.545435:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a56829e/0xa29a79078f3bb76f lrc: 0/0,0 mode: --/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ba9 expref: 1296 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545439:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545439:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545440:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545441:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966633088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545443:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 4/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545445:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545450:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.545452:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11441 00000100:00100000:0.0:1651529344.545454:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41278:x1731746396307456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.545456:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41278:x1731746396307392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.545457:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.545459:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11440 00010000:00010000:0.0:1651529344.545459:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 4/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1295 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.545463:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11442 00010000:00010000:0.0:1651529344.545463:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 3/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1294 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.545465:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1294:41278:x1731746396307648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545467:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545469:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 4/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1294 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545469:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9082412/0xa29a79078f3b96e5 lrc: 0/0,0 mode: --/PR res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd93b expref: 1294 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.545472:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 3/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545473:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545473:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545474:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545477:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecf93893/0xa29a79078f3b9bbc lrc: 0/0,0 mode: --/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecd6 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.545477:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 4/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545484:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.545491:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545492:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545493:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545496:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 4/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545504:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.545520:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1292:41278:x1731746396307456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.545523:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11441 00000100:00100000:1.0:1651529344.545528:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41278:x1731746396307648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545531:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11442 00010000:00010000:0.0:1651529344.545531:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545535:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545538:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545538:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545540:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545541:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545545:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545547:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545590:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946426304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1263us (1371us total) trans 30064893341 rc 0/0 00000100:00100000:1.0:1651529344.545591:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+773:39029:x1731745946426176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1385us total) trans 30064893342 rc 0/0 00000100:00100000:0.0:1651529344.545593:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152479 00000100:00100000:1.0:1651529344.545595:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152478 00010000:00010000:0.0:1651529344.545600:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545604:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.545605:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545608:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 3/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545610:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545612:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 1/0,0 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545614:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.545615:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545615:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be582 lrc: 0/0,0 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545618:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 3/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545620:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545622:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 1/0,0 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545622:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4f1e207 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.545623:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545625:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be597 lrc: 0/0,0 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545629:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 3/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545632:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 1/0,0 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545635:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be590 lrc: 0/0,0 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545640:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.545643:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545646:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545648:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.545682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.545696:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+772:39030:x1731745946426816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1117us (1140us total) trans 30064893343 rc 0/0 00000100:00100000:0.0:1651529344.545699:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152480 00000100:00100000:0.0:1651529344.545704:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427136 00000100:00100000:0.0:1651529344.545710:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427072 00000100:00100000:0.0:1651529344.545714:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427200 00000100:00100000:0.0:1651529344.545718:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152483 00000100:00100000:0.0:1651529344.545719:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+774:39030:x1731745946427136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.545724:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177276 count 1 00010000:00010000:0.0:1651529344.545728:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545742:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 2/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.545745:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545746:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545747:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 4/0,1 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545753:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 3/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.545757:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 4/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.545759:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152484 00000100:00100000:0.0:1651529344.545761:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966633280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.545766:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+774:39029:x1731745946427072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.545772:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177275 count 1 00010000:00010000:1.0:1651529344.545782:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545787:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 2/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.545790:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.545800:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545801:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545802:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 4/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545821:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152485 00010000:00010000:1.0:1651529344.545822:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 3/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.545823:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+774:39029:x1731745946427200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.545826:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.545829:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177277 count 1 00000100:00100000:1.0:1651529344.545830:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966633344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.545833:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545838:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 2/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.545840:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.545841:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545841:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545842:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 4/0,1 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545845:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545848:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ba1b787 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.545849:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545849:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 3/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.545852:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 3/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545852:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 4/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.545856:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966633408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545857:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 1/0,0 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545869:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba1b787/0xa29a79078f3be59e lrc: 0/0,0 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545879:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.545887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.545947:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.545974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.545990:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966633152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545994:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546014:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.546023:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427264 00000100:00100000:0.0:1651529344.546032:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427392 00000100:00100000:1.0:1651529344.546035:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427328 00000100:00100000:0.0:1651529344.546037:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152486 00000100:00100000:0.0:1651529344.546039:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+777:39030:x1731745946427264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.546044:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152487 00002000:00080000:0.0:1651529344.546044:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177278 count 1 00000100:00100000:1.0:1651529344.546045:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+777:39030:x1731745946427392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.546049:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.546050:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177280 count 1 00010000:00010000:1.0:1651529344.546054:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546056:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 2/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546059:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 2/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1290 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546059:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546059:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546060:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 4/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546062:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546062:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546063:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 4/0,1 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546067:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 3/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546070:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 3/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1290 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546070:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546074:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966633472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546085:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 4/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1290 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546088:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.546095:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966633536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546095:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152488 00000100:00100000:0.0:1651529344.546097:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+777:39030:x1731745946427328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.546102:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177279 count 1 00000100:00100000:1.0:1651529344.546104:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.546105:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546110:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 2/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546113:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546114:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546114:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 4/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546120:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 3/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1290 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546124:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546128:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966633600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546138:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.546147:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966633216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.546150:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546157:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308160 00010000:00010000:0.0:1651529344.546162:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1291 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546172:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11443 00000100:00100000:0.0:1651529344.546174:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41278:x1731746396308160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.546177:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.546178:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1291 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546182:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 3/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1291 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546188:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cac85a15/0xa29a79078f3ba793 lrc: 0/0,0 mode: --/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1df2 expref: 1291 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546192:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546192:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546193:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546196:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 4/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546202:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.546236:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41278:x1731746396308160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.546239:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11443 00010000:00010000:0.0:1651529344.546246:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.546250:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546253:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546262:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546318:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546337:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966633344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546344:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+778:39030:x1731745946427008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 981us (1009us total) trans 30064893344 rc 0/0 00010000:00010000:1.0:1651529344.546346:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546348:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152482 00000100:00100000:1.0:1651529344.546354:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308096 00010000:00010000:0.0:1651529344.546355:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546358:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546364:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308224 00010000:00010000:1.0:1651529344.546366:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 5/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1291 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546370:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308288 00010000:00010000:0.0:1651529344.546371:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d26bd014 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.546372:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1292 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546373:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546376:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 3/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546381:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 1/0,0 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546383:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bd014/0xa29a79078f3be5ac lrc: 0/0,0 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546387:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308352 00010000:00010000:1.0:1651529344.546390:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 5/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546392:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11444 00000100:00100000:0.0:1651529344.546394:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1293:41278:x1731746396308096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.546395:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11445 00000100:00100000:1.0:1651529344.546397:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1293:41279:x1731746396308224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.546398:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546400:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.546400:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546401:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 5/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546405:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 4/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546406:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 3/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546410:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546411:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546411:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3ba51d lrc: 0/0,0 mode: --/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1364 expref: 1293 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546412:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546414:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546415:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 4/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546415:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546416:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546419:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.546419:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 4/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546429:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.546446:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1292:41279:x1731746396308224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.546447:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1292:41278:x1731746396308096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546449:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11445 00000100:00100000:0.0:1651529344.546450:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11444 00000100:00100000:1.0:1651529344.546454:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11446 00000100:00100000:1.0:1651529344.546461:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41278:x1731746396308288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.546464:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546465:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546466:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11447 00000100:00100000:0.0:1651529344.546468:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41279:x1731746396308352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.546469:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 3/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546471:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.546473:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 5/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1290 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546475:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca662a98/0xa29a79078f3b8cce lrc: 0/0,0 mode: --/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc338 expref: 1290 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546478:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546479:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546479:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546482:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 4/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546489:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.546490:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 4/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1289 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546500:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1289:41278:x1731746396308288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546503:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11446 00010000:00010000:0.0:1651529344.546503:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546504:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546505:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546508:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 4/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546510:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546513:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546513:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.546524:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546525:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1288:41279:x1731746396308352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.546527:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546528:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11447 00010000:00010000:0.0:1651529344.546547:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b12f15/0xa29a79078f3bb9d0 lrc: 0/0,0 mode: --/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6518 expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546552:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966633408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.546556:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546559:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546562:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546565:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546568:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546582:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+778:39029:x1731745946426944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1242us (1289us total) trans 30064893345 rc 0/0 00000100:00100000:1.0:1651529344.546586:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152481 00010000:00010000:1.0:1651529344.546593:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546596:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cb78239 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.546597:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546600:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 3/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546605:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 1/0,0 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546608:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be5a5 lrc: 0/0,0 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546612:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546615:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df1d0290 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.546616:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546618:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+778:39029:x1731745946427200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 794us (935us total) trans 30064893346 rc 0/0 00010000:00010000:1.0:1651529344.546619:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 3/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546621:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152485 00010000:00010000:1.0:1651529344.546622:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 1/0,0 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546624:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1d0290/0xa29a79078f3be5c1 lrc: 0/0,0 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546630:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546632:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546633:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966633472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546635:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546637:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546638:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546651:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068628a45/0xa29a79078f3ba1f8 lrc: 0/0,0 mode: --/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0587 expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.546656:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966633280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.546658:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546661:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546664:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546667:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546670:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546688:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+778:39029:x1731745946427072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (1031us total) trans 30064893347 rc 0/0 00000100:00100000:1.0:1651529344.546691:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152484 00010000:00010000:1.0:1651529344.546699:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546702:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8e86e58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.546703:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546706:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 3/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546711:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 1/0,0 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546713:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be5ba lrc: 0/0,0 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546717:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546720:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349b2dd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.546721:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546724:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 3/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546724:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+778:39030:x1731745946427136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1004us (1082us total) trans 30064893348 rc 0/0 00000100:00100000:0.0:1651529344.546727:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152483 00010000:00010000:1.0:1651529344.546729:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 1/0,0 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546742:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349b2dd6/0xa29a79078f3be5b3 lrc: 0/0,0 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546782:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308416 00010000:00010000:1.0:1651529344.546793:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546821:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11448 00000100:00100000:1.0:1651529344.546823:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1286:41278:x1731746396308416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.546826:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546828:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546832:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 3/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546837:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bb006 lrc: 0/0,0 mode: --/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ec9 expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546841:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546841:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.546841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.546842:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546847:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 4/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546856:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.546868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546870:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1285:41278:x1731746396308416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546879:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11448 00000100:00100000:0.0:1651529344.546882:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966633600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.546884:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308544 00010000:00010000:0.0:1651529344.546886:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546888:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1285 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546893:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308480 00010000:00010000:1.0:1651529344.546895:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 5/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1286 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546899:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11449 00000100:00100000:1.0:1651529344.546901:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1286:41278:x1731746396308544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.546903:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546905:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546906:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546908:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 3/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546910:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546913:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3b99a8 lrc: 0/0,0 mode: --/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce47f expref: 1286 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.546913:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546916:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546917:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546917:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546918:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546921:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 4/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546931:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.546937:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1285:41278:x1731746396308544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546940:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11449 00000100:00100000:1.0:1651529344.546944:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11450 00000100:00100000:1.0:1651529344.546945:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1284:41278:x1731746396308480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.546948:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546949:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 5/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1284 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546953:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 4/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1284 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.546957:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546957:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546958:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546963:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 4/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546967:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.546972:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1284:41278:x1731746396308480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546974:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11450 00000100:00100000:0.0:1651529344.546977:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+778:39030:x1731745946427264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 936us (1089us total) trans 30064893349 rc 0/0 00010000:00010000:1.0:1651529344.546984:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c0ec8a6/0xa29a79078f3b9683 lrc: 0/0,0 mode: --/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd807 expref: 1283 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.546988:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966633536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546989:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152486 00010000:00010000:1.0:1651529344.546991:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546995:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546997:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546998:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547000:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547001:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a207f8b0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.547002:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547003:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547005:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 3/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547010:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 1/0,0 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547019:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a207f8b0/0xa29a79078f3be5c8 lrc: 0/0,0 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547024:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547027:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1d141d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.547028:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547030:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 3/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547036:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 1/0,0 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547039:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be5cf lrc: 0/0,0 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547046:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+778:39030:x1731745946427392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1000us (1100us total) trans 30064893350 rc 0/0 00010000:00010000:0.0:1651529344.547046:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547049:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547050:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152487 00010000:00010000:0.0:1651529344.547052:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547068:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547095:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.547110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.547111:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+778:39030:x1731745946427328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1136us total) trans 30064893351 rc 0/0 00000100:00100000:0.0:1651529344.547121:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152488 00000100:00100000:1.0:1651529344.547126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.547126:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428032 00000100:00100000:1.0:1651529344.547137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.547141:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427968 00000100:00100000:0.0:1651529344.547146:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428160 00000100:00100000:0.0:1651529344.547150:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428096 00000100:00100000:1.0:1651529344.547154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.547154:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152489 00000100:00100000:0.0:1651529344.547155:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+781:39030:x1731745946428032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.547165:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177282 count 1 00010000:00010000:0.0:1651529344.547170:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547175:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 2/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547178:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547178:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547179:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 4/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547186:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 3/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547190:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1282 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.547194:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966633664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547209:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.547216:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428224 00000100:00100000:1.0:1651529344.547221:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152490 00000100:00100000:1.0:1651529344.547235:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+782:39029:x1731745946427968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.547241:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177281 count 1 00000100:00100000:0.0:1651529344.547242:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152491 00000100:00100000:0.0:1651529344.547244:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+782:39030:x1731745946428160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.547246:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547251:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 2/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1282 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547254:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547254:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547255:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 4/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.547260:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177284 count 1 00010000:00010000:1.0:1651529344.547262:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 3/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1282 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547264:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547266:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1282 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547269:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 2/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.547270:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966633728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.547272:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547273:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547274:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 4/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547280:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.547280:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547284:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1282 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.547286:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152492 00000100:00100000:1.0:1651529344.547288:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+782:39029:x1731745946428096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.547288:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966633792:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.547292:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177283 count 1 00010000:00010000:1.0:1651529344.547296:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547297:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.547300:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 2/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1282 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547303:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547304:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547304:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 4/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547304:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152493 00000100:00100000:0.0:1651529344.547305:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+782:39029:x1731745946428224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.547310:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 3/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1282 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.547310:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177285 count 1 00010000:00010000:0.0:1651529344.547313:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547314:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1282 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547317:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 2/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.547318:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966633856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.547320:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547320:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547321:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 4/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547324:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.547330:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547330:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 3/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547334:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1282 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.547337:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966633920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547343:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000511d1ff5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.547344:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547344:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.547347:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 3/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547352:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 1/0,0 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547354:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511d1ff5/0xa29a79078f3be5d6 lrc: 0/0,0 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.547418:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428288 00000100:00100000:0.0:1651529344.547426:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152494 00000100:00100000:0.0:1651529344.547428:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+783:39030:x1731745946428288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.547429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.547433:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177286 count 1 00000100:00100000:1.0:1651529344.547441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.547443:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547465:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 2/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1282 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547468:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547469:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547469:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 4/0,1 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547477:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 3/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1282 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547483:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 4/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1282 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.547487:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966633984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547498:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.547504:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428352 00000100:00100000:0.0:1651529344.547514:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428416 00000100:00100000:1.0:1651529344.547518:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152495 00000100:00100000:1.0:1651529344.547525:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+785:39029:x1731745946428352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.547525:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152496 00000100:00100000:0.0:1651529344.547526:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+785:39030:x1731745946428416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.547530:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177287 count 1 00002000:00080000:0.0:1651529344.547531:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177288 count 1 00010000:00010000:1.0:1651529344.547535:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547535:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547539:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 2/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547540:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 2/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1282 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547542:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547543:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547543:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547544:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 4/0,1 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547550:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547550:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 3/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1282 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547551:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 4/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547554:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 4/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1282 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547559:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 3/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1282 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.547561:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966634048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547563:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 4/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1282 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.547567:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547568:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.547576:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.547779:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966633664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.547784:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547821:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966633792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.547822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.547824:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.547838:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966633920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.547840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.547841:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.547855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.547864:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966633728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547868:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547874:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309120 00000100:00100000:1.0:1651529344.547876:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966633856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547878:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547880:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1283 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.547885:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309248 00000100:00100000:0.0:1651529344.547886:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309376 00010000:00010000:0.0:1651529344.547888:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1285 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547890:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1285 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.547893:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309184 00010000:00010000:0.0:1651529344.547895:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1286 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.547899:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309312 00010000:00010000:0.0:1651529344.547901:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1287 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.547905:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11451 00000100:00100000:1.0:1651529344.547907:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1287:41279:x1731746396309120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.547907:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11452 00000100:00100000:0.0:1651529344.547909:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1287:41279:x1731746396309376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.547910:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.547911:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547911:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.547913:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547915:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 3/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547916:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 3/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547921:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3b9f43 lrc: 0/0,0 mode: --/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb4d expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547922:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3ba811 lrc: 0/0,0 mode: --/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fea expref: 1287 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547925:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547926:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547926:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547927:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547927:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547928:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547930:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 4/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547931:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 4/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547939:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.547946:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.547949:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1285:41279:x1731746396309120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.547952:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11451 00000100:00100000:0.0:1651529344.547954:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1285:41279:x1731746396309376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.547958:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11452 00000100:00100000:1.0:1651529344.547962:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11453 00000100:00100000:1.0:1651529344.547971:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1283:41279:x1731746396309184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.547971:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11454 00000100:00100000:0.0:1651529344.547972:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1283:41279:x1731746396309248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.547974:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.547975:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1283 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547975:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.547977:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1283 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547979:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 3/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1283 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547980:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1283 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547985:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df681fde/0xa29a79078f3b77ff lrc: 0/0,0 mode: --/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb570 expref: 1283 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.547985:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a84ff56d/0xa29a79078f3bc132 lrc: 0/0,0 mode: --/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8214 expref: 1283 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.547988:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547989:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547990:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547990:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547993:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 4/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547993:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 4/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547999:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548006:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1281:41279:x1731746396309184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548008:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11453 00010000:00010000:0.0:1651529344.548011:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548013:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11455 00000100:00100000:1.0:1651529344.548015:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.548017:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.548018:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.548019:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1280 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.548021:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11454 00010000:00010000:0.0:1651529344.548029:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548030:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 3/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1279 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548033:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548035:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7f7e1d/0xa29a79078f3b9595 lrc: 0/0,0 mode: --/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd46b expref: 1279 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548036:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548038:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548039:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548039:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548039:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548042:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 4/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548048:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548054:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1278:41279:x1731746396309312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548057:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11455 00010000:00010000:1.0:1651529344.548064:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548067:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548070:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548079:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+786:39029:x1731745946428224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 773us (925us total) trans 30064893352 rc 0/0 00010000:00010000:1.0:1651529344.548082:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548082:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152493 00010000:00010000:0.0:1651529344.548098:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548102:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e76bff1f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.548103:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548106:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 3/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548111:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 1/0,0 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548113:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76bff1f/0xa29a79078f3be5f9 lrc: 0/0,0 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548126:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+786:39029:x1731745946428096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 837us (988us total) trans 30064893353 rc 0/0 00010000:00010000:0.0:1651529344.548126:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548129:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152492 00010000:00010000:0.0:1651529344.548129:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e8a9075 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.548130:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548133:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 3/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548136:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 1/0,0 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548137:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548139:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be5f2 lrc: 0/0,0 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548140:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548143:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548145:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548146:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548148:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548151:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548153:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548179:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+787:39029:x1731745946427968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 943us (1069us total) trans 30064893354 rc 0/0 00000100:00100000:1.0:1651529344.548182:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152490 00010000:00010000:1.0:1651529344.548188:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548191:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000319d7947 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.548192:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548197:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+786:39030:x1731745946428160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1071us total) trans 30064893355 rc 0/0 00000100:00100000:0.0:1651529344.548200:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152491 00010000:00010000:1.0:1651529344.548203:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 3/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548207:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548208:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 1/0,0 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548211:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be5e4 lrc: 0/0,0 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548211:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e471716 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.548212:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548215:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 3/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548219:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 1/0,0 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548222:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e471716/0xa29a79078f3be5eb lrc: 0/0,0 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548227:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548230:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548233:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548236:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.548283:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+786:39030:x1731745946428032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1126us (1188us total) trans 30064893356 rc 0/0 00000100:00100000:0.0:1651529344.548286:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152489 00000100:00100000:1.0:1651529344.548290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.548300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.548314:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548318:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db78a802 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.548319:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548322:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 3/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548327:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 1/0,0 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548329:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db78a802/0xa29a79078f3be5dd lrc: 0/0,0 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548337:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309440 00010000:00010000:0.0:1651529344.548342:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 5/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1278 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.548351:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309504 00010000:00010000:0.0:1651529344.548353:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 5/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1279 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.548357:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309568 00010000:00010000:0.0:1651529344.548359:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 5/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1280 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.548361:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548364:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11456 00000100:00100000:0.0:1651529344.548365:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.548366:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548368:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.548369:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 5/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1280 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548373:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 4/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1280 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.548374:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11457 00000100:00100000:1.0:1651529344.548375:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.548379:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.548381:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 5/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1280 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.548384:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 4/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1280 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548398:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548399:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548401:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548402:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548402:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 4/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548403:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548406:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 4/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548407:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.548411:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.548421:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.548424:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11456 00000100:00100000:1.0:1651529344.548425:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396309504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548428:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11457 00000100:00100000:0.0:1651529344.548430:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11458 00000100:00100000:0.0:1651529344.548431:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1278:41278:x1731746396309568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.548434:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.548436:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 4/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1278 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548440:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 3/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1278 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548445:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c246b72/0xa29a79078f3bbbc1 lrc: 0/0,0 mode: --/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc7 expref: 1278 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548448:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548449:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548449:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548452:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 4/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548460:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.548467:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1277:41278:x1731746396309568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.548469:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11458 00010000:00010000:1.0:1651529344.548475:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548479:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548483:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548485:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548485:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3b962f lrc: 0/0,0 mode: --/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6ef expref: 1276 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.548489:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966634048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548492:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548495:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548498:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548501:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548504:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548525:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+786:39029:x1731745946428352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1095us total) trans 30064893357 rc 0/0 00000100:00100000:1.0:1651529344.548528:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152495 00010000:00010000:1.0:1651529344.548545:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548548:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5a5be4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.548550:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548552:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 3/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548557:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 1/0,0 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548560:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be607 lrc: 0/0,0 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548564:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548567:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.548567:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+786:39030:x1731745946428416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1040us (1126us total) trans 30064893358 rc 0/0 00010000:00010000:1.0:1651529344.548568:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548571:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 3/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548571:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152496 00010000:00010000:1.0:1651529344.548574:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 1/0,0 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548582:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d39c560c/0xa29a79078f3b923f lrc: 0/0,0 mode: --/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6e2 expref: 1275 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.548584:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be60e lrc: 0/0,0 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548586:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966633984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548589:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548593:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548596:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548599:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548601:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548644:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+786:39030:x1731745946428288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1215us (1248us total) trans 30064893359 rc 0/0 00000100:00100000:0.0:1651529344.548647:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152494 00000100:00100000:1.0:1651529344.548651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548651:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429056 00000100:00100000:0.0:1651529344.548658:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428992 00000100:00100000:0.0:1651529344.548662:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152497 00000100:00100000:1.0:1651529344.548664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548664:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+787:39030:x1731745946429056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.548668:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177290 count 1 00000100:00100000:1.0:1651529344.548673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.548688:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548694:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 2/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.548700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.548700:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548700:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548701:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 4/0,1 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548711:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429184 00010000:00010000:0.0:1651529344.548714:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 3/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548718:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 4/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.548719:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429120 00000100:00100000:1.0:1651529344.548724:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429248 00000100:00100000:0.0:1651529344.548727:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966634176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.548739:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152498 00000100:00100000:1.0:1651529344.548741:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+790:39029:x1731745946428992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.548747:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177289 count 1 00010000:00010000:1.0:1651529344.548751:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548757:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 2/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548760:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548760:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548761:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 4/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548768:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.548775:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 3/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.548776:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152499 00000100:00100000:0.0:1651529344.548778:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+790:39030:x1731745946429184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.548783:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177292 count 1 00010000:00010000:0.0:1651529344.548787:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548789:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548791:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 2/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.548793:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966634240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548794:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548795:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548796:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 4/0,1 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548816:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 3/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.548819:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.548825:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152500 00010000:00010000:0.0:1651529344.548825:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 4/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.548827:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+790:39029:x1731745946429120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.548829:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966634304:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.548832:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177291 count 1 00010000:00010000:1.0:1651529344.548836:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548838:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.548841:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 2/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548844:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548844:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.548844:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152501 00010000:00010000:1.0:1651529344.548845:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 4/0,1 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548846:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+790:39029:x1731745946429248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.548850:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177293 count 1 00010000:00010000:1.0:1651529344.548851:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 3/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548854:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548855:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 4/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.548858:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 2/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548861:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548862:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548863:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 4/0,1 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548868:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 3/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.548869:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966634368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548872:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 4/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.548877:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.548886:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966634432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548895:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.548902:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548906:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047a8bbf9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.548907:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548910:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 3/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548914:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 1/0,0 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548917:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a8bbf9/0xa29a79078f3be600 lrc: 0/0,0 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.548982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548983:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429440 00000100:00100000:1.0:1651529344.548991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.549003:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429504 00000100:00100000:0.0:1651529344.549009:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429568 00000100:00100000:0.0:1651529344.549014:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152502 00000100:00100000:0.0:1651529344.549015:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+793:39030:x1731745946429440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.549016:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152503 00000100:00100000:1.0:1651529344.549018:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+793:39029:x1731745946429504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.549021:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177294 count 1 00002000:00080000:1.0:1651529344.549024:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177295 count 1 00010000:00010000:0.0:1651529344.549025:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549028:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549032:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 2/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549035:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549036:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549037:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 4/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549037:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 2/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549040:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549041:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549042:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 4/0,1 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549043:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 3/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549047:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 4/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549049:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 3/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1274 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.549051:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549053:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 4/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549057:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966634560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549069:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.549069:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.549075:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152504 00000100:00100000:0.0:1651529344.549077:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+793:39030:x1731745946429568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.549081:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177296 count 1 00010000:00010000:0.0:1651529344.549085:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549089:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 2/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1274 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549092:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549093:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549093:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 4/0,1 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549099:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 3/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1274 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549103:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 4/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1274 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549107:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966634624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.549113:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.549266:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966634176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.549281:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966634240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.549285:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549296:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549305:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310144 00010000:00010000:0.0:1651529344.549320:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 4/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1275 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549329:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11459 00000100:00100000:0.0:1651529344.549331:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41278:x1731746396310144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.549334:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549335:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 4/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1275 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549339:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 3/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1275 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549345:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062ca73f9/0xa29a79078f3bbdff lrc: 0/0,0 mode: --/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74d1 expref: 1275 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549348:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549349:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549350:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549353:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 4/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549359:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.549382:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.549385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.549385:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11459 00000100:00100000:0.0:1651529344.549391:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310208 00010000:00010000:0.0:1651529344.549394:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549403:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11460 00000100:00100000:0.0:1651529344.549405:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.549408:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549409:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549412:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 3/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549434:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3ba4bb lrc: 0/0,0 mode: --/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11a4 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.549443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.549443:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549444:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549445:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.549448:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 4/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.549456:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.549480:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1273:41278:x1731746396310208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.549483:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11460 00000100:00100000:0.0:1651529344.549488:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310336 00010000:00010000:0.0:1651529344.549498:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 5/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1273 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549503:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11461 00000100:00100000:0.0:1651529344.549504:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1273:41278:x1731746396310336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.549507:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549508:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 5/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1273 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549512:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 4/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1273 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549517:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549518:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549519:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549522:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 4/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549524:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310272 00010000:00010000:0.0:1651529344.549526:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.549530:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 5/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549537:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.549540:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11461 00000100:00100000:1.0:1651529344.549543:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310400 00000100:00100000:0.0:1651529344.549545:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11462 00010000:00010000:1.0:1651529344.549546:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 5/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549546:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.549549:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549550:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 5/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.549551:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11463 00000100:00100000:1.0:1651529344.549553:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.549554:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 4/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1274 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.549556:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.549558:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 5/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549560:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549561:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 4/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1274 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549566:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 4/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549569:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.549574:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1274:41278:x1731746396310272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.549577:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11462 00010000:00010000:1.0:1651529344.549578:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549579:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549580:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549583:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 4/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549587:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.549587:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001b780f6/0xa29a79078f3b876b lrc: 0/0,0 mode: --/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc08a expref: 1273 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549591:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966634432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549594:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549595:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41278:x1731746396310400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.549598:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11463 00010000:00010000:0.0:1651529344.549598:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549600:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549603:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549606:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549609:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16499ef/0xa29a79078f3ba5c5 lrc: 0/0,0 mode: --/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1666 expref: 1271 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.549614:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966634368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.549624:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549627:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549630:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549633:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549643:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549679:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+795:39029:x1731745946429248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 832us (978us total) trans 30064893360 rc 0/0 00000100:00100000:0.0:1651529344.549682:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152501 00000100:00100000:1.0:1651529344.549687:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+794:39029:x1731745946429120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 859us (1013us total) trans 30064893361 rc 0/0 00000100:00100000:1.0:1651529344.549690:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152500 00010000:00010000:0.0:1651529344.549690:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549698:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549701:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549704:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549707:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549710:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.549711:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549725:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 3/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549739:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 1/0,0 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549742:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be631 lrc: 0/0,0 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549747:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549749:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db06f438 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.549750:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549754:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+794:39029:x1731745946428992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1103us total) trans 30064893362 rc 0/0 00010000:00010000:0.0:1651529344.549756:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 3/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549757:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152498 00010000:00010000:0.0:1651529344.549759:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 1/0,0 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549762:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db06f438/0xa29a79078f3be62a lrc: 0/0,0 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549765:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549768:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000213da448 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.549769:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549772:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3ba1d5 lrc: 0/0,0 mode: --/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0509 expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549776:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966634304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549779:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549780:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 3/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549782:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549785:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 1/0,0 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549785:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549788:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000213da448/0xa29a79078f3be61c lrc: 0/0,0 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549788:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549790:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549798:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.549802:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.549849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.549850:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+794:39030:x1731745946429184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1186us total) trans 30064893363 rc 0/0 00000100:00100000:0.0:1651529344.549853:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152499 00000100:00100000:1.0:1651529344.549861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.549861:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549864:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.549872:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549875:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 3/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549880:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 1/0,0 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549883:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be623 lrc: 0/0,0 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549894:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966634624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549897:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549904:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310528 00010000:00010000:0.0:1651529344.549908:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 4/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549916:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310464 00010000:00010000:0.0:1651529344.549918:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 5/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1271 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.549922:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310592 00010000:00010000:0.0:1651529344.549925:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 4/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1272 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.549930:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11464 00000100:00100000:1.0:1651529344.549932:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41279:x1731746396310528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.549932:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11465 00000100:00100000:0.0:1651529344.549933:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41279:x1731746396310464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.549936:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549936:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549937:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 5/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1272 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.549938:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 4/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1272 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549941:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 4/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1272 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.549942:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 3/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1272 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.549946:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549947:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549947:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549950:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 4/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549951:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004667bd73/0xa29a79078f3bc3c4 lrc: 0/0,0 mode: --/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c0f expref: 1272 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.549955:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549955:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549955:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.549956:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549959:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 4/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549969:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1271:41279:x1731746396310464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.549971:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11465 00010000:00010000:1.0:1651529344.549973:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.549976:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11466 00000100:00100000:0.0:1651529344.549978:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1270:41279:x1731746396310592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.549980:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1270:41279:x1731746396310528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.549983:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11464 00010000:00010000:0.0:1651529344.549995:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.549996:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549997:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 4/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1269 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.549999:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550001:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 3/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1269 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550002:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550005:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550007:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3b81b4 lrc: 0/0,0 mode: --/PR res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbda4 expref: 1269 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550010:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550011:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550011:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550015:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 4/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550021:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.550027:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1268:41279:x1731746396310592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.550030:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11466 00010000:00010000:0.0:1651529344.550037:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550040:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550043:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550045:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+794:39029:x1731745946429504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1063us total) trans 30064893364 rc 0/0 00010000:00010000:0.0:1651529344.550046:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550049:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152503 00010000:00010000:1.0:1651529344.550056:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550059:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000830524fd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.550060:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550063:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 3/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550067:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 1/0,0 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550070:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830524fd/0xa29a79078f3be63f lrc: 0/0,0 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550074:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550077:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.550078:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550083:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 3/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550087:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 1/0,0 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550089:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be646 lrc: 0/0,0 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550111:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+794:39030:x1731745946429568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1033us (1119us total) trans 30064893365 rc 0/0 00000100:00100000:0.0:1651529344.550114:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152504 00000100:00100000:1.0:1651529344.550124:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550127:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525a01f6/0xa29a79078f3bb0ca lrc: 0/0,0 mode: --/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41c4 expref: 1267 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550139:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966634560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550143:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550146:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550149:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550154:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550157:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550161:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.550175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.550198:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+794:39030:x1731745946429440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1181us (1226us total) trans 30064893366 rc 0/0 00000100:00100000:0.0:1651529344.550201:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152502 00000100:00100000:0.0:1651529344.550205:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430016 00000100:00100000:0.0:1651529344.550216:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430080 00000100:00100000:0.0:1651529344.550220:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430144 00000100:00100000:0.0:1651529344.550224:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430208 00000100:00100000:0.0:1651529344.550228:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152505 00000100:00100000:0.0:1651529344.550230:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+797:39029:x1731745946430016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.550240:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152506 00000100:00100000:1.0:1651529344.550242:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+797:39030:x1731745946430080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.550247:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177298 count 1 00002000:00080000:0.0:1651529344.550249:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177297 count 1 00010000:00010000:1.0:1651529344.550251:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550253:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550256:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 2/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550259:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550259:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 2/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550260:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550261:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 4/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550262:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550262:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550263:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 4/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550272:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550276:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 4/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550279:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 3/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.550280:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966634688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.550283:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550287:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550299:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550303:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.550306:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152507 00000100:00100000:1.0:1651529344.550307:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+797:39029:x1731745946430144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.550311:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152508 00002000:00080000:1.0:1651529344.550312:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177299 count 1 00000100:00100000:0.0:1651529344.550312:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+797:39030:x1731745946430208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.550315:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.550317:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177300 count 1 00010000:00010000:1.0:1651529344.550320:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 2/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550321:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550323:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550323:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550324:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 4/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550325:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 2/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550328:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550329:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550330:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 3/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550330:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 4/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550333:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550336:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 3/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550340:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550344:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966634880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550345:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966634816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.550350:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.550353:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.550355:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550358:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.550359:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550362:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 3/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550367:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 1/0,0 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550369:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be638 lrc: 0/0,0 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550378:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550381:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550384:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550389:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 2/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550403:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550407:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.550408:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550416:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 3/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550421:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 1/0,0 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550424:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be615 lrc: 0/0,0 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.550467:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+798:39030:x1731745946429056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1802us (1849us total) trans 30064893367 rc 0/0 00000100:00100000:0.0:1651529344.550470:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152497 00000100:00100000:0.0:1651529344.550475:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430528 00000100:00100000:0.0:1651529344.550481:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152509 00000100:00100000:0.0:1651529344.550483:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+798:39029:x1731745946430528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.550488:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177301 count 1 00000100:00100000:1.0:1651529344.550491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550492:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550525:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 2/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1266 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550528:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550528:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550529:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 4/0,1 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550536:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 3/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1266 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550540:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 4/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1266 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550554:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966634944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550555:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966634752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.550560:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550567:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550573:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430592 00000100:00100000:0.0:1651529344.550582:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430656 00000100:00100000:0.0:1651529344.550588:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152510 00000100:00100000:0.0:1651529344.550590:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+800:39030:x1731745946430592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.550594:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177302 count 1 00010000:00010000:0.0:1651529344.550598:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550603:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 2/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550605:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550606:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550607:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 4/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550612:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 3/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.550616:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152511 00010000:00010000:0.0:1651529344.550616:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550618:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+800:39029:x1731745946430656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.550620:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635008:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.550624:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177303 count 1 00010000:00010000:1.0:1651529344.550628:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550633:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.550639:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 2/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550642:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550643:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550643:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 4/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550650:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 3/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1266 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550654:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 4/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550658:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.550662:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966634688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550666:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.550666:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.550687:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430720 00000100:00100000:1.0:1651529344.550703:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152512 00000100:00100000:1.0:1651529344.550705:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+801:39030:x1731745946430720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.550721:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177304 count 1 00010000:00010000:1.0:1651529344.550725:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550729:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 2/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1266 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550749:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550749:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550750:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 4/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.550763:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 3/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1266 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.550765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.550767:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1266 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550771:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.550771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.550781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.550794:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550797:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966634880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550801:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550815:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966634816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.550820:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550827:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311168 00010000:00010000:1.0:1651529344.550832:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1267 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550843:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311296 00000100:00100000:1.0:1651529344.550849:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311232 00010000:00010000:1.0:1651529344.550852:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 4/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1269 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550856:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311360 00010000:00010000:1.0:1651529344.550858:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550859:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.550863:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11467 00000100:00100000:1.0:1651529344.550864:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1270:41279:x1731746396311168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.550867:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.550867:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11468 00010000:00010000:1.0:1651529344.550868:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550868:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1270:41279:x1731746396311232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.550871:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.550872:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 3/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550873:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 4/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550877:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca29ca54/0xa29a79078f3bbfd4 lrc: 0/0,0 mode: --/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c4f expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550877:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1270 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550881:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550881:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550882:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550885:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 4/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550895:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bac08 lrc: 0/0,0 mode: --/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eb5 expref: 1269 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550899:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.550899:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550900:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550901:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550904:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 4/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550906:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1268:41279:x1731746396311168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.550909:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11467 00010000:00010000:0.0:1651529344.550911:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.550914:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11469 00000100:00100000:1.0:1651529344.550915:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41279:x1731746396311360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.550918:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.550919:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41279:x1731746396311232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.550920:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1267 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550922:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11468 00010000:00010000:1.0:1651529344.550924:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 3/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1267 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550927:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11470 00010000:00010000:1.0:1651529344.550929:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000544e9f11/0xa29a79078f3ba28b lrc: 0/0,0 mode: --/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0889 expref: 1266 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.550929:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1266:41279:x1731746396311296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.550931:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.550932:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550933:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550933:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550934:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550936:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 4/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550936:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 3/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.550941:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7fe43a8/0xa29a79078f3bb84f lrc: 0/0,0 mode: --/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f61 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.550942:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.550947:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1265:41279:x1731746396311360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.550956:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11469 00010000:00010000:0.0:1651529344.550957:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550958:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550958:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550961:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 4/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550964:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550967:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550968:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.550971:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550973:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550975:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1263:41279:x1731746396311296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.550978:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11470 00010000:00010000:0.0:1651529344.550990:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550994:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfd959dd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.550995:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550998:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 3/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551002:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 1/0,0 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551005:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd959dd/0xa29a79078f3be64d lrc: 0/0,0 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551017:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+802:39030:x1731745946430080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 774us (867us total) trans 30064893368 rc 0/0 00000100:00100000:1.0:1651529344.551020:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152506 00010000:00010000:0.0:1651529344.551020:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551023:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551026:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551027:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551029:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551030:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551033:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551036:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551070:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+803:39030:x1731745946430208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 757us (894us total) trans 30064893369 rc 0/0 00000100:00100000:0.0:1651529344.551073:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152508 00010000:00010000:0.0:1651529344.551080:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551082:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+802:39029:x1731745946430144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 774us (920us total) trans 30064893370 rc 0/0 00010000:00010000:0.0:1651529344.551083:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4f1e207 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551084:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551085:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152507 00010000:00010000:0.0:1651529344.551087:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 3/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551092:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551092:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 1/0,0 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551096:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040268506 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.551097:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551100:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 3/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551102:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be662 lrc: 0/0,0 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551104:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 1/0,0 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551107:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040268506/0xa29a79078f3be65b lrc: 0/0,0 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551110:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551112:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551116:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551118:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.551189:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+802:39029:x1731745946430016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1058us total) trans 30064893371 rc 0/0 00000100:00100000:0.0:1651529344.551192:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152505 00000100:00100000:1.0:1651529344.551193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.551203:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.551207:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551208:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551211:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 3/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551223:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 1/0,0 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551226:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be654 lrc: 0/0,0 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551237:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.551240:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551247:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311424 00010000:00010000:0.0:1651529344.551252:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 5/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1263 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.551262:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311552 00010000:00010000:0.0:1651529344.551265:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1264 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.551269:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311488 00010000:00010000:0.0:1651529344.551271:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 5/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.551275:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11471 00000100:00100000:0.0:1651529344.551277:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1265:41279:x1731746396311424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.551280:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.551281:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 5/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1265 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.551289:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551293:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551300:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 4/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1265 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551306:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551306:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551307:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551310:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 4/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551312:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11472 00000100:00100000:1.0:1651529344.551314:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1265:41279:x1731746396311552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.551315:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.551317:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551319:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.551323:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 3/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.551329:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bb030 lrc: 0/0,0 mode: --/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f71 expref: 1265 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.551333:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551333:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551334:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551343:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 4/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551346:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1264:41279:x1731746396311424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.551349:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11471 00010000:00010000:1.0:1651529344.551353:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.551361:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1263:41279:x1731746396311552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.551361:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11473 00000100:00100000:0.0:1651529344.551362:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1263:41278:x1731746396311488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.551364:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11472 00010000:00010000:0.0:1651529344.551365:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.551367:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 4/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551371:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 3/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551376:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c91c3e/0xa29a79078f3ba65f lrc: 0/0,0 mode: --/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18a4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551380:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551381:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551382:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551385:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 4/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551394:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.551401:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1261:41278:x1731746396311488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.551404:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11473 00010000:00010000:0.0:1651529344.551429:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551433:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551446:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551449:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.551478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.551487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.551494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.551503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.551512:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551517:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551523:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551529:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+802:39030:x1731745946430592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 938us (1038us total) trans 30064893372 rc 0/0 00010000:00010000:1.0:1651529344.551531:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551532:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152510 00010000:00010000:1.0:1651529344.551535:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551538:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551538:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431104 00000100:00100000:0.0:1651529344.551544:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431040 00000100:00100000:0.0:1651529344.551548:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431232 00000100:00100000:0.0:1651529344.551551:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431168 00000100:00100000:0.0:1651529344.551554:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152513 00000100:00100000:0.0:1651529344.551555:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946431104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.551560:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177306 count 1 00010000:00010000:0.0:1651529344.551565:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551570:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 2/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551573:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551573:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551574:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 4/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551581:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 3/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551584:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1260 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.551586:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+806:39029:x1731745946430656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1084us total) trans 30064893373 rc 0/0 00000100:00100000:0.0:1651529344.551588:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.551589:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152511 00000100:00100000:1.0:1651529344.551595:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152514 00000100:00100000:1.0:1651529344.551596:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+805:39029:x1731745946431040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.551597:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.551601:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177305 count 1 00000100:00100000:0.0:1651529344.551604:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152515 00010000:00010000:1.0:1651529344.551605:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551606:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+805:39030:x1731745946431232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.551610:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177308 count 1 00010000:00010000:0.0:1651529344.551614:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551618:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 2/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551618:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 2/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.551621:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551621:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551621:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551621:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551622:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 4/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551622:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 4/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551628:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 3/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.551629:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551631:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1260 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.551633:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1260 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.551635:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966635264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.551637:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.551641:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.551646:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.551646:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551649:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551650:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551653:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152516 00010000:00010000:0.0:1651529344.551653:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 3/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551655:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+805:39029:x1731745946431168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.551658:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 1/0,0 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.551659:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177307 count 1 00010000:00010000:0.0:1651529344.551661:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be670 lrc: 0/0,0 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551663:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551665:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551667:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 2/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551667:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aacdb540 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551668:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551670:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551671:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 3/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551674:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 1/0,0 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551677:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aacdb540/0xa29a79078f3be677 lrc: 0/0,0 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551678:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551678:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 4/0,1 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551685:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 3/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1260 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.551685:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312128 00010000:00010000:1.0:1651529344.551689:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 4/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1261 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551689:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1261 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.551693:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966635392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.551701:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11474 00000100:00100000:0.0:1651529344.551702:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1261:41278:x1731746396312128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.551705:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.551707:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.551707:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1261 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551710:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 3/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1261 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551715:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac4b456/0xa29a79078f3b959c lrc: 0/0,0 mode: --/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd49c expref: 1261 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.551718:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551719:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551720:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551723:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 4/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551738:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.551745:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1260:41278:x1731746396312128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.551748:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11474 00010000:00010000:0.0:1651529344.551759:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0260e3f/0xa29a79078f3b80aa lrc: 0/0,0 mode: --/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd03 expref: 1259 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.551763:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966634944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.551767:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551770:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551772:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551775:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551778:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551796:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551822:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551826:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551829:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551863:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+807:39029:x1731745946430528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1379us (1409us total) trans 30064893374 rc 0/0 00000100:00100000:0.0:1651529344.551866:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152509 00010000:00010000:0.0:1651529344.551874:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551878:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551879:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551885:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946430720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1179us (1204us total) trans 30064893375 rc 0/0 00000100:00100000:1.0:1651529344.551889:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152512 00010000:00010000:0.0:1651529344.551893:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 3/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551915:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 1/0,0 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551919:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be669 lrc: 0/0,0 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.551923:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551926:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000750dfe48 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.551926:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551929:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 3/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551933:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 1/0,0 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551935:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750dfe48/0xa29a79078f3be67e lrc: 0/0,0 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551946:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.551949:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.551966:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431360 00000100:00100000:0.0:1651529344.551967:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431296 00000100:00100000:1.0:1651529344.551974:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152517 00000100:00100000:1.0:1651529344.551976:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+807:39030:x1731745946431360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.551976:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152518 00000100:00100000:0.0:1651529344.551977:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+807:39029:x1731745946431296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.551981:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177310 count 1 00002000:00080000:0.0:1651529344.551983:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177309 count 1 00010000:00010000:1.0:1651529344.551985:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551987:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551990:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 2/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.551991:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 2/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.551993:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551994:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551994:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 4/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551994:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551995:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551995:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 4/0,1 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552002:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 3/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552002:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 3/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552005:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 4/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552006:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 4/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.552010:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.552010:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966635520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.552021:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.552021:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.552074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552105:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966635264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552110:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.552127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.552129:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431424 00000100:00100000:1.0:1651529344.552136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.552149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.552149:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431488 00000100:00100000:1.0:1651529344.552157:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.552168:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152519 00000100:00100000:0.0:1651529344.552170:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+809:39029:x1731745946431424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.552173:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635328:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.552175:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177311 count 1 00010000:00010000:1.0:1651529344.552177:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552179:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552184:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966635392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552184:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 2/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552187:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552187:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552187:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552188:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 4/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552194:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152520 00010000:00010000:0.0:1651529344.552195:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 3/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.552196:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf61e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+809:39030:x1731745946431488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.552198:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.552201:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177312 count 1 00000100:00100000:0.0:1651529344.552202:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966635584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.552205:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552209:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 2/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1258 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552212:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552212:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552213:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 4/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552218:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.552225:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312192 00010000:00010000:1.0:1651529344.552227:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1259 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552230:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1259 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552234:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 4/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1259 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.552238:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966635648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.552244:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312320 00000100:00100000:1.0:1651529344.552246:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.552247:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1260 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.552251:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312256 00000100:00100000:1.0:1651529344.552252:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312384 00010000:00010000:0.0:1651529344.552253:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1261 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552257:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 4/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.552280:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11475 00000100:00100000:0.0:1651529344.552282:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1262:41279:x1731746396312192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.552286:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.552287:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552291:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 3/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.552292:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11476 00000100:00100000:1.0:1651529344.552294:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1262:41279:x1731746396312320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.552297:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.552297:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000044510d/0xa29a79078f3b9bc3 lrc: 0/0,0 mode: --/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cece4 expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552298:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1262 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552301:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552302:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1261 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552302:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552303:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552306:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 4/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552308:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3ba83b lrc: 0/0,0 mode: --/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d206f expref: 1261 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552312:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552312:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552313:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552318:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 4/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552320:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.552325:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.552328:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1260:41279:x1731746396312192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.552331:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11475 00000100:00100000:1.0:1651529344.552332:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1260:41279:x1731746396312320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.552335:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11476 00000100:00100000:0.0:1651529344.552337:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11477 00000100:00100000:0.0:1651529344.552338:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396312256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.552340:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11478 00010000:00010000:0.0:1651529344.552341:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.552342:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396312384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.552342:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552344:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.552346:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 4/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552346:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 3/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552350:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 3/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552351:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c791f2/0xa29a79078f3bba32 lrc: 0/0,0 mode: --/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66bc expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552354:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a47563/0xa29a79078f3bbaa9 lrc: 0/0,0 mode: --/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d681a expref: 1258 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552355:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552355:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552356:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552358:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552358:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552359:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552359:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 4/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552362:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 4/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552365:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.552370:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1256:41278:x1731746396312256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (221us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.552378:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.552380:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11477 00000100:00100000:1.0:1651529344.552384:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41278:x1731746396312384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.552386:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552387:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11478 00010000:00010000:0.0:1651529344.552390:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552393:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552395:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552398:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.552408:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552414:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552417:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.552418:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552421:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 3/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552426:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 1/0,0 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552428:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be693 lrc: 0/0,0 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552434:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552439:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+810:39030:x1731745946431232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 832us (944us total) trans 30064893376 rc 0/0 00000100:00100000:0.0:1651529344.552442:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152515 00010000:00010000:1.0:1651529344.552446:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552449:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552449:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552452:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552452:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552455:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552457:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552496:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+811:39029:x1731745946431168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 840us (992us total) trans 30064893377 rc 0/0 00000100:00100000:1.0:1651529344.552499:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152516 00000100:00100000:0.0:1651529344.552502:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+810:39030:x1731745946431104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (1048us total) trans 30064893378 rc 0/0 00000100:00100000:0.0:1651529344.552505:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152513 00010000:00010000:1.0:1651529344.552507:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552510:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552512:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552513:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552515:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051ec9b8f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.552516:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552516:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552519:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 3/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552524:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 1/0,0 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552527:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ec9b8f/0xa29a79078f3be69a lrc: 0/0,0 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552531:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552534:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.552535:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552540:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 3/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552543:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 1/0,0 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552546:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be685 lrc: 0/0,0 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552548:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+810:39029:x1731745946431040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1061us total) trans 30064893379 rc 0/0 00010000:00010000:0.0:1651529344.552549:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552552:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005de4c89 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.552553:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552555:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 3/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552558:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 1/0,0 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552560:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152514 00010000:00010000:0.0:1651529344.552561:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005de4c89/0xa29a79078f3be68c lrc: 0/0,0 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552603:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.552621:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312448 00010000:00010000:0.0:1651529344.552627:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 4/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1255 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.552645:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11479 00000100:00100000:0.0:1651529344.552647:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41278:x1731746396312448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.552651:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.552652:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 4/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1255 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552656:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 3/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1255 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552662:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4f7d68/0xa29a79078f3bbb2e lrc: 0/0,0 mode: --/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a4a expref: 1255 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552665:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552666:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552667:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552670:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 4/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552679:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.552689:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396312448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.552693:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552698:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552701:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552704:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552706:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11479 00010000:00010000:0.0:1651529344.552724:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552728:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb7fe31f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.552729:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552750:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 3/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552754:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+810:39030:x1731745946431360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 777us (831us total) trans 30064893380 rc 0/0 00010000:00010000:0.0:1651529344.552755:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 1/0,0 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552757:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152517 00010000:00010000:0.0:1651529344.552767:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb7fe31f/0xa29a79078f3be6a1 lrc: 0/0,0 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552779:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966635520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552783:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.552858:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432128 00000100:00100000:1.0:1651529344.552874:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152521 00000100:00100000:1.0:1651529344.552875:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+810:39030:x1731745946432128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.552877:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966635584:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.552881:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177314 count 1 00010000:00010000:0.0:1651529344.552881:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552885:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552889:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312512 00010000:00010000:1.0:1651529344.552890:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 2/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1253 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552894:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 4/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552902:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.552907:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11480 00010000:00010000:1.0:1651529344.552908:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552909:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 4/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552909:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396312512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.552912:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.552913:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 4/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552917:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 3/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.552918:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 3/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1254 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552922:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.552922:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ea2bf79/0xa29a79078f3baeee lrc: 0/0,0 mode: --/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a1c expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.552926:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552926:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552926:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552927:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552930:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 4/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552935:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.552937:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.552958:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41278:x1731746396312512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.552961:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11480 00010000:00010000:0.0:1651529344.552968:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552972:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552975:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552978:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552997:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966635648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.553002:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553022:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+811:39029:x1731745946431296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1043us (1068us total) trans 30064893381 rc 0/0 00000100:00100000:0.0:1651529344.553025:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152518 00010000:00010000:0.0:1651529344.553032:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553036:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.553037:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553040:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 3/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553044:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 1/0,0 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553047:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be6a8 lrc: 0/0,0 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.553069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.553075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.553084:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432064 00000100:00100000:0.0:1651529344.553085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.553092:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432192 00000100:00100000:0.0:1651529344.553093:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432256 00000100:00100000:1.0:1651529344.553100:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432320 00000100:00100000:1.0:1651529344.553104:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152522 00000100:00100000:1.0:1651529344.553106:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+814:39029:x1731745946432064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.553108:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152523 00000100:00100000:0.0:1651529344.553110:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+814:39030:x1731745946432192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.553111:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177313 count 1 00002000:00080000:0.0:1651529344.553115:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177315 count 1 00010000:00010000:1.0:1651529344.553116:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553119:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553123:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 2/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.553124:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 2/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1252 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.553126:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553126:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553127:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 4/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553127:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553127:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553128:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 4/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553134:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 3/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.553135:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 3/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1252 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.553137:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553139:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 4/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1252 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553141:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.553143:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553153:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.553153:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.553159:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152524 00000100:00100000:1.0:1651529344.553160:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+814:39030:x1731745946432256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.553165:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177316 count 1 00010000:00010000:1.0:1651529344.553168:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553172:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 2/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.553175:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553176:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553177:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 4/0,1 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553182:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152525 00010000:00010000:1.0:1651529344.553183:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 3/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.553184:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+814:39030:x1731745946432320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.553187:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 4/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.553189:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177317 count 1 00000100:00100000:1.0:1651529344.553190:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966635904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.553193:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553197:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.553198:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 2/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.553201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553202:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 4/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553208:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 3/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1252 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.553209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.553212:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553216:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966635968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.553224:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.553237:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432384 00000100:00100000:1.0:1651529344.553238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.553243:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152526 00000100:00100000:0.0:1651529344.553245:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+815:39030:x1731745946432384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.553249:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177318 count 1 00010000:00010000:0.0:1651529344.553253:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553258:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 2/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1252 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.553261:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553261:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553262:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 4/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553268:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 3/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1252 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.553269:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312576 00010000:00010000:0.0:1651529344.553271:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1253 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553275:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1253 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553275:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966636032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553283:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312640 00000100:00100000:0.0:1651529344.553289:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.553291:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 4/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553301:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11481 00000100:00100000:1.0:1651529344.553303:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41279:x1731746396312576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.553306:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.553306:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11482 00010000:00010000:1.0:1651529344.553307:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553308:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396312640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.553311:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 3/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553311:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553317:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6fd6fe1/0xa29a79078f3bb7a0 lrc: 0/0,0 mode: --/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c89 expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553321:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553322:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553322:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553326:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 4/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553326:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 4/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553331:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1253 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553334:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553341:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396312576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553344:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11481 00010000:00010000:0.0:1651529344.553345:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d75e2c3c/0xa29a79078f3bac78 lrc: 0/0,0 mode: --/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d303d expref: 1253 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553357:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553358:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553359:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553362:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 4/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553371:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.553379:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1251:41278:x1731746396312640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.553381:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11482 00010000:00010000:0.0:1651529344.553390:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553393:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553396:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553398:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553424:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966635712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.553434:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553439:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553442:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553446:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553449:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553475:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+817:39029:x1731745946431424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1304us (1401us total) trans 30064893382 rc 0/0 00000100:00100000:0.0:1651529344.553478:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152519 00000100:00100000:1.0:1651529344.553493:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf61e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+816:39030:x1731745946431488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1296us (1380us total) trans 30064893383 rc 0/0 00000100:00100000:1.0:1651529344.553496:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152520 00010000:00010000:0.0:1651529344.553513:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553517:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553518:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.553519:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553520:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007274da18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.553521:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553521:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 3/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553525:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 3/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553527:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 1/0,0 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553529:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 1/0,0 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553529:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be6af lrc: 0/0,0 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553532:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be6b6 lrc: 0/0,0 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553579:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966635776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.553588:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553596:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966635904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.553596:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966635968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.553599:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553600:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553607:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966636032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.553610:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553616:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966635840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.553619:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553625:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313216 00010000:00010000:0.0:1651529344.553629:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1251 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.553677:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313344 00010000:00010000:0.0:1651529344.553682:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 4/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1252 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.553703:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313472 00000100:00100000:1.0:1651529344.553706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.553707:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1253 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553712:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313280 00000100:00100000:1.0:1651529344.553713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553724:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313408 00010000:00010000:1.0:1651529344.553729:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 4/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1254 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553743:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1255 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553750:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313536 00010000:00010000:0.0:1651529344.553752:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1256 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553755:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11483 00000100:00100000:1.0:1651529344.553757:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1256:41278:x1731746396313216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.553758:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11484 00010000:00010000:1.0:1651529344.553761:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553762:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1256 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553766:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 3/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1256 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553768:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1256:41279:x1731746396313344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.553771:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.553772:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 4/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1256 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553775:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ed74e87/0xa29a79078f3bba9b lrc: 0/0,0 mode: --/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67fe expref: 1256 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553776:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 3/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1256 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553778:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553779:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553780:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553782:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c7b3b9/0xa29a79078f3bc3fc lrc: 0/0,0 mode: --/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d12 expref: 1255 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553783:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 4/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553786:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553787:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553788:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553790:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553791:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 4/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553797:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396313216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.553798:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553800:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11483 00000100:00100000:1.0:1651529344.553822:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11485 00000100:00100000:1.0:1651529344.553824:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396313472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.553824:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396313344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.553827:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.553827:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11484 00010000:00010000:1.0:1651529344.553829:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1253 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553833:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 3/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553833:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11486 00000100:00100000:0.0:1651529344.553834:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1252:41279:x1731746396313280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.553837:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553838:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c522083c/0xa29a79078f3bc163 lrc: 0/0,0 mode: --/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82d8 expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553839:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1252 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553844:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553844:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553845:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553848:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 4/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553850:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 3/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1251 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553856:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553861:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061bc2ecd/0xa29a79078f3bbb43 lrc: 0/0,0 mode: --/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aba expref: 1251 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553863:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1251:41279:x1731746396313472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553865:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11485 00010000:00010000:0.0:1651529344.553865:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553866:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553867:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553870:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11487 00010000:00010000:0.0:1651529344.553870:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 4/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553871:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1249:41279:x1731746396313408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.553874:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553875:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 4/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1249 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.553879:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.553886:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 3/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1249 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.553886:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1249:41279:x1731746396313280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.553889:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11486 00010000:00010000:1.0:1651529344.553891:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdb05f4/0xa29a79078f3bad7b lrc: 0/0,0 mode: --/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3522 expref: 1248 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553894:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553895:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553896:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553898:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11488 00010000:00010000:1.0:1651529344.553899:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 4/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553900:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1247:41279:x1731746396313536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.553902:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.553903:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1247 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.553904:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553907:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 3/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1247 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553910:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1247:41279:x1731746396313408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553912:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11487 00010000:00010000:0.0:1651529344.553919:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d50517fc/0xa29a79078f3b94ca lrc: 0/0,0 mode: --/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0ac expref: 1246 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553920:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432448 00010000:00010000:0.0:1651529344.553923:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553924:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553924:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553931:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152527 00000100:00100000:1.0:1651529344.553932:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+816:39030:x1731745946432448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.553933:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 4/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.553937:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177319 count 1 00010000:00010000:0.0:1651529344.553939:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.553941:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553945:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 2/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1245 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.553946:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1245:41279:x1731746396313536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.553948:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11488 00010000:00010000:1.0:1651529344.553949:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553949:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553950:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 4/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553955:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553956:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 3/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.553959:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553962:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553964:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553971:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1244 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.553975:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966636096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553984:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.553989:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553993:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553996:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553998:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.554031:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+818:39030:x1731745946432320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 845us (945us total) trans 30064893384 rc 0/0 00000100:00100000:0.0:1651529344.554034:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152525 00010000:00010000:0.0:1651529344.554041:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554042:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+817:39030:x1731745946432128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1166us (1244us total) trans 30064893385 rc 0/0 00000100:00100000:1.0:1651529344.554045:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152521 00010000:00010000:0.0:1651529344.554045:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.554046:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554049:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 3/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554053:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554053:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 1/0,0 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554056:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554056:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be6d9 lrc: 0/0,0 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554060:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554063:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.554064:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554069:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554072:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554077:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 3/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554081:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 1/0,0 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554083:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be6bd lrc: 0/0,0 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554087:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554090:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e8a9075 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.554091:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554093:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 3/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554096:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 1/0,0 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554099:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be6c4 lrc: 0/0,0 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554105:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554107:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+817:39029:x1731745946432064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1045us total) trans 30064893386 rc 0/0 00000100:00100000:1.0:1651529344.554109:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152522 00010000:00010000:0.0:1651529344.554112:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554115:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554116:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554118:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554119:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554122:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554125:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.554162:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+818:39030:x1731745946432384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (953us total) trans 30064893387 rc 0/0 00000100:00100000:1.0:1651529344.554163:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+818:39030:x1731745946432256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1088us total) trans 30064893388 rc 0/0 00000100:00100000:0.0:1651529344.554165:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152526 00000100:00100000:1.0:1651529344.554167:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152524 00010000:00010000:0.0:1651529344.554172:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554173:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554176:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a98cab06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.554177:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554179:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 3/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554184:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 1/0,0 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554186:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1d141d6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.554187:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554187:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be6e0 lrc: 0/0,0 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554190:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 3/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554195:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 1/0,0 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554198:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be6d2 lrc: 0/0,0 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554201:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554204:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554207:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554210:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.554247:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+817:39030:x1731745946432192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1177us total) trans 30064893389 rc 0/0 00000100:00100000:0.0:1651529344.554250:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152523 00010000:00010000:0.0:1651529344.554257:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554260:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.554261:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554263:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 3/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554268:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 1/0,0 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554278:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be6cb lrc: 0/0,0 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.554295:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554369:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432512 00000100:00100000:0.0:1651529344.554377:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152528 00000100:00100000:0.0:1651529344.554379:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+817:39030:x1731745946432512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.554384:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177320 count 1 00010000:00010000:0.0:1651529344.554388:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554412:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 2/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554416:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554417:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554417:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 4/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554425:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 3/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554429:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.554433:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966636160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554445:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554581:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554628:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554637:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.554645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554665:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433088 00000100:00100000:0.0:1651529344.554672:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433152 00000100:00100000:0.0:1651529344.554675:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433216 00000100:00100000:0.0:1651529344.554678:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433280 00000100:00100000:0.0:1651529344.554681:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433344 00000100:00100000:0.0:1651529344.554683:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433408 00000100:00100000:0.0:1651529344.554686:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152529 00000100:00100000:0.0:1651529344.554687:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+823:39029:x1731745946433088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.554692:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177321 count 1 00010000:00010000:0.0:1651529344.554697:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554702:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 2/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554705:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554706:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554706:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 4/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554713:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 3/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554717:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1244 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.554722:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966636224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554741:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554760:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152530 00000100:00100000:0.0:1651529344.554762:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+823:39030:x1731745946433152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.554767:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177322 count 1 00010000:00010000:0.0:1651529344.554771:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554775:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 2/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554778:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554779:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554780:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 4/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554786:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 3/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554790:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1244 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.554797:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.554821:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152531 00000100:00100000:1.0:1651529344.554823:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+823:39029:x1731745946433216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.554823:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.554830:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177323 count 1 00000100:00100000:0.0:1651529344.554830:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152532 00000100:00100000:0.0:1651529344.554831:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+823:39030:x1731745946433280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.554834:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.554836:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177324 count 1 00010000:00010000:1.0:1651529344.554838:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 2/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1244 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554840:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554841:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554842:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554843:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 4/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554844:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 2/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554847:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554848:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554848:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 4/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554855:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 3/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554858:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1244 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.554860:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1244 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.554862:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966636352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.554864:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1244 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.554868:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966636416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554869:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554877:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554877:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152533 00000100:00100000:0.0:1651529344.554879:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+823:39029:x1731745946433344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.554883:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177325 count 1 00000100:00100000:1.0:1651529344.554885:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152534 00000100:00100000:1.0:1651529344.554886:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+823:39030:x1731745946433408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.554886:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554890:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 2/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.554891:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177326 count 1 00010000:00010000:0.0:1651529344.554893:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554894:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554894:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554894:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 4/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554899:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 2/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1244 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554901:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 3/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554902:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554902:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554903:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 4/0,1 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554905:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1244 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.554909:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 3/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1244 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.554909:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966636480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.554913:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 4/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1244 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.554915:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554917:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966636544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554923:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966636160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.554925:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.554926:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554933:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966636096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554934:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313600 00010000:00010000:1.0:1651529344.554937:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554938:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1245 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.554951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.554957:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313664 00010000:00010000:0.0:1651529344.554960:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1246 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.554969:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11489 00000100:00100000:0.0:1651529344.554971:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1246:41279:x1731746396313600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.554974:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.554976:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.554979:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 3/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.554985:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006df69351/0xa29a79078f3bb13a lrc: 0/0,0 mode: --/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d435a expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.554989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554990:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554993:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 4/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555001:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555008:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1245:41279:x1731746396313600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.555017:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11489 00000100:00100000:0.0:1651529344.555022:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11490 00000100:00100000:0.0:1651529344.555024:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1244:41279:x1731746396313664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.555027:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.555028:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555032:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 3/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555036:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024b741ad/0xa29a79078f3b966e lrc: 0/0,0 mode: --/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7b3 expref: 1244 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555040:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555041:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555042:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555044:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555045:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 4/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555048:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555051:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555054:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555072:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555085:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1243:41279:x1731746396313664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.555088:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11490 00010000:00010000:0.0:1651529344.555095:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555104:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946432448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1170us (1397us total) trans 30064893390 rc 0/0 00010000:00010000:0.0:1651529344.555106:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5a5be4e already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.555107:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152527 00010000:00010000:0.0:1651529344.555107:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555110:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 3/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555125:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 1/0,0 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555128:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be6e7 lrc: 0/0,0 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555135:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555137:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555141:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555143:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555184:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555191:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bac242b4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.555192:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555198:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946432512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 818us (902us total) trans 30064893391 rc 0/0 00010000:00010000:1.0:1651529344.555200:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 3/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555205:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 1/0,0 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555208:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac242b4/0xa29a79078f3be6ee lrc: 0/0,0 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555222:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152528 00000100:00100000:0.0:1651529344.555234:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966636224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555238:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.555283:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314240 00010000:00010000:0.0:1651529344.555289:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1243 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555300:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11491 00000100:00100000:0.0:1651529344.555302:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1243:41278:x1731746396314240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.555315:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.555317:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1243 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555321:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 3/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1243 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555326:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3b9e94 lrc: 0/0,0 mode: --/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf883 expref: 1243 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555345:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555346:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555347:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.555358:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 4/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.555374:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555383:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41278:x1731746396314240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.555385:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11491 00000100:00100000:0.0:1651529344.555396:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555400:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555407:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966636352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555410:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555418:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433664 00000100:00100000:0.0:1651529344.555424:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966636480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.555427:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433600 00000100:00100000:1.0:1651529344.555432:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152535 00010000:00010000:0.0:1651529344.555432:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555434:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+825:39030:x1731745946433664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.555437:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.555439:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177328 count 1 00010000:00010000:0.0:1651529344.555440:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555443:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555445:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555448:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 2/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1241 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.555448:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555453:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555454:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555455:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 4/0,1 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555462:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 3/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1241 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.555465:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 4/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1241 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.555469:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966636608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.555480:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.555487:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966636416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.555488:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+826:39029:x1731745946433088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 799us (926us total) trans 30064893392 rc 0/0 00010000:00010000:1.0:1651529344.555491:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555491:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152529 00000100:00100000:1.0:1651529344.555498:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152536 00000100:00100000:1.0:1651529344.555499:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+826:39029:x1731745946433600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.555504:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177327 count 1 00010000:00010000:1.0:1651529344.555507:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555511:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 2/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1241 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.555514:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555516:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555517:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555518:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 4/0,1 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555523:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 3/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1241 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.555527:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 4/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1241 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.555531:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966636672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.555537:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.555538:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002801aa2b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.555539:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555542:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 3/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555547:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 1/0,0 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555550:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002801aa2b/0xa29a79078f3be6f5 lrc: 0/0,0 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.555583:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314304 00010000:00010000:0.0:1651529344.555588:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555606:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11492 00000100:00100000:0.0:1651529344.555608:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41279:x1731746396314304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.555611:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.555612:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555616:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 3/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.555618:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966636544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555621:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3b9f5f lrc: 0/0,0 mode: --/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbaf expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.555623:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555625:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555626:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555627:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555630:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 4/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555636:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555647:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1241:41279:x1731746396314304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.555650:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11492 00010000:00010000:0.0:1651529344.555656:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555660:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555663:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555665:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.555756:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+826:39030:x1731745946433152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 993us (1186us total) trans 30064893393 rc 0/0 00000100:00100000:0.0:1651529344.555760:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152530 00000100:00100000:0.0:1651529344.555765:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433728 00000100:00100000:0.0:1651529344.555771:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152537 00000100:00100000:0.0:1651529344.555773:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+826:39030:x1731745946433728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.555778:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177329 count 1 00010000:00010000:0.0:1651529344.555782:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555787:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 2/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.555790:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555790:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555791:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 4/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555798:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 3/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.555821:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555825:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7db30c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.555827:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555832:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 3/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555836:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1240 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.555837:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 1/0,0 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555840:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7db30c8/0xa29a79078f3be6fc lrc: 0/0,0 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555841:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.555856:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.555894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.555902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555912:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314368 00000100:00100000:0.0:1651529344.555912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.555917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.555918:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1241 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555939:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314560 00010000:00010000:1.0:1651529344.555943:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 4/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1242 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555947:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314432 00010000:00010000:1.0:1651529344.555950:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1243 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555950:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314496 00000100:00100000:1.0:1651529344.555954:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314688 00010000:00010000:0.0:1651529344.555955:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1245 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.555956:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 5/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1245 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.555961:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314624 00000100:00100000:0.0:1651529344.555962:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11493 00010000:00010000:1.0:1651529344.555963:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 5/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1246 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.555964:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1246:41279:x1731746396314368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.555967:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.555968:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11494 00010000:00010000:0.0:1651529344.555968:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.555969:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1246:41279:x1731746396314560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.555972:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.555972:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 3/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.555974:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 4/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1246 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.555977:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 3/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1246 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555978:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fd1f096/0xa29a79078f3bc178 lrc: 0/0,0 mode: --/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8302 expref: 1246 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555982:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555982:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555983:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fcbe92/0xa29a79078f3b837b lrc: 0/0,0 mode: --/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea0 expref: 1245 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.555983:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555986:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 4/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555987:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555987:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555988:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555991:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 4/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555993:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.555998:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.556023:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1244:41279:x1731746396314368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.556024:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1244:41279:x1731746396314560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556026:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11493 00000100:00100000:1.0:1651529344.556028:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11494 00000100:00100000:1.0:1651529344.556033:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11495 00000100:00100000:1.0:1651529344.556035:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41278:x1731746396314432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.556037:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11496 00010000:00010000:1.0:1651529344.556038:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556039:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1242 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.556039:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41278:x1731746396314496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.556042:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556043:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1242 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556044:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556048:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a21721/0xa29a79078f3b95a3 lrc: 0/0,0 mode: --/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4b8 expref: 1242 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556048:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 3/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1242 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556051:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556052:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556053:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556053:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d007a2/0xa29a79078f3bc1b7 lrc: 0/0,0 mode: --/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83d4 expref: 1241 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556056:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 4/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556059:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556060:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556061:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.556061:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556063:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 4/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556067:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1240:41278:x1731746396314432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.556069:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11495 00010000:00010000:0.0:1651529344.556070:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.556073:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11497 00000100:00100000:1.0:1651529344.556075:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41278:x1731746396314688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.556077:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556078:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 5/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1239 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556082:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 4/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1239 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556087:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556087:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556088:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556091:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 4/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556093:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41278:x1731746396314496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.556095:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.556096:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11496 00000100:00100000:1.0:1651529344.556100:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1238:41278:x1731746396314688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556101:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11498 00000100:00100000:1.0:1651529344.556103:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11497 00000100:00100000:0.0:1651529344.556103:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1238:41279:x1731746396314624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.556106:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.556108:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 5/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1237 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556112:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 4/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1237 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.556114:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029691c1d/0xa29a79078f3bb2e5 lrc: 0/0,0 mode: --/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aae expref: 1237 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556116:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556117:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.556118:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966636608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556118:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556121:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556123:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 4/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556124:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556127:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556127:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.556133:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1236:41279:x1731746396314624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556135:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11498 00010000:00010000:1.0:1651529344.556140:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556142:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556143:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556145:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556148:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556151:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556189:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+828:39030:x1731745946433280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1357us (1591us total) trans 30064893395 rc 0/0 00000100:00100000:0.0:1651529344.556192:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152532 00000100:00100000:1.0:1651529344.556194:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+828:39030:x1731745946433664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 759us (836us total) trans 30064893394 rc 0/0 00000100:00100000:1.0:1651529344.556197:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152535 00010000:00010000:0.0:1651529344.556199:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556202:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556205:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556208:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3b9740 lrc: 0/0,0 mode: --/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb02 expref: 1235 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556208:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556212:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966636672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556223:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556227:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556229:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556232:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556244:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556247:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+827:39029:x1731745946433344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1367us (1619us total) trans 30064893396 rc 0/0 00000100:00100000:0.0:1651529344.556250:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152533 00010000:00010000:0.0:1651529344.556257:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556260:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cb78239 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556261:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556264:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 3/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556269:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 1/0,0 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556272:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be71f lrc: 0/0,0 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556276:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556279:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052f453be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556280:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556281:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+827:39029:x1731745946433600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 780us (907us total) trans 30064893397 rc 0/0 00010000:00010000:0.0:1651529344.556282:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 3/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556283:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152536 00010000:00010000:0.0:1651529344.556286:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 1/0,0 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556288:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052f453be/0xa29a79078f3be70a lrc: 0/0,0 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556291:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556291:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556294:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556294:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b199f4f9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556295:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556297:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556297:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 3/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556300:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556300:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 1/0,0 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556305:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b199f4f9/0xa29a79078f3be711 lrc: 0/0,0 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556309:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556311:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556312:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556315:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 3/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556318:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 1/0,0 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556320:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be726 lrc: 0/0,0 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556324:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556326:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8e86e58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556327:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556331:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+827:39030:x1731745946433408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1444us (1686us total) trans 30064893398 rc 0/0 00010000:00010000:0.0:1651529344.556332:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 3/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556334:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152534 00010000:00010000:0.0:1651529344.556335:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 1/0,0 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556338:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be718 lrc: 0/0,0 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556340:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556343:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.556356:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556364:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.556404:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+827:39029:x1731745946433216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1580us (1823us total) trans 30064893399 rc 0/0 00000100:00100000:1.0:1651529344.556407:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152531 00000100:00100000:1.0:1651529344.556412:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433856 00000100:00100000:1.0:1651529344.556419:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152538 00000100:00100000:1.0:1651529344.556427:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+827:39030:x1731745946433856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.556432:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177330 count 1 00010000:00010000:1.0:1651529344.556447:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 3/0,1 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556454:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556457:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 2/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556458:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000319d7947 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556459:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556461:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556461:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 3/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556462:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556462:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 4/0,1 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556466:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 1/0,0 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556469:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 3/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556469:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be703 lrc: 0/0,0 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556483:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 4/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.556487:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966636800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556501:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.556512:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556516:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556523:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314880 00010000:00010000:0.0:1651529344.556528:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.556535:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11499 00000100:00100000:0.0:1651529344.556537:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1235:41278:x1731746396314880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.556540:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.556541:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556545:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 3/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556550:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003586beb6/0xa29a79078f3bb531 lrc: 0/0,0 mode: --/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53ec expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556553:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556554:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556555:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556560:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 4/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556566:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.556588:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41278:x1731746396314880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556600:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11499 00010000:00010000:0.0:1651529344.556608:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556611:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.556625:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556629:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556647:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556665:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556671:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556692:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434304 00000100:00100000:0.0:1651529344.556697:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946433728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 923us (966us total) trans 30064893400 rc 0/0 00000100:00100000:0.0:1651529344.556700:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152537 00000100:00100000:1.0:1651529344.556707:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434432 00000100:00100000:1.0:1651529344.556713:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434240 00000100:00100000:0.0:1651529344.556715:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434560 00000100:00100000:1.0:1651529344.556718:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434368 00000100:00100000:1.0:1651529344.556721:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434496 00000100:00100000:1.0:1651529344.556725:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152539 00000100:00100000:1.0:1651529344.556726:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.556727:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152540 00000100:00100000:0.0:1651529344.556729:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.556741:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177332 count 1 00002000:00080000:0.0:1651529344.556742:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177334 count 1 00010000:00010000:1.0:1651529344.556746:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556747:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556750:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 2/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1233 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556752:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 2/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1233 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556754:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556754:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556755:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 4/0,1 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556755:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556756:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556756:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 4/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556762:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 3/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1233 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556763:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 3/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1233 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556766:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 4/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1233 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556767:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 4/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1233 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.556770:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966636864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.556771:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556779:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.556786:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152541 00000100:00100000:1.0:1651529344.556788:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.556792:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177331 count 1 00010000:00010000:1.0:1651529344.556796:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556796:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.556800:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 2/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556824:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556825:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.556825:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152542 00010000:00010000:1.0:1651529344.556826:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 4/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556827:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.556832:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177333 count 1 00010000:00010000:1.0:1651529344.556833:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 3/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556836:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556839:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1233 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556840:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 2/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.556843:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966636992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556846:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556846:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556847:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 4/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556851:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.556854:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 3/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.556857:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152543 00010000:00010000:0.0:1651529344.556857:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1233 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.556859:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.556861:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637056:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.556863:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177336 count 1 00010000:00010000:1.0:1651529344.556867:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556869:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.556871:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 2/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556874:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556874:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556875:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 4/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556876:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152544 00000100:00100000:0.0:1651529344.556878:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+833:39030:x1731745946434496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.556881:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 3/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.556882:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177335 count 1 00010000:00010000:1.0:1651529344.556884:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1233 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.556885:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556889:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 2/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.556891:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966637120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556892:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556893:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556894:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 4/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556898:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.556902:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1233 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556906:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1233 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.556910:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966637184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.556915:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.556922:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556925:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ae36632 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.556926:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556929:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 3/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556933:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 1/0,0 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556936:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae36632/0xa29a79078f3be72d lrc: 0/0,0 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.556957:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966636800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556967:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 3/0,1 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556993:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315328 00010000:00010000:0.0:1651529344.556999:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 4/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.557007:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11500 00000100:00100000:0.0:1651529344.557009:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41278:x1731746396315328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.557012:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.557013:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 4/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557017:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 3/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557022:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cee0665/0xa29a79078f3ba284 lrc: 0/0,0 mode: --/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d087b expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557026:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557026:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557027:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557030:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 4/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557042:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 4/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557046:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 4/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557049:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 4/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557052:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 3/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557062:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.557075:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1233:41278:x1731746396315328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.557078:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11500 00000100:00100000:1.0:1651529344.557099:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946433856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 677us (746us total) trans 30064893401 rc 0/0 00000100:00100000:0.0:1651529344.557099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.557102:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152538 00000100:00100000:1.0:1651529344.557108:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434752 00000100:00100000:1.0:1651529344.557118:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152545 00000100:00100000:1.0:1651529344.557120:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946434752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.557132:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177337 count 1 00010000:00010000:1.0:1651529344.557136:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557147:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 2/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1232 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557150:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557151:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557152:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 4/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557159:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1232 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557162:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1232 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.557166:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557180:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.557186:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 2/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557189:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.557190:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 2/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557193:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 3/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557211:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 1/0,0 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557214:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be734 lrc: 0/0,0 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557377:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.557393:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434816 00000100:00100000:0.0:1651529344.557400:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152546 00000100:00100000:0.0:1651529344.557402:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+835:39030:x1731745946434816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.557413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.557413:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177338 count 1 00000100:00100000:1.0:1651529344.557422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.557422:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.557432:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 2/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557435:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557435:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557436:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 4/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.557446:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966636864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557450:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557456:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1232 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.557457:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966636992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557460:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557466:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315392 00010000:00010000:0.0:1651529344.557469:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1233 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557471:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 4/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1233 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.557473:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966637312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557476:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315520 00010000:00010000:1.0:1651529344.557478:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1234 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.557487:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.557497:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315456 00000100:00100000:0.0:1651529344.557497:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557501:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 5/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1235 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557501:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557504:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315584 00010000:00010000:1.0:1651529344.557506:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1236 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.557511:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11501 00000100:00100000:0.0:1651529344.557511:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966636928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557512:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1236:41279:x1731746396315392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.557514:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557515:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.557516:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 4/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1236 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557520:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 3/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1236 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.557521:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11502 00000100:00100000:0.0:1651529344.557522:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1236:41279:x1731746396315520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.557525:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.557526:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d1189a/0xa29a79078f3b9430 lrc: 0/0,0 mode: --/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce8a expref: 1236 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557527:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1236 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557529:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557530:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557530:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 3/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557531:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557534:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 4/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557536:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3ba922 lrc: 0/0,0 mode: --/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23be expref: 1235 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557540:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557541:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557541:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557544:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 4/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557548:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.557554:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.557561:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41279:x1731746396315392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.557562:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41279:x1731746396315520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.557564:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11501 00000100:00100000:0.0:1651529344.557566:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11502 00000100:00100000:1.0:1651529344.557569:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11503 00000100:00100000:1.0:1651529344.557571:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396315456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.557572:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11504 00010000:00010000:1.0:1651529344.557574:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.557574:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396315584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.557575:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 4/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1232 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557576:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.557578:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1232 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557579:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 3/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1232 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557581:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 3/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1232 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557584:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b017da2d/0xa29a79078f3b9063 lrc: 0/0,0 mode: --/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc514 expref: 1232 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.557586:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3b9fc1 lrc: 0/0,0 mode: --/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcce expref: 1232 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.557588:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557588:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557589:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557590:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557590:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557591:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557592:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 4/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557594:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 4/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557601:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.557607:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1230:41279:x1731746396315456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.557608:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.557614:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1230:41279:x1731746396315584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.557616:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11503 00000100:00100000:0.0:1651529344.557618:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11504 00010000:00010000:1.0:1651529344.557625:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557628:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557631:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557634:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557646:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557649:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557653:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557655:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557672:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+836:39030:x1731745946434240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 883us (1007us total) trans 30064893402 rc 0/0 00000100:00100000:1.0:1651529344.557675:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152541 00010000:00010000:1.0:1651529344.557682:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557685:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.557686:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557689:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 3/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557694:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 1/0,0 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557697:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be749 lrc: 0/0,0 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557701:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557704:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e8a9075 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.557704:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557704:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+836:39030:x1731745946434368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 877us (1032us total) trans 30064893403 rc 0/0 00010000:00010000:1.0:1651529344.557707:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 3/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557707:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152542 00010000:00010000:1.0:1651529344.557711:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 1/0,0 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557713:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be750 lrc: 0/0,0 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557716:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557718:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557720:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557721:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557723:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557724:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557725:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557727:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557776:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946434432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1046us (1134us total) trans 30064893404 rc 0/0 00000100:00100000:1.0:1651529344.557782:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946434304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1054us (1163us total) trans 30064893405 rc 0/0 00000100:00100000:1.0:1651529344.557785:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152539 00000100:00100000:0.0:1651529344.557787:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152540 00010000:00010000:1.0:1651529344.557792:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557795:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4f1e207 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.557795:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557796:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557799:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 3/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557799:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.557800:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557818:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 3/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557820:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 1/0,0 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557824:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be742 lrc: 0/0,0 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557824:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 1/0,0 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557827:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be73b lrc: 0/0,0 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557884:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966637120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557889:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557903:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557906:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.557933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.557964:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966637184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.557968:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557975:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315648 00010000:00010000:0.0:1651529344.557980:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1229 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.557990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.557998:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315712 00000100:00100000:0.0:1651529344.558007:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315840 00010000:00010000:1.0:1651529344.558010:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1230 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.558017:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1231 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.558018:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11505 00000100:00100000:1.0:1651529344.558019:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1231:41279:x1731746396315648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.558022:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.558023:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11506 00010000:00010000:1.0:1651529344.558024:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1231 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558025:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1231:41279:x1731746396315712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.558028:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 3/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1231 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.558028:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.558030:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1231 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558034:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f5d139/0xa29a79078f3bac39 lrc: 0/0,0 mode: --/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fb1 expref: 1231 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.558034:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1231 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558038:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558038:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558039:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558040:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb4fedce/0xa29a79078f3b9cbf lrc: 0/0,0 mode: --/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf160 expref: 1230 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558042:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 4/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558043:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558044:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558045:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558048:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 4/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558049:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.558055:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.558061:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1229:41279:x1731746396315648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558064:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11505 00000100:00100000:1.0:1651529344.558069:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11507 00000100:00100000:1.0:1651529344.558071:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1228:41279:x1731746396315840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.558074:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558075:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1228 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558079:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1228 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558082:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1228:41279:x1731746396315712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.558084:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb232/0xa29a79078f3b979b lrc: 0/0,0 mode: --/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc60 expref: 1228 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558085:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11506 00010000:00010000:1.0:1651529344.558088:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558088:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558089:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558092:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 4/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558093:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558105:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558107:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.558108:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558111:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558114:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396315840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558116:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11507 00010000:00010000:1.0:1651529344.558141:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558145:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558148:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558150:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558176:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946434496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1298us (1496us total) trans 30064893406 rc 0/0 00000100:00100000:0.0:1651529344.558179:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152544 00000100:00100000:1.0:1651529344.558199:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+836:39030:x1731745946434560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1543us total) trans 30064893407 rc 0/0 00000100:00100000:1.0:1651529344.558202:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152543 00000100:00100000:0.0:1651529344.558209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.558216:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435392 00000100:00100000:1.0:1651529344.558227:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152547 00000100:00100000:1.0:1651529344.558228:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+836:39029:x1731745946435392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.558233:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177340 count 1 00010000:00010000:1.0:1651529344.558237:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558251:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 2/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.558255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.558269:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558270:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558271:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 4/0,1 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558278:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 3/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.558282:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 4/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.558286:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966637376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.558295:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.558300:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.558311:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558314:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558316:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.558317:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558344:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435456 00000100:00100000:0.0:1651529344.558351:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435328 00000100:00100000:0.0:1651529344.558354:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435520 00000100:00100000:0.0:1651529344.558358:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152548 00000100:00100000:0.0:1651529344.558360:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+840:39030:x1731745946435456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.558366:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177341 count 1 00010000:00010000:0.0:1651529344.558370:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558375:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 2/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558379:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558379:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558380:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 4/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558385:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+840:39030:x1731745946434752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1264us (1286us total) trans 30064893408 rc 0/0 00000100:00100000:1.0:1651529344.558388:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152545 00000100:00100000:1.0:1651529344.558394:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152549 00000100:00100000:1.0:1651529344.558396:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b8765e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+839:39029:x1731745946435328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.558401:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177339 count 1 00010000:00010000:1.0:1651529344.558405:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558408:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 3/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.558410:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 2/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558412:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558413:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558413:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558414:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 4/0,1 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558416:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966637440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558421:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 3/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.558425:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 4/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558425:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.558429:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558433:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966637312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.558437:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.558450:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558453:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558454:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1d141d6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.558455:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558458:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 3/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558462:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 1/0,0 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558462:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152550 00000100:00100000:0.0:1651529344.558463:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+839:39030:x1731745946435520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.558465:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1d141d6/0xa29a79078f3be75e lrc: 0/0,0 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.558468:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177342 count 1 00010000:00010000:1.0:1651529344.558469:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558472:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007274da18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.558472:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558473:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558475:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 3/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558479:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 1/0,0 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558485:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 2/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1225 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.558489:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be757 lrc: 0/0,0 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558492:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558495:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.558496:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558499:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 3/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558502:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 1/0,0 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558504:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558505:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be765 lrc: 0/0,0 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558505:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558505:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 4/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558513:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 3/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1225 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558517:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1225 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.558521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.558521:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558529:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.558537:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435712 00000100:00100000:0.0:1651529344.558549:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152551 00000100:00100000:0.0:1651529344.558551:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+840:39030:x1731745946435712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.558556:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177344 count 1 00010000:00010000:0.0:1651529344.558560:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558564:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 2/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558567:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558568:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558569:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 4/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.558575:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 3/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558579:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558583:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966637632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558590:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.558593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.558596:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435648 00000100:00100000:0.0:1651529344.558601:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152552 00000100:00100000:0.0:1651529344.558602:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+841:39029:x1731745946435648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.558606:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177343 count 1 00010000:00010000:0.0:1651529344.558610:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558614:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 2/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558617:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558618:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558619:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 4/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558624:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 3/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1225 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558630:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558634:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966637696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.558635:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316352 00010000:00010000:1.0:1651529344.558641:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558645:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.558653:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316416 00000100:00100000:1.0:1651529344.558654:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11508 00010000:00010000:0.0:1651529344.558658:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 5/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1227 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.558663:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1227:41279:x1731746396316352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.558666:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558667:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1227 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558671:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1227 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558677:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848d1817/0xa29a79078f3ba1f1 lrc: 0/0,0 mode: --/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0580 expref: 1227 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558681:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558682:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558683:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558684:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11509 00010000:00010000:1.0:1651529344.558686:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 4/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558686:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41278:x1731746396316416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.558689:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.558691:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 5/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.558695:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.558701:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 4/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.558703:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396316352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558706:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11508 00010000:00010000:0.0:1651529344.558707:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558707:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558708:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558711:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 4/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558717:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bb4a3fd/0xa29a79078f3ba850 lrc: 0/0,0 mode: --/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a0 expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.558718:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.558721:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966637376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558726:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41278:x1731746396316416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.558740:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558744:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558746:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558750:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558750:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11509 00010000:00010000:1.0:1651529344.558752:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558758:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558762:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558765:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558768:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558799:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+843:39029:x1731745946435392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 570us (590us total) trans 30064893409 rc 0/0 00000100:00100000:1.0:1651529344.558819:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152547 00010000:00010000:1.0:1651529344.558826:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558829:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.558830:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558830:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+842:39030:x1731745946434816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1427us (1454us total) trans 30064893410 rc 0/0 00010000:00010000:1.0:1651529344.558833:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 3/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558834:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152546 00010000:00010000:1.0:1651529344.558848:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 1/0,0 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558851:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be773 lrc: 0/0,0 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.558855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558857:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a98cab06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.558858:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558861:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 3/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558864:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 1/0,0 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558867:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a98cab06/0xa29a79078f3be76c lrc: 0/0,0 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558893:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435776 00000100:00100000:0.0:1651529344.558903:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152553 00000100:00100000:0.0:1651529344.558905:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+842:39030:x1731745946435776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.558910:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177345 count 1 00010000:00010000:0.0:1651529344.558915:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558947:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 2/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558951:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558952:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558952:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 4/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558960:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 3/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558963:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.558967:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966637760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558989:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.559008:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966637440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.559012:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.559026:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.559032:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.559036:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559042:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316480 00010000:00010000:1.0:1651529344.559047:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1224 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.559060:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316544 00000100:00100000:0.0:1651529344.559061:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966637632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.559064:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 5/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1225 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559065:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559068:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316608 00010000:00010000:1.0:1651529344.559070:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1226 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559072:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11510 00000100:00100000:0.0:1651529344.559074:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41278:x1731746396316480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.559075:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11511 00000100:00100000:1.0:1651529344.559076:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396316544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.559077:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.559079:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.559079:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559080:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 5/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559083:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 3/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559084:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 4/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559088:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e97528a/0xa29a79078f3bb43c lrc: 0/0,0 mode: --/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5018 expref: 1226 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559090:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559091:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559091:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559092:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559093:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559094:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 4/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559094:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559097:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 4/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559102:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559109:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1225:41279:x1731746396316544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.559112:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11511 00000100:00100000:1.0:1651529344.559116:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11512 00010000:00010000:0.0:1651529344.559116:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559117:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41278:x1731746396316608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.559120:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.559121:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1224 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559124:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 3/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1224 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559125:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41278:x1731746396316480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.559127:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11510 00010000:00010000:1.0:1651529344.559129:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efb2dd0/0xa29a79078f3b947d lrc: 0/0,0 mode: --/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf6a expref: 1224 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559132:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559133:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559134:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559135:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559137:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 4/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559139:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559142:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559146:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.559151:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559152:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1222:41278:x1731746396316608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.559155:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11512 00010000:00010000:1.0:1651529344.559166:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3b9f4a lrc: 0/0,0 mode: --/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb85 expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.559170:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.559174:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559177:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559180:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559183:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559185:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559200:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+843:39030:x1731745946435456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 839us (976us total) trans 30064893411 rc 0/0 00000100:00100000:0.0:1651529344.559203:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152548 00010000:00010000:0.0:1651529344.559211:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559215:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.559216:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559219:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 3/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559223:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 1/0,0 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559225:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b8765e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+843:39029:x1731745946435328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 828us (942us total) trans 30064893412 rc 0/0 00000100:00100000:1.0:1651529344.559228:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152549 00010000:00010000:0.0:1651529344.559229:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be77a lrc: 0/0,0 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559233:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559236:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.559237:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559239:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 3/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559243:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 1/0,0 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559245:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be781 lrc: 0/0,0 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559282:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559286:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559289:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559292:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.559317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.559351:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+843:39030:x1731745946435520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 886us (1034us total) trans 30064893413 rc 0/0 00000100:00100000:0.0:1651529344.559354:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152550 00000100:00100000:0.0:1651529344.559359:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436224 00000100:00100000:0.0:1651529344.559369:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436288 00000100:00100000:0.0:1651529344.559374:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152554 00000100:00100000:0.0:1651529344.559376:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+844:39030:x1731745946436224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.559386:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177346 count 1 00010000:00010000:0.0:1651529344.559391:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559396:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 2/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1220 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559399:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559399:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559400:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 4/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.559407:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 3/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1220 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559410:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1220 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559415:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.559427:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152555 00000100:00100000:1.0:1651529344.559428:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+844:39030:x1731745946436288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.559434:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.559439:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177347 count 1 00010000:00010000:1.0:1651529344.559444:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559449:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 2/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1220 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559452:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559453:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559453:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 4/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559456:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966637696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.559460:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 3/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1220 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559460:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559464:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1220 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.559468:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559476:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.559481:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559482:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966637760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.559485:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.559486:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559495:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559498:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 3/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559503:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 1/0,0 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559504:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316672 00010000:00010000:1.0:1651529344.559506:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be788 lrc: 0/0,0 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559509:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.559514:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316864 00000100:00100000:0.0:1651529344.559514:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316928 00010000:00010000:0.0:1651529344.559517:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559519:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559522:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11513 00000100:00100000:0.0:1651529344.559523:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1223:41279:x1731746396316672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.559526:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11514 00010000:00010000:0.0:1651529344.559526:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.559527:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1223:41279:x1731746396316928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.559528:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559530:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.559532:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559534:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 3/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559535:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 3/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559540:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bacef lrc: 0/0,0 mode: --/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32b3 expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559551:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3b9923 lrc: 0/0,0 mode: --/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2bf expref: 1223 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559552:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559553:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559554:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559555:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559556:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559556:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559557:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 4/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559560:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 4/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559566:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559573:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1221:41279:x1731746396316928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.559573:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559576:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11514 00000100:00100000:1.0:1651529344.559581:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11515 00000100:00100000:0.0:1651529344.559581:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1220:41279:x1731746396316672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.559583:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1220:41278:x1731746396316864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.559584:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11513 00010000:00010000:1.0:1651529344.559585:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.559587:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.559590:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 3/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559591:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559594:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559595:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000388edf73/0xa29a79078f3bae93 lrc: 0/0,0 mode: --/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38da expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559597:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559599:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559603:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559605:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559606:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559616:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 4/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559625:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559632:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41278:x1731746396316864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.559634:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11515 00010000:00010000:1.0:1651529344.559645:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559649:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.559650:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559652:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 3/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559657:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 1/0,0 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559659:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be78f lrc: 0/0,0 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559660:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+845:39030:x1731745946435712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1107us (1138us total) trans 30064893414 rc 0/0 00000100:00100000:0.0:1651529344.559663:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152551 00010000:00010000:0.0:1651529344.559671:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559674:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559677:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559680:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.559712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.559721:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+845:39029:x1731745946435648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1118us (1148us total) trans 30064893415 rc 0/0 00000100:00100000:0.0:1651529344.559725:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152552 00000100:00100000:0.0:1651529344.559729:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436352 00000100:00100000:1.0:1651529344.559743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.559753:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436416 00000100:00100000:0.0:1651529344.559757:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436480 00000100:00100000:0.0:1651529344.559764:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152556 00000100:00100000:0.0:1651529344.559766:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+847:39030:x1731745946436352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.559771:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177348 count 1 00010000:00010000:0.0:1651529344.559775:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559780:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 2/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559783:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559784:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559784:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 4/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559791:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 3/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559795:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1217 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559799:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966637952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.559825:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.559830:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152557 00000100:00100000:1.0:1651529344.559833:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+847:39030:x1731745946436416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.559838:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177349 count 1 00010000:00010000:1.0:1651529344.559843:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559847:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 2/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.559847:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152558 00000100:00100000:0.0:1651529344.559849:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+847:39030:x1731745946436480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.559850:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559851:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559852:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 4/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.559854:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177350 count 1 00010000:00010000:0.0:1651529344.559858:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559859:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 3/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559862:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 2/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1217 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559863:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1217 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.559866:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559866:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.559867:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966638016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.559867:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 4/0,1 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559874:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 3/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1217 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.559875:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.559877:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 4/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1217 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559881:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966638080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.559905:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.559912:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559915:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.559916:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559919:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 3/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559924:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 1/0,0 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559936:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be796 lrc: 0/0,0 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559943:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436736 00000100:00100000:0.0:1651529344.559954:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152559 00000100:00100000:0.0:1651529344.559956:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+848:39030:x1731745946436736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.559959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.559961:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177352 count 1 00010000:00010000:0.0:1651529344.559964:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559967:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436672 00010000:00010000:0.0:1651529344.559969:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 2/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559972:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559972:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.559973:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152560 00010000:00010000:0.0:1651529344.559973:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 4/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559975:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+849:39029:x1731745946436672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.559979:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 3/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559983:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1217 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.559987:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966638144:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.559989:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177351 count 1 00010000:00010000:1.0:1651529344.559993:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559997:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 2/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1217 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.560000:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.560007:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560007:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560007:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560008:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 4/0,1 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560010:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560013:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560015:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 3/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1217 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.560016:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560019:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 4/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1217 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.560028:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.560037:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.560043:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560046:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5a5be4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.560047:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560050:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 3/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560064:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 1/0,0 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560067:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a5be4e/0xa29a79078f3be79d lrc: 0/0,0 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560086:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+850:39030:x1731745946435776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1180us (1234us total) trans 30064893416 rc 0/0 00000100:00100000:0.0:1651529344.560089:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152553 00000100:00100000:0.0:1651529344.560199:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966637824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.560220:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560249:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966637888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560254:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.560280:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436800 00000100:00100000:0.0:1651529344.560291:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152561 00000100:00100000:0.0:1651529344.560293:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+850:39030:x1731745946436800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.560298:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177353 count 1 00010000:00010000:0.0:1651529344.560302:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560307:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 2/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.560310:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560311:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560311:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 4/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560318:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 3/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1217 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.560321:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1217 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560326:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.560339:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.560405:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560422:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317504 00010000:00010000:1.0:1651529344.560428:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1218 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.560441:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317568 00000100:00100000:0.0:1651529344.560442:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966638080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560443:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560447:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560453:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11516 00000100:00100000:1.0:1651529344.560455:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1219:41278:x1731746396317504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.560458:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560459:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560460:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966637952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560463:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 3/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560463:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560470:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11517 00000100:00100000:0.0:1651529344.560472:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1219:41278:x1731746396317568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.560475:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560476:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3ba7d2 lrc: 0/0,0 mode: --/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f0a expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560477:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560480:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560481:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560481:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 3/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1218 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560482:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560485:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 4/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560486:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e04fb8e9/0xa29a79078f3ba914 lrc: 0/0,0 mode: --/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a2 expref: 1218 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560490:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560491:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560493:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.560498:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560501:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 4/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560503:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1217:41278:x1731746396317504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.560505:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11516 00010000:00010000:0.0:1651529344.560510:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.560518:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1216:41278:x1731746396317568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.560521:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966638016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.560521:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11517 00010000:00010000:1.0:1651529344.560525:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560528:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560532:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560532:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560535:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560537:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560538:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560540:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560553:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560607:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946436288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1177us (1289us total) trans 30064893417 rc 0/0 00000100:00100000:1.0:1651529344.560610:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152555 00010000:00010000:1.0:1651529344.560617:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560620:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+851:39030:x1731745946436224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1345us total) trans 30064893418 rc 0/0 00010000:00010000:1.0:1651529344.560621:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.560622:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560623:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152554 00010000:00010000:1.0:1651529344.560625:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 3/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560629:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 1/0,0 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560632:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be7a4 lrc: 0/0,0 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560636:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560639:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.560648:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560651:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 3/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560655:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 1/0,0 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560658:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be7ab lrc: 0/0,0 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560702:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966638144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.560707:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560755:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560760:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560772:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317632 00010000:00010000:1.0:1651529344.560777:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1216 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560783:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317760 00010000:00010000:1.0:1651529344.560785:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 4/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1217 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560786:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.560789:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317888 00010000:00010000:0.0:1651529344.560790:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560791:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 4/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1218 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560797:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317696 00010000:00010000:0.0:1651529344.560801:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1219 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.560824:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317824 00010000:00010000:1.0:1651529344.560828:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1220 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560828:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317952 00010000:00010000:0.0:1651529344.560832:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.560833:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11518 00000100:00100000:1.0:1651529344.560834:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1221:41279:x1731746396317632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.560836:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11519 00010000:00010000:1.0:1651529344.560837:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.560838:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1221:41278:x1731746396317760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.560839:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560841:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560843:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 3/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560843:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 4/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1221 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560846:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 3/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1221 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560848:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea6165d/0xa29a79078f3b9a0a lrc: 0/0,0 mode: --/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5c8 expref: 1221 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560851:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560852:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560852:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f52bf7/0xa29a79078f3b9691 lrc: 0/0,0 mode: --/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd831 expref: 1220 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560853:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560856:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 4/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560856:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560856:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560857:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560860:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 4/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560865:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.560872:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.560874:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1219:41279:x1731746396317632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.560884:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11518 00000100:00100000:1.0:1651529344.560889:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11520 00000100:00100000:1.0:1651529344.560891:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41278:x1731746396317888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.560894:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560895:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 4/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1218 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560897:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41278:x1731746396317760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.560899:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 3/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1218 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560900:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11519 00010000:00010000:1.0:1651529344.560904:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eec0c2f2/0xa29a79078f3b788b lrc: 0/0,0 mode: --/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ae expref: 1217 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560906:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11521 00000100:00100000:0.0:1651529344.560907:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1216:41279:x1731746396317696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.560908:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560909:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560909:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560910:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560912:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 4/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560912:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1216 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560916:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 3/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1216 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560918:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.560921:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3b9eef lrc: 0/0,0 mode: --/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf99b expref: 1216 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.560924:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1215:41278:x1731746396317888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.560924:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560925:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560926:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560927:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11520 00010000:00010000:0.0:1651529344.560929:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 4/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560931:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11522 00010000:00010000:0.0:1651529344.560939:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.560945:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396317824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.560946:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396317696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.560948:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.560949:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11521 00010000:00010000:1.0:1651529344.560950:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1214 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560953:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 3/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1213 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560957:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11523 00010000:00010000:1.0:1651529344.560958:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d3b0dc/0xa29a79078f3baa8e lrc: 0/0,0 mode: --/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d290c expref: 1213 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.560959:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1213:41278:x1731746396317952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.560962:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560962:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560962:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560963:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560963:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1212 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560966:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 4/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560967:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 3/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1212 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.560972:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb995d51/0xa29a79078f3b9a18 lrc: 0/0,0 mode: --/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5e4 expref: 1212 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.560975:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.560981:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1212:41279:x1731746396317824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.560983:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.560984:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11522 00010000:00010000:0.0:1651529344.560984:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560984:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560988:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 4/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560991:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560993:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.560995:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560999:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1210:41278:x1731746396317952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.561001:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11523 00010000:00010000:1.0:1651529344.561007:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561008:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561010:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561011:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561017:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561020:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561054:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946436416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1220us (1341us total) trans 30064893419 rc 0/0 00000100:00100000:1.0:1651529344.561057:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152557 00000100:00100000:0.0:1651529344.561059:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946436480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1209us (1316us total) trans 30064893420 rc 0/0 00000100:00100000:0.0:1651529344.561062:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152558 00010000:00010000:1.0:1651529344.561064:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561067:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.561069:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561069:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561071:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 3/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561072:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561075:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561076:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 1/0,0 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561078:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561079:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be7b9 lrc: 0/0,0 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561083:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561097:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.561098:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561101:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 3/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561104:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 1/0,0 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561107:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be7c0 lrc: 0/0,0 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561111:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561114:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.561115:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561116:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+851:39030:x1731745946436736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1159us (1195us total) trans 30064893421 rc 0/0 00010000:00010000:1.0:1651529344.561117:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 3/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561118:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152559 00010000:00010000:1.0:1651529344.561120:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 1/0,0 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561126:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561131:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be7c7 lrc: 0/0,0 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561132:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561135:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561137:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561138:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561140:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561144:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561147:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561168:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946436352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1401us (1474us total) trans 30064893422 rc 0/0 00000100:00100000:0.0:1651529344.561171:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152556 00010000:00010000:0.0:1651529344.561177:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561180:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.561181:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561184:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+851:39029:x1731745946436672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1224us total) trans 30064893423 rc 0/0 00010000:00010000:0.0:1651529344.561184:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 3/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561187:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152560 00010000:00010000:0.0:1651529344.561189:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 1/0,0 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561191:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be7b2 lrc: 0/0,0 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561195:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561197:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561198:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.561199:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561200:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561202:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 3/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561203:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561206:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561220:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 1/0,0 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561223:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be7ce lrc: 0/0,0 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561228:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561230:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.561231:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561234:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 3/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561237:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 1/0,0 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561240:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be7d5 lrc: 0/0,0 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561245:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+851:39030:x1731745946436800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 952us (972us total) trans 30064893424 rc 0/0 00000100:00100000:0.0:1651529344.561248:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152561 00000100:00100000:1.0:1651529344.561255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.561277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561283:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436864 00000100:00100000:0.0:1651529344.561290:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436928 00000100:00100000:0.0:1651529344.561294:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152562 00000100:00100000:0.0:1651529344.561295:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946436864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.561300:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177354 count 1 00010000:00010000:0.0:1651529344.561304:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561309:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 2/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561315:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561315:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561316:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 4/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561323:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 3/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561327:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.561331:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152563 00000100:00100000:0.0:1651529344.561331:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.561334:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+852:39029:x1731745946436928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.561346:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.561352:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177355 count 1 00010000:00010000:1.0:1651529344.561356:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561361:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 2/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.561364:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561365:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561366:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 4/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561373:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 3/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.561377:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.561381:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.561396:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.561589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561604:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436992 00000100:00100000:1.0:1651529344.561605:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.561610:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561612:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152564 00000100:00100000:0.0:1651529344.561614:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+853:39030:x1731745946436992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.561619:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177356 count 1 00010000:00010000:0.0:1651529344.561624:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561628:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 2/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561632:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561632:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561633:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 4/0,1 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561640:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 3/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1209 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561671:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 4/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.561676:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966638464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.561706:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.561713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.561715:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.561724:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561741:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318080 00010000:00010000:0.0:1651529344.561746:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.561757:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11524 00000100:00100000:0.0:1651529344.561758:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1210:41279:x1731746396318080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.561761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.561761:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.561763:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.561766:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 3/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.561779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.561781:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bb500 lrc: 0/0,0 mode: --/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52d4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.561789:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318016 00010000:00010000:0.0:1651529344.561789:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561790:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561791:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561794:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 4/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561795:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.561815:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.561831:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11525 00000100:00100000:1.0:1651529344.561833:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1210:41278:x1731746396318016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.561836:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.561838:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.561839:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1210:41279:x1731746396318080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 79us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.561842:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 3/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1210 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.561842:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11524 00010000:00010000:1.0:1651529344.561848:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d5e677/0xa29a79078f3bbd65 lrc: 0/0,0 mode: --/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72c4 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.561852:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561852:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561853:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561856:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 4/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561860:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437056 00010000:00010000:1.0:1651529344.561866:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.561874:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41278:x1731746396318016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.561885:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11525 00000100:00100000:0.0:1651529344.561886:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152565 00010000:00010000:1.0:1651529344.561893:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561896:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+854:39030:x1731745946437056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.561897:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561900:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.561901:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177357 count 1 00010000:00010000:1.0:1651529344.561902:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561906:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561917:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 2/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561920:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561921:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561921:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 4/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561928:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 3/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561932:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 4/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1207 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.561936:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966638528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.561944:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.561950:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561953:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.561955:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561957:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 3/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561958:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+855:39029:x1731745946436928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 624us (681us total) trans 30064893425 rc 0/0 00000100:00100000:1.0:1651529344.561962:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152563 00010000:00010000:0.0:1651529344.561962:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 1/0,0 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561965:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be7e3 lrc: 0/0,0 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561973:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561976:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561979:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561982:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.562033:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+855:39030:x1731745946436864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 736us (778us total) trans 30064893426 rc 0/0 00000100:00100000:0.0:1651529344.562036:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152562 00000100:00100000:0.0:1651529344.562041:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437376 00000100:00100000:1.0:1651529344.562048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.562048:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152566 00000100:00100000:0.0:1651529344.562049:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+855:39030:x1731745946437376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.562054:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177358 count 1 00010000:00010000:0.0:1651529344.562058:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562062:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 2/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562065:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562066:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562067:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 4/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.562074:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 3/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562077:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 4/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.562081:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562089:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.562095:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437504 00000100:00100000:0.0:1651529344.562101:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152567 00000100:00100000:0.0:1651529344.562103:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+856:39030:x1731745946437504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.562104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.562107:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177360 count 1 00010000:00010000:0.0:1651529344.562110:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562114:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 2/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562117:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562118:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562118:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 4/0,1 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562124:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 3/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.562137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.562144:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562148:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.562149:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562150:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 4/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.562155:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966638656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.562162:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 3/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562167:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 1/0,0 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562170:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be7dc lrc: 0/0,0 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562180:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.562182:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437440 00000100:00100000:0.0:1651529344.562186:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437568 00000100:00100000:1.0:1651529344.562194:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152568 00000100:00100000:1.0:1651529344.562196:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+858:39029:x1731745946437440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.562200:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152569 00002000:00080000:1.0:1651529344.562201:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177359 count 1 00000100:00100000:0.0:1651529344.562201:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+858:39029:x1731745946437568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.562205:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.562206:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177361 count 1 00010000:00010000:1.0:1651529344.562210:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 2/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562210:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562213:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562213:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562214:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 4/0,1 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562221:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 3/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562227:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 4/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1207 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562231:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966638720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562238:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 2/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562241:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562241:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562242:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 4/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562249:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.562250:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562253:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 4/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562255:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318144 00010000:00010000:1.0:1651529344.562260:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 5/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562268:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11526 00000100:00100000:1.0:1651529344.562270:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41278:x1731746396318144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.562273:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.562274:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 5/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.562278:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 4/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.562278:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966638784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.562283:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562284:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562284:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562287:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 4/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562287:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.562294:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.562297:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebc0c4b7/0xa29a79078f3bb887 lrc: 0/0,0 mode: --/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6033 expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562300:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41278:x1731746396318144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.562301:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966638464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.562303:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11526 00010000:00010000:0.0:1651529344.562305:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562308:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562311:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562314:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562317:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.562343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.562360:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+859:39030:x1731745946436992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 745us (771us total) trans 30064893427 rc 0/0 00000100:00100000:0.0:1651529344.562363:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152564 00000100:00100000:0.0:1651529344.562368:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437888 00000100:00100000:0.0:1651529344.562385:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437952 00000100:00100000:0.0:1651529344.562390:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152570 00000100:00100000:0.0:1651529344.562392:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+860:39030:x1731745946437888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.562397:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177362 count 1 00000100:00100000:1.0:1651529344.562399:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152571 00000100:00100000:1.0:1651529344.562402:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+860:39029:x1731745946437952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.562407:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177363 count 1 00010000:00010000:1.0:1651529344.562412:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562415:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562417:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 2/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562420:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562420:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562421:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 4/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562421:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 2/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562424:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562424:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562425:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 4/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562427:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 3/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562431:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1206 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.562433:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 3/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562436:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 4/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1206 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562438:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562440:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966638912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.562449:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.562449:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.562453:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562457:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4f1e207 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.562458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562461:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 3/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562465:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 1/0,0 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562468:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f1e207/0xa29a79078f3be7ea lrc: 0/0,0 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.562543:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438016 00000100:00100000:1.0:1651529344.562550:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152572 00000100:00100000:1.0:1651529344.562551:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+861:39030:x1731745946438016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.562556:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177364 count 1 00010000:00010000:1.0:1651529344.562560:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562567:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 2/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562570:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562570:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562571:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 4/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562577:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1206 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562590:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1206 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.562592:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.562594:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966638976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.562611:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.562611:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966638528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562616:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562617:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318592 00010000:00010000:1.0:1651529344.562622:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 4/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1207 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562629:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318656 00010000:00010000:1.0:1651529344.562631:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 5/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.562632:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966638592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562635:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562641:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11527 00000100:00100000:1.0:1651529344.562643:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41279:x1731746396318592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.562648:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11528 00000100:00100000:0.0:1651529344.562650:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41278:x1731746396318656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.562653:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.562654:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 4/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1208 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.562658:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 3/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1208 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.562664:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081092121/0xa29a79078f3b96d7 lrc: 0/0,0 mode: --/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd911 expref: 1208 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.562667:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.562668:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562668:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562669:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562669:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 4/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.562672:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 4/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562673:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 3/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.562681:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.562684:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3babf3 lrc: 0/0,0 mode: --/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e61 expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.562688:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1207:41279:x1731746396318592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (96us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.562689:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562689:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562690:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562691:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11527 00010000:00010000:0.0:1651529344.562693:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 4/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562699:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.562707:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1205:41278:x1731746396318656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.562715:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11528 00000100:00100000:0.0:1651529344.562741:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966638656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562745:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562751:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562754:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562757:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562760:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562817:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946437056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 919us (1056us total) trans 30064893428 rc 0/0 00000100:00100000:0.0:1651529344.562820:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152565 00010000:00010000:0.0:1651529344.562827:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562831:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000319d7947 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.562832:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562835:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 3/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562840:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 1/0,0 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562842:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000319d7947/0xa29a79078f3be7f1 lrc: 0/0,0 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562849:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562852:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562855:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562858:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562869:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562873:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8e86e58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.562874:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562885:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 3/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562890:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 1/0,0 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562893:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e86e58/0xa29a79078f3be7f8 lrc: 0/0,0 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562910:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946437376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 859us (905us total) trans 30064893429 rc 0/0 00000100:00100000:0.0:1651529344.562913:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152566 00000100:00100000:1.0:1651529344.563001:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966638720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.563006:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.563061:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966638848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.563063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.563065:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.563078:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318784 00000100:00100000:0.0:1651529344.563078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.563087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.563088:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 4/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1205 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.563099:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318976 00010000:00010000:1.0:1651529344.563102:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 5/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1206 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.563121:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319040 00010000:00010000:1.0:1651529344.563124:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 5/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1207 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.563127:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966638784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.563132:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563135:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318912 00010000:00010000:1.0:1651529344.563138:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 4/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1208 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.563141:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966638912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.563142:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319104 00010000:00010000:0.0:1651529344.563143:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563144:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.563149:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11529 00000100:00100000:1.0:1651529344.563151:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1209:41278:x1731746396318784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.563151:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11530 00010000:00010000:1.0:1651529344.563153:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.563153:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1209:41279:x1731746396318976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.563155:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 4/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563156:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.563158:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 4/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563159:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 3/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563162:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563164:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e3edcad/0xa29a79078f3babbb lrc: 0/0,0 mode: --/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d81 expref: 1209 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563167:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563168:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aed4784/0xa29a79078f3bb55b lrc: 0/0,0 mode: --/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d549b expref: 1208 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563172:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563172:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563173:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563175:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563176:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563176:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 4/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563179:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 4/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563182:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.563188:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.563196:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1207:41279:x1731746396318976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.563197:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1207:41278:x1731746396318784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.563199:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11530 00000100:00100000:1.0:1651529344.563201:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11529 00000100:00100000:0.0:1651529344.563205:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11531 00000100:00100000:1.0:1651529344.563207:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11532 00000100:00100000:0.0:1651529344.563207:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1205:41279:x1731746396319040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.563209:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1205:41278:x1731746396318912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.563210:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.563212:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.563212:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 4/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1205 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563213:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 4/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1205 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563215:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 3/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1205 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563217:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 3/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1205 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563220:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3ba038 lrc: 0/0,0 mode: --/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfebf expref: 1205 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563222:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6266dd/0xa29a79078f3b98f2 lrc: 0/0,0 mode: --/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ca expref: 1205 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563224:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563224:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563225:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563226:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563226:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563227:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563228:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 4/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563234:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.563239:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 4/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563240:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1203:41279:x1731746396319040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.563242:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11531 00010000:00010000:1.0:1651529344.563246:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.563247:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11533 00000100:00100000:0.0:1651529344.563248:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1202:41278:x1731746396319104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.563251:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.563252:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1202:41278:x1731746396318912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.563252:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1202 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.563255:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11532 00010000:00010000:0.0:1651529344.563256:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 3/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1202 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563260:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ab19c8/0xa29a79078f3b8acf lrc: 0/0,0 mode: --/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc235 expref: 1201 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563263:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563264:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.563265:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966638976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.563265:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563268:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 4/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563269:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563274:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563277:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.563283:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1200:41278:x1731746396319104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.563284:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563286:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11533 00010000:00010000:1.0:1651529344.563287:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563290:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563292:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563296:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563299:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563301:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563329:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+863:39029:x1731745946437440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1133us (1225us total) trans 30064893430 rc 0/0 00000100:00100000:1.0:1651529344.563333:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152568 00000100:00100000:0.0:1651529344.563340:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946437504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1292us total) trans 30064893431 rc 0/0 00000100:00100000:0.0:1651529344.563343:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152567 00000100:00100000:1.0:1651529344.563347:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438272 00010000:00010000:0.0:1651529344.563350:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563356:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152573 00000100:00100000:1.0:1651529344.563358:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946438272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.563360:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b010eb0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.563361:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.563363:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177365 count 1 00010000:00010000:0.0:1651529344.563364:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 3/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563367:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 3/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563369:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 1/0,0 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563372:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 2/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563372:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be806 lrc: 0/0,0 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563375:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563376:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563376:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 4/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563376:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563379:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e8a9075 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.563380:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563383:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 3/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563383:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 3/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563386:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563386:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 1/0,0 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563388:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8a9075/0xa29a79078f3be7ff lrc: 0/0,0 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563391:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.563394:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563396:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563399:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.563399:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563402:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563405:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563415:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563429:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563432:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563458:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+864:39029:x1731745946437568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1256us (1322us total) trans 30064893432 rc 0/0 00000100:00100000:0.0:1651529344.563461:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152569 00010000:00010000:0.0:1651529344.563469:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563473:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cb78239 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.563474:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563475:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+863:39029:x1731745946437952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1072us (1131us total) trans 30064893433 rc 0/0 00010000:00010000:0.0:1651529344.563476:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 3/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563478:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152571 00010000:00010000:0.0:1651529344.563481:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 1/0,0 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563484:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb78239/0xa29a79078f3be80d lrc: 0/0,0 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563485:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563488:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.563489:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563490:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563492:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 3/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563493:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563497:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 1/0,0 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563497:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563499:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 2/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563500:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be814 lrc: 0/0,0 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563504:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563518:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011187589 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.563520:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 2/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563522:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 3/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563526:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 1/0,0 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563528:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be81b lrc: 0/0,0 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563544:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946437888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1151us (1224us total) trans 30064893434 rc 0/0 00000100:00100000:0.0:1651529344.563547:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152570 00000100:00100000:1.0:1651529344.563557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.563571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563595:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319168 00010000:00010000:0.0:1651529344.563601:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1200 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.563609:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11534 00000100:00100000:0.0:1651529344.563610:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1200:41278:x1731746396319168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.563613:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.563615:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1200 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563618:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1200 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563624:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e86037c/0xa29a79078f3bbe76 lrc: 0/0,0 mode: --/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d770f expref: 1200 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.563630:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563631:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563632:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563634:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 4/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563645:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.563647:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563652:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563655:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563658:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563674:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41278:x1731746396319168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.563678:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11534 00010000:00010000:0.0:1651529344.563684:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563688:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.563700:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563704:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 3/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563705:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946438016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1152us (1168us total) trans 30064893435 rc 0/0 00000100:00100000:1.0:1651529344.563708:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152572 00010000:00010000:0.0:1651529344.563709:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 1/0,0 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563711:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be822 lrc: 0/0,0 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563713:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438336 00000100:00100000:1.0:1651529344.563723:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152574 00000100:00100000:1.0:1651529344.563725:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+863:39030:x1731745946438336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.563729:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177366 count 1 00010000:00010000:1.0:1651529344.563742:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563747:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 2/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563750:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563751:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563752:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 4/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563765:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 3/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563776:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.563780:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.563795:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.563842:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.563858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.563868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.563877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563878:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438720 00000100:00100000:1.0:1651529344.563892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563902:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438784 00000100:00100000:1.0:1651529344.563903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563907:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438848 00000100:00100000:0.0:1651529344.563911:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438912 00000100:00100000:1.0:1651529344.563912:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438976 00000100:00100000:0.0:1651529344.563914:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439040 00000100:00100000:0.0:1651529344.563917:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152575 00000100:00100000:0.0:1651529344.563919:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946438720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.563921:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152576 00000100:00100000:1.0:1651529344.563923:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946438784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.563925:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177367 count 1 00002000:00080000:1.0:1651529344.563928:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177368 count 1 00010000:00010000:0.0:1651529344.563929:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563932:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563934:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 2/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563936:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 2/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563937:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563938:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563939:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 4/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563940:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563940:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563941:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 4/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563946:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 3/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563947:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 3/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563949:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.563951:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.563954:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966639168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.563955:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966639232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.563984:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.563990:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.563992:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152577 00000100:00100000:0.0:1651529344.563994:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946438848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.563996:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152578 00000100:00100000:1.0:1651529344.563998:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf9f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946438912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.563998:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177369 count 1 00002000:00080000:1.0:1651529344.564002:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177370 count 1 00010000:00010000:0.0:1651529344.564002:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564006:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564007:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 2/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564010:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 2/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564013:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564014:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564014:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 4/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564020:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 3/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564022:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564022:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564023:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564023:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 4/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564027:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966639296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564031:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 3/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.564034:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.564035:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564039:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966639360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564041:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564045:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 3/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564046:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.564053:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152579 00000100:00100000:0.0:1651529344.564055:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946439040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.564059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.564059:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177372 count 1 00010000:00010000:0.0:1651529344.564063:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564077:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 2/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564080:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564080:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564081:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 4/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564088:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 3/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564091:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564095:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966639424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.564102:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.564108:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152580 00000100:00100000:0.0:1651529344.564110:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946438976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.564114:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177371 count 1 00010000:00010000:0.0:1651529344.564117:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564121:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 2/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564124:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564125:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564126:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 4/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564131:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 3/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564135:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564138:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966639488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564146:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.564151:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.564155:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564159:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319360 00010000:00010000:0.0:1651529344.564164:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564172:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11535 00000100:00100000:0.0:1651529344.564173:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41279:x1731746396319360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.564176:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.564178:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564181:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 3/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564202:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aafdd702/0xa29a79078f3baec4 lrc: 0/0,0 mode: --/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3982 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564209:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564209:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564210:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564213:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 4/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564225:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 4/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564229:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 4/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564236:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564236:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564239:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564244:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1198:41279:x1731746396319360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.564247:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11535 00000100:00100000:0.0:1651529344.564267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.564279:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946438272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 920us (1231us total) trans 30064893436 rc 0/0 00000100:00100000:1.0:1651529344.564283:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152573 00010000:00010000:1.0:1651529344.564299:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564304:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319552 00010000:00010000:1.0:1651529344.564308:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.564309:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564310:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564313:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 3/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564317:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11536 00000100:00100000:0.0:1651529344.564318:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1198:41279:x1731746396319552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.564321:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.564322:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564326:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 3/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564329:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 1/0,0 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564332:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3be829 lrc: 0/0,0 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564334:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bb4d6 lrc: 0/0,0 mode: --/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5241 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564338:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564338:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564339:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564342:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 4/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564351:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564354:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564357:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564360:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564360:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1197:41279:x1731746396319552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (93us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.564363:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564363:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11536 00000100:00100000:1.0:1651529344.564415:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946438336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 689us (851us total) trans 30064893437 rc 0/0 00000100:00100000:1.0:1651529344.564418:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152574 00010000:00010000:1.0:1651529344.564425:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564428:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.564429:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564442:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 3/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564448:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 1/0,0 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564450:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3be830 lrc: 0/0,0 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.564469:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439168 00000100:00100000:0.0:1651529344.564469:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966639168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564473:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564476:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152581 00000100:00100000:1.0:1651529344.564478:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946439168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.564483:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177373 count 1 00010000:00010000:1.0:1651529344.564487:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564491:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 2/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1196 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564494:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564495:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564496:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 4/0,1 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564502:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 3/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1196 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564517:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 4/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.564521:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564533:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.564579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.564589:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439296 00000100:00100000:1.0:1651529344.564600:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152582 00000100:00100000:1.0:1651529344.564602:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+871:39030:x1731745946439296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.564607:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177374 count 1 00010000:00010000:1.0:1651529344.564611:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564622:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 2/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1196 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564625:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564626:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564626:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 4/0,1 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564633:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 3/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1196 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564636:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 4/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.564651:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564664:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.564703:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966639296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564708:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.564715:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966639232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.564715:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.564718:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.564755:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966639360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564759:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564778:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319872 00000100:00100000:0.0:1651529344.564779:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966639424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564782:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564783:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1197 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.564791:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319936 00010000:00010000:1.0:1651529344.564793:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.564797:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320000 00010000:00010000:1.0:1651529344.564800:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564821:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966639488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564824:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11537 00010000:00010000:0.0:1651529344.564825:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564826:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41279:x1731746396319872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564838:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564839:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564843:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 3/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564847:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11538 00010000:00010000:1.0:1651529344.564849:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fad759c9/0xa29a79078f3bb523 lrc: 0/0,0 mode: --/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5360 expref: 1199 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564849:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41279:x1731746396319936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564853:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564853:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564853:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564854:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564855:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564857:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 4/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564859:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 3/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564866:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.564871:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071b4ce64/0xa29a79078f3bc1a9 lrc: 0/0,0 mode: --/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d839c expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.564876:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1197:41279:x1731746396319872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.564876:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564878:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11537 00000100:00100000:1.0:1651529344.564883:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11539 00000100:00100000:1.0:1651529344.564885:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1196:41279:x1731746396320000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564888:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564889:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.564889:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 4/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564897:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564906:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 3/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.564906:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1196:41279:x1731746396319936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.564909:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11538 00010000:00010000:1.0:1651529344.564911:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fad5114/0xa29a79078f3baee7 lrc: 0/0,0 mode: --/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a0e expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.564915:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564916:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564916:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564917:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564919:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 4/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564925:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.564932:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1194:41279:x1731746396320000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.564933:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564934:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11539 00010000:00010000:0.0:1651529344.564936:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564939:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564942:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564945:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564949:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564961:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564992:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+873:39029:x1731745946438720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1072us (1150us total) trans 30064893438 rc 0/0 00000100:00100000:0.0:1651529344.564995:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152575 00010000:00010000:0.0:1651529344.565003:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565006:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.565013:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946438784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1089us (1154us total) trans 30064893439 rc 0/0 00000100:00100000:1.0:1651529344.565016:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152576 00010000:00010000:0.0:1651529344.565016:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565019:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 3/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565023:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565024:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 1/0,0 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565027:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565027:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be837 lrc: 0/0,0 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565030:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565032:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565032:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565034:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007274da18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.565035:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565038:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 3/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565041:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 1/0,0 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565044:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3be83e lrc: 0/0,0 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565055:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565058:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.565059:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565061:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 3/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565065:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 1/0,0 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565067:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3be84c lrc: 0/0,0 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565078:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf9f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946438912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1201us total) trans 30064893440 rc 0/0 00000100:00100000:1.0:1651529344.565081:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152578 00000100:00100000:0.0:1651529344.565102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.565143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565148:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320128 00010000:00010000:0.0:1651529344.565154:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565172:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320064 00010000:00010000:0.0:1651529344.565176:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1195 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565181:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320192 00010000:00010000:0.0:1651529344.565183:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1196 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.565187:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320256 00010000:00010000:0.0:1651529344.565189:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 5/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1197 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.565197:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320320 00000100:00100000:0.0:1651529344.565208:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11540 00010000:00010000:1.0:1651529344.565210:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 5/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.565210:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1198:41279:x1731746396320128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.565213:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.565215:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565217:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11541 00000100:00100000:1.0:1651529344.565218:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1198:41279:x1731746396320064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.565219:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 3/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565221:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.565223:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565224:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a415cd0/0xa29a79078f3b9a7a lrc: 0/0,0 mode: --/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7a4 expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565227:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 3/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1198 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565228:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565229:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565230:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565233:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd01cd0/0xa29a79078f3baa3a lrc: 0/0,0 mode: --/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d277d expref: 1197 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565233:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 4/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565237:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565238:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565238:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565240:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.565242:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 4/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565248:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1196:41279:x1731746396320128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.565251:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.565258:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11540 00000100:00100000:1.0:1651529344.565259:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1196:41279:x1731746396320064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565261:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11541 00000100:00100000:0.0:1651529344.565263:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11542 00000100:00100000:0.0:1651529344.565265:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1194:41279:x1731746396320192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.565266:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11543 00000100:00100000:1.0:1651529344.565268:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1194:41278:x1731746396320256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.565268:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.565269:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565271:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.565272:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 5/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565273:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 3/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565276:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 4/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565278:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3ba498 lrc: 0/0,0 mode: --/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10d2 expref: 1194 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565281:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565282:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565282:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565283:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565285:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 4/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565286:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 4/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565289:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.565291:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.565293:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1193:41278:x1731746396320256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565296:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11543 00000100:00100000:0.0:1651529344.565297:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1193:41279:x1731746396320192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565299:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11544 00000100:00100000:1.0:1651529344.565301:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41278:x1731746396320320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.565303:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.565305:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 5/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1192 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565308:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 4/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1192 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.565313:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565313:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565314:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565319:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11542 00010000:00010000:1.0:1651529344.565324:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 4/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565328:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.565332:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565334:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1191:41278:x1731746396320320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565336:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11544 00010000:00010000:0.0:1651529344.565336:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565339:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565341:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565346:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000968f4fa0/0xa29a79078f3b9cc6 lrc: 0/0,0 mode: --/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf17c expref: 1190 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565350:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565354:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565357:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565359:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565363:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565366:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565381:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946439040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1325us (1477us total) trans 30064893441 rc 0/0 00000100:00100000:0.0:1651529344.565384:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152579 00010000:00010000:0.0:1651529344.565391:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565394:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565397:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565400:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565405:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946439168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 925us (951us total) trans 30064893442 rc 0/0 00000100:00100000:1.0:1651529344.565416:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152581 00010000:00010000:1.0:1651529344.565423:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565427:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.565428:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565430:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 3/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565435:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 1/0,0 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565437:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+872:39029:x1731745946438848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1443us (1569us total) trans 30064893443 rc 0/0 00010000:00010000:1.0:1651529344.565438:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be853 lrc: 0/0,0 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565440:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152577 00010000:00010000:1.0:1651529344.565442:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565445:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.565446:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565449:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 3/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565452:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 1/0,0 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565454:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3be861 lrc: 0/0,0 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565458:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565460:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.565461:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565461:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565464:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 3/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565464:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565467:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 1/0,0 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565467:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565469:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be845 lrc: 0/0,0 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565470:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 2/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565475:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 2/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565478:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.565478:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 2/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565481:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 3/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565484:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 1/0,0 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565487:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be85a lrc: 0/0,0 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565496:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3bb0ae lrc: 0/0,0 mode: --/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4170 expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.565499:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+872:39029:x1731745946438976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1389us (1607us total) trans 30064893444 rc 0/0 00000100:00100000:1.0:1651529344.565500:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.565502:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152580 00010000:00010000:1.0:1651529344.565503:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565506:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565511:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565514:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565516:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.565543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.565553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565570:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+872:39030:x1731745946439296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (991us total) trans 30064893445 rc 0/0 00000100:00100000:1.0:1651529344.565573:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152582 00000100:00100000:1.0:1651529344.565578:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439808 00000100:00100000:1.0:1651529344.565599:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439744 00000100:00100000:0.0:1651529344.565610:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152583 00000100:00100000:0.0:1651529344.565612:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+873:39030:x1731745946439808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.565618:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177376 count 1 00000100:00100000:1.0:1651529344.565621:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439872 00010000:00010000:0.0:1651529344.565622:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565627:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 2/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.565632:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152584 00000100:00100000:1.0:1651529344.565634:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+874:39029:x1731745946439744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.565638:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.565639:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177375 count 1 00010000:00010000:0.0:1651529344.565639:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565640:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 4/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565643:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565648:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 2/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1188 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.565648:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 3/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565651:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565652:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565653:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 4/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565660:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1188 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565664:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1188 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.565667:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 4/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565668:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.565672:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966639680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565684:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.565689:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.565690:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152585 00000100:00100000:1.0:1651529344.565692:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+874:39029:x1731745946439872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.565697:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177377 count 1 00010000:00010000:1.0:1651529344.565700:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565704:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 2/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565707:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565708:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565709:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 4/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565715:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 3/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565729:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.565743:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966639808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565756:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.565763:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565766:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.565767:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565770:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 3/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565775:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 1/0,0 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565784:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be868 lrc: 0/0,0 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565873:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439936 00000100:00100000:0.0:1651529344.565876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565891:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440000 00000100:00100000:0.0:1651529344.565892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565911:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440064 00000100:00100000:1.0:1651529344.565918:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152586 00000100:00100000:1.0:1651529344.565920:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+877:39030:x1731745946439936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.565923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.565925:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177378 count 1 00010000:00010000:1.0:1651529344.565929:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.565933:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 2/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565936:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565937:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565938:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 4/0,1 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565951:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 3/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565959:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 4/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.565961:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440320 00000100:00100000:1.0:1651529344.565963:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.565967:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440256 00000100:00100000:0.0:1651529344.565971:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152587 00000100:00100000:0.0:1651529344.565972:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+879:39029:x1731745946440000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.565977:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.565983:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177379 count 1 00000100:00100000:1.0:1651529344.565984:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152588 00000100:00100000:1.0:1651529344.565986:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946440064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.565988:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.565990:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177380 count 1 00010000:00010000:1.0:1651529344.565994:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565998:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 2/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566001:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566002:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566003:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 4/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566003:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 2/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566006:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566007:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566007:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 4/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566008:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 3/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566012:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 4/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566015:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966639936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.566015:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 3/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566019:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566022:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.566023:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.566030:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966639744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.566032:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.566034:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566039:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152589 00000100:00100000:0.0:1651529344.566041:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946440320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.566046:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177382 count 1 00010000:00010000:0.0:1651529344.566049:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566053:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 2/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566056:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566064:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566065:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 4/0,1 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566098:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 3/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566102:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 4/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566106:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.566124:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.566130:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152590 00000100:00100000:0.0:1651529344.566132:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946440256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.566137:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177381 count 1 00010000:00010000:0.0:1651529344.566140:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566145:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 2/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566148:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566148:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566149:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 4/0,1 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.566155:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 3/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1188 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.566163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.566169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.566169:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 4/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1188 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566182:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966639808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566186:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566193:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320896 00000100:00100000:0.0:1651529344.566193:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566198:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1189 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566211:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.566214:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320960 00010000:00010000:1.0:1651529344.566217:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 5/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1190 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566222:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321024 00000100:00100000:0.0:1651529344.566222:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966639680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566224:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1191 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566226:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566228:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11545 00000100:00100000:1.0:1651529344.566230:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1191:41279:x1731746396320896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566233:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566234:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1191 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566234:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11546 00000100:00100000:0.0:1651529344.566236:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1191:41278:x1731746396320960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566238:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1191 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566239:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566240:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 4/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1191 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566243:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3b83c8 lrc: 0/0,0 mode: --/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbebc expref: 1191 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566244:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 3/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1191 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566247:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566248:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566249:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566250:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006da2ed4/0xa29a79078f3bb7d1 lrc: 0/0,0 mode: --/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d3f expref: 1190 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566254:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 4/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566254:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566254:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566255:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566259:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 4/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566260:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.566265:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566267:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41279:x1731746396320896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566270:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11545 00000100:00100000:0.0:1651529344.566272:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41278:x1731746396320960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566274:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11547 00000100:00100000:1.0:1651529344.566276:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1188:41278:x1731746396321024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.566276:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11546 00010000:00010000:1.0:1651529344.566279:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566280:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566284:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 3/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566284:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566288:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e46d6716/0xa29a79078f3bc108 lrc: 0/0,0 mode: --/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8150 expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566288:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566291:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566292:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566292:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566293:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566293:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566296:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 4/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566310:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566316:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1186:41278:x1731746396321024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566319:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11547 00010000:00010000:1.0:1651529344.566326:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566329:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.566330:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566333:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 3/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566337:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 1/0,0 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566340:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be86f lrc: 0/0,0 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566345:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566348:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566362:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566365:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566390:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+881:39030:x1731745946439808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 776us (860us total) trans 30064893446 rc 0/0 00000100:00100000:0.0:1651529344.566393:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152583 00010000:00010000:0.0:1651529344.566400:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566404:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008290e4b2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.566405:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566408:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 3/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566412:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+880:39029:x1731745946439872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 718us (858us total) trans 30064893447 rc 0/0 00010000:00010000:0.0:1651529344.566413:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 1/0,0 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566415:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152585 00010000:00010000:1.0:1651529344.566423:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566427:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566429:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be87d lrc: 0/0,0 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566430:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566432:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566480:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+880:39029:x1731745946439744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 844us (936us total) trans 30064893448 rc 0/0 00000100:00100000:0.0:1651529344.566481:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.566483:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152584 00010000:00010000:1.0:1651529344.566495:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.566505:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.566506:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.566509:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 3/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566514:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 1/0,0 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566516:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be876 lrc: 0/0,0 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566533:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966639936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566538:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.566551:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321088 00010000:00010000:1.0:1651529344.566555:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 5/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1186 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566556:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.566560:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566561:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321152 00010000:00010000:1.0:1651529344.566563:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 4/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566567:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321216 00000100:00100000:0.0:1651529344.566567:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321280 00010000:00010000:1.0:1651529344.566569:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566572:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 5/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566574:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11548 00000100:00100000:1.0:1651529344.566575:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41278:x1731746396321088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566578:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.566578:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11549 00010000:00010000:1.0:1651529344.566579:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 5/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566580:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41279:x1731746396321152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566583:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 4/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566583:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566584:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 4/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566588:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566588:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 3/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566589:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566589:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566592:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 4/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566597:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566610:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41278:x1731746396321088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566613:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11548 00010000:00010000:0.0:1651529344.566614:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a10c95/0xa29a79078f3bae46 lrc: 0/0,0 mode: --/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3783 expref: 1189 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566618:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11550 00000100:00100000:1.0:1651529344.566619:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1187:41278:x1731746396321216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.566619:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566620:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566621:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566622:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566623:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566624:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 4/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566627:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 3/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566633:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.566638:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d115901e/0xa29a79078f3b9a6c lrc: 0/0,0 mode: --/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce77a expref: 1187 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566641:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1187:41279:x1731746396321152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.566642:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566643:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566644:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566644:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11549 00010000:00010000:1.0:1651529344.566646:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 4/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566654:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566660:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1185:41278:x1731746396321216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.566661:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11551 00000100:00100000:0.0:1651529344.566662:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1185:41279:x1731746396321280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.566663:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11550 00010000:00010000:0.0:1651529344.566665:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566667:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 5/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1184 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.566669:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566673:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566676:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566679:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566686:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 4/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1184 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.566691:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566692:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566693:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566696:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 4/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566700:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.566706:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1184:41279:x1731746396321280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.566709:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11551 00010000:00010000:0.0:1651529344.566719:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a910c2b1/0xa29a79078f3baddd lrc: 0/0,0 mode: --/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d363a expref: 1183 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.566723:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.566725:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+880:39030:x1731745946440064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 738us (840us total) trans 30064893449 rc 0/0 00010000:00010000:0.0:1651529344.566726:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566728:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152588 00010000:00010000:0.0:1651529344.566738:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566742:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566744:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566746:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566748:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.566748:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566749:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566752:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 3/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566757:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 1/0,0 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566759:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be892 lrc: 0/0,0 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566764:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566767:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.566768:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566771:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 3/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566774:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 1/0,0 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566777:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be899 lrc: 0/0,0 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566786:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250904ae/0xa29a79078f3ba356 lrc: 0/0,0 mode: --/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b7d expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.566789:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966639872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566792:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566795:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566798:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566801:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566822:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566850:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+881:39030:x1731745946440320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 807us (927us total) trans 30064893450 rc 0/0 00000100:00100000:0.0:1651529344.566853:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152589 00000100:00100000:1.0:1651529344.566860:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+880:39030:x1731745946439936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 939us (1007us total) trans 30064893451 rc 0/0 00010000:00010000:0.0:1651529344.566862:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566863:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152586 00010000:00010000:0.0:1651529344.566865:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.566866:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566869:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 3/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566874:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 1/0,0 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566877:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be884 lrc: 0/0,0 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566883:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566886:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566889:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566892:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.566935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.566945:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+880:39029:x1731745946440000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 972us (1069us total) trans 30064893452 rc 0/0 00000100:00100000:0.0:1651529344.566948:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152587 00000100:00100000:0.0:1651529344.566954:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440704 00000100:00100000:1.0:1651529344.566957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.566962:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440832 00000100:00100000:0.0:1651529344.566966:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152591 00000100:00100000:0.0:1651529344.566968:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+881:39030:x1731745946440704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.566973:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177383 count 1 00010000:00010000:0.0:1651529344.566977:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566982:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 2/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.566983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.566985:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566985:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566986:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 4/0,1 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566993:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 3/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566997:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 4/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567001:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.567010:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.567018:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567021:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567028:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440768 00000100:00100000:0.0:1651529344.567035:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152592 00000100:00100000:0.0:1651529344.567036:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+882:39030:x1731745946440832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.567041:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177385 count 1 00010000:00010000:0.0:1651529344.567044:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567048:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 2/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567051:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567051:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567052:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 4/0,1 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567058:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 3/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567059:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567062:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 4/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567063:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.567064:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567066:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567068:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 3/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567073:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 1/0,0 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567075:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be88b lrc: 0/0,0 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567087:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152593 00000100:00100000:1.0:1651529344.567088:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+882:39029:x1731745946440768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.567094:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177384 count 1 00000100:00100000:0.0:1651529344.567097:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.567104:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567109:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 2/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567112:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567113:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567113:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 4/0,1 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567120:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 3/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567131:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 4/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.567135:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966640320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567150:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567158:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321472 00010000:00010000:1.0:1651529344.567163:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 4/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.567176:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11552 00000100:00100000:1.0:1651529344.567177:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1182:41278:x1731746396321472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.567180:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.567181:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 4/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567185:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 3/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567190:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a3ed7bd/0xa29a79078f3bbe22 lrc: 0/0,0 mode: --/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75db expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.567194:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567194:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567195:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567205:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 4/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567213:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.567227:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41278:x1731746396321472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.567230:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11552 00000100:00100000:1.0:1651529344.567238:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441024 00000100:00100000:1.0:1651529344.567253:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152594 00000100:00100000:1.0:1651529344.567255:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+883:39029:x1731745946441024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.567260:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177387 count 1 00010000:00010000:1.0:1651529344.567264:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567269:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 2/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567272:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567272:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567273:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 4/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.567286:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 3/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567290:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567294:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966640384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.567297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567302:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567309:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440960 00000100:00100000:1.0:1651529344.567313:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441088 00000100:00100000:1.0:1651529344.567316:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441152 00000100:00100000:1.0:1651529344.567319:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152595 00000100:00100000:1.0:1651529344.567320:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946440960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.567324:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177386 count 1 00010000:00010000:1.0:1651529344.567328:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.567347:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 2/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1180 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567350:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.567350:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321600 00010000:00010000:1.0:1651529344.567351:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567351:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 4/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567356:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 5/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567358:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 3/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567361:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567364:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11553 00000100:00100000:1.0:1651529344.567365:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966640448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.567365:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41278:x1731746396321600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.567369:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.567370:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 5/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.567374:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 4/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.567379:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567386:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152596 00000100:00100000:1.0:1651529344.567387:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946441088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.567392:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177388 count 1 00010000:00010000:1.0:1651529344.567395:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567398:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567399:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567400:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 2/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567402:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 4/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567405:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567406:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567406:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 4/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567407:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.567413:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 3/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1181 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.567415:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41278:x1731746396321600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (82us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.567416:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 4/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567417:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11553 00000100:00100000:1.0:1651529344.567420:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966640512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567424:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567427:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.567428:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567457:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567460:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567502:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.567502:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+887:39030:x1731745946440256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1369us (1571us total) trans 30064893453 rc 0/0 00000100:00100000:0.0:1651529344.567505:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152590 00000100:00100000:0.0:1651529344.567518:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152597 00000100:00100000:0.0:1651529344.567520:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+886:39029:x1731745946441152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.567525:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177389 count 1 00000100:00100000:1.0:1651529344.567532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.567542:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567546:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.567547:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567550:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 3/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567555:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567560:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 1/0,0 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567561:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 2/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1180 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567563:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be8a0 lrc: 0/0,0 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567564:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567565:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567565:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 4/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567573:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966640320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567573:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 3/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1180 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567577:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567577:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1180 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567581:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567584:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321664 00010000:00010000:1.0:1651529344.567588:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 5/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567590:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567595:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321792 00010000:00010000:1.0:1651529344.567598:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 4/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567600:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11554 00000100:00100000:1.0:1651529344.567603:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11555 00000100:00100000:0.0:1651529344.567603:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1182:41279:x1731746396321664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.567605:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1182:41279:x1731746396321792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.567605:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.567607:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 5/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567608:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.567609:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 4/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567613:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 3/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567618:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070dfc194/0xa29a79078f3bb1b1 lrc: 0/0,0 mode: --/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d453d expref: 1182 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567622:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567622:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567623:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567626:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 4/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567632:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.567638:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 4/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1181 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.567639:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41279:x1731746396321792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.567641:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11555 00010000:00010000:0.0:1651529344.567644:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567645:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567646:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567648:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567649:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 4/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567651:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567654:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567654:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.567657:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567661:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1180:41279:x1731746396321664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.567671:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11554 00010000:00010000:0.0:1651529344.567679:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567683:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.567684:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567687:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 3/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567691:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 1/0,0 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567704:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3be8b5 lrc: 0/0,0 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567710:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+887:39029:x1731745946440768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 620us (727us total) trans 30064893454 rc 0/0 00000100:00100000:1.0:1651529344.567713:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152593 00010000:00010000:0.0:1651529344.567715:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b77290/0xa29a79078f3bbb66 lrc: 0/0,0 mode: --/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b38 expref: 1179 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567718:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567722:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567725:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567728:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567740:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567743:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.567785:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+887:39030:x1731745946440704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 816us (878us total) trans 30064893455 rc 0/0 00000100:00100000:0.0:1651529344.567788:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152591 00000100:00100000:0.0:1651529344.567794:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441408 00000100:00100000:0.0:1651529344.567801:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152598 00000100:00100000:0.0:1651529344.567818:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+887:39030:x1731745946441408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.567824:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177390 count 1 00010000:00010000:0.0:1651529344.567828:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567832:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 2/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1178 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567835:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567836:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567837:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 4/0,1 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567844:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 3/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1178 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567847:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 4/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.567851:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567869:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966640384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567874:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567881:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567882:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.567884:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.567885:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567888:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 3/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567892:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 1/0,0 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567895:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be8a7 lrc: 0/0,0 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567903:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966640448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567904:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007ff9ca8/0xa29a79078f3bb74c lrc: 0/0,0 mode: --/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b55 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.567906:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567909:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567913:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567917:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567919:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567922:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567925:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.567983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568008:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966640512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568013:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+888:39030:x1731745946440832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 976us (1078us total) trans 30064893456 rc 0/0 00000100:00100000:0.0:1651529344.568017:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152592 00010000:00010000:1.0:1651529344.568018:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568022:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441536 00010000:00010000:1.0:1651529344.568024:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568027:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568028:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568028:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441600 00010000:00010000:1.0:1651529344.568031:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 3/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568032:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152599 00000100:00100000:0.0:1651529344.568033:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+889:39030:x1731745946441536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.568035:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 1/0,0 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568038:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3be8ae lrc: 0/0,0 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.568038:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177391 count 1 00010000:00010000:0.0:1651529344.568042:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568045:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152600 00010000:00010000:0.0:1651529344.568046:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 2/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1177 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.568047:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+889:39030:x1731745946441600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.568049:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568050:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568051:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 4/0,1 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.568053:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177392 count 1 00010000:00010000:1.0:1651529344.568056:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568057:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 3/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1177 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568061:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 2/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1177 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.568061:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 4/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1177 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568064:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568065:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568065:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 4/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568065:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.568072:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 3/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1177 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.568073:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.568076:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1177 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.568080:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966640768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568082:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321920 00010000:00010000:0.0:1651529344.568086:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.568089:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.568092:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322176 00010000:00010000:0.0:1651529344.568094:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1179 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.568095:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322240 00000100:00100000:0.0:1651529344.568099:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11556 00010000:00010000:1.0:1651529344.568100:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 4/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568100:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1180:41278:x1731746396321920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.568103:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568104:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.568106:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11557 00000100:00100000:1.0:1651529344.568108:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1180:41278:x1731746396322176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.568108:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 3/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568111:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568112:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568114:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1807e61/0xa29a79078f3bc26d lrc: 0/0,0 mode: --/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8700 expref: 1180 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568117:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568118:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 3/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1179 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568118:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568118:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568122:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 4/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568124:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88a24db/0xa29a79078f3bbce0 lrc: 0/0,0 mode: --/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70f6 expref: 1179 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568127:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568128:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568129:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568131:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.568138:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1178:41278:x1731746396321920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.568140:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 4/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568141:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11556 00010000:00010000:1.0:1651529344.568146:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.568151:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11558 00000100:00100000:1.0:1651529344.568153:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1177:41278:x1731746396322176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.568153:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1177:41278:x1731746396322240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568155:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.568156:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11557 00010000:00010000:0.0:1651529344.568157:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 4/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1177 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568161:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 3/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1176 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568164:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568166:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ebd48f/0xa29a79078f3bb5bd lrc: 0/0,0 mode: --/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5597 expref: 1176 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568167:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568169:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568170:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568170:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568171:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568173:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 4/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568175:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568182:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.568209:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396322240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.568212:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11558 00010000:00010000:0.0:1651529344.568220:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568223:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.568224:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+890:39029:x1731745946441024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 968us (1044us total) trans 30064893457 rc 0/0 00010000:00010000:0.0:1651529344.568224:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568227:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152594 00010000:00010000:0.0:1651529344.568227:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 3/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568232:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 1/0,0 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568234:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568237:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3be8bc lrc: 0/0,0 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568238:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568241:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568243:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568286:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+890:39030:x1731745946440960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 965us (1008us total) trans 30064893458 rc 0/0 00000100:00100000:0.0:1651529344.568286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568289:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152595 00010000:00010000:1.0:1651529344.568296:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.568300:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568301:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568304:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 3/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568308:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 1/0,0 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568311:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be8c3 lrc: 0/0,0 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568317:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568327:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568330:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568337:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.568341:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568348:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322496 00010000:00010000:1.0:1651529344.568351:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568352:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1175 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568363:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322624 00010000:00010000:0.0:1651529344.568366:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 5/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1176 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568374:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11559 00000100:00100000:0.0:1651529344.568375:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41278:x1731746396322496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568378:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568380:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1176 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568383:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 3/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1176 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568408:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d008a6f5/0xa29a79078f3b77ce lrc: 0/0,0 mode: --/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f2 expref: 1176 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568412:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568412:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.568416:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+890:39030:x1731745946441088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1028us (1126us total) trans 30064893459 rc 0/0 00000100:00100000:1.0:1651529344.568419:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152596 00000100:00100000:1.0:1651529344.568428:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11560 00010000:00010000:0.0:1651529344.568429:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568430:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396322624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568433:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 4/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568434:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568436:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 5/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1175 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568439:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.568440:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 4/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1175 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568445:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568446:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568447:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568447:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396322496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 71us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.568450:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 4/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568455:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.568461:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396322624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.568461:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11559 00000100:00100000:1.0:1651529344.568463:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11560 00010000:00010000:1.0:1651529344.568469:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568472:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05ce93c/0xa29a79078f3bc266 lrc: 0/0,0 mode: --/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86d6 expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568473:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568474:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568476:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 3/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568476:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966640640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.568479:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568480:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 1/0,0 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568483:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be8ca lrc: 0/0,0 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568483:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568485:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568489:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568492:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568537:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+890:39030:x1731745946441408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 733us (777us total) trans 30064893460 rc 0/0 00000100:00100000:0.0:1651529344.568540:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152598 00010000:00010000:0.0:1651529344.568566:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568570:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.568571:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568574:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 3/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568581:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.568592:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 1/0,0 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568595:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be8d8 lrc: 0/0,0 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568602:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568605:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568608:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.568611:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.568649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.568656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.568664:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966640768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.568669:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568677:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+890:39029:x1731745946441152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1155us (1379us total) trans 30064893461 rc 0/0 00000100:00100000:0.0:1651529344.568680:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152597 00000100:00100000:1.0:1651529344.568683:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322688 00000100:00100000:0.0:1651529344.568685:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441728 00010000:00010000:1.0:1651529344.568688:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 5/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568693:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441664 00000100:00100000:0.0:1651529344.568697:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441792 00000100:00100000:1.0:1651529344.568702:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322752 00010000:00010000:1.0:1651529344.568705:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568708:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152601 00000100:00100000:1.0:1651529344.568710:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11561 00000100:00100000:0.0:1651529344.568710:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+892:39030:x1731745946441728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.568712:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396322688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00002000:00080000:0.0:1651529344.568715:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177394 count 1 00010000:00010000:0.0:1651529344.568719:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568723:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568724:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 2/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1174 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568725:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 5/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568729:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 4/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568744:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568744:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568745:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568749:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 4/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568749:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568750:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568750:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 4/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568753:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568759:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 3/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1174 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.568760:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396322688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.568762:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.568763:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11561 00000100:00100000:0.0:1651529344.568767:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.568768:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11562 00000100:00100000:1.0:1651529344.568770:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1173:41278:x1731746396322752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.568772:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568774:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568775:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.568777:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 3/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568783:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152602 00000100:00100000:0.0:1651529344.568784:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+892:39030:x1731745946441664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.568789:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177393 count 1 00010000:00010000:1.0:1651529344.568792:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79e189b/0xa29a79078f3ba4fa lrc: 0/0,0 mode: --/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12bc expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.568793:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568795:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568796:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568797:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568797:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 2/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1172 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568800:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 4/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568800:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568801:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568802:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 4/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568824:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568827:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 3/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1172 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.568831:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1172:41278:x1731746396322752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.568833:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11562 00010000:00010000:0.0:1651529344.568834:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1172 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568838:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966640896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.568841:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568844:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568845:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568845:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.568848:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 3/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568851:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152603 00010000:00010000:1.0:1651529344.568852:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 1/0,0 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568853:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+892:39030:x1731745946441792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.568857:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177395 count 1 00010000:00010000:0.0:1651529344.568861:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568864:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be8d1 lrc: 0/0,0 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568865:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 2/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1171 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.568868:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568868:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568869:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 4/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568873:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568875:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 3/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1171 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568876:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568878:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1171 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.568879:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568882:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568885:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966640960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568891:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.568900:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bb4f2 lrc: 0/0,0 mode: --/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d528e expref: 1171 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.568904:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966640704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.568907:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568910:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568913:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568916:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568919:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568920:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+893:39030:x1731745946441600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 872us (937us total) trans 30064893462 rc 0/0 00000100:00100000:1.0:1651529344.568923:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152600 00010000:00010000:1.0:1651529344.568930:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568933:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568934:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568937:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 3/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568950:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 1/0,0 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568953:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be8e6 lrc: 0/0,0 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568957:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568958:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+893:39030:x1731745946441536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 923us (1001us total) trans 30064893463 rc 0/0 00010000:00010000:1.0:1651529344.568960:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.568961:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568961:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152599 00010000:00010000:1.0:1651529344.568964:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 3/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568967:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 1/0,0 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568969:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be8df lrc: 0/0,0 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.568991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.569038:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441920 00000100:00100000:0.0:1651529344.569047:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442112 00000100:00100000:0.0:1651529344.569055:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152604 00000100:00100000:0.0:1651529344.569056:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+894:39030:x1731745946441920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.569061:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177396 count 1 00000100:00100000:1.0:1651529344.569066:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152605 00010000:00010000:0.0:1651529344.569066:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569068:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+894:39030:x1731745946442112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.569074:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177397 count 1 00010000:00010000:1.0:1651529344.569086:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569086:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 2/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569089:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569089:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569090:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 4/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569091:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 2/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1170 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.569094:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569095:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569095:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 4/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569103:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1170 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.569106:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1170 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.569108:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 3/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.569110:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569112:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.569116:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966641088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.569122:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.569125:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.569169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.569175:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442496 00000100:00100000:0.0:1651529344.569187:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152606 00000100:00100000:0.0:1651529344.569212:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946442496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.569218:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177398 count 1 00010000:00010000:0.0:1651529344.569222:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.569226:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 2/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569229:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569230:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569231:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 4/0,1 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569237:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 3/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569241:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 4/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.569244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.569245:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966641152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.569250:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442560 00000100:00100000:0.0:1651529344.569256:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.569257:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442624 00000100:00100000:1.0:1651529344.569265:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152607 00000100:00100000:1.0:1651529344.569267:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d66e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+897:39029:x1731745946442560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.569272:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177399 count 1 00010000:00010000:1.0:1651529344.569276:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569289:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152608 00000100:00100000:0.0:1651529344.569291:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+897:39030:x1731745946442624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.569296:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 2/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1170 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.569296:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177400 count 1 00010000:00010000:1.0:1651529344.569300:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569300:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569300:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569301:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 4/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569305:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 2/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.569308:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 3/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569308:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569309:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569309:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 4/0,1 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569312:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1170 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.569316:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966641216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569316:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 3/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569320:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 4/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.569324:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.569327:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.569332:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.569446:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966640832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569450:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569620:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966640896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569629:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569637:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966640960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569640:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569962:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569967:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569983:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966641216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.569984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.569986:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.569996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.570005:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323136 00000100:00100000:0.0:1651529344.570005:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.570013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.570017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.570019:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1171 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.570026:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323392 00010000:00010000:1.0:1651529344.570028:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1172 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570032:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323456 00010000:00010000:1.0:1651529344.570034:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1173 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.570045:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966641088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570046:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323584 00010000:00010000:1.0:1651529344.570049:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570049:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570053:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323712 00010000:00010000:1.0:1651529344.570055:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1175 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570057:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570059:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323520 00010000:00010000:0.0:1651529344.570059:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570061:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1176 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570065:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323776 00000100:00100000:0.0:1651529344.570066:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323648 00010000:00010000:1.0:1651529344.570067:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 4/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570070:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 5/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570072:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11563 00000100:00100000:1.0:1651529344.570073:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1178:41279:x1731746396323136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.570077:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11564 00000100:00100000:0.0:1651529344.570078:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1178:41279:x1731746396323392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.570081:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570083:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.570083:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570084:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570087:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 3/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570088:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 3/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570093:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dccb71f5/0xa29a79078f3b9af8 lrc: 0/0,0 mode: --/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea36 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570094:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e300b5/0xa29a79078f3bb967 lrc: 0/0,0 mode: --/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63c8 expref: 1178 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570096:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570097:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570098:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570098:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570099:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570100:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570101:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 4/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570103:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 4/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570108:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.570112:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.570122:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41279:x1731746396323136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.570123:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41279:x1731746396323392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.570125:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11563 00000100:00100000:0.0:1651529344.570127:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11564 00000100:00100000:0.0:1651529344.570132:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11565 00000100:00100000:0.0:1651529344.570134:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396323456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.570135:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11566 00000100:00100000:1.0:1651529344.570137:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396323584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.570137:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.570138:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1174 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570140:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570141:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1174 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570142:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1174 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570147:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4fc8d0/0xa29a79078f3b7b78 lrc: 0/0,0 mode: --/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba5c expref: 1174 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570151:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570151:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570152:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570155:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 3/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570155:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 4/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570160:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095274e06/0xa29a79078f3ba6b3 lrc: 0/0,0 mode: --/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a09 expref: 1173 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570164:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.570170:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.570170:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1172:41279:x1731746396323456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.570171:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570172:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570173:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11565 00010000:00010000:1.0:1651529344.570175:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 4/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570178:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11567 00000100:00100000:0.0:1651529344.570179:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1171:41279:x1731746396323712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.570184:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.570187:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.570189:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1171 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570191:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1171:41279:x1731746396323584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.570193:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11566 00010000:00010000:0.0:1651529344.570193:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 3/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1171 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570198:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11568 00010000:00010000:0.0:1651529344.570198:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dbb42ab/0xa29a79078f3b9851 lrc: 0/0,0 mode: --/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf7e expref: 1170 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570200:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1170:41278:x1731746396323520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.570203:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570204:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1169 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570205:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570205:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570206:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570208:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 3/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1169 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570209:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 4/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570217:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.570223:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1169:41279:x1731746396323712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.570226:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9248085/0xa29a79078f3bb39b lrc: 0/0,0 mode: --/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d40 expref: 1169 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570226:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11567 00010000:00010000:1.0:1651529344.570229:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570230:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570231:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570231:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11569 00000100:00100000:0.0:1651529344.570232:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41278:x1731746396323776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.570234:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 4/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570235:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.570236:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 4/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570240:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 3/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570243:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.570249:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41278:x1731746396323520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.570251:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b056fb4e/0xa29a79078f3bb753 lrc: 0/0,0 mode: --/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b6a expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570252:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11568 00010000:00010000:0.0:1651529344.570255:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570255:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570256:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570257:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11570 00000100:00100000:1.0:1651529344.570258:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1165:41278:x1731746396323648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.570259:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 4/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570261:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570262:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 5/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1165 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.570264:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.570266:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 4/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1165 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570270:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1165:41278:x1731746396323776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.570271:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.570273:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11569 00010000:00010000:1.0:1651529344.570277:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570278:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570279:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570281:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 4/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570283:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570286:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.570286:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570288:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570292:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1164:41278:x1731746396323648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.570294:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11570 00010000:00010000:1.0:1651529344.570312:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570315:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b010eb0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570316:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570319:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 3/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570324:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 1/0,0 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570326:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3be8f4 lrc: 0/0,0 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570333:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570337:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+898:39030:x1731745946441664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1551us (1688us total) trans 30064893464 rc 0/0 00000100:00100000:0.0:1651529344.570340:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152602 00010000:00010000:1.0:1651529344.570345:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570346:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570349:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570351:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570352:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570355:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570364:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570401:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d66e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+899:39029:x1731745946442560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1134us (1175us total) trans 30064893465 rc 0/0 00000100:00100000:0.0:1651529344.570404:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+899:39030:x1731745946441728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1693us (1765us total) trans 30064893466 rc 0/0 00000100:00100000:1.0:1651529344.570405:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152607 00000100:00100000:0.0:1651529344.570407:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152601 00010000:00010000:1.0:1651529344.570413:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570414:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570416:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570417:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570418:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570420:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 3/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570421:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570424:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570425:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 1/0,0 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570427:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be917 lrc: 0/0,0 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570439:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570442:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011187589 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570443:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570446:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 3/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570449:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 1/0,0 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570452:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be8ed lrc: 0/0,0 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570455:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570458:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570460:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+898:39030:x1731745946441792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1606us (1803us total) trans 30064893467 rc 0/0 00010000:00010000:1.0:1651529344.570461:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 3/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570464:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152603 00010000:00010000:1.0:1651529344.570466:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 1/0,0 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570469:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3be8fb lrc: 0/0,0 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570475:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570475:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000311ee34e/0xa29a79078f3bb7e6 lrc: 0/0,0 mode: --/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d85 expref: 1163 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.570478:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570479:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966641152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.570481:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570483:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570484:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570486:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570489:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570499:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570502:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570536:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+899:39030:x1731745946442112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1467us (1545us total) trans 30064893468 rc 0/0 00000100:00100000:1.0:1651529344.570539:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152605 00000100:00100000:0.0:1651529344.570541:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+899:39030:x1731745946442496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1351us (1372us total) trans 30064893469 rc 0/0 00000100:00100000:0.0:1651529344.570544:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152606 00010000:00010000:1.0:1651529344.570547:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570551:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.570551:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570552:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570555:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 3/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570557:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.570558:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570559:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 1/0,0 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570561:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 3/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570562:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be909 lrc: 0/0,0 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570566:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 1/0,0 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570569:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be910 lrc: 0/0,0 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570574:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570577:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570580:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570583:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570620:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+898:39030:x1731745946442624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1328us (1376us total) trans 30064893470 rc 0/0 00000100:00100000:0.0:1651529344.570623:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152608 00010000:00010000:0.0:1651529344.570630:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570634:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570637:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570639:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570674:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+898:39030:x1731745946441920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1617us (1695us total) trans 30064893471 rc 0/0 00000100:00100000:0.0:1651529344.570677:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152604 00010000:00010000:1.0:1651529344.570706:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570715:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570716:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570719:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 3/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570724:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 1/0,0 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570727:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be91e lrc: 0/0,0 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570740:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570743:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.570744:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570747:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 3/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570750:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 1/0,0 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570753:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be902 lrc: 0/0,0 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.570823:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570837:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443264 00000100:00100000:0.0:1651529344.570844:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443200 00000100:00100000:0.0:1651529344.570852:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152609 00000100:00100000:0.0:1651529344.570854:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+899:39030:x1731745946443264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.570859:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177402 count 1 00000100:00100000:1.0:1651529344.570861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.570863:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570874:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443328 00010000:00010000:0.0:1651529344.570874:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 2/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570880:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570880:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.570885:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152610 00010000:00010000:0.0:1651529344.570885:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 4/0,1 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570886:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946443200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.570892:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177401 count 1 00010000:00010000:1.0:1651529344.570896:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570901:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 2/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570906:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570907:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570908:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 4/0,1 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570914:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 3/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570916:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 3/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570918:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 4/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570923:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.570928:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 4/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.570933:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.570933:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.570943:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.570950:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152611 00000100:00100000:0.0:1651529344.570951:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946443328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.570956:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177403 count 1 00010000:00010000:0.0:1651529344.570960:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.570964:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 2/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570967:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570968:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570969:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 4/0,1 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570977:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 3/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.570979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.570980:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 4/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.570992:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966641472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.570999:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.571005:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443456 00000100:00100000:1.0:1651529344.571011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.571021:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443392 00000100:00100000:0.0:1651529344.571026:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443584 00000100:00100000:0.0:1651529344.571043:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152612 00000100:00100000:0.0:1651529344.571045:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+903:39029:x1731745946443456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.571050:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177405 count 1 00010000:00010000:0.0:1651529344.571054:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.571058:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 2/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1162 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.571061:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571062:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.571063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.571063:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 4/0,1 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571069:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 3/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1162 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.571070:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443520 00010000:00010000:0.0:1651529344.571073:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 4/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1162 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571075:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443648 00000100:00100000:0.0:1651529344.571076:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966641536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.571079:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152613 00000100:00100000:1.0:1651529344.571080:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+905:39030:x1731745946443392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.571085:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177404 count 1 00000100:00100000:0.0:1651529344.571091:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.571096:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571098:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152614 00000100:00100000:0.0:1651529344.571099:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+905:39029:x1731745946443584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.571103:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 2/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.571104:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177407 count 1 00010000:00010000:1.0:1651529344.571106:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571107:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571107:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571108:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 4/0,1 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571112:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 2/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.571115:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 3/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.571115:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571115:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571116:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 4/0,1 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571118:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 4/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571122:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966641600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.571122:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 3/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.571126:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 4/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571131:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.571138:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152615 00000100:00100000:1.0:1651529344.571140:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+905:39030:x1731745946443520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.571144:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177406 count 1 00010000:00010000:1.0:1651529344.571147:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571147:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966641664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571151:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 2/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.571154:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571155:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571156:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 4/0,1 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571156:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.571162:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 3/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1162 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.571163:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152616 00000100:00100000:0.0:1651529344.571165:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+905:39030:x1731745946443648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.571166:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 4/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571169:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966641728:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.571169:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177408 count 1 00010000:00010000:0.0:1651529344.571173:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571176:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.571177:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 2/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1162 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.571180:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571181:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571181:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 4/0,1 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571188:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 3/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1162 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.571191:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 4/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1162 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571195:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966641792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.571201:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.571248:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571253:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571660:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.571674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.571683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571685:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324352 00010000:00010000:1.0:1651529344.571691:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 4/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1163 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571706:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324416 00010000:00010000:1.0:1651529344.571714:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 5/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1164 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571718:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324480 00000100:00100000:0.0:1651529344.571720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.571721:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 5/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1165 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571727:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324608 00010000:00010000:1.0:1651529344.571729:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 5/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1166 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571740:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571744:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324544 00010000:00010000:1.0:1651529344.571747:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 5/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1167 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571751:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324672 00010000:00010000:1.0:1651529344.571753:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 5/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1168 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571757:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324800 00010000:00010000:1.0:1651529344.571758:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 5/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1169 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571763:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11571 00000100:00100000:1.0:1651529344.571764:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1169:41279:x1731746396324352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.571769:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324736 00010000:00010000:1.0:1651529344.571774:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571775:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 5/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571776:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 4/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571779:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 3/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571782:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11572 00000100:00100000:0.0:1651529344.571784:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1170:41278:x1731746396324416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.571785:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df42741/0xa29a79078f3bbd7a lrc: 0/0,0 mode: --/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7318 expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571787:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571789:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 5/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571792:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 4/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1170 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571798:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571798:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571799:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571799:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571800:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571800:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571818:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 4/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571819:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 4/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571826:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.571827:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571835:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1169:41279:x1731746396324352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.571835:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1169:41278:x1731746396324416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571838:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11571 00000100:00100000:0.0:1651529344.571840:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11572 00000100:00100000:1.0:1651529344.571843:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11573 00000100:00100000:1.0:1651529344.571845:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396324480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.571845:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11574 00000100:00100000:0.0:1651529344.571847:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396324608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.571848:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571850:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 5/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571850:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571851:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 5/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571854:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 4/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571855:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 4/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1167 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571859:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571859:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571860:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571860:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571861:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571861:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571864:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 4/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571868:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.571872:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396324608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.571873:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 4/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571875:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11574 00010000:00010000:1.0:1651529344.571877:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.571878:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11575 00000100:00100000:0.0:1651529344.571880:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1166:41279:x1731746396324544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.571882:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571883:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 5/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1166 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571884:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1166:41279:x1731746396324480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571886:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11573 00010000:00010000:0.0:1651529344.571887:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 4/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1166 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571891:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11576 00010000:00010000:0.0:1651529344.571891:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571892:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571892:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571893:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1165:41279:x1731746396324672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.571895:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571895:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 4/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571896:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 5/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1165 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571899:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.571900:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 4/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1165 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571903:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1165:41279:x1731746396324544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.571905:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571906:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571906:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571906:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11575 00010000:00010000:1.0:1651529344.571909:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 4/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571909:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11577 00000100:00100000:0.0:1651529344.571911:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1164:41278:x1731746396324800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.571913:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.571913:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571915:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 5/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1164 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571918:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1164:41279:x1731746396324672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.571918:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 4/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1164 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.571923:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571923:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571924:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571926:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11576 00010000:00010000:0.0:1651529344.571927:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 4/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571930:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571931:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11578 00000100:00100000:1.0:1651529344.571932:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1163:41278:x1731746396324736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.571934:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1163:41278:x1731746396324800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (187us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.571935:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571937:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 5/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1163 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.571937:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11577 00010000:00010000:1.0:1651529344.571940:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 4/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1162 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571945:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571946:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571947:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571949:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 4/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571950:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085167232/0xa29a79078f3b9827 lrc: 0/0,0 mode: --/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdef2 expref: 1162 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.571954:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.571954:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966641792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.571957:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571959:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1161:41278:x1731746396324736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (197us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.571960:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571961:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11578 00010000:00010000:0.0:1651529344.571963:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571966:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571969:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571973:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e52438d/0xa29a79078f3bbf09 lrc: 0/0,0 mode: --/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78f2 expref: 1160 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.571977:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966641600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571987:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571991:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571994:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571997:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571999:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572014:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946443648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 848us (949us total) trans 30064893472 rc 0/0 00000100:00100000:0.0:1651529344.572017:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152616 00010000:00010000:0.0:1651529344.572023:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572027:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.572028:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572031:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 3/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572035:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 1/0,0 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572038:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be956 lrc: 0/0,0 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572042:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946443392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1062us total) trans 30064893473 rc 0/0 00010000:00010000:0.0:1651529344.572042:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572045:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152613 00010000:00010000:0.0:1651529344.572045:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.572046:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572049:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 3/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572052:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 1/0,0 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572055:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3be941 lrc: 0/0,0 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572056:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d4c8df/0xa29a79078f3bbe29 lrc: 0/0,0 mode: --/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75f0 expref: 1159 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572060:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966641728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572064:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572064:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088986c20/0xa29a79078f3b9938 lrc: 0/0,0 mode: --/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2f7 expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.572067:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572067:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966641472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572070:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572072:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572073:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572075:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572076:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572077:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572079:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572084:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572111:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+907:39030:x1731745946443520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 970us (1056us total) trans 30064893474 rc 0/0 00000100:00100000:1.0:1651529344.572114:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152615 00000100:00100000:0.0:1651529344.572120:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946443328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1259us total) trans 30064893475 rc 0/0 00010000:00010000:1.0:1651529344.572121:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572123:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152611 00010000:00010000:1.0:1651529344.572124:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008290e4b2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.572125:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572127:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 3/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572132:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 1/0,0 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572134:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa07052b/0xa29a79078f3bbb35 lrc: 0/0,0 mode: --/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a58 expref: 1157 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.572135:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3be94f lrc: 0/0,0 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572138:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966641664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572139:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572141:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572142:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.572143:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572145:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572146:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 3/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572147:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572149:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 1/0,0 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572150:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572151:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3be933 lrc: 0/0,0 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572153:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572157:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572160:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572170:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572173:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572193:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+907:39029:x1731745946443584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1093us (1182us total) trans 30064893476 rc 0/0 00000100:00100000:0.0:1651529344.572196:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152614 00010000:00010000:0.0:1651529344.572203:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572207:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.572208:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572209:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946443200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1322us (1387us total) trans 30064893477 rc 0/0 00010000:00010000:0.0:1651529344.572211:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 3/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572212:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152610 00010000:00010000:0.0:1651529344.572215:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 1/0,0 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572218:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be948 lrc: 0/0,0 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572220:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572223:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.572224:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572227:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 3/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572227:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a8f461/0xa29a79078f3b95bf lrc: 0/0,0 mode: --/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd528 expref: 1156 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.572230:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966641536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572231:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 1/0,0 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572234:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3be92c lrc: 0/0,0 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572234:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572239:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572242:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572245:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572247:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572280:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+906:39029:x1731745946443456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1234us (1316us total) trans 30064893478 rc 0/0 00000100:00100000:0.0:1651529344.572283:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152612 00010000:00010000:0.0:1651529344.572290:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572293:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.572294:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572297:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 3/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572301:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 1/0,0 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572304:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be93a lrc: 0/0,0 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572313:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bab67 lrc: 0/0,0 mode: --/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c7e expref: 1155 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.572316:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572319:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572322:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572325:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572328:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572331:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572375:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572379:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.572380:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572385:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 3/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572389:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 1/0,0 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572395:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946443264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1540us (1603us total) trans 30064893479 rc 0/0 00010000:00010000:1.0:1651529344.572397:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be925 lrc: 0/0,0 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572398:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152609 00000100:00100000:1.0:1651529344.572442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572471:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444288 00000100:00100000:0.0:1651529344.572479:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152617 00000100:00100000:0.0:1651529344.572481:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946444288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.572484:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.572486:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177410 count 1 00010000:00010000:0.0:1651529344.572490:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572492:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444224 00010000:00010000:0.0:1651529344.572495:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 2/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572498:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.572503:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152618 00000100:00100000:1.0:1651529344.572505:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+907:39030:x1731745946444224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.572505:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572506:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 4/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.572510:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177409 count 1 00010000:00010000:1.0:1651529344.572514:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572519:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 2/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1154 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572522:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572522:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572523:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 4/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572537:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1154 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572539:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 3/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572541:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1154 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.572543:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572545:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572548:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572554:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572557:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572587:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572606:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444352 00000100:00100000:0.0:1651529344.572614:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152619 00000100:00100000:0.0:1651529344.572616:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+908:39030:x1731745946444352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.572621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.572631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.572638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.572638:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177411 count 1 00010000:00010000:0.0:1651529344.572642:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572647:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 2/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572650:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572651:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572651:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 4/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.572661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.572668:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 3/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.572670:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444416 00010000:00010000:0.0:1651529344.572672:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572679:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444544 00000100:00100000:0.0:1651529344.572680:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966641984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572683:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444672 00000100:00100000:1.0:1651529344.572685:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444480 00000100:00100000:1.0:1651529344.572687:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444608 00000100:00100000:1.0:1651529344.572690:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152620 00000100:00100000:1.0:1651529344.572691:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+913:39030:x1731745946444416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.572691:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.572696:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177412 count 1 00000100:00100000:0.0:1651529344.572697:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152621 00000100:00100000:0.0:1651529344.572699:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+913:39030:x1731745946444544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.572700:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.572704:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177414 count 1 00010000:00010000:1.0:1651529344.572705:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 2/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572707:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572708:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572709:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572709:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 4/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572712:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 2/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572716:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 3/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572717:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572718:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572718:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 4/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572720:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 4/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572724:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966642048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572725:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 3/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572728:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572742:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572744:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966642112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572749:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152622 00000100:00100000:1.0:1651529344.572751:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+913:39030:x1731745946444672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.572753:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.572755:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177416 count 1 00010000:00010000:1.0:1651529344.572759:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572759:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152623 00000100:00100000:0.0:1651529344.572761:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+913:39029:x1731745946444480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.572763:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 2/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.572765:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177413 count 1 00010000:00010000:1.0:1651529344.572766:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572767:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572767:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 4/0,1 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572769:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572773:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 3/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572773:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 2/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1154 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572776:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572776:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572777:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 4/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572779:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 4/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572783:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966642176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572786:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 3/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1154 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572789:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1154 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572790:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572793:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966642240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572796:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152624 00000100:00100000:1.0:1651529344.572798:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+913:39029:x1731745946444608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.572799:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.572801:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177415 count 1 00010000:00010000:1.0:1651529344.572817:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572827:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 2/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572830:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572830:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572831:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 4/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572838:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 3/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1154 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572842:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 4/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572848:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966642304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572885:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.572955:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966641920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.572960:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572968:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966641856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572968:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325312 00010000:00010000:1.0:1651529344.572972:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572973:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1155 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.572984:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325440 00010000:00010000:0.0:1651529344.572987:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.572990:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11579 00000100:00100000:1.0:1651529344.572992:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1156:41279:x1731746396325312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.572995:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.572995:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11580 00010000:00010000:1.0:1651529344.572997:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1156 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.572997:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1156:41278:x1731746396325440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.573000:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.573001:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1156 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573001:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573005:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 3/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573007:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3b82da lrc: 0/0,0 mode: --/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe4c expref: 1156 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573011:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573011:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573011:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a29521b/0xa29a79078f3bb650 lrc: 0/0,0 mode: --/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5773 expref: 1155 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573012:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573014:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573015:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573016:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573019:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 4/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573025:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.573026:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 4/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573032:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.573033:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1154:41278:x1731746396325440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.573036:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11580 00000100:00100000:1.0:1651529344.573040:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41279:x1731746396325312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (92us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.573042:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573043:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11579 00010000:00010000:0.0:1651529344.573045:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573048:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573051:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573053:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573055:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573058:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573067:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573116:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+915:39030:x1731745946444288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 635us (674us total) trans 30064893480 rc 0/0 00000100:00100000:0.0:1651529344.573120:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152617 00000100:00100000:1.0:1651529344.573121:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+915:39030:x1731745946444224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 615us (637us total) trans 30064893481 rc 0/0 00000100:00100000:1.0:1651529344.573125:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152618 00010000:00010000:0.0:1651529344.573127:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573131:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.573132:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573132:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573135:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 3/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573136:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.573140:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 1/0,0 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573143:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3be95d lrc: 0/0,0 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573144:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573148:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 3/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573152:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 1/0,0 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573155:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3be964 lrc: 0/0,0 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.573385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.573400:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966641984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.573405:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.573424:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966642112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573426:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.573426:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.573433:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966642240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.573443:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.573454:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325504 00000100:00100000:1.0:1651529344.573455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.573459:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1153 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573462:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444800 00000100:00100000:0.0:1651529344.573464:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325632 00010000:00010000:0.0:1651529344.573467:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 5/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1154 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573471:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152625 00000100:00100000:1.0:1651529344.573473:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+914:39030:x1731745946444800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.573477:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325760 00002000:00080000:1.0:1651529344.573479:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177418 count 1 00010000:00010000:0.0:1651529344.573480:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1155 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573483:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573483:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325568 00010000:00010000:0.0:1651529344.573486:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 5/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573487:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 2/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1156 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.573490:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325696 00010000:00010000:0.0:1651529344.573499:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1157 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573501:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573501:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573502:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 4/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573504:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325824 00010000:00010000:0.0:1651529344.573506:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 5/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573510:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 3/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1158 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.573510:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11581 00000100:00100000:0.0:1651529344.573512:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1158:41279:x1731746396325504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.573514:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573515:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.573517:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573519:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966642368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.573520:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 3/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573526:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb404fda/0xa29a79078f3ba1e3 lrc: 0/0,0 mode: --/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0548 expref: 1158 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573529:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573530:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.573532:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.573537:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573540:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 4/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573541:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966642048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573545:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573546:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.573553:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966642176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573555:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573560:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1157:41279:x1731746396325504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.573562:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966642304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.573563:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11581 00010000:00010000:1.0:1651529344.573564:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573568:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11582 00000100:00100000:0.0:1651529344.573570:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1156:41279:x1731746396325632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.573573:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.573574:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 4/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573578:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 3/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573581:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11583 00000100:00100000:1.0:1651529344.573583:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1156:41279:x1731746396325760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.573583:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bad20 lrc: 0/0,0 mode: --/PR res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33af expref: 1156 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573586:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573587:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.573587:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573588:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1155 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573588:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573590:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 4/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573592:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 3/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1155 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573599:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.573604:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ae8044/0xa29a79078f3b7830 lrc: 0/0,0 mode: --/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb65e expref: 1155 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.573605:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1155:41279:x1731746396325632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.573607:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11582 00010000:00010000:1.0:1651529344.573608:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573609:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573610:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573613:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 4/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573618:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11584 00000100:00100000:0.0:1651529344.573619:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41278:x1731746396325568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.573622:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.573628:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.573629:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41279:x1731746396325760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (197us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.573630:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 4/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1153 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573632:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11583 00010000:00010000:0.0:1651529344.573634:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 3/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1153 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.573638:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11585 00000100:00100000:1.0:1651529344.573639:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1152:41278:x1731746396325696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.573639:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd0cb7c6/0xa29a79078f3bb6f8 lrc: 0/0,0 mode: --/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a44 expref: 1152 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573642:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.573643:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573643:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573644:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1151 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573644:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573647:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 4/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573648:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 3/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1151 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573653:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279172b9/0xa29a79078f3bb879 lrc: 0/0,0 mode: --/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6009 expref: 1151 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573655:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.573662:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1151:41278:x1731746396325568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.573663:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573664:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573664:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573664:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11584 00010000:00010000:1.0:1651529344.573668:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 4/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573673:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11586 00010000:00010000:1.0:1651529344.573676:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.573681:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41278:x1731746396325824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.573682:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41278:x1731746396325696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.573684:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.573685:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11585 00010000:00010000:0.0:1651529344.573686:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 4/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1149 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573689:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 3/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573692:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573695:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573695:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf7b663/0xa29a79078f3bbcb6 lrc: 0/0,0 mode: --/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d704e expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.573698:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573699:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573699:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573701:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573702:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 4/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573703:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573711:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.573717:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1147:41278:x1731746396325824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.573720:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11586 00000100:00100000:0.0:1651529344.573728:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444736 00000100:00100000:0.0:1651529344.573744:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152626 00000100:00100000:0.0:1651529344.573746:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946444736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.573751:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177417 count 1 00010000:00010000:0.0:1651529344.573755:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573762:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+916:39030:x1731745946444672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1011us (1124us total) trans 30064893482 rc 0/0 00010000:00010000:0.0:1651529344.573762:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 2/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.573765:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.573766:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152622 00010000:00010000:0.0:1651529344.573766:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573766:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 4/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573773:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573773:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 3/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573776:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.573776:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.573777:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573780:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 3/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573780:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966642432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573785:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 1/0,0 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573788:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3be980 lrc: 0/0,0 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573789:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.573793:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573795:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573797:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573798:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573800:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573801:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573819:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573822:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573864:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+917:39030:x1731745946444416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1249us total) trans 30064893483 rc 0/0 00000100:00100000:1.0:1651529344.573867:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152620 00000100:00100000:0.0:1651529344.573872:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+916:39030:x1731745946444544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1171us (1240us total) trans 30064893484 rc 0/0 00010000:00010000:1.0:1651529344.573875:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573875:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152621 00010000:00010000:1.0:1651529344.573878:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.573879:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573882:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 3/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573883:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573886:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 1/0,0 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573887:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.573888:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573889:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3be972 lrc: 0/0,0 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573891:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 3/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573895:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573895:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 1/0,0 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573898:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573898:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3be979 lrc: 0/0,0 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573901:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573904:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573904:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573907:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573910:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573913:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573947:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+917:39029:x1731745946444608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1284us total) trans 30064893485 rc 0/0 00000100:00100000:1.0:1651529344.573949:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152624 00000100:00100000:0.0:1651529344.573953:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946444480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1301us total) trans 30064893486 rc 0/0 00010000:00010000:1.0:1651529344.573956:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573956:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152623 00010000:00010000:1.0:1651529344.573960:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.573961:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573963:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 3/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573964:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573967:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573968:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 1/0,0 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573970:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573973:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573979:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3be98e lrc: 0/0,0 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573984:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573986:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.573987:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573990:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 3/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573994:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 1/0,0 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573996:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3be987 lrc: 0/0,0 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574000:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574002:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.574003:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574004:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+916:39030:x1731745946444352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1387us (1417us total) trans 30064893487 rc 0/0 00000100:00100000:0.0:1651529344.574007:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152619 00010000:00010000:1.0:1651529344.574012:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 3/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574016:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 1/0,0 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574019:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3be96b lrc: 0/0,0 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.574300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.574306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.574320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.574333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.574338:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445440 00000100:00100000:0.0:1651529344.574340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.574350:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445376 00000100:00100000:1.0:1651529344.574355:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445568 00000100:00100000:1.0:1651529344.574359:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445696 00000100:00100000:1.0:1651529344.574362:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445504 00000100:00100000:0.0:1651529344.574363:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152627 00000100:00100000:1.0:1651529344.574365:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445632 00000100:00100000:0.0:1651529344.574365:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+920:39030:x1731745946445440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.574368:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152628 00000100:00100000:1.0:1651529344.574369:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+921:39030:x1731745946445568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.574370:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177420 count 1 00002000:00080000:1.0:1651529344.574375:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177422 count 1 00010000:00010000:0.0:1651529344.574375:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574379:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574379:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 2/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574383:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574383:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574384:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 2/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574384:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 4/0,1 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574387:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574387:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574388:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 4/0,1 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574391:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 3/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574395:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 4/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574399:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966642496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.574405:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 3/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.574409:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 4/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.574420:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966642560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574427:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.574430:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.574434:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152629 00000100:00100000:0.0:1651529344.574436:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946445376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.574437:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152630 00000100:00100000:1.0:1651529344.574438:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+921:39030:x1731745946445696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.574441:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177419 count 1 00002000:00080000:1.0:1651529344.574443:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177424 count 1 00010000:00010000:0.0:1651529344.574445:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574446:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574450:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 2/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.574451:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 2/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574453:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574454:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574454:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574454:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574455:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 4/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574455:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 4/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574461:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 3/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574461:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 3/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.574465:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.574465:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 4/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574469:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966642624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574476:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.574478:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966642688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574483:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152631 00000100:00100000:0.0:1651529344.574484:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946445504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.574486:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.574489:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177421 count 1 00010000:00010000:0.0:1651529344.574492:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574493:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152632 00000100:00100000:1.0:1651529344.574495:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946445632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.574496:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 2/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.574499:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177423 count 1 00010000:00010000:0.0:1651529344.574502:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574502:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574503:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574503:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 4/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574507:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 2/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.574508:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 3/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.574510:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574510:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574511:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 4/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574512:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 4/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574516:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966642752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.574517:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.574521:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574522:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.574525:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966642816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.574531:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.574565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.574570:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966642368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.574575:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574581:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966642432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.574585:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574592:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326400 00010000:00010000:0.0:1651529344.574596:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574606:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326464 00010000:00010000:0.0:1651529344.574609:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574619:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11587 00000100:00100000:0.0:1651529344.574621:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1148:41279:x1731746396326400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.574624:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.574625:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.574629:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 3/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.574635:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3bafd5 lrc: 0/0,0 mode: --/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e2f expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.574638:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574639:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574640:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574643:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 4/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574645:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11588 00000100:00100000:1.0:1651529344.574647:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1147:41279:x1731746396326464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.574650:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.574656:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.574658:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.574660:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1147:41279:x1731746396326400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.574662:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 3/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.574668:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aaff797/0xa29a79078f3bb85d lrc: 0/0,0 mode: --/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f99 expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.574672:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574673:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574673:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574677:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 4/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574678:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11587 00010000:00010000:1.0:1651529344.574687:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.574693:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574694:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1145:41279:x1731746396326464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.574697:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11588 00010000:00010000:0.0:1651529344.574697:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574700:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574703:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574706:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574709:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574712:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574715:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574768:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+923:39029:x1731745946444736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1021us (1383us total) trans 30064893488 rc 0/0 00000100:00100000:0.0:1651529344.574771:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152626 00000100:00100000:1.0:1651529344.574774:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+923:39030:x1731745946444800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1299us (1410us total) trans 30064893489 rc 0/0 00000100:00100000:1.0:1651529344.574777:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152625 00010000:00010000:0.0:1651529344.574779:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574783:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.574784:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574784:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574787:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.574787:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 3/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574788:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574791:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 3/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574791:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 1/0,0 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574794:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3be99c lrc: 0/0,0 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574796:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 1/0,0 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574801:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3be995 lrc: 0/0,0 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575093:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445760 00000100:00100000:1.0:1651529344.575103:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445824 00000100:00100000:1.0:1651529344.575110:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152633 00000100:00100000:1.0:1651529344.575116:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+923:39030:x1731745946445760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.575122:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177425 count 1 00010000:00010000:1.0:1651529344.575132:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575142:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 2/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1144 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.575142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.575149:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575150:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575150:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 4/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.575160:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.575162:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1144 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575166:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1144 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575167:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.575172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.575173:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966642880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.575185:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.575188:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966642496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575192:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966642688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.575193:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575196:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575201:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152634 00000100:00100000:1.0:1651529344.575203:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966642816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575203:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+923:39030:x1731745946445824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.575205:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.575208:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177426 count 1 00000100:00100000:1.0:1651529344.575212:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326528 00010000:00010000:0.0:1651529344.575212:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575216:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 4/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575217:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 2/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1145 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575220:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575220:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.575221:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326656 00010000:00010000:0.0:1651529344.575221:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 4/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575224:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575228:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326784 00010000:00010000:0.0:1651529344.575228:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 3/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1146 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575230:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 5/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575234:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326592 00010000:00010000:0.0:1651529344.575234:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 4/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575236:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 5/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1148 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575238:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966642944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575242:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326720 00010000:00010000:1.0:1651529344.575244:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 5/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1149 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575247:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.575248:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326848 00010000:00010000:1.0:1651529344.575250:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1150 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575254:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11589 00000100:00100000:0.0:1651529344.575255:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966642624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575256:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1150:41279:x1731746396326528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.575258:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.575259:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 4/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1150 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575259:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575263:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 3/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1150 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575265:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966642752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.575268:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bab52 lrc: 0/0,0 mode: --/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c15 expref: 1150 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575268:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575272:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575273:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575273:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575274:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11590 00010000:00010000:1.0:1651529344.575276:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 4/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575276:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41279:x1731746396326656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.575279:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.575281:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1149 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575284:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 3/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1149 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575288:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.575295:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41279:x1731746396326528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.575298:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11589 00010000:00010000:0.0:1651529344.575298:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025576bc5/0xa29a79078f3bb61f lrc: 0/0,0 mode: --/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56e7 expref: 1149 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575302:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.575303:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11591 00010000:00010000:0.0:1651529344.575303:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575303:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575305:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1147:41279:x1731746396326784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.575306:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 4/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575307:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.575309:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 4/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575313:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 3/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575316:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.575323:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1147:41279:x1731746396326656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.575325:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a00ee6ba/0xa29a79078f3bbc00 lrc: 0/0,0 mode: --/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dbc expref: 1147 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575326:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11590 00010000:00010000:1.0:1651529344.575329:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575329:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575330:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575332:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11592 00010000:00010000:1.0:1651529344.575333:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 4/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575333:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1145:41278:x1731746396326592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.575336:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.575337:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 5/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575341:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.575347:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1145:41279:x1731746396326784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.575348:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 4/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575350:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11591 00010000:00010000:0.0:1651529344.575353:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575354:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575355:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575360:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11593 00010000:00010000:0.0:1651529344.575360:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 4/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575361:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1144:41278:x1731746396326720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.575364:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.575365:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 4/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1144 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575365:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.575369:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 3/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1144 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.575370:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1144:41278:x1731746396326592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.575373:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11592 00010000:00010000:1.0:1651529344.575374:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd991dc8/0xa29a79078f3bba47 lrc: 0/0,0 mode: --/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66f4 expref: 1144 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575377:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.575377:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11594 00010000:00010000:1.0:1651529344.575378:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575379:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575379:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1142:41278:x1731746396326848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.575381:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.575382:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 4/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575382:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575386:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.575390:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.575396:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1142:41278:x1731746396326720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.575398:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075667892/0xa29a79078f3babc2 lrc: 0/0,0 mode: --/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d9d expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575399:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11593 00010000:00010000:0.0:1651529344.575401:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575402:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575403:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575405:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 4/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575410:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004514e0f6/0xa29a79078f3bbe5a lrc: 0/0,0 mode: --/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76b4 expref: 1140 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.575414:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.575420:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1139:41278:x1731746396326848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.575421:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966642560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575423:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11594 00010000:00010000:1.0:1651529344.575424:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575428:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575430:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575430:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575433:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575433:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575436:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575436:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575439:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575482:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+925:39030:x1731745946445568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1176us total) trans 30064893490 rc 0/0 00000100:00100000:1.0:1651529344.575485:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152628 00000100:00100000:0.0:1651529344.575488:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+924:39029:x1731745946445504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1154us total) trans 30064893491 rc 0/0 00000100:00100000:0.0:1651529344.575491:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152631 00010000:00010000:1.0:1651529344.575493:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575496:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575497:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575498:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575501:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575502:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 3/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575502:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575507:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 1/0,0 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575508:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 3/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575510:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3be9aa lrc: 0/0,0 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575513:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 1/0,0 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575515:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3be9bf lrc: 0/0,0 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575516:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575519:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575521:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575522:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575524:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575524:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575527:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575530:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575569:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+925:39029:x1731745946445632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1228us total) trans 30064893492 rc 0/0 00000100:00100000:0.0:1651529344.575571:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+925:39029:x1731745946445376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1133us (1270us total) trans 30064893493 rc 0/0 00000100:00100000:1.0:1651529344.575572:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152632 00000100:00100000:0.0:1651529344.575573:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152629 00010000:00010000:1.0:1651529344.575579:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575581:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575584:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575585:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575587:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575588:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 3/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575590:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575592:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 1/0,0 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575592:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575595:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3be9c6 lrc: 0/0,0 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575599:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575602:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011187589 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575603:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575605:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 3/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575609:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 1/0,0 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575614:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3be9b1 lrc: 0/0,0 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575617:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575620:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575621:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575623:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 3/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575624:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+924:39030:x1731745946445440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1259us (1334us total) trans 30064893494 rc 0/0 00010000:00010000:1.0:1651529344.575626:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 1/0,0 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575627:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152627 00010000:00010000:1.0:1651529344.575629:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3be9a3 lrc: 0/0,0 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575634:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575636:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575639:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575642:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575689:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+924:39030:x1731745946445696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1368us total) trans 30064893495 rc 0/0 00000100:00100000:1.0:1651529344.575692:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152630 00010000:00010000:1.0:1651529344.575718:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575722:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.575723:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575726:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 3/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575739:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 1/0,0 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575742:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3be9b8 lrc: 0/0,0 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575909:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446464 00000100:00100000:1.0:1651529344.575921:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152635 00000100:00100000:1.0:1651529344.575923:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+924:39030:x1731745946446464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.575929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.575935:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177428 count 1 00000100:00100000:0.0:1651529344.575937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.575939:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575943:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.575944:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 2/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575953:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.575953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.575954:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575955:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 4/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.575960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.575967:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.575969:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446400 00010000:00010000:1.0:1651529344.575971:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.575975:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966643008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575976:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446592 00000100:00100000:0.0:1651529344.575979:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446720 00000100:00100000:0.0:1651529344.575982:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446528 00000100:00100000:0.0:1651529344.575984:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446656 00000100:00100000:0.0:1651529344.575986:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152636 00000100:00100000:1.0:1651529344.575987:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.575988:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b87f7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946446400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.575993:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152637 00002000:00080000:0.0:1651529344.575993:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177427 count 1 00000100:00100000:1.0:1651529344.575994:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946446592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.575998:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.575999:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177430 count 1 00010000:00010000:1.0:1651529344.576003:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576003:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 2/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576006:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576007:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 2/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576007:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576007:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 4/0,1 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576013:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576014:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576014:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 4/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576014:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 3/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576018:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 4/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576020:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 3/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.576022:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576024:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 4/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576028:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966643136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576031:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.576035:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.576038:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152638 00000100:00100000:1.0:1651529344.576040:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152639 00000100:00100000:0.0:1651529344.576040:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946446720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.576042:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946446528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.576044:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177432 count 1 00002000:00080000:1.0:1651529344.576046:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177429 count 1 00010000:00010000:0.0:1651529344.576047:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576049:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576051:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 2/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576053:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 2/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576056:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576057:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576057:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576058:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 4/0,1 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576058:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576058:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 4/0,1 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576064:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 3/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576068:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 4/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576072:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966643200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576076:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 3/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.576078:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.576080:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 4/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576083:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152640 00000100:00100000:1.0:1651529344.576084:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966643264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576085:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946446656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.576089:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177431 count 1 00000100:00100000:1.0:1651529344.576091:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.576092:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576097:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 2/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576099:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576100:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576101:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 4/0,1 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576109:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 3/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1138 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576112:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 4/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576116:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966643328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576122:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.576514:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966642880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576519:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.576579:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966643008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576588:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576600:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966643136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576600:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.576608:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.576619:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327424 00000100:00100000:0.0:1651529344.576622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.576624:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1139 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.576641:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327488 00000100:00100000:0.0:1651529344.576641:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966642944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576644:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 4/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1140 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576646:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576648:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327552 00010000:00010000:1.0:1651529344.576650:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1141 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576653:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327680 00000100:00100000:1.0:1651529344.576654:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327616 00010000:00010000:1.0:1651529344.576656:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 5/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1143 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576658:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 4/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1143 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576660:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327808 00010000:00010000:1.0:1651529344.576662:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 5/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1144 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576664:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327744 00000100:00100000:1.0:1651529344.576666:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327872 00010000:00010000:0.0:1651529344.576666:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 5/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576668:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 5/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576672:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11595 00000100:00100000:0.0:1651529344.576673:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1146:41279:x1731746396327424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.576675:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11596 00000100:00100000:1.0:1651529344.576676:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1146:41278:x1731746396327488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576676:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.576678:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576679:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576681:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 4/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576682:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576687:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ca6ddc0/0xa29a79078f3bc2ac lrc: 0/0,0 mode: --/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d880a expref: 1146 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576691:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576692:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576693:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 3/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576695:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 4/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576699:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bb05a lrc: 0/0,0 mode: --/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ffd expref: 1145 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576705:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576708:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576709:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576710:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576715:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1144:41279:x1731746396327424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.576717:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 4/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576718:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11595 00000100:00100000:0.0:1651529344.576724:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11597 00010000:00010000:1.0:1651529344.576727:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.576742:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1143:41279:x1731746396327552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.576744:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1143:41278:x1731746396327488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 67us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.576746:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.576747:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11596 00010000:00010000:0.0:1651529344.576748:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1143 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576752:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576753:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11598 00000100:00100000:1.0:1651529344.576755:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1142:41278:x1731746396327616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.576757:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.576757:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000769d467/0xa29a79078f3bbd34 lrc: 0/0,0 mode: --/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71f2 expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576759:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 5/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1142 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576760:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576761:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576762:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576763:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 4/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1141 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576765:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 4/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576768:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576769:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576769:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576773:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576780:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 4/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576780:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1141:41279:x1731746396327552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576783:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11597 00010000:00010000:1.0:1651529344.576784:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.576788:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11599 00000100:00100000:0.0:1651529344.576789:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41279:x1731746396327680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.576790:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41278:x1731746396327616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.576792:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.576793:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11598 00010000:00010000:0.0:1651529344.576793:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 4/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1140 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576797:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11600 00010000:00010000:0.0:1651529344.576797:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 3/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1139 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576799:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1139:41279:x1731746396327808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.576801:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.576802:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0eeb4ef/0xa29a79078f3ba9ca lrc: 0/0,0 mode: --/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25e0 expref: 1139 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576814:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 5/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1139 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576821:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576821:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576822:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 4/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1138 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576822:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576825:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 4/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576828:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576828:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576829:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576832:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576839:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 4/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576839:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1138:41279:x1731746396327680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576841:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11599 00010000:00010000:1.0:1651529344.576844:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.576850:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1137:41279:x1731746396327808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576850:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11601 00000100:00100000:0.0:1651529344.576852:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1137:41278:x1731746396327744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.576853:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11600 00010000:00010000:0.0:1651529344.576855:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.576856:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 5/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.576857:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11602 00000100:00100000:1.0:1651529344.576859:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1136:41278:x1731746396327872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576860:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 4/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576862:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576863:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 5/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576865:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576866:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576866:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576867:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 4/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.576869:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 4/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576871:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576872:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576873:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576873:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576876:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 4/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576878:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1136:41278:x1731746396327744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.576879:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.576880:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11601 00000100:00100000:1.0:1651529344.576884:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1135:41278:x1731746396327872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.576887:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11602 00010000:00010000:0.0:1651529344.576891:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c46883/0xa29a79078f3ba8c7 lrc: 0/0,0 mode: --/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2275 expref: 1134 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.576895:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576896:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576898:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576899:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576901:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576902:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576904:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576905:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576907:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576910:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576972:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+931:39030:x1731745946446592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 977us (1034us total) trans 30064893496 rc 0/0 00000100:00100000:1.0:1651529344.576975:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152637 00000100:00100000:0.0:1651529344.576978:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b87f7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+931:39029:x1731745946446400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 988us (1048us total) trans 30064893497 rc 0/0 00000100:00100000:0.0:1651529344.576981:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152636 00010000:00010000:1.0:1651529344.576983:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576987:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.576988:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576990:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 3/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576992:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120c6851/0xa29a79078f3badf2 lrc: 0/0,0 mode: --/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d368e expref: 1133 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.576995:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 1/0,0 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576996:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966643200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576998:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3be9e9 lrc: 0/0,0 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576999:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577002:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577003:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577005:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.577005:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577006:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577008:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 3/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577008:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577011:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 2/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577012:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 1/0,0 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577014:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3be9e2 lrc: 0/0,0 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577018:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577026:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.577028:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 2/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577033:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 3/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577037:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 1/0,0 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577039:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3be9f0 lrc: 0/0,0 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577046:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577049:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577052:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577053:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+930:39030:x1731745946446720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1109us total) trans 30064893498 rc 0/0 00010000:00010000:1.0:1651529344.577054:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577056:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152638 00010000:00010000:0.0:1651529344.577066:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a41d87/0xa29a79078f3bbd42 lrc: 0/0,0 mode: --/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d721c expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577070:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966643328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.577073:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577077:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577079:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577082:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577085:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577090:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+930:39030:x1731745946445760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1977us (2021us total) trans 30064893499 rc 0/0 00000100:00100000:1.0:1651529344.577101:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152633 00010000:00010000:1.0:1651529344.577107:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577120:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.577122:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577123:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+930:39029:x1731745946446656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1037us (1163us total) trans 30064893500 rc 0/0 00010000:00010000:1.0:1651529344.577124:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 3/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577126:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152640 00010000:00010000:1.0:1651529344.577129:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 1/0,0 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577132:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3be9cd lrc: 0/0,0 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577133:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577137:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.577138:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577141:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 3/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577143:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008690ab93/0xa29a79078f3bae1c lrc: 0/0,0 mode: --/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3728 expref: 1131 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.577145:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 1/0,0 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577147:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966643264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.577148:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3be9fe lrc: 0/0,0 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577150:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577154:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577154:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577156:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577157:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577160:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577163:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577168:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577176:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577199:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+931:39030:x1731745946445824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1996us (2121us total) trans 30064893501 rc 0/0 00000100:00100000:0.0:1651529344.577203:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152634 00000100:00100000:1.0:1651529344.577213:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+930:39029:x1731745946446528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1170us (1260us total) trans 30064893502 rc 0/0 00000100:00100000:1.0:1651529344.577216:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152639 00010000:00010000:1.0:1651529344.577224:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577227:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.577228:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577231:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 3/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577235:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 1/0,0 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577238:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3be9d4 lrc: 0/0,0 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577250:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577253:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.577254:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577293:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 3/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577303:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 1/0,0 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577305:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3be9f7 lrc: 0/0,0 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577313:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577316:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577319:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577322:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577344:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577349:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.577350:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577353:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 3/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577358:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 1/0,0 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577361:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3be9db lrc: 0/0,0 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577365:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+930:39030:x1731745946446464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1442us (1475us total) trans 30064893503 rc 0/0 00000100:00100000:1.0:1651529344.577375:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152635 00000100:00100000:0.0:1651529344.577529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.577539:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447296 00000100:00100000:0.0:1651529344.577540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.577548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.577559:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447360 00000100:00100000:1.0:1651529344.577564:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447424 00000100:00100000:0.0:1651529344.577564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.577570:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447488 00000100:00100000:1.0:1651529344.577574:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152641 00000100:00100000:1.0:1651529344.577576:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+933:39029:x1731745946447296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.577576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.577581:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177433 count 1 00000100:00100000:0.0:1651529344.577582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.577585:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577587:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.577591:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 2/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577594:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577594:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.577594:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.577595:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 4/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577600:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447552 00010000:00010000:1.0:1651529344.577602:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 3/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577606:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577606:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447616 00000100:00100000:0.0:1651529344.577608:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447680 00000100:00100000:1.0:1651529344.577610:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966643392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577610:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447744 00000100:00100000:0.0:1651529344.577613:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152642 00000100:00100000:0.0:1651529344.577615:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946447360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.577621:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.577621:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177434 count 1 00010000:00010000:0.0:1651529344.577625:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577630:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 2/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577633:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577634:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577635:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 4/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577636:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152643 00000100:00100000:1.0:1651529344.577638:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+937:39029:x1731745946447424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.577642:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 3/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.577643:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177435 count 1 00010000:00010000:0.0:1651529344.577645:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.577646:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577650:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966643456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577651:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 2/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577654:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577655:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577655:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 4/0,1 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577659:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.577662:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 3/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577666:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 4/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577666:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152644 00000100:00100000:0.0:1651529344.577667:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946447488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.577670:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966643520:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.577672:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177436 count 1 00010000:00010000:0.0:1651529344.577675:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577677:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.577680:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 2/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.577683:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152645 00010000:00010000:0.0:1651529344.577683:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577683:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577684:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 4/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577685:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+937:39029:x1731745946447552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.577689:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177437 count 1 00010000:00010000:0.0:1651529344.577689:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 3/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577692:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577693:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577697:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966643584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577698:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 2/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577701:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577702:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577702:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 4/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577703:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.577708:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 3/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.577709:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152646 00000100:00100000:0.0:1651529344.577711:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946447616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.577712:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.577715:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177438 count 1 00000100:00100000:1.0:1651529344.577716:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966643648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.577718:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577722:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.577722:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 2/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.577727:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152647 00010000:00010000:0.0:1651529344.577728:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577728:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.577729:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946447680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.577729:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 4/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.577743:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177439 count 1 00010000:00010000:1.0:1651529344.577747:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577747:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 3/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577750:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.577751:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 2/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577754:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.577754:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966643712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577755:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577756:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 4/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577762:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 3/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1130 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.577762:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.577766:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1130 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577768:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152648 00000100:00100000:1.0:1651529344.577770:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966643776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577770:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946447744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.577774:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177440 count 1 00000100:00100000:1.0:1651529344.577777:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.577778:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577782:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 2/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1130 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577785:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577786:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577786:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 4/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577795:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1130 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577799:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1130 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.577820:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577828:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.577946:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966643392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577956:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577999:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966643456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.578004:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578008:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966643520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578012:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578257:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966643648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578266:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578279:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966643776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578282:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.578291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578294:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328512 00000100:00100000:0.0:1651529344.578297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.578300:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1131 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578303:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578306:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328448 00010000:00010000:1.0:1651529344.578308:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578312:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11603 00000100:00100000:0.0:1651529344.578313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578314:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1132:41278:x1731746396328512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.578317:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578318:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.578322:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 3/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578326:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966643584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578327:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90d3686/0xa29a79078f3ba6e4 lrc: 0/0,0 mode: --/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b1a expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578330:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578331:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578331:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578332:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578335:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 4/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578337:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966643712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.578340:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578346:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.578354:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.578356:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41278:x1731746396328512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (87us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.578357:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578359:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11603 00000100:00100000:1.0:1651529344.578364:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328640 00000100:00100000:0.0:1651529344.578364:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328576 00010000:00010000:1.0:1651529344.578367:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578369:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 4/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578371:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328768 00010000:00010000:1.0:1651529344.578374:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1133 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578375:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328704 00010000:00010000:0.0:1651529344.578377:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1134 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578378:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328896 00010000:00010000:1.0:1651529344.578381:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1135 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578382:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328832 00010000:00010000:0.0:1651529344.578384:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578386:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11604 00000100:00100000:1.0:1651529344.578387:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1136:41279:x1731746396328448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.578389:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11605 00010000:00010000:1.0:1651529344.578390:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578391:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578391:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1136:41278:x1731746396328640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.578394:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 3/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578394:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.578395:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578399:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3ba2bc lrc: 0/0,0 mode: --/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0923 expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578399:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 3/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1136 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578403:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578403:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578404:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578405:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7e67c2/0xa29a79078f3b9c3a lrc: 0/0,0 mode: --/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeea expref: 1135 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578407:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 4/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578409:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578409:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578410:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578413:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.578413:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 4/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578418:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1134:41279:x1731746396328448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.578420:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.578421:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11604 00000100:00100000:1.0:1651529344.578425:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11606 00000100:00100000:1.0:1651529344.578427:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1133:41279:x1731746396328576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.578427:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1133:41278:x1731746396328640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.578429:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578430:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 4/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1133 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578430:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11605 00010000:00010000:1.0:1651529344.578434:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 3/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578439:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397fa10b/0xa29a79078f3b9b37 lrc: 0/0,0 mode: --/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb16 expref: 1132 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578440:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11607 00010000:00010000:1.0:1651529344.578442:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.578442:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41278:x1731746396328768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.578443:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578443:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578444:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578446:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 4/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578446:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1131 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578449:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 3/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1131 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578452:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.578454:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000720c3eb5/0xa29a79078f3b9b68 lrc: 0/0,0 mode: --/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb7f expref: 1131 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578456:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41279:x1731746396328576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.578459:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11606 00010000:00010000:0.0:1651529344.578460:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578461:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578462:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578463:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11608 00000100:00100000:1.0:1651529344.578464:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1129:41279:x1731746396328704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.578464:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 4/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578466:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578468:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1129 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578470:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.578472:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 3/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1129 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578475:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1129:41278:x1731746396328768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.578476:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456b49f7/0xa29a79078f3ba4d0 lrc: 0/0,0 mode: --/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1214 expref: 1129 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578478:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11607 00010000:00010000:1.0:1651529344.578479:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578479:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578480:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578482:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11609 00000100:00100000:0.0:1651529344.578484:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1127:41278:x1731746396328896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.578485:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 4/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578486:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.578488:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1127 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.578491:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.578491:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1127 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578496:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1127:41279:x1731746396328704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.578496:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c327e108/0xa29a79078f3b9422 lrc: 0/0,0 mode: --/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce6e expref: 1127 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.578498:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11608 00010000:00010000:0.0:1651529344.578499:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578500:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578500:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578502:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11610 00010000:00010000:0.0:1651529344.578503:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 4/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578504:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396328832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.578506:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578508:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.578508:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.578511:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 3/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578513:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41278:x1731746396328896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.578516:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061037f8e/0xa29a79078f3bbea0 lrc: 0/0,0 mode: --/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77b0 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.578516:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11609 00010000:00010000:1.0:1651529344.578519:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578519:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578520:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578522:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578523:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 4/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578525:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578529:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.578529:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578531:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578533:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1123:41279:x1731746396328832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.578536:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11610 00010000:00010000:1.0:1651529344.578548:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578552:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008290e4b2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.578553:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578556:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 3/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578560:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 1/0,0 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578563:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3bea28 lrc: 0/0,0 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578569:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578572:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578586:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578589:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578589:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+938:39030:x1731745946447616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 877us (1006us total) trans 30064893504 rc 0/0 00000100:00100000:0.0:1651529344.578592:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152646 00010000:00010000:0.0:1651529344.578599:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578605:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578608:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578610:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578630:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+939:39029:x1731745946447424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 991us (1081us total) trans 30064893505 rc 0/0 00000100:00100000:1.0:1651529344.578633:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152643 00010000:00010000:1.0:1651529344.578640:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578644:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b010eb0 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.578644:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+938:39030:x1731745946447360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1028us (1104us total) trans 30064893506 rc 0/0 00010000:00010000:1.0:1651529344.578645:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578647:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 3/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578647:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152642 00010000:00010000:1.0:1651529344.578652:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 1/0,0 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578654:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578655:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3bea13 lrc: 0/0,0 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578657:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.578658:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578661:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578661:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 3/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578664:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578666:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 1/0,0 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578667:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578669:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 2/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578669:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bea0c lrc: 0/0,0 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578674:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578676:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.578677:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 2/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578680:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 3/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578683:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 1/0,0 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578686:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bea21 lrc: 0/0,0 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578691:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578694:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578696:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578699:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578703:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+938:39029:x1731745946447552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1018us (1127us total) trans 30064893507 rc 0/0 00000100:00100000:1.0:1651529344.578714:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152645 00010000:00010000:1.0:1651529344.578721:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578724:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.578725:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578728:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 3/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578743:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 1/0,0 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578745:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bea1a lrc: 0/0,0 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578748:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+938:39030:x1731745946447488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1079us (1183us total) trans 30064893508 rc 0/0 00000100:00100000:0.0:1651529344.578751:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152644 00010000:00010000:0.0:1651529344.578758:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578759:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578762:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578762:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578765:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578765:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578767:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578768:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578800:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946447744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1206us total) trans 30064893509 rc 0/0 00000100:00100000:0.0:1651529344.578821:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152648 00000100:00100000:1.0:1651529344.578822:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946447680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1088us (1230us total) trans 30064893510 rc 0/0 00000100:00100000:1.0:1651529344.578826:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152647 00010000:00010000:0.0:1651529344.578828:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578832:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.578833:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578835:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578836:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 3/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578838:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.578839:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578841:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 1/0,0 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578842:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 3/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578844:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3bea36 lrc: 0/0,0 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578847:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 1/0,0 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578850:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3bea2f lrc: 0/0,0 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578857:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578860:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578863:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578865:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578946:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+938:39029:x1731745946447296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1369us (1417us total) trans 30064893511 rc 0/0 00000100:00100000:1.0:1651529344.578949:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152641 00010000:00010000:1.0:1651529344.578957:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578960:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.578961:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578964:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 3/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578969:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 1/0,0 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578972:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3bea05 lrc: 0/0,0 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.579137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.579176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.579186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.579186:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448320 00000100:00100000:1.0:1651529344.579195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.579200:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448384 00000100:00100000:1.0:1651529344.579201:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.579205:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448448 00000100:00100000:1.0:1651529344.579208:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.579208:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448512 00000100:00100000:1.0:1651529344.579218:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448576 00000100:00100000:0.0:1651529344.579219:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448640 00000100:00100000:0.0:1651529344.579223:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448704 00000100:00100000:1.0:1651529344.579225:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152649 00000100:00100000:1.0:1651529344.579226:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+944:39029:x1731745946448320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.579228:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152650 00000100:00100000:0.0:1651529344.579229:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+944:39030:x1731745946448384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.579232:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177441 count 1 00002000:00080000:0.0:1651529344.579235:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177442 count 1 00010000:00010000:1.0:1651529344.579236:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579241:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 2/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.579244:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579245:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579246:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 4/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579253:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579255:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579258:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 2/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.579259:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1122 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.579261:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579262:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579263:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 4/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579264:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966643904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579270:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 3/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.579275:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.579276:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 4/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1122 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.579281:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152651 00000100:00100000:0.0:1651529344.579281:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.579282:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+944:39029:x1731745946448448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.579287:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177443 count 1 00010000:00010000:1.0:1651529344.579290:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579290:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.579294:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 2/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.579297:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152652 00010000:00010000:1.0:1651529344.579298:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579298:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579299:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 4/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579299:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+944:39030:x1731745946448512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.579303:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177444 count 1 00010000:00010000:1.0:1651529344.579305:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 3/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579307:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579308:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.579311:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 2/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579314:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579314:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579315:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 4/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579321:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966644032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579321:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579325:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.579329:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.579336:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152653 00000100:00100000:1.0:1651529344.579338:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+944:39029:x1731745946448576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.579342:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177445 count 1 00000100:00100000:0.0:1651529344.579342:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966644096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.579346:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579350:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 2/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.579350:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.579353:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579354:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579354:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 4/0,1 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579357:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152654 00000100:00100000:0.0:1651529344.579359:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+944:39030:x1731745946448640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.579360:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 3/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.579363:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177446 count 1 00010000:00010000:1.0:1651529344.579364:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 4/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.579366:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579368:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966644160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579371:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 2/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.579374:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.579374:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579374:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579375:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 4/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579380:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152655 00010000:00010000:0.0:1651529344.579381:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 3/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1122 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.579382:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+944:39029:x1731745946448704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.579385:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1122 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.579386:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177447 count 1 00010000:00010000:1.0:1651529344.579389:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579389:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966644224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.579393:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 2/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1122 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.579395:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.579396:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579396:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579397:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 4/0,1 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579403:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 3/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1122 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.579406:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 4/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1122 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.579410:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966644288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.579411:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.579416:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.579426:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448768 00000100:00100000:0.0:1651529344.579433:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152656 00000100:00100000:0.0:1651529344.579435:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+945:39030:x1731745946448768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.579440:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177448 count 1 00010000:00010000:0.0:1651529344.579444:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579449:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 2/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579452:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579452:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579453:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 4/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579459:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 3/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1122 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579462:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 4/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.579466:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.579474:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.579611:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966643904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.579616:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579659:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966643968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579664:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579718:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966644032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.579722:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579779:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966644096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579784:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580021:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.580032:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329472 00000100:00100000:0.0:1651529344.580032:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.580040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.580043:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1123 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.580050:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329600 00010000:00010000:1.0:1651529344.580052:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 4/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1124 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580052:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.580057:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329856 00000100:00100000:0.0:1651529344.580057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.580059:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 5/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580063:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329664 00010000:00010000:1.0:1651529344.580065:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1126 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580065:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966644224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.580068:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329792 00010000:00010000:0.0:1651529344.580069:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580070:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1127 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580074:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329920 00010000:00010000:1.0:1651529344.580076:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580077:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11611 00000100:00100000:0.0:1651529344.580079:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1128:41279:x1731746396329472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.580081:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11612 00000100:00100000:1.0:1651529344.580082:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1128:41279:x1731746396329600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.580083:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.580084:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580087:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580088:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 4/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580088:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580092:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 3/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580098:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4e64919/0xa29a79078f3b9890 lrc: 0/0,0 mode: --/PR res: [0x2b522:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce050 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580101:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580102:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580103:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580106:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 4/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580117:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.580125:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f3e97b2/0xa29a79078f3b7861 lrc: 0/0,0 mode: --/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6f8 expref: 1128 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580137:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580138:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.580141:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1126:41279:x1731746396329600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.580143:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580144:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11612 00010000:00010000:0.0:1651529344.580147:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 4/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580149:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11613 00000100:00100000:1.0:1651529344.580151:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396329856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.580156:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.580159:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580161:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 5/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580164:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396329472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 84us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.580167:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 4/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1125 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580167:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11611 00010000:00010000:1.0:1651529344.580172:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580173:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580174:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580177:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 4/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580177:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11614 00000100:00100000:0.0:1651529344.580179:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1124:41278:x1731746396329664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.580181:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.580182:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.580184:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1124 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580187:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1124:41279:x1731746396329856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.580188:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 3/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1124 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580190:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11613 00010000:00010000:0.0:1651529344.580193:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c02f51cc/0xa29a79078f3b9fa5 lrc: 0/0,0 mode: --/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc81 expref: 1123 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580194:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11615 00000100:00100000:1.0:1651529344.580196:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1123:41278:x1731746396329792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.580197:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580198:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580199:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580203:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580204:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580205:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580207:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf4d3d3/0xa29a79078f3bb141 lrc: 0/0,0 mode: --/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4392 expref: 1122 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580208:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 4/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580213:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580214:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580215:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580217:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.580224:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 4/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580224:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1121:41278:x1731746396329664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.580227:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11614 00010000:00010000:1.0:1651529344.580233:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.580239:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1120:41278:x1731746396329792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.580240:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11616 00000100:00100000:1.0:1651529344.580242:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11615 00000100:00100000:0.0:1651529344.580242:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1120:41278:x1731746396329920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.580245:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.580247:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1119 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580249:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580251:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 3/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1119 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580252:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580256:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580256:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003224c988/0xa29a79078f3b960c lrc: 0/0,0 mode: --/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd671 expref: 1119 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580258:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580259:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580260:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580261:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580276:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 4/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580282:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.580288:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41278:x1731746396329920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.580291:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11616 00010000:00010000:0.0:1651529344.580299:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580302:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.580303:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946448320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1076us (1173us total) trans 30064893512 rc 0/0 00010000:00010000:0.0:1651529344.580303:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580306:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152649 00010000:00010000:0.0:1651529344.580306:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 3/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580310:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 1/0,0 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580313:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3bea3d lrc: 0/0,0 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580317:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b261c99e/0xa29a79078f3ba309 lrc: 0/0,0 mode: --/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a50 expref: 1117 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580319:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580322:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966644160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.580322:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580325:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580329:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580331:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580333:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580334:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580336:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580337:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580381:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946448512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1194us total) trans 30064893513 rc 0/0 00000100:00100000:0.0:1651529344.580384:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152652 00010000:00010000:0.0:1651529344.580391:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580394:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580395:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946448576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1055us (1199us total) trans 30064893514 rc 0/0 00000100:00100000:1.0:1651529344.580398:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152653 00010000:00010000:0.0:1651529344.580398:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580400:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580406:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580410:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580411:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580414:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 3/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580419:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 1/0,0 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580422:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3bea52 lrc: 0/0,0 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580426:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580429:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580430:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580432:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 3/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580435:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 1/0,0 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580438:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3bea59 lrc: 0/0,0 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580441:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580444:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580445:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580448:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 3/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580449:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+946:39030:x1731745946448640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1089us (1247us total) trans 30064893515 rc 0/0 00010000:00010000:1.0:1651529344.580451:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 1/0,0 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580452:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152654 00010000:00010000:1.0:1651529344.580453:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3bea60 lrc: 0/0,0 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580459:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580460:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580462:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580465:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580467:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580473:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580476:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580479:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580511:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+947:39029:x1731745946448448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1228us (1336us total) trans 30064893516 rc 0/0 00000100:00100000:0.0:1651529344.580518:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946448384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1287us (1380us total) trans 30064893517 rc 0/0 00000100:00100000:0.0:1651529344.580520:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152650 00000100:00100000:1.0:1651529344.580523:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152651 00010000:00010000:1.0:1651529344.580531:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580535:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580536:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580544:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 3/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580549:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 1/0,0 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580552:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3bea4b lrc: 0/0,0 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580556:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580558:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580559:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.580562:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 3/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580568:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 1/0,0 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.580571:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3bea44 lrc: 0/0,0 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580578:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329984 00010000:00010000:1.0:1651529344.580583:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 5/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1117 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580589:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330048 00010000:00010000:1.0:1651529344.580592:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 5/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1118 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580603:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11617 00000100:00100000:1.0:1651529344.580604:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41279:x1731746396329984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.580607:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580609:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 5/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1118 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580622:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 4/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1118 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.580630:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580633:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580634:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580635:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580635:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580638:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 4/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580642:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11618 00010000:00010000:1.0:1651529344.580643:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.580644:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41278:x1731746396330048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.580648:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.580649:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 4/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1118 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580656:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41279:x1731746396329984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.580659:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11617 00010000:00010000:1.0:1651529344.580670:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f684fc3c/0xa29a79078f3b8af9 lrc: 0/0,0 mode: --/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc24a expref: 1117 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.580674:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966644288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580677:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580681:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580683:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580685:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 3/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.580686:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580689:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580691:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a3a2b0/0xa29a79078f3ba682 lrc: 0/0,0 mode: --/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d194c expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580695:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580696:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580697:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580706:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 4/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580712:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.580720:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41278:x1731746396330048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.580723:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11618 00010000:00010000:0.0:1651529344.580741:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580745:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007274da18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.580746:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580749:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946448704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1366us (1541us total) trans 30064893518 rc 0/0 00010000:00010000:0.0:1651529344.580749:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 3/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580753:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152655 00010000:00010000:0.0:1651529344.580761:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 1/0,0 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580764:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3bea67 lrc: 0/0,0 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580770:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580787:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580799:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580826:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.580896:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580900:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.580901:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580904:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 3/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580909:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 1/0,0 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580912:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bea6e lrc: 0/0,0 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580922:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+946:39030:x1731745946448768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1485us (1510us total) trans 30064893519 rc 0/0 00000100:00100000:0.0:1651529344.580925:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152656 00000100:00100000:0.0:1651529344.580931:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449472 00000100:00100000:1.0:1651529344.580933:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449536 00000100:00100000:0.0:1651529344.580940:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449600 00000100:00100000:0.0:1651529344.580945:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449664 00000100:00100000:1.0:1651529344.580953:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449728 00000100:00100000:1.0:1651529344.580956:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449792 00000100:00100000:0.0:1651529344.580957:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152657 00000100:00100000:0.0:1651529344.580959:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946449472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.580960:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152658 00000100:00100000:1.0:1651529344.580962:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946449600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.580967:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177451 count 1 00010000:00010000:1.0:1651529344.580971:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.580973:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177449 count 1 00010000:00010000:1.0:1651529344.580976:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 2/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580977:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580979:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580980:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580980:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 4/0,1 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580982:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 2/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580985:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580986:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580987:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 3/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580987:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 4/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580991:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 4/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.580994:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 3/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.580995:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966644416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.580998:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 4/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581002:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.581004:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.581011:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152659 00000100:00100000:0.0:1651529344.581012:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.581013:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946449536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.581017:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177450 count 1 00000100:00100000:0.0:1651529344.581019:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152660 00010000:00010000:1.0:1651529344.581020:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581021:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946449664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.581025:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 2/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.581025:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177452 count 1 00010000:00010000:1.0:1651529344.581028:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581028:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581028:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581029:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 4/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581033:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 2/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1114 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.581035:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 3/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.581038:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 4/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581042:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966644544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581043:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581044:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581045:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 4/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581049:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.581052:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 3/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1114 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.581054:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152661 00000100:00100000:1.0:1651529344.581056:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946449728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.581056:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 4/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1114 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.581060:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177453 count 1 00000100:00100000:0.0:1651529344.581060:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966644608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581063:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581068:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 2/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.581068:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.581073:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581074:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581074:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 4/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581074:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152662 00000100:00100000:0.0:1651529344.581076:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946449792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.581080:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 3/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.581081:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177454 count 1 00010000:00010000:1.0:1651529344.581083:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581084:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581087:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966644672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581088:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 2/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.581091:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581091:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581092:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 4/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581093:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.581101:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 3/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.581104:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.581108:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966644736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.581114:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.581119:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449856 00000100:00100000:0.0:1651529344.581125:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152663 00000100:00100000:0.0:1651529344.581127:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+952:39030:x1731745946449856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.581131:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177455 count 1 00010000:00010000:0.0:1651529344.581134:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581138:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 2/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.581141:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581141:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581142:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 4/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581147:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 3/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.581153:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581157:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966644800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.581174:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.581273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.581283:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450048 00000100:00100000:1.0:1651529344.581294:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152664 00000100:00100000:1.0:1651529344.581296:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+953:39030:x1731745946450048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.581301:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177456 count 1 00010000:00010000:1.0:1651529344.581305:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581310:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 2/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.581313:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581313:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581314:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 4/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581321:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 3/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1114 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.581325:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581329:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966644864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.581340:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.581416:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966644416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581420:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581420:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581425:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581448:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966644544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581452:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581482:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966644608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581486:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581513:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966644736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.581516:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966644672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581516:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581521:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581524:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966644800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581527:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581728:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966644864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581739:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.581755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.581764:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330688 00010000:00010000:1.0:1651529344.581770:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 4/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1115 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581780:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330816 00000100:00100000:0.0:1651529344.581787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.581789:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 4/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1116 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581798:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.581799:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11619 00000100:00100000:1.0:1651529344.581801:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1116:41278:x1731746396330688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.581812:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.581816:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.581818:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 4/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581822:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 3/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581823:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.581828:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001be0b226/0xa29a79078f3bbddc lrc: 0/0,0 mode: --/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7468 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581828:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.581831:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581832:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581833:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.581836:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 4/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581840:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330944 00010000:00010000:0.0:1651529344.581846:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581853:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.581859:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330624 00010000:00010000:0.0:1651529344.581862:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 4/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1117 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581863:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1117:41278:x1731746396330688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.581866:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11619 00000100:00100000:0.0:1651529344.581866:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331072 00010000:00010000:0.0:1651529344.581868:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1118 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.581872:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330752 00010000:00010000:0.0:1651529344.581874:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 4/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1118 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581876:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330880 00000100:00100000:0.0:1651529344.581878:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331008 00010000:00010000:1.0:1651529344.581880:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1120 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581881:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1120 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.581886:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11620 00000100:00100000:1.0:1651529344.581887:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1120:41278:x1731746396330816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.581888:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11621 00000100:00100000:0.0:1651529344.581889:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1120:41278:x1731746396330944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.581890:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581891:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 4/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1120 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581892:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581894:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1120 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581895:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 3/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1120 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581898:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 3/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1120 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581900:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdcb13d2/0xa29a79078f3b95c6 lrc: 0/0,0 mode: --/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd552 expref: 1120 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581903:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581904:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581904:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000404e056d/0xa29a79078f3ba723 lrc: 0/0,0 mode: --/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c0f expref: 1119 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581905:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581907:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581908:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 4/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581908:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581909:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581912:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 4/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581919:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.581924:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.581932:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41278:x1731746396330944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.581933:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41278:x1731746396330816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581935:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11621 00000100:00100000:1.0:1651529344.581937:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11620 00000100:00100000:0.0:1651529344.581941:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11622 00000100:00100000:1.0:1651529344.581943:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11623 00000100:00100000:0.0:1651529344.581943:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1116:41279:x1731746396330624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.581945:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1116:41278:x1731746396331072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.581946:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581947:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581947:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 4/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581949:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581953:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 3/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581954:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 3/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581958:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5a4860/0xa29a79078f3bbbf2 lrc: 0/0,0 mode: --/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6da0 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581959:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc6444/0xa29a79078f3ba5b7 lrc: 0/0,0 mode: --/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1620 expref: 1116 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581961:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581962:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581962:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581962:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581963:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581963:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581965:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 4/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581967:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 4/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581971:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.581976:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.581982:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1114:41278:x1731746396331072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581984:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1114:41279:x1731746396330624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.581986:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11623 00000100:00100000:0.0:1651529344.581987:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11622 00000100:00100000:1.0:1651529344.581990:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11624 00000100:00100000:1.0:1651529344.581992:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1112:41279:x1731746396330752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.581992:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11625 00000100:00100000:0.0:1651529344.581993:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1112:41279:x1731746396330880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.581994:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581996:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 4/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.581996:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581997:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.581999:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 3/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.582001:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 3/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.582004:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002095b3de/0xa29a79078f3bc101 lrc: 0/0,0 mode: --/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8118 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.582005:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdb6947/0xa29a79078f3bc2ba lrc: 0/0,0 mode: --/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8834 expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.582008:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582008:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582009:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582009:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582009:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582010:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582012:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 4/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582013:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 4/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582017:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.582021:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.582026:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41279:x1731746396330880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.582028:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11625 00000100:00100000:1.0:1651529344.582029:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41279:x1731746396330752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.582032:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11624 00000100:00100000:0.0:1651529344.582034:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11626 00000100:00100000:0.0:1651529344.582035:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1108:41279:x1731746396331008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.582037:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.582039:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1108 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.582042:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582042:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 3/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1108 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.582046:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582047:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce71b2e0/0xa29a79078f3bb577 lrc: 0/0,0 mode: --/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54ef expref: 1108 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.582049:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582051:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582053:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582053:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582054:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582057:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 4/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582063:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.582067:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41279:x1731746396331008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.582070:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11626 00010000:00010000:0.0:1651529344.582079:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582083:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582086:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582089:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582099:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+954:39029:x1731745946449600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1241us total) trans 30064893520 rc 0/0 00000100:00100000:1.0:1651529344.582102:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152658 00010000:00010000:1.0:1651529344.582109:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582113:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582116:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582119:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582136:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+955:39030:x1731745946449792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1253us total) trans 30064893521 rc 0/0 00000100:00100000:0.0:1651529344.582139:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152662 00010000:00010000:0.0:1651529344.582147:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582150:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582153:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582156:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582157:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946449536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1143us (1306us total) trans 30064893522 rc 0/0 00000100:00100000:1.0:1651529344.582162:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152659 00010000:00010000:1.0:1651529344.582169:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582173:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582174:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582176:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 3/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582181:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 1/0,0 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582184:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3bea75 lrc: 0/0,0 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582187:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946449664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1166us (1320us total) trans 30064893523 rc 0/0 00010000:00010000:1.0:1651529344.582188:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582190:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152660 00010000:00010000:1.0:1651529344.582191:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582192:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582195:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 3/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582197:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582200:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582203:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582205:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582209:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 1/0,0 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582212:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bea98 lrc: 0/0,0 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582216:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582218:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582219:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582222:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 3/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582225:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 1/0,0 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582227:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3bea83 lrc: 0/0,0 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582231:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582233:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.582234:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946449856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1106us (1127us total) trans 30064893524 rc 0/0 00000100:00100000:0.0:1651529344.582237:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152663 00010000:00010000:1.0:1651529344.582239:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582242:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 3/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582243:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582246:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 1/0,0 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582247:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582248:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bea8a lrc: 0/0,0 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582248:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582251:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 3/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582255:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582255:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 1/0,0 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582258:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582258:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bea9f lrc: 0/0,0 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582261:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582263:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582264:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582267:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582270:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582272:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582308:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946449728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1251us (1432us total) trans 30064893525 rc 0/0 00000100:00100000:1.0:1651529344.582311:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152661 00000100:00100000:0.0:1651529344.582313:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946449472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1353us (1469us total) trans 30064893526 rc 0/0 00000100:00100000:0.0:1651529344.582317:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152657 00010000:00010000:1.0:1651529344.582318:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582330:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582331:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582334:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 3/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582339:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 1/0,0 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582342:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3bea91 lrc: 0/0,0 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582346:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582349:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.582350:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582352:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 3/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582355:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 1/0,0 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582383:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bea7c lrc: 0/0,0 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582410:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582419:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582422:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582424:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582451:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582455:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.582456:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582459:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 3/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582464:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 1/0,0 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582470:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946450048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1173us (1197us total) trans 30064893527 rc 0/0 00000100:00100000:1.0:1651529344.582473:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152664 00010000:00010000:0.0:1651529344.582473:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beaa6 lrc: 0/0,0 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.582638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.582648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582648:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450560 00000100:00100000:1.0:1651529344.582655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.582663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582663:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450688 00000100:00100000:0.0:1651529344.582667:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450624 00000100:00100000:1.0:1651529344.582669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582681:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450816 00000100:00100000:0.0:1651529344.582685:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450752 00000100:00100000:1.0:1651529344.582686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582689:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450880 00000100:00100000:0.0:1651529344.582691:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450944 00000100:00100000:1.0:1651529344.582694:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152665 00000100:00100000:1.0:1651529344.582696:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb97afa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946450560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.582696:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152666 00000100:00100000:0.0:1651529344.582698:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946450688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.582702:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177457 count 1 00010000:00010000:1.0:1651529344.582706:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582711:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 2/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582714:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582715:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582716:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 4/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582723:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 3/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.582726:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177459 count 1 00010000:00010000:0.0:1651529344.582739:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582744:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 2/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582746:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.582747:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582748:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582748:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 4/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582751:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966644928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582756:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582760:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.582763:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582764:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582769:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152667 00000100:00100000:1.0:1651529344.582770:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946450624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.582774:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.582775:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177458 count 1 00010000:00010000:1.0:1651529344.582779:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582781:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152668 00000100:00100000:0.0:1651529344.582783:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946450816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.582786:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 2/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.582788:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177461 count 1 00010000:00010000:1.0:1651529344.582789:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582789:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582790:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 4/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582792:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582796:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 3/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582798:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 2/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582800:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 4/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.582801:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582802:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582822:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 4/0,1 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582824:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966645056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582830:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 3/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.582832:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.582834:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 4/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.582838:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152669 00000100:00100000:0.0:1651529344.582838:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966645120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582840:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946450752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.582845:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177460 count 1 00000100:00100000:0.0:1651529344.582845:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.582848:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582852:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 2/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.582852:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152670 00000100:00100000:0.0:1651529344.582854:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946450880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.582855:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.582858:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177462 count 1 00010000:00010000:0.0:1651529344.582862:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582864:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582865:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 4/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582866:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 2/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582869:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582870:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582870:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 4/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582872:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 3/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582876:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 4/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.582877:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 3/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.582880:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966645184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582881:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.582885:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966645248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582887:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582891:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.582894:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152671 00000100:00100000:1.0:1651529344.582896:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+960:39030:x1731745946450944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.582900:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177463 count 1 00010000:00010000:1.0:1651529344.582903:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.582908:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 2/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582911:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582911:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582912:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 4/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582918:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 3/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582924:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 4/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.582928:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966645312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582934:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582955:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451008 00000100:00100000:0.0:1651529344.582963:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152672 00000100:00100000:0.0:1651529344.582980:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+961:39029:x1731745946451008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.582985:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177464 count 1 00010000:00010000:0.0:1651529344.582989:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582994:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 2/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582997:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582997:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582998:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 4/0,1 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583005:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 3/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1106 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583009:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 4/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.583013:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966645376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.583040:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.583142:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966644928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.583147:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583161:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966644992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583166:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583424:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966645120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.583442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583461:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583470:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966645248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583473:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.583485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.583487:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331776 00000100:00100000:1.0:1651529344.583493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583493:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1107 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.583498:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331904 00000100:00100000:1.0:1651529344.583499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583501:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 5/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1108 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.583507:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332032 00000100:00100000:1.0:1651529344.583509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583510:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 5/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1109 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.583514:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331840 00010000:00010000:0.0:1651529344.583515:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1110 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.583519:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332160 00010000:00010000:0.0:1651529344.583521:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 5/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1111 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583522:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966645056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.583525:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331968 00010000:00010000:1.0:1651529344.583526:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583527:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 4/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1112 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.583531:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332096 00010000:00010000:0.0:1651529344.583533:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1113 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583534:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966645184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.583536:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583536:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332224 00010000:00010000:0.0:1651529344.583538:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 5/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.583543:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11627 00000100:00100000:0.0:1651529344.583544:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1114:41279:x1731746396331776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.583545:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966645312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.583548:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583548:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583550:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583553:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 3/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583555:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11628 00000100:00100000:1.0:1651529344.583557:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1114:41279:x1731746396331904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.583559:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a94d1423/0xa29a79078f3baab8 lrc: 0/0,0 mode: --/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2967 expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.583560:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583561:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 4/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1114 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583563:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583563:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583564:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583565:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 3/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1113 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583567:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 4/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583571:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43bc9cf/0xa29a79078f3b9c02 lrc: 0/0,0 mode: --/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedfc expref: 1113 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583578:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.583581:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583582:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583583:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583586:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 4/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583587:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1112:41279:x1731746396331776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.583590:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11627 00010000:00010000:1.0:1651529344.583593:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.583596:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11629 00000100:00100000:0.0:1651529344.583597:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1111:41279:x1731746396332032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.583600:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1111:41279:x1731746396331904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.583600:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583602:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 4/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1111 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583603:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11628 00010000:00010000:0.0:1651529344.583608:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 3/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1110 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583609:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11630 00000100:00100000:1.0:1651529344.583611:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41278:x1731746396331840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.583613:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583613:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3bb0a0 lrc: 0/0,0 mode: --/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4146 expref: 1110 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.583615:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1110 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583616:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583617:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583618:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583619:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1109 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583621:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 4/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583624:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000417b5570/0xa29a79078f3ba5b0 lrc: 0/0,0 mode: --/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1604 expref: 1109 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583629:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.583634:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583634:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583635:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583635:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1108:41279:x1731746396332032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.583637:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11629 00010000:00010000:1.0:1651529344.583638:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 4/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583642:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11631 00000100:00100000:0.0:1651529344.583643:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41279:x1731746396332160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.583647:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.583652:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.583653:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41278:x1731746396331840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.583654:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 4/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1107 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583656:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11630 00010000:00010000:0.0:1651529344.583658:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 3/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1107 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583661:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11632 00000100:00100000:1.0:1651529344.583662:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1106:41278:x1731746396331968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.583663:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea78728/0xa29a79078f3badeb lrc: 0/0,0 mode: --/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3679 expref: 1106 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.583665:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583666:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 4/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1105 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583666:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583667:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583668:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583670:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 3/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1105 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583670:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 4/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583675:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7498/0xa29a79078f3baf81 lrc: 0/0,0 mode: --/PR res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c7d expref: 1105 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583679:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.583685:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583685:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.583685:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1104:41279:x1731746396332160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.583686:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583688:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11631 00010000:00010000:1.0:1651529344.583689:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 4/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583692:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11633 00000100:00100000:0.0:1651529344.583694:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1103:41278:x1731746396332096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.583697:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.583702:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.583703:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1103:41278:x1731746396331968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.583704:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1103 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583706:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11632 00010000:00010000:0.0:1651529344.583708:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 3/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1103 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.583710:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11634 00000100:00100000:1.0:1651529344.583712:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41278:x1731746396332224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.583712:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622a5d7f/0xa29a79078f3bbaa2 lrc: 0/0,0 mode: --/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d680c expref: 1102 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.583714:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583716:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 5/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1102 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583718:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583719:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583720:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 4/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1101 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.583720:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583722:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 4/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583724:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583725:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583726:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583728:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.583729:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 4/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583741:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.583743:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1101:41278:x1731746396332096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.583746:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11633 00000100:00100000:1.0:1651529344.583747:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1101:41278:x1731746396332224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583750:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11634 00010000:00010000:1.0:1651529344.583757:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583761:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583762:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efdaa30/0xa29a79078f3bbae1 lrc: 0/0,0 mode: --/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68bb expref: 1099 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.583764:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583766:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583766:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966645376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583770:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583773:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583776:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583779:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583782:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583829:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb97afa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+963:39030:x1731745946450560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1132us (1216us total) trans 30064893528 rc 0/0 00000100:00100000:1.0:1651529344.583833:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152665 00010000:00010000:1.0:1651529344.583854:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583858:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.583859:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583860:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+962:39029:x1731745946451008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 880us (952us total) trans 30064893529 rc 0/0 00010000:00010000:1.0:1651529344.583862:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 3/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583863:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152672 00010000:00010000:1.0:1651529344.583867:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 1/0,0 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583869:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beaad lrc: 0/0,0 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583871:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583875:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.583876:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583878:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583879:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 3/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583881:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583884:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583884:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 1/0,0 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583887:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3beade lrc: 0/0,0 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583893:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583896:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583896:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583899:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583902:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583940:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+963:39030:x1731745946450944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1044us (1254us total) trans 30064893530 rc 0/0 00000100:00100000:0.0:1651529344.583942:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+963:39029:x1731745946450880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1272us total) trans 30064893531 rc 0/0 00000100:00100000:1.0:1651529344.583944:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152671 00000100:00100000:0.0:1651529344.583945:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152670 00010000:00010000:1.0:1651529344.583951:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583953:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583955:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.583956:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583956:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583958:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 3/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583959:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583962:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583963:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 1/0,0 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583966:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3bead7 lrc: 0/0,0 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583970:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583973:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.583974:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583977:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 3/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583980:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 1/0,0 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583982:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bead0 lrc: 0/0,0 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583986:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583988:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.583989:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583992:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 3/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583992:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+962:39030:x1731745946450816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1209us (1337us total) trans 30064893532 rc 0/0 00010000:00010000:1.0:1651529344.583995:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 1/0,0 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583995:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152668 00010000:00010000:1.0:1651529344.583997:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3beac2 lrc: 0/0,0 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584002:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584008:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584011:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584013:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584015:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584018:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584021:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584023:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584043:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+963:39030:x1731745946450688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1345us (1406us total) trans 30064893533 rc 0/0 00000100:00100000:0.0:1651529344.584046:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152666 00010000:00010000:0.0:1651529344.584052:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584055:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.584056:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584059:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 3/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584061:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+962:39029:x1731745946450752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1219us (1397us total) trans 30064893534 rc 0/0 00000100:00100000:1.0:1651529344.584063:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152669 00010000:00010000:0.0:1651529344.584064:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 1/0,0 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584066:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3beab4 lrc: 0/0,0 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584070:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584071:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584073:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.584074:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584074:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584077:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584077:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 3/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584079:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584080:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 1/0,0 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584083:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3beac9 lrc: 0/0,0 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584086:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584089:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.584090:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584092:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 3/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584098:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 1/0,0 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584100:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3beabb lrc: 0/0,0 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584110:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+962:39029:x1731745946450624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1462us total) trans 30064893535 rc 0/0 00000100:00100000:1.0:1651529344.584113:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152667 00000100:00100000:1.0:1651529344.584357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.584380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.584388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.584398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584399:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451648 00000100:00100000:1.0:1651529344.584407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.584420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584420:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451776 00000100:00100000:0.0:1651529344.584433:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451904 00000100:00100000:1.0:1651529344.584435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584443:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451712 00000100:00100000:1.0:1651529344.584446:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584447:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452032 00000100:00100000:0.0:1651529344.584450:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451840 00000100:00100000:1.0:1651529344.584452:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451968 00000100:00100000:0.0:1651529344.584452:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452096 00000100:00100000:0.0:1651529344.584455:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152673 00000100:00100000:0.0:1651529344.584457:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946451648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.584459:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152674 00000100:00100000:1.0:1651529344.584461:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946451776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.584462:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177465 count 1 00002000:00080000:1.0:1651529344.584466:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177467 count 1 00010000:00010000:0.0:1651529344.584467:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584471:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584472:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 2/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1098 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584475:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584475:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584476:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 2/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584476:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 4/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584479:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584480:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584481:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 4/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584483:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 3/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1098 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584487:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 3/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584487:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1098 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.584491:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966645440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.584500:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.584503:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.584505:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966645504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.584509:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152675 00000100:00100000:0.0:1651529344.584511:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946451904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.584514:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.584515:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177469 count 1 00010000:00010000:0.0:1651529344.584519:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584521:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152676 00000100:00100000:1.0:1651529344.584523:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946451712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.584523:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 2/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1098 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584526:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.584527:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177466 count 1 00010000:00010000:0.0:1651529344.584527:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584527:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 4/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584531:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584533:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 3/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1098 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584535:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 2/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584537:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1098 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.584538:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584539:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584539:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 4/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584544:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966645568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.584546:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 3/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584549:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.584551:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.584557:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152677 00000100:00100000:0.0:1651529344.584558:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946452032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.584562:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177471 count 1 00000100:00100000:1.0:1651529344.584564:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966645632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584565:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584569:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 2/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.584572:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.584572:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584573:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584573:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 4/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584578:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152678 00010000:00010000:0.0:1651529344.584579:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.584580:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946451840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.584583:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.584585:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177468 count 1 00000100:00100000:0.0:1651529344.584587:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966645696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.584588:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584592:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 2/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.584593:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.584595:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584596:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584596:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 4/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584598:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152679 00000100:00100000:0.0:1651529344.584600:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946452096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.584603:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 3/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.584604:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177472 count 1 00010000:00010000:1.0:1651529344.584606:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.584607:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584610:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966645760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584611:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 2/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584614:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584614:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584615:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 4/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584616:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.584620:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1098 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.584622:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152680 00000100:00100000:1.0:1651529344.584624:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946451968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.584624:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.584628:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177470 count 1 00000100:00100000:0.0:1651529344.584628:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966645824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.584631:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584634:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.584635:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 2/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1098 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584638:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584638:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584639:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 4/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584645:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 3/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1098 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584649:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1098 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.584653:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966645888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.584659:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.585025:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966645440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585035:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.585049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.585058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.585067:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966645568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.585070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.585071:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.585079:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966645696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585081:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585107:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332800 00000100:00100000:1.0:1651529344.585108:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966645504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585113:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1099 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585114:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585119:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332928 00010000:00010000:0.0:1651529344.585121:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1100 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.585122:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966645632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.585124:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585125:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332864 00010000:00010000:0.0:1651529344.585127:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1101 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.585131:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332992 00000100:00100000:0.0:1651529344.585132:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333056 00010000:00010000:0.0:1651529344.585133:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1103 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585136:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1103 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585138:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11635 00000100:00100000:0.0:1651529344.585140:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1103:41279:x1731746396332800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.585143:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11636 00000100:00100000:1.0:1651529344.585144:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1103:41279:x1731746396332928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.585147:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.585149:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1103 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585153:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 3/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1103 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585154:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.585156:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1103 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585158:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a42d302/0xa29a79078f3b9701 lrc: 0/0,0 mode: --/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9b9 expref: 1103 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585163:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585163:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585163:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 3/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1102 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585164:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585168:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3b936c lrc: 0/0,0 mode: --/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb73 expref: 1102 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585172:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585173:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585174:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585177:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 4/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585177:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 4/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585185:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.585195:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1101:41279:x1731746396332928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.585198:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11636 00010000:00010000:0.0:1651529344.585198:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.585203:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11637 00000100:00100000:1.0:1651529344.585205:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41279:x1731746396332864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.585207:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41279:x1731746396332800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.585208:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.585209:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1100 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585210:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11635 00010000:00010000:1.0:1651529344.585213:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 3/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1099 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585215:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11638 00000100:00100000:0.0:1651529344.585217:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1099:41278:x1731746396333056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.585218:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6b88d7/0xa29a79078f3baef5 lrc: 0/0,0 mode: --/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a31 expref: 1099 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585220:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.585221:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1099 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585222:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585223:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585223:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585225:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585226:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 4/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585230:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3b9f2e lrc: 0/0,0 mode: --/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaf9 expref: 1098 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585234:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585234:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585235:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585238:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 4/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585240:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.585245:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.585246:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1097:41279:x1731746396332864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.585249:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11637 00000100:00100000:0.0:1651529344.585250:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1097:41278:x1731746396333056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.585252:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11638 00000100:00100000:1.0:1651529344.585254:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11639 00000100:00100000:1.0:1651529344.585256:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1095:41279:x1731746396332992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.585258:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.585260:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585262:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966645824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.585263:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 3/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585265:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585268:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002447ebb9/0xa29a79078f3bbacc lrc: 0/0,0 mode: --/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d687c expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585271:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585272:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585272:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585273:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585276:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 4/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585282:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.585286:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1094:41279:x1731746396332992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (216us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.585287:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585289:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11639 00010000:00010000:0.0:1651529344.585291:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585294:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585299:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966645760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.585303:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585308:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585311:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585314:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585317:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585348:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+971:39029:x1731745946452032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 788us (940us total) trans 30064893536 rc 0/0 00000100:00100000:0.0:1651529344.585351:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152677 00010000:00010000:0.0:1651529344.585359:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585363:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.585364:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585367:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 3/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585368:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+970:39030:x1731745946451712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 844us (969us total) trans 30064893537 rc 0/0 00000100:00100000:1.0:1651529344.585371:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152676 00010000:00010000:0.0:1651529344.585372:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 1/0,0 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585374:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3beb01 lrc: 0/0,0 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585378:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585380:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585382:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b010eb0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.585383:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585383:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585387:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585388:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 3/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585390:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585393:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 1/0,0 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585395:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b010eb0/0xa29a79078f3beafa lrc: 0/0,0 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585407:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585410:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.585411:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585414:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 3/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585417:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 1/0,0 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585420:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beaf3 lrc: 0/0,0 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585426:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585429:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585429:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+970:39029:x1731745946451904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 917us (1040us total) trans 30064893538 rc 0/0 00010000:00010000:1.0:1651529344.585432:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585432:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152675 00010000:00010000:1.0:1651529344.585435:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585439:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585449:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585452:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585455:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585483:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+971:39029:x1731745946451776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1021us (1108us total) trans 30064893539 rc 0/0 00000100:00100000:1.0:1651529344.585486:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152674 00010000:00010000:1.0:1651529344.585493:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585493:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+970:39029:x1731745946451648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1035us (1142us total) trans 30064893540 rc 0/0 00010000:00010000:1.0:1651529344.585496:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008290e4b2 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.585496:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152673 00010000:00010000:1.0:1651529344.585497:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585500:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 3/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585503:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585504:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 1/0,0 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585507:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008290e4b2/0xa29a79078f3beaec lrc: 0/0,0 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585509:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011187589 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.585510:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585513:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 3/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585517:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 1/0,0 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585520:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3beae5 lrc: 0/0,0 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.585586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.585602:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333120 00010000:00010000:0.0:1651529344.585613:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1094 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.585616:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333184 00000100:00100000:0.0:1651529344.585624:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11640 00000100:00100000:0.0:1651529344.585626:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1095:41278:x1731746396333120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.585627:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.585629:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.585631:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.585638:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11641 00000100:00100000:1.0:1651529344.585640:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1095:41278:x1731746396333184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.585640:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 3/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585644:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.585645:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585649:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585655:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f507b605/0xa29a79078f3ba395 lrc: 0/0,0 mode: --/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c5d expref: 1095 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585658:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585659:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585660:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585662:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03271f0/0xa29a79078f3bbc1c lrc: 0/0,0 mode: --/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6df4 expref: 1094 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585663:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 4/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585666:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585667:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585668:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585671:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.585677:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 4/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585686:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.585694:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41278:x1731746396333120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.585695:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41278:x1731746396333184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.585697:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11640 00000100:00100000:1.0:1651529344.585699:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11641 00010000:00010000:0.0:1651529344.585708:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585709:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585711:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585712:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585714:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585715:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585717:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585718:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585773:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+971:39030:x1731745946451840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1357us total) trans 30064893542 rc 0/0 00000100:00100000:1.0:1651529344.585776:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152678 00010000:00010000:1.0:1651529344.585784:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585787:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e794ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.585788:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585790:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+970:39030:x1731745946452096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1323us total) trans 30064893541 rc 0/0 00010000:00010000:1.0:1651529344.585791:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 3/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585794:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152679 00010000:00010000:1.0:1651529344.585798:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 1/0,0 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585801:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e794ee/0xa29a79078f3beb08 lrc: 0/0,0 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585823:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585830:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.585831:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585834:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 3/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585838:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 1/0,0 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585840:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3beb0f lrc: 0/0,0 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.585861:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966645888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.585865:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.585875:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333248 00010000:00010000:1.0:1651529344.585879:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1092 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.585899:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11642 00000100:00100000:1.0:1651529344.585901:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1092:41278:x1731746396333248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.585904:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.585907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.585911:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1092 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.585915:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 3/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1092 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.585923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.585925:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffddb00/0xa29a79078f3b77b2 lrc: 0/0,0 mode: --/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb42e expref: 1092 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585929:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.585929:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452736 00010000:00010000:1.0:1651529344.585930:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585931:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585933:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 4/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585938:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452672 00000100:00100000:0.0:1651529344.585942:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452864 00010000:00010000:1.0:1651529344.585944:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.585945:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452800 00000100:00100000:0.0:1651529344.585948:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452928 00000100:00100000:0.0:1651529344.585952:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152681 00000100:00100000:1.0:1651529344.585956:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1091:41278:x1731746396333248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.585959:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+974:39030:x1731745946452736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.585965:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177474 count 1 00000100:00100000:1.0:1651529344.585966:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11642 00010000:00010000:0.0:1651529344.585970:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585974:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 2/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1090 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.585975:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152682 00000100:00100000:1.0:1651529344.585977:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+974:39029:x1731745946452672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.585978:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585978:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585979:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 4/0,1 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.585982:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177473 count 1 00010000:00010000:1.0:1651529344.585986:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585988:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 3/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1090 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585990:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 2/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585992:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 4/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1090 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.585993:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585994:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585995:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 4/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585996:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966645952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586001:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.586005:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1090 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586005:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.586009:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586012:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152683 00000100:00100000:0.0:1651529344.586013:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+974:39030:x1731745946452864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.586018:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.586018:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177476 count 1 00010000:00010000:0.0:1651529344.586021:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586024:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152684 00010000:00010000:0.0:1651529344.586025:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 2/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.586026:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+974:39029:x1731745946452800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.586028:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586029:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586029:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 4/0,1 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.586030:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177475 count 1 00010000:00010000:0.0:1651529344.586035:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 3/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.586041:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586046:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 2/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.586049:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586049:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586050:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 4/0,1 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586055:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 4/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1090 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586057:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 3/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.586060:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 4/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.586064:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586069:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966646080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.586071:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.586076:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586078:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.586079:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586082:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586085:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586085:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152685 00000100:00100000:0.0:1651529344.586087:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+974:39029:x1731745946452928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.586092:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177477 count 1 00010000:00010000:0.0:1651529344.586096:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586107:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 2/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586110:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586111:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586112:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 4/0,1 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586118:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 3/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586122:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 4/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586125:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966646208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.586134:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+975:39030:x1731745946451968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1509us (1699us total) trans 30064893543 rc 0/0 00000100:00100000:0.0:1651529344.586134:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.586137:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152680 00010000:00010000:0.0:1651529344.586141:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586152:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba99f88c already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.586154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.586154:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586157:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 3/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586162:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 1/0,0 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586165:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99f88c/0xa29a79078f3beb16 lrc: 0/0,0 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.586173:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452992 00000100:00100000:0.0:1651529344.586180:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453056 00000100:00100000:0.0:1651529344.586184:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152686 00000100:00100000:0.0:1651529344.586186:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+976:39030:x1731745946452992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.586190:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177478 count 1 00010000:00010000:0.0:1651529344.586193:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586198:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 2/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586201:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586201:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586208:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 4/0,1 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586215:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 3/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586219:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 4/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1090 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586223:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586231:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.586254:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152687 00000100:00100000:0.0:1651529344.586256:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+976:39029:x1731745946453056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.586261:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177479 count 1 00010000:00010000:0.0:1651529344.586265:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586269:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 2/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586272:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586273:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586274:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 4/0,1 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586280:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 3/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1090 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586294:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 4/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586299:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966646336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586329:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.586342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.586363:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453120 00000100:00100000:0.0:1651529344.586370:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152688 00000100:00100000:0.0:1651529344.586372:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946453120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.586377:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177480 count 1 00010000:00010000:0.0:1651529344.586381:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586386:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 2/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586389:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586390:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586390:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 4/0,1 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586397:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 3/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1090 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.586400:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 4/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1090 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586407:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966646400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586431:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.586520:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586525:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586544:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586547:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586564:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333888 00010000:00010000:1.0:1651529344.586569:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1091 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586569:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966645952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.586574:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586580:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333824 00010000:00010000:1.0:1651529344.586583:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 4/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1092 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586587:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333952 00000100:00100000:1.0:1651529344.586588:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11643 00000100:00100000:1.0:1651529344.586589:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41278:x1731746396333888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.586592:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 4/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1093 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586598:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11644 00000100:00100000:0.0:1651529344.586600:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41278:x1731746396333824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.586601:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586602:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1093 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586603:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.586605:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 4/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1093 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586606:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1093 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586608:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 3/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1093 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586612:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2d42b0/0xa29a79078f3baa41 lrc: 0/0,0 mode: --/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d278b expref: 1093 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586614:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e9044b6/0xa29a79078f3b928c lrc: 0/0,0 mode: --/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc808 expref: 1093 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586616:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586617:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586617:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586620:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586621:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 4/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586627:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.586638:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586640:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586643:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 4/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586647:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1091:41278:x1731746396333888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.586650:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11643 00000100:00100000:1.0:1651529344.586655:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11645 00000100:00100000:1.0:1651529344.586657:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1090:41278:x1731746396333952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.586660:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586661:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 4/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586674:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.586675:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 3/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586680:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110e4e5d/0xa29a79078f3b93a4 lrc: 0/0,0 mode: --/PR res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc7d expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586684:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586685:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586685:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586688:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 4/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586693:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1089:41278:x1731746396333824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 92us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.586694:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.586696:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11644 00000100:00100000:1.0:1651529344.586701:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1088:41278:x1731746396333952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.586703:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11645 00000100:00100000:0.0:1651529344.586708:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966646080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586711:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586712:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586714:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586717:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586717:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586720:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586722:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586723:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586726:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586786:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946452736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 831us (936us total) trans 30064893544 rc 0/0 00000100:00100000:1.0:1651529344.586790:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+979:39029:x1731745946452800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 762us (875us total) trans 30064893545 rc 0/0 00000100:00100000:1.0:1651529344.586793:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152684 00010000:00010000:1.0:1651529344.586801:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586815:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152681 00010000:00010000:1.0:1651529344.586822:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba6022c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.586823:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586826:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 3/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586831:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 1/0,0 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586834:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6022c6/0xa29a79078f3beb32 lrc: 0/0,0 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586838:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586848:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.586849:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586852:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 3/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586856:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 1/0,0 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586858:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3beb1d lrc: 0/0,0 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586866:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586868:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586877:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586879:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.586930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.586937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586939:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+978:39029:x1731745946452672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1054us total) trans 30064893546 rc 0/0 00000100:00100000:1.0:1651529344.586942:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152682 00000100:00100000:1.0:1651529344.586950:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334016 00000100:00100000:0.0:1651529344.586959:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966646208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586963:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 4/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1088 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586964:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586969:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334080 00000100:00100000:0.0:1651529344.586971:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334208 00010000:00010000:1.0:1651529344.586972:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 4/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.586976:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 5/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1090 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.586977:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334144 00010000:00010000:1.0:1651529344.586979:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 5/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1091 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.586981:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334272 00000100:00100000:1.0:1651529344.586984:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11646 00010000:00010000:0.0:1651529344.586984:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 5/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1092 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.586986:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1092:41279:x1731746396334016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.586988:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.586989:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11647 00010000:00010000:1.0:1651529344.586990:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 4/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1092 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586993:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 3/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1092 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.586999:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3ba483 lrc: 0/0,0 mode: --/PR res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1062 expref: 1092 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.587002:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587003:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587004:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587006:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1091:41278:x1731746396334080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.587010:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.587012:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 4/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1091 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.587018:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 4/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587018:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 3/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1091 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587024:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3b971d lrc: 0/0,0 mode: --/PR res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda92 expref: 1091 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.587027:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.587035:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.587037:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1090:41279:x1731746396334016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.587040:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11646 00010000:00010000:0.0:1651529344.587040:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587040:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587044:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 4/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587046:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11648 00000100:00100000:1.0:1651529344.587047:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1089:41279:x1731746396334208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.587050:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.587050:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.587052:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 5/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1089 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.587055:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 4/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1089 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587057:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1089:41278:x1731746396334080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.587060:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.587060:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11647 00010000:00010000:1.0:1651529344.587061:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587062:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587065:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 4/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587069:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.587070:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11649 00000100:00100000:0.0:1651529344.587072:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1088:41278:x1731746396334144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.587073:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1088:41279:x1731746396334208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.587074:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.587076:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11648 00010000:00010000:0.0:1651529344.587076:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 5/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1088 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587080:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11650 00010000:00010000:0.0:1651529344.587080:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 4/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1087 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587082:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41278:x1731746396334272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.587084:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.587085:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 5/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1087 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587085:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587086:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587087:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587089:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 4/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1087 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587090:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 4/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587093:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587094:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587094:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587094:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.587097:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 4/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587098:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41278:x1731746396334144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.587101:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.587101:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11649 00000100:00100000:1.0:1651529344.587105:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1086:41278:x1731746396334272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.587108:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11650 00010000:00010000:0.0:1651529344.587127:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5120b22/0xa29a79078f3ba604 lrc: 0/0,0 mode: --/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1754 expref: 1085 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587131:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587135:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587138:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.587141:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587144:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587153:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587179:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587193:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e225128c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.587194:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587197:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 3/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587201:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946452992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1014us (1047us total) trans 30064893547 rc 0/0 00000100:00100000:0.0:1651529344.587204:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152686 00010000:00010000:1.0:1651529344.587207:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 1/0,0 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587209:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e225128c/0xa29a79078f3beb24 lrc: 0/0,0 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587209:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453312 00010000:00010000:1.0:1651529344.587214:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587217:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000782d46a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.587217:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587220:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 3/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587223:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 1/0,0 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587229:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782d46a5/0xa29a79078f3beb40 lrc: 0/0,0 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587236:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453248 00000100:00100000:0.0:1651529344.587247:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152689 00000100:00100000:0.0:1651529344.587249:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946453248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.587251:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152690 00000100:00100000:1.0:1651529344.587252:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+979:39029:x1731745946453312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.587254:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177481 count 1 00002000:00080000:1.0:1651529344.587258:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177482 count 1 00010000:00010000:0.0:1651529344.587258:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587262:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587263:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 2/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1084 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587266:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 2/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1084 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587266:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587267:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587267:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 4/0,1 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587269:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587270:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587271:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 4/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587274:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 3/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1084 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587278:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 3/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1084 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587278:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 4/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1084 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.587281:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1084 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587285:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587286:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587295:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.587297:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.587304:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f004a70d/0xa29a79078f3b94d8 lrc: 0/0,0 mode: --/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0c8 expref: 1084 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587308:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966646336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587311:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.587315:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587317:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587320:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587323:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587369:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+980:39029:x1731745946453056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1201us total) trans 30064893548 rc 0/0 00000100:00100000:0.0:1651529344.587372:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152687 00010000:00010000:1.0:1651529344.587374:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587378:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebafc874 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.587378:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453568 00010000:00010000:1.0:1651529344.587379:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587382:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 3/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587386:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152691 00000100:00100000:0.0:1651529344.587388:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+980:39029:x1731745946453568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.587392:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177483 count 1 00010000:00010000:0.0:1651529344.587396:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587397:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 1/0,0 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587400:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebafc874/0xa29a79078f3beb47 lrc: 0/0,0 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587401:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 2/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1083 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587404:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587404:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587405:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 4/0,1 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587411:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 3/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1083 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587415:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 4/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1083 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587419:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966646592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587431:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.587439:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f126a755/0xa29a79078f3ba3d4 lrc: 0/0,0 mode: --/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d3d expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587444:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966646400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587447:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587475:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587479:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.587482:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587485:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587500:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453888 00000100:00100000:1.0:1651529344.587508:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152692 00000100:00100000:1.0:1651529344.587509:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+981:39030:x1731745946453888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.587514:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177484 count 1 00010000:00010000:1.0:1651529344.587524:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587529:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 2/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1082 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587542:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587543:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587544:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 4/0,1 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587551:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 3/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1082 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587562:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 4/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1082 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587566:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587576:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.587579:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+982:39030:x1731745946453120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1205us (1237us total) trans 30064893549 rc 0/0 00010000:00010000:1.0:1651529344.587581:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587582:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152688 00010000:00010000:1.0:1651529344.587584:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007274da18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.587585:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587588:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 3/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587590:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587593:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 1/0,0 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587593:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587596:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587598:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007274da18/0xa29a79078f3beb4e lrc: 0/0,0 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587598:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587635:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+982:39030:x1731745946452864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1621us (1728us total) trans 30064893550 rc 0/0 00000100:00100000:0.0:1651529344.587638:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152683 00010000:00010000:0.0:1651529344.587645:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.587649:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.587650:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587661:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 3/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587670:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 1/0,0 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587673:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3beb2b lrc: 0/0,0 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587681:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453952 00000100:00100000:0.0:1651529344.587687:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152693 00000100:00100000:0.0:1651529344.587689:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+982:39030:x1731745946453952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.587693:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646528:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.587694:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177485 count 1 00010000:00010000:1.0:1651529344.587697:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587697:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587704:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 2/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1082 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587707:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587708:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587708:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 4/0,1 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587715:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 3/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1082 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587718:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 4/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1082 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587722:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966646720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587744:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.587751:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587754:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587757:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587760:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587780:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587784:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acd0e753 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.587785:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587788:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 3/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587793:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 1/0,0 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587796:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0e753/0xa29a79078f3beb39 lrc: 0/0,0 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.587848:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+983:39029:x1731745946452928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1760us (1925us total) trans 30064893551 rc 0/0 00000100:00100000:1.0:1651529344.587852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587852:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152685 00000100:00100000:0.0:1651529344.587876:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334464 00010000:00010000:0.0:1651529344.587882:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587893:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11651 00000100:00100000:0.0:1651529344.587895:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.587898:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.587899:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587903:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 3/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587909:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.587909:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acaf7d83/0xa29a79078f3ba78c lrc: 0/0,0 mode: --/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dd6 expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587913:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587913:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587914:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587917:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 4/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587926:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.587930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587933:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1082:41279:x1731746396334464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.587936:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11651 00000100:00100000:0.0:1651529344.587941:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334592 00010000:00010000:0.0:1651529344.587944:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 5/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1082 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587951:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11652 00000100:00100000:0.0:1651529344.587953:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1082:41279:x1731746396334592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.587955:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.587956:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 5/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1082 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.587960:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 4/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1082 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.587964:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587965:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587966:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587968:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 4/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.587973:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.587978:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334400 00000100:00100000:0.0:1651529344.587982:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.587985:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11652 00010000:00010000:1.0:1651529344.587989:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 5/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1082 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.587990:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334784 00010000:00010000:0.0:1651529344.587993:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 5/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1083 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.587997:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11653 00000100:00100000:1.0:1651529344.587998:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.588000:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11654 00010000:00010000:1.0:1651529344.588001:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.588001:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.588003:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 5/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588004:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.588005:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 5/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1083 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588007:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 4/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1083 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588008:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 4/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1083 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588012:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588013:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588013:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588013:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588014:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588014:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588017:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 4/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588022:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588029:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (69us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.588032:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 4/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588037:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588042:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11653 00000100:00100000:0.0:1651529344.588044:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396334784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.588046:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11654 00010000:00010000:1.0:1651529344.588050:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588053:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588056:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588059:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588059:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454080 00000100:00100000:0.0:1651529344.588065:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454016 00000100:00100000:0.0:1651529344.588074:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152694 00000100:00100000:0.0:1651529344.588075:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbfdac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+984:39029:x1731745946454080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.588081:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177487 count 1 00010000:00010000:0.0:1651529344.588085:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588090:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 2/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1081 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588093:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588093:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588094:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 4/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588100:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 3/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1081 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588104:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1081 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.588108:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966646784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.588111:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+985:39029:x1731745946453312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 857us (981us total) trans 30064893552 rc 0/0 00000100:00100000:1.0:1651529344.588114:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152690 00000100:00100000:1.0:1651529344.588119:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152695 00000100:00100000:1.0:1651529344.588120:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+984:39030:x1731745946454016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.588125:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177486 count 1 00010000:00010000:1.0:1651529344.588129:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588133:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 2/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1081 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588137:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588138:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588138:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 4/0,1 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588142:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.588145:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 3/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1081 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588149:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 4/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1081 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.588153:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588155:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822d0a8f/0xa29a79078f3b787d lrc: 0/0,0 mode: --/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb776 expref: 1081 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.588159:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966646592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.588161:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.588163:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588166:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588169:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588171:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ddc0818/0xa29a79078f3b7902 lrc: 0/0,0 mode: --/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb913 expref: 1080 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588172:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588174:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588175:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.588178:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588182:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588184:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588187:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588192:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588213:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+986:39029:x1731745946453568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 824us (901us total) trans 30064893553 rc 0/0 00000100:00100000:0.0:1651529344.588216:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152691 00010000:00010000:0.0:1651529344.588224:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588227:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d686e09 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.588228:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588231:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 3/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588238:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 1/0,0 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588241:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d686e09/0xa29a79078f3beb5c lrc: 0/0,0 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588242:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+985:39030:x1731745946453888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 732us (761us total) trans 30064893554 rc 0/0 00000100:00100000:1.0:1651529344.588245:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152692 00010000:00010000:0.0:1651529344.588245:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588248:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4534330 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.588248:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588251:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 3/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588253:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588254:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 1/0,0 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588257:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.588257:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4534330/0xa29a79078f3beb63 lrc: 0/0,0 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588258:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588260:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 3/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588265:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 1/0,0 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588265:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003561c521/0xa29a79078f3bbada lrc: 0/0,0 mode: --/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68ad expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588268:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3beb6a lrc: 0/0,0 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588269:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588272:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588275:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588278:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588281:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588283:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.588314:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.588334:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+985:39030:x1731745946453248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1084us (1192us total) trans 30064893555 rc 0/0 00000100:00100000:0.0:1651529344.588337:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152689 00000100:00100000:0.0:1651529344.588342:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454208 00000100:00100000:0.0:1651529344.588352:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152696 00000100:00100000:0.0:1651529344.588354:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+985:39030:x1731745946454208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.588358:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177488 count 1 00010000:00010000:0.0:1651529344.588362:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588367:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 2/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1078 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588372:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588373:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588373:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 4/0,1 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588380:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 3/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1078 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588383:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 4/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1078 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.588387:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.588418:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.588427:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966646720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588430:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588451:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588455:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007caba12d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.588456:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588459:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 3/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588464:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 1/0,0 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588467:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caba12d/0xa29a79078f3beb55 lrc: 0/0,0 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588475:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334912 00010000:00010000:0.0:1651529344.588479:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 4/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.588487:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11655 00000100:00100000:0.0:1651529344.588489:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1079:41278:x1731746396334912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.588491:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.588493:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 4/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588496:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 3/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588501:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc37839b/0xa29a79078f3bb363 lrc: 0/0,0 mode: --/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c7c expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588504:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588505:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588506:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588511:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 4/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588517:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.588534:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1078:41278:x1731746396334912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.588537:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11655 00010000:00010000:0.0:1651529344.588544:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588565:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588569:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.588580:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588607:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.588624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.588634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.588641:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454336 00000100:00100000:1.0:1651529344.588650:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454272 00000100:00100000:1.0:1651529344.588655:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454464 00000100:00100000:1.0:1651529344.588661:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454400 00000100:00100000:1.0:1651529344.588664:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152697 00000100:00100000:1.0:1651529344.588666:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+990:39029:x1731745946454336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.588671:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177490 count 1 00010000:00010000:1.0:1651529344.588683:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588687:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+990:39030:x1731745946453952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 996us (1040us total) trans 30064893556 rc 0/0 00010000:00010000:1.0:1651529344.588688:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 2/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.588690:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152693 00010000:00010000:1.0:1651529344.588691:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588692:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588692:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 4/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588696:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152698 00000100:00100000:0.0:1651529344.588698:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+989:39030:x1731745946454272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.588699:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 3/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588703:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.588703:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177489 count 1 00000100:00100000:1.0:1651529344.588707:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588715:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588716:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.588720:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 2/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588723:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588724:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588725:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 4/0,1 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588738:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588740:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 3/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588742:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b7ff839 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.588743:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588744:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 4/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588746:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 3/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588748:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966647040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.588751:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 1/0,0 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588753:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7ff839/0xa29a79078f3beb71 lrc: 0/0,0 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588757:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.588762:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152699 00000100:00100000:1.0:1651529344.588764:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+989:39029:x1731745946454464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.588764:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152700 00000100:00100000:0.0:1651529344.588766:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+989:39030:x1731745946454400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.588769:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177492 count 1 00002000:00080000:0.0:1651529344.588771:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177491 count 1 00010000:00010000:1.0:1651529344.588772:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588774:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588776:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 2/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588779:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 2/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588780:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588780:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588781:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 4/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588788:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588792:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588792:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588792:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588793:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 4/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588796:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966647104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588800:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 3/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1077 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588822:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 4/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.588824:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.588826:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.588835:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.588908:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966646784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588913:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588930:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966646848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.588934:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.588941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.588948:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.588958:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335296 00000100:00100000:0.0:1651529344.588958:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335232 00010000:00010000:1.0:1651529344.588964:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 4/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1079 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588964:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1079 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.588971:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335360 00000100:00100000:1.0:1651529344.588972:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11656 00000100:00100000:1.0:1651529344.588974:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1079:41278:x1731746396335296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.588977:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.588979:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 4/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1080 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.588981:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 5/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1080 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588982:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 3/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1080 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588991:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e93d27f/0xa29a79078f3ba75b lrc: 0/0,0 mode: --/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d12 expref: 1080 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.588995:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588995:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588996:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588999:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 4/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589002:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11657 00000100:00100000:0.0:1651529344.589004:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1079:41279:x1731746396335232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.589005:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.589007:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.589009:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1079 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589013:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1079:41278:x1731746396335296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.589013:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 3/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1079 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589016:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11656 00010000:00010000:0.0:1651529344.589019:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c3e7c6/0xa29a79078f3b9548 lrc: 0/0,0 mode: --/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2c0 expref: 1078 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589021:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11658 00000100:00100000:1.0:1651529344.589023:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1077:41279:x1731746396335360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.589023:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589024:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589025:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.589025:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589026:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 5/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.589028:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 4/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589030:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 4/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589035:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589035:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.589036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589036:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589039:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 4/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589043:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.589059:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1077:41279:x1731746396335360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.589059:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1077:41279:x1731746396335232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.589061:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11658 00000100:00100000:0.0:1651529344.589062:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11657 00010000:00010000:1.0:1651529344.589068:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589070:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589071:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589074:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589077:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589082:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589085:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589088:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589124:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+991:39030:x1731745946454016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1198us total) trans 30064893557 rc 0/0 00000100:00100000:1.0:1651529344.589127:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152695 00010000:00010000:1.0:1651529344.589134:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589138:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbfdac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+990:39029:x1731745946454080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1061us (1286us total) trans 30064893558 rc 0/0 00010000:00010000:1.0:1651529344.589140:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589141:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589141:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152694 00010000:00010000:1.0:1651529344.589144:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 3/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589148:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 1/0,0 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589151:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3beb7f lrc: 0/0,0 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589155:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589158:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016dc5c6d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589159:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589162:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 3/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589165:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 1/0,0 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589167:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3b9f3c lrc: 0/0,0 mode: --/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb3f expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589178:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dc5c6d/0xa29a79078f3beb78 lrc: 0/0,0 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589187:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966646912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.589219:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589223:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589226:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589232:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589234:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589292:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+990:39030:x1731745946454208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1006us total) trans 30064893559 rc 0/0 00000100:00100000:0.0:1651529344.589295:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152696 00000100:00100000:0.0:1651529344.589299:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454976 00000100:00100000:0.0:1651529344.589310:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152701 00000100:00100000:0.0:1651529344.589312:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+990:39030:x1731745946454976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.589314:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.589317:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177493 count 1 00010000:00010000:0.0:1651529344.589327:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589332:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 2/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1074 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589335:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589336:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589336:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 4/0,1 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589343:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 3/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1074 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.589345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.589355:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 4/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1074 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.589359:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966647232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.589373:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589395:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589399:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589402:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966646976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.589406:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589407:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335616 00010000:00010000:1.0:1651529344.589413:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589416:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000653b59b7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589417:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589420:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 3/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589431:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 1/0,0 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589431:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589434:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653b59b7/0xa29a79078f3beb86 lrc: 0/0,0 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589438:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335680 00010000:00010000:0.0:1651529344.589441:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 5/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1076 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589443:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966647104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.589445:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335744 00010000:00010000:1.0:1651529344.589446:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589447:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.589451:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335808 00000100:00100000:1.0:1651529344.589453:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11659 00010000:00010000:0.0:1651529344.589453:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 4/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1078 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589455:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1078:41279:x1731746396335616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.589459:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.589460:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1078 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.589460:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11660 00000100:00100000:0.0:1651529344.589462:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1078:41279:x1731746396335680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.589464:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 3/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1078 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589469:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ffcc86/0xa29a79078f3b9c6b lrc: 0/0,0 mode: --/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefe6 expref: 1078 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589473:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589473:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589474:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589475:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.589477:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 4/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589477:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 5/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.589481:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 4/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1077 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589483:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.589487:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589487:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589488:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589491:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 4/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589496:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.589499:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1077:41279:x1731746396335616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.589502:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11659 00000100:00100000:0.0:1651529344.589503:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1077:41279:x1731746396335680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.589506:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11660 00000100:00100000:1.0:1651529344.589508:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11661 00000100:00100000:1.0:1651529344.589509:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1075:41279:x1731746396335744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.589511:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11662 00010000:00010000:1.0:1651529344.589512:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.589512:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1075:41279:x1731746396335808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.589513:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.589515:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.589516:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 4/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589517:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.589520:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 3/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589522:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e10ea5d/0xa29a79078f3ba586 lrc: 0/0,0 mode: --/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14c2 expref: 1075 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589526:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589526:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589527:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589530:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 4/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589536:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.589538:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000723d7bae/0xa29a79078f3bba8d lrc: 0/0,0 mode: --/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67d4 expref: 1074 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589541:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1073:41279:x1731746396335744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (186us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.589541:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589542:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589543:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589544:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11661 00010000:00010000:0.0:1651529344.589546:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 4/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589553:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.589560:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41279:x1731746396335808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.589562:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589562:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11662 00010000:00010000:1.0:1651529344.589565:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589568:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589569:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589571:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589572:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589575:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589587:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589622:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+992:39029:x1731745946454464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 857us (998us total) trans 30064893560 rc 0/0 00000100:00100000:1.0:1651529344.589625:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152699 00000100:00100000:0.0:1651529344.589630:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+991:39030:x1731745946454400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 863us (996us total) trans 30064893561 rc 0/0 00010000:00010000:1.0:1651529344.589633:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589633:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152700 00010000:00010000:1.0:1651529344.589636:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589637:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589640:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 3/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589641:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589645:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 1/0,0 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589645:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000562f6b2a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.589646:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589649:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 3/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589650:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3beb9b lrc: 0/0,0 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589653:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 1/0,0 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589656:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f6b2a/0xa29a79078f3beba2 lrc: 0/0,0 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589657:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589659:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589663:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589665:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589666:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b10ea015/0xa29a79078f3bb7df lrc: 0/0,0 mode: --/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d77 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.589670:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966647040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589673:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589676:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589679:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589682:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589685:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589708:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+992:39029:x1731745946454336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1129us total) trans 30064893562 rc 0/0 00000100:00100000:1.0:1651529344.589711:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152697 00010000:00010000:1.0:1651529344.589718:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589721:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589722:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589725:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 3/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589725:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+991:39030:x1731745946454272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1026us (1123us total) trans 30064893563 rc 0/0 00000100:00100000:0.0:1651529344.589728:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152698 00010000:00010000:1.0:1651529344.589739:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 1/0,0 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589742:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3beb8d lrc: 0/0,0 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589747:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589749:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ef7e315 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.589750:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589753:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 3/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589756:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 1/0,0 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589759:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef7e315/0xa29a79078f3beb94 lrc: 0/0,0 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589829:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455168 00000100:00100000:0.0:1651529344.589842:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455104 00000100:00100000:0.0:1651529344.589849:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152702 00000100:00100000:0.0:1651529344.589851:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+992:39030:x1731745946455168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.589854:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.589856:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177495 count 1 00010000:00010000:0.0:1651529344.589860:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.589868:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 2/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589876:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589877:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589878:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 4/0,1 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589885:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 3/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589889:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 4/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1070 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.589893:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966647296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.589902:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589909:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152703 00000100:00100000:0.0:1651529344.589911:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+992:39030:x1731745946455104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.589912:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455232 00002000:00080000:0.0:1651529344.589915:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177494 count 1 00010000:00010000:0.0:1651529344.589918:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589921:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152704 00000100:00100000:1.0:1651529344.589922:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+993:39030:x1731745946455232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.589923:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 2/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589925:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589926:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589927:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 4/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589933:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 3/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.589936:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177496 count 1 00010000:00010000:0.0:1651529344.589936:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 4/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1070 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.589940:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589940:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.589945:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 2/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589948:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589949:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589950:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 4/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589957:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 3/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1070 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589960:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1070 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.589964:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.589965:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966647424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589974:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589974:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966647232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589977:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589981:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335872 00010000:00010000:1.0:1651529344.589986:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 4/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.589997:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11663 00000100:00100000:1.0:1651529344.589999:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1071:41279:x1731746396335872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.590002:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590003:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 4/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590007:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 3/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590013:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce723539/0xa29a79078f3b9b7d lrc: 0/0,0 mode: --/PR res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebb0 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590037:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590038:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590046:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 4/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590055:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590065:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1070:41279:x1731746396335872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590068:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11663 00010000:00010000:0.0:1651529344.590072:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590083:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.590085:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590089:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590092:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590153:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455488 00000100:00100000:1.0:1651529344.590161:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455552 00000100:00100000:1.0:1651529344.590166:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152705 00000100:00100000:1.0:1651529344.590168:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+996:39029:x1731745946455488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.590180:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+996:39030:x1731745946454976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 867us (985us total) trans 30064893564 rc 0/0 00000100:00100000:0.0:1651529344.590184:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152701 00002000:00080000:1.0:1651529344.590185:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177497 count 1 00000100:00100000:0.0:1651529344.590189:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455616 00010000:00010000:1.0:1651529344.590190:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590195:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 2/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.590197:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455680 00000100:00100000:0.0:1651529344.590201:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152706 00000100:00100000:0.0:1651529344.590202:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946455552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.590203:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590204:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590205:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 4/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.590207:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177498 count 1 00010000:00010000:1.0:1651529344.590212:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 3/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590212:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590215:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590216:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 2/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1069 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.590219:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966647488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590219:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590220:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590221:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 4/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590227:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 3/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1069 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.590228:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.590231:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1069 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.590235:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152707 00000100:00100000:0.0:1651529344.590235:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966647552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.590237:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+997:39029:x1731745946455616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.590241:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177499 count 1 00010000:00010000:1.0:1651529344.590244:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590244:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.590249:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 2/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1069 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590249:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590252:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590252:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590253:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 4/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590253:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b3aa030 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.590254:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590257:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 3/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590259:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 3/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1069 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590261:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 1/0,0 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590262:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1069 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590264:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3beba9 lrc: 0/0,0 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590266:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966647616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.590271:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152708 00000100:00100000:1.0:1651529344.590273:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.590273:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946455680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.590278:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177500 count 1 00010000:00010000:0.0:1651529344.590281:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590285:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 2/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1069 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590288:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590288:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590289:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 4/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590295:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1069 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590299:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.590303:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966647680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.590309:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.590424:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966647424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.590424:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.590433:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590441:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336512 00000100:00100000:0.0:1651529344.590441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.590446:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 5/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1070 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.590448:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590453:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336448 00010000:00010000:1.0:1651529344.590455:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 5/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1071 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.590457:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.590460:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336576 00010000:00010000:0.0:1651529344.590461:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590462:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.590467:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11664 00000100:00100000:1.0:1651529344.590468:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41279:x1731746396336512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.590469:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11665 00010000:00010000:1.0:1651529344.590471:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.590471:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41279:x1731746396336448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.590472:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 5/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590474:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590476:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 4/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590476:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 4/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590479:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 3/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590481:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590482:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590483:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590485:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007291fbf8/0xa29a79078f3bc362 lrc: 0/0,0 mode: --/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ab8 expref: 1072 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590486:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 4/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590489:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590490:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.590490:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590491:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590494:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 4/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590503:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1071:41279:x1731746396336512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590506:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11664 00010000:00010000:0.0:1651529344.590506:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590511:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11666 00000100:00100000:1.0:1651529344.590513:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1070:41278:x1731746396336576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.590514:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1070:41279:x1731746396336448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (72us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.590515:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.590516:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11665 00010000:00010000:1.0:1651529344.590517:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1070 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590521:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 3/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590525:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c59da6/0xa29a79078f3ba39c lrc: 0/0,0 mode: --/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c6b expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590525:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590528:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590529:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590530:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590530:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590531:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590533:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 4/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590533:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590539:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590550:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1068:41278:x1731746396336576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590553:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11666 00010000:00010000:1.0:1651529344.590561:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590564:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.590565:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590579:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 3/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590579:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+998:39030:x1731745946455104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 667us (779us total) trans 30064893565 rc 0/0 00000100:00100000:0.0:1651529344.590582:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152703 00010000:00010000:1.0:1651529344.590583:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 1/0,0 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590586:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bebb7 lrc: 0/0,0 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590587:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455744 00010000:00010000:1.0:1651529344.590592:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590595:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590598:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590601:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590628:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152709 00000100:00100000:0.0:1651529344.590630:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+999:39030:x1731745946455744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.590636:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177501 count 1 00010000:00010000:0.0:1651529344.590640:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590645:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 2/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1067 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590648:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590648:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590649:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 4/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590650:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+999:39030:x1731745946455232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 727us (783us total) trans 30064893566 rc 0/0 00000100:00100000:1.0:1651529344.590653:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152704 00010000:00010000:0.0:1651529344.590656:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 3/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1067 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590659:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1067 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590660:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590663:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.590666:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.590667:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590670:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 3/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590673:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.590675:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 1/0,0 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590677:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bebbe lrc: 0/0,0 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590683:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec00927f/0xa29a79078f3bc346 lrc: 0/0,0 mode: --/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a6b expref: 1067 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.590688:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966647296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590691:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590694:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590697:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590700:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590702:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590762:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+999:39030:x1731745946455168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 910us (989us total) trans 30064893567 rc 0/0 00000100:00100000:0.0:1651529344.590765:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152702 00010000:00010000:0.0:1651529344.590772:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590775:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.590776:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.590779:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 3/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590784:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 1/0,0 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590786:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bebb0 lrc: 0/0,0 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590789:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.590796:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966647680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590799:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590824:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966647552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590828:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590847:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966647488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.590852:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590860:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966647616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.590862:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590879:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336640 00000100:00100000:1.0:1651529344.590881:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336768 00010000:00010000:1.0:1651529344.590886:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1068 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590886:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1068 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.590893:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336704 00000100:00100000:0.0:1651529344.590894:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11667 00010000:00010000:1.0:1651529344.590896:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1069 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.590896:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1069:41279:x1731746396336640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.590900:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11668 00010000:00010000:0.0:1651529344.590900:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.590901:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.590902:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1069:41279:x1731746396336768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.590905:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.590905:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 3/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590906:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1069 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590910:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 3/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1069 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590910:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3ba4a6 lrc: 0/0,0 mode: --/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1103 expref: 1069 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590914:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590914:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590915:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d50cca2/0xa29a79078f3b8e87 lrc: 0/0,0 mode: --/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc418 expref: 1068 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.590915:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590918:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 4/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590919:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590919:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590920:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590923:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 4/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590927:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.590936:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590943:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1067:41279:x1731746396336768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590946:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11668 00000100:00100000:0.0:1651529344.590949:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41279:x1731746396336640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590951:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11669 00000100:00100000:1.0:1651529344.590953:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41279:x1731746396336704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.590953:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11667 00010000:00010000:1.0:1651529344.590955:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590957:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590960:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 3/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590965:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2be8da9/0xa29a79078f3b96bb lrc: 0/0,0 mode: --/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8af expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.590968:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590969:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590970:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590972:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 4/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590981:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590987:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41279:x1731746396336704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.590988:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590990:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11669 00010000:00010000:1.0:1651529344.590999:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591002:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591005:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591008:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591037:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.591053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.591062:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+999:39029:x1731745946455616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 825us (928us total) trans 30064893568 rc 0/0 00000100:00100000:1.0:1651529344.591065:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152707 00000100:00100000:1.0:1651529344.591076:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456128 00000100:00100000:0.0:1651529344.591084:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456192 00000100:00100000:1.0:1651529344.591089:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456448 00000100:00100000:0.0:1651529344.591093:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152710 00000100:00100000:1.0:1651529344.591095:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152711 00000100:00100000:0.0:1651529344.591095:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1001:39029:x1731745946456128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.591096:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1001:39030:x1731745946456192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.591100:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177502 count 1 00002000:00080000:1.0:1651529344.591102:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177503 count 1 00010000:00010000:0.0:1651529344.591105:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591106:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591109:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 2/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591110:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 2/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591112:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591113:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591113:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591114:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591114:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 4/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591120:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 3/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591123:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 4/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591124:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591128:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966647808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591131:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591135:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.591139:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966647872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591153:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.591160:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152712 00000100:00100000:0.0:1651529344.591160:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.591162:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1001:39030:x1731745946456448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.591166:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177504 count 1 00010000:00010000:0.0:1651529344.591167:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591170:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591170:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591174:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 2/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1063 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591174:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591177:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591177:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591178:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591178:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 4/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591191:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 3/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1063 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591205:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1063 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.591209:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966647936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591217:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.591222:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591225:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.591226:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591229:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 3/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591234:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 1/0,0 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591236:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3bebd3 lrc: 0/0,0 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591236:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1002:39030:x1731745946455552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1032us (1110us total) trans 30064893569 rc 0/0 00000100:00100000:0.0:1651529344.591239:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152706 00010000:00010000:1.0:1651529344.591241:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591243:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594b0e00 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.591251:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591254:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 3/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.591258:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 1/0,0 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591260:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bebcc lrc: 0/0,0 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591267:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591270:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591273:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591276:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591303:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591307:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.591308:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591311:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 3/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591317:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 1/0,0 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591319:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3bebc5 lrc: 0/0,0 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591327:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456512 00000100:00100000:1.0:1651529344.591336:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1003:39029:x1731745946455488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1167us (1252us total) trans 30064893570 rc 0/0 00000100:00100000:1.0:1651529344.591339:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152705 00000100:00100000:0.0:1651529344.591341:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152713 00000100:00100000:0.0:1651529344.591343:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1002:39030:x1731745946456512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.591348:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177505 count 1 00010000:00010000:0.0:1651529344.591352:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.591357:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 2/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591360:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591360:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591361:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 4/0,1 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591368:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 3/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591371:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 4/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591375:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966648000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.591402:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.591418:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966647744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591422:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.591444:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336832 00000100:00100000:0.0:1651529344.591444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.591455:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1064 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.591465:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336896 00010000:00010000:1.0:1651529344.591468:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1065 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591471:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456576 00000100:00100000:1.0:1651529344.591476:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11670 00000100:00100000:1.0:1651529344.591478:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1065:41279:x1731746396336832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.591481:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591482:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1065 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591488:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152714 00000100:00100000:0.0:1651529344.591490:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1003:39030:x1731745946456576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.591491:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1065 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591497:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a9b135/0xa29a79078f3bc0fa lrc: 0/0,0 mode: --/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d810a expref: 1065 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591501:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591501:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591502:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591505:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 4/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.591528:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177506 count 1 00010000:00010000:1.0:1651529344.591530:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.591532:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591537:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 2/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1064 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.591538:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41279:x1731746396336832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.591540:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.591541:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11670 00010000:00010000:0.0:1651529344.591541:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591541:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 4/0,1 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591546:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11671 00000100:00100000:1.0:1651529344.591548:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1063:41279:x1731746396336896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.591548:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 3/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1063 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591550:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591552:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.591552:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 4/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591555:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 3/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591556:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966648064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591561:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000de85353/0xa29a79078f3bba40 lrc: 0/0,0 mode: --/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66e6 expref: 1063 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591564:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591565:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591565:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591565:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.591568:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 4/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591572:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591577:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.591581:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591583:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1062:41279:x1731746396336896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.591585:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591586:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11671 00010000:00010000:0.0:1651529344.591588:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.591630:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946455680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1356us (1486us total) trans 30064893571 rc 0/0 00000100:00100000:0.0:1651529344.591633:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152708 00000100:00100000:0.0:1651529344.591638:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456640 00000100:00100000:0.0:1651529344.591648:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152715 00000100:00100000:0.0:1651529344.591650:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946456640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.591655:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177507 count 1 00010000:00010000:0.0:1651529344.591658:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591663:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 2/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1061 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591666:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591667:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591667:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 4/0,1 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591674:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591674:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 3/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1061 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591677:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 4/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1061 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591678:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf7a79e8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.591679:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591682:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 3/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591684:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966648128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591687:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 1/0,0 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591689:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bebda lrc: 0/0,0 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591697:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.591702:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591706:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591708:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966647872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591709:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591711:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591712:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591725:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591728:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8285924 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.591729:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591740:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 3/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591745:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 1/0,0 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591747:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bebe1 lrc: 0/0,0 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591758:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1005:39030:x1731745946455744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1126us (1323us total) trans 30064893572 rc 0/0 00000100:00100000:0.0:1651529344.591761:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152709 00000100:00100000:0.0:1651529344.591842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.591873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.591904:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966647808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591924:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.591933:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337408 00010000:00010000:0.0:1651529344.591938:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1062 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.591945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591963:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966647936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.591963:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337600 00010000:00010000:0.0:1651529344.591966:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1063 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591967:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591971:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337536 00010000:00010000:0.0:1651529344.591972:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1064 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.591975:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337664 00000100:00100000:0.0:1651529344.591976:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337728 00010000:00010000:0.0:1651529344.591979:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 5/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1066 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591980:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 5/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1066 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.591983:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11672 00000100:00100000:0.0:1651529344.591985:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41279:x1731746396337408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.591987:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11673 00000100:00100000:1.0:1651529344.591988:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41278:x1731746396337600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.591988:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.591989:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1066 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.591992:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1066 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.591998:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c41ba84e/0xa29a79078f3ba1dc lrc: 0/0,0 mode: --/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0517 expref: 1066 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.591999:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.592001:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592002:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592002:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592003:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592005:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 3/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592006:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 4/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592011:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd6df02f/0xa29a79078f3b95b8 lrc: 0/0,0 mode: --/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4fe expref: 1065 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592020:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592021:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592022:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592025:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 4/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592025:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.592031:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.592033:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41279:x1731746396337408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592036:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11672 00000100:00100000:1.0:1651529344.592039:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1063:41278:x1731746396337600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592041:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11674 00000100:00100000:1.0:1651529344.592043:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11673 00000100:00100000:0.0:1651529344.592043:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1063:41279:x1731746396337536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.592046:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.592048:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11675 00010000:00010000:0.0:1651529344.592048:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1062 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.592050:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1062:41279:x1731746396337728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.592051:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 3/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1062 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592053:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.592054:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 5/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1062 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592056:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a9596d/0xa29a79078f3bc274 lrc: 0/0,0 mode: --/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8746 expref: 1062 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592060:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 4/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1061 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592060:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592060:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592061:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592065:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592066:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592066:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592066:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 4/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592069:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 4/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592073:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.592074:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.592079:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1061:41279:x1731746396337728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592079:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1061:41279:x1731746396337536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592081:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11674 00000100:00100000:1.0:1651529344.592083:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11675 00000100:00100000:0.0:1651529344.592086:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11676 00000100:00100000:0.0:1651529344.592087:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41279:x1731746396337664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.592089:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.592091:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 5/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1059 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.592092:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456832 00010000:00010000:0.0:1651529344.592095:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 4/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1059 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.592097:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456896 00010000:00010000:0.0:1651529344.592099:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592100:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592100:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592107:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152716 00000100:00100000:1.0:1651529344.592108:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1006:39030:x1731745946456832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.592111:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 4/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.592113:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177508 count 1 00010000:00010000:0.0:1651529344.592115:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.592117:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592121:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41279:x1731746396337664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.592122:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 2/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1059 pid: 142993 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.592124:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11676 00010000:00010000:1.0:1651529344.592125:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592132:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592133:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 4/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592137:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152717 00000100:00100000:0.0:1651529344.592139:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1006:39030:x1731745946456896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.592140:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1058 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592144:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1058 pid: 142993 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.592144:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177509 count 1 00000100:00100000:1.0:1651529344.592148:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966648192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592148:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592153:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 2/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1058 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592156:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592156:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.592157:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.592157:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 4/0,1 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592162:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592163:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 3/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1058 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592165:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592167:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 4/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1058 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592168:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592171:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592171:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966648256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.592186:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.592191:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592197:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.592198:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592201:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 3/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592205:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 1/0,0 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592208:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3bebef lrc: 0/0,0 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592213:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946456192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1115us (1209us total) trans 30064893573 rc 0/0 00000100:00100000:1.0:1651529344.592216:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152711 00010000:00010000:0.0:1651529344.592219:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc6d8236/0xa29a79078f3ba229 lrc: 0/0,0 mode: --/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d063d expref: 1058 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.592222:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966648064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592224:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592225:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592228:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592229:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592231:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592231:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592233:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592237:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592239:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592274:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1008:39030:x1731745946456448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1221us total) trans 30064893574 rc 0/0 00000100:00100000:1.0:1651529344.592277:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152712 00010000:00010000:1.0:1651529344.592285:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592286:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946456576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 795us (854us total) trans 30064893575 rc 0/0 00010000:00010000:1.0:1651529344.592288:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.592289:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592289:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152714 00010000:00010000:1.0:1651529344.592292:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 3/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592297:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 1/0,0 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592297:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592299:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3bebf6 lrc: 0/0,0 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592301:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592304:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592304:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592307:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.592307:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592308:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592310:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 3/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592313:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 1/0,0 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592316:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bec04 lrc: 0/0,0 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592319:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592322:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7fda0ee already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.592323:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592325:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 3/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592338:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1007:39029:x1731745946456128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1350us total) trans 30064893576 rc 0/0 00010000:00010000:1.0:1651529344.592340:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 1/0,0 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592341:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152710 00010000:00010000:1.0:1651529344.592343:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bebe8 lrc: 0/0,0 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592352:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ecca2c/0xa29a79078f3bbb0b lrc: 0/0,0 mode: --/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b0 expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.592359:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966648000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592369:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592373:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592375:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592378:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592381:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.592420:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946456512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1076us (1166us total) trans 30064893577 rc 0/0 00000100:00100000:0.0:1651529344.592423:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152713 00000100:00100000:0.0:1651529344.592431:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337792 00010000:00010000:0.0:1651529344.592436:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 5/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.592443:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11677 00000100:00100000:0.0:1651529344.592445:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1057:41278:x1731746396337792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.592447:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.592448:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 5/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592452:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 4/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592458:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592458:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592459:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592462:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 4/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592467:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.592472:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1057:41278:x1731746396337792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592475:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11677 00010000:00010000:0.0:1651529344.592481:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592484:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ca427590 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.592485:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592488:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 3/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592494:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 1/0,0 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592497:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bebfd lrc: 0/0,0 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592527:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bb4c1 lrc: 0/0,0 mode: --/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51f4 expref: 1056 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.592531:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966648128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592534:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592537:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592540:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592543:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592545:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592558:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592562:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.592563:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592566:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 3/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592575:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 1/0,0 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592578:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bec0b lrc: 0/0,0 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592607:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.592620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.592633:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946456640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 982us (1025us total) trans 30064893578 rc 0/0 00000100:00100000:0.0:1651529344.592637:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152715 00000100:00100000:0.0:1651529344.592642:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457408 00000100:00100000:0.0:1651529344.592648:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457344 00000100:00100000:0.0:1651529344.592656:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152718 00000100:00100000:0.0:1651529344.592657:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1008:39029:x1731745946457408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.592668:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966648192:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.592678:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177511 count 1 00010000:00010000:1.0:1651529344.592679:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592682:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592687:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152719 00000100:00100000:1.0:1651529344.592689:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1008:39029:x1731745946457344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.592694:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177510 count 1 00010000:00010000:0.0:1651529344.592696:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 2/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1055 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592698:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592699:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592700:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592701:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 4/0,1 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592703:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 2/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592706:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592706:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592707:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 4/0,1 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592708:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 3/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1055 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592711:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 4/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1055 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592713:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 3/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.592715:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966648320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592717:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 4/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.592722:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966648384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.592724:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.592740:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.592753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.592797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.592822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.592825:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.592834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.592842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.592851:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457472 00000100:00100000:0.0:1651529344.592854:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966648256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592858:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592859:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457600 00000100:00100000:1.0:1651529344.592866:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457536 00000100:00100000:1.0:1651529344.592869:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457728 00000100:00100000:1.0:1651529344.592873:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152720 00000100:00100000:0.0:1651529344.592873:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337984 00000100:00100000:1.0:1651529344.592874:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946457472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.592878:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1056 pid: 142993 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.592879:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177512 count 1 00010000:00010000:1.0:1651529344.592884:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592889:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338048 00010000:00010000:0.0:1651529344.592891:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 4/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592894:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 2/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1057 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.592900:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11678 00000100:00100000:0.0:1651529344.592901:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1057:41278:x1731746396337984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.592902:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592903:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592904:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 4/0,1 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592904:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.592906:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1057 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592910:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1057 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592911:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 3/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1057 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592915:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 4/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1057 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592915:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da2a78c/0xa29a79078f3bc3f5 lrc: 0/0,0 mode: --/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cda expref: 1057 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.592919:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966648448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592919:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592920:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592920:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592924:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 4/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592932:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.592935:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.592939:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1056:41278:x1731746396337984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.592941:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152721 00000100:00100000:0.0:1651529344.592942:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11678 00000100:00100000:1.0:1651529344.592943:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946457600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.592946:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11679 00002000:00080000:1.0:1651529344.592948:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177514 count 1 00000100:00100000:0.0:1651529344.592948:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396338048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.592950:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.592952:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592952:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 4/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592955:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 3/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.592956:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 2/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1055 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592959:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592960:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592960:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 4/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592960:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e476e64f/0xa29a79078f3bc08a lrc: 0/0,0 mode: --/PR res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f5f expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592963:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592964:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592965:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592966:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 3/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1054 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592969:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1054 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.592970:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 4/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592973:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966648512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592976:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.592980:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.592982:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1054:41279:x1731746396338048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592984:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11679 00010000:00010000:1.0:1651529344.592987:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592990:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592991:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152722 00010000:00010000:1.0:1651529344.592993:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592993:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946457536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.592996:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.592998:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177513 count 1 00010000:00010000:0.0:1651529344.593001:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593006:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 2/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1053 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.593009:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593009:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593010:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 4/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593016:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 3/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1053 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.593020:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1053 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.593026:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966648576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.593034:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.593043:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946456832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 934us (1202us total) trans 30064893579 rc 0/0 00000100:00100000:0.0:1651529344.593047:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152723 00000100:00100000:1.0:1651529344.593049:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152716 00000100:00100000:0.0:1651529344.593049:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1696324 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946457728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.593053:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177515 count 1 00010000:00010000:1.0:1651529344.593057:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593057:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593060:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f92497e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.593061:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593061:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 2/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1053 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593064:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 3/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593064:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593065:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593065:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 4/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593069:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 1/0,0 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593071:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 3/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1053 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593072:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92497e9/0xa29a79078f3bec12 lrc: 0/0,0 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593075:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1053 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.593078:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966648640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.593085:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.593090:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593094:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593097:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593099:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593181:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946456896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1252us total) trans 30064893580 rc 0/0 00000100:00100000:0.0:1651529344.593185:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152717 00010000:00010000:0.0:1651529344.593205:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.593225:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.593226:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593229:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 3/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593234:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 1/0,0 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593237:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bec19 lrc: 0/0,0 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.593251:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966648384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.593252:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457856 00010000:00010000:1.0:1651529344.593256:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593263:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152724 00000100:00100000:0.0:1651529344.593265:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946457856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.593269:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338560 00010000:00010000:1.0:1651529344.593274:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 4/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1054 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.593284:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177516 count 1 00000100:00100000:1.0:1651529344.593286:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338496 00010000:00010000:0.0:1651529344.593288:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593289:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 5/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1055 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.593294:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11680 00000100:00100000:1.0:1651529344.593295:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396338560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.593298:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593300:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 4/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593303:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 3/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593309:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f38e57a6/0xa29a79078f3b781b lrc: 0/0,0 mode: --/PR res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb618 expref: 1055 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593312:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593313:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593314:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593314:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 2/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1054 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593327:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 4/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593327:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593327:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593328:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 4/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593334:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.593336:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 3/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1054 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.593340:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1054 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.593342:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1054:41279:x1731746396338560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.593344:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11680 00000100:00100000:0.0:1651529344.593344:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966648704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.593349:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11681 00000100:00100000:1.0:1651529344.593351:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1053:41278:x1731746396338496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.593353:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.593353:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.593355:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 5/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1053 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593358:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 4/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1053 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593363:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593364:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593365:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593366:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c91ab14/0xa29a79078f3b82b0 lrc: 0/0,0 mode: --/PR res: [0x2b567:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe22 expref: 1053 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593368:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 4/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593372:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.593373:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966648320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.593376:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1052:41278:x1731746396338496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.593376:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593379:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11681 00010000:00010000:0.0:1651529344.593379:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593382:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593385:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593386:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593387:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593389:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593392:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593401:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593430:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1015:39029:x1731745946457408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 772us (823us total) trans 30064893581 rc 0/0 00000100:00100000:0.0:1651529344.593433:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152718 00000100:00100000:1.0:1651529344.593442:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1014:39029:x1731745946457344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 752us (821us total) trans 30064893582 rc 0/0 00000100:00100000:1.0:1651529344.593445:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152719 00010000:00010000:1.0:1651529344.593461:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593465:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.593466:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.593468:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 3/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593478:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 1/0,0 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593481:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bec20 lrc: 0/0,0 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593485:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593488:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000dcf2b2e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.593488:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593491:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 3/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593494:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 1/0,0 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593497:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dcf2b2e/0xa29a79078f3bec27 lrc: 0/0,0 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593515:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966648448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.593519:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593550:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966648512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.593553:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593569:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593580:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457920 00000100:00100000:0.0:1651529344.593580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593595:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152725 00000100:00100000:1.0:1651529344.593597:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1014:39030:x1731745946457920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.593602:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177517 count 1 00010000:00010000:1.0:1651529344.593606:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.593610:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 2/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1051 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593613:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593614:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593614:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 4/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.593621:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 3/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1051 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593624:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1051 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.593626:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966648576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.593629:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966648768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.593630:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593638:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966648640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.593643:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.593647:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593649:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338688 00010000:00010000:1.0:1651529344.593654:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 4/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1052 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.593669:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338944 00000100:00100000:0.0:1651529344.593669:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338816 00010000:00010000:1.0:1651529344.593672:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.593674:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1054 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.593676:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338880 00010000:00010000:1.0:1651529344.593679:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.593681:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11682 00000100:00100000:0.0:1651529344.593683:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41278:x1731746396338688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.593684:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11683 00000100:00100000:1.0:1651529344.593686:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396338944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.593688:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593690:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593693:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 3/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.593697:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593699:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8936863/0xa29a79078f3bb7bc lrc: 0/0,0 mode: --/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cf9 expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.593700:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 4/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1055 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593702:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593703:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593704:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593704:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 3/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593707:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 4/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593709:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b80f88/0xa29a79078f3b9bae lrc: 0/0,0 mode: --/PR res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec82 expref: 1054 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.593713:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593714:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593715:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593718:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 4/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593722:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.593728:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1053:41279:x1731746396338944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.593741:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.593746:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11683 00000100:00100000:0.0:1651529344.593749:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1052:41278:x1731746396338688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.593752:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11684 00000100:00100000:1.0:1651529344.593753:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1052:41279:x1731746396338816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.593753:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11682 00010000:00010000:1.0:1651529344.593756:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593758:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1051 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593762:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 3/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1051 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.593764:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11685 00000100:00100000:0.0:1651529344.593766:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1051:41278:x1731746396338880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.593767:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e68be7/0xa29a79078f3b977f lrc: 0/0,0 mode: --/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc1a expref: 1051 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.593769:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593770:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593770:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593771:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593774:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 3/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593775:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 4/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593779:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc134e1b/0xa29a79078f3bad04 lrc: 0/0,0 mode: --/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d334d expref: 1050 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.593781:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.593782:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593783:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593784:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593786:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1049:41279:x1731746396338816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.593787:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 4/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593794:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.593797:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11684 00000100:00100000:0.0:1651529344.593799:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1049:41278:x1731746396338880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.593802:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11685 00010000:00010000:1.0:1651529344.593823:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593827:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593827:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593830:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593831:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593833:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593834:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593837:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593881:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1016:39030:x1731745946457472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1084us total) trans 30064893583 rc 0/0 00000100:00100000:1.0:1651529344.593884:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152720 00000100:00100000:0.0:1651529344.593888:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946457536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (1058us total) trans 30064893584 rc 0/0 00010000:00010000:1.0:1651529344.593891:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593891:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152722 00010000:00010000:1.0:1651529344.593895:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593898:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593899:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593900:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593902:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056976381 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.593903:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593909:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 3/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593913:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 1/0,0 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593916:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056976381/0xa29a79078f3bec2e lrc: 0/0,0 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593920:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593923:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005d294e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.593924:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593927:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 3/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593930:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 1/0,0 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593933:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bec3c lrc: 0/0,0 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593936:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593937:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946457600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 993us (1115us total) trans 30064893585 rc 0/0 00010000:00010000:0.0:1651529344.593939:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006baf5f4b already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.593940:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152721 00010000:00010000:0.0:1651529344.593940:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593942:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 3/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593945:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 1/0,0 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593948:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006baf5f4b/0xa29a79078f3bec35 lrc: 0/0,0 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593953:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593956:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.593959:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593961:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.594012:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1696324 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946457728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 962us (1169us total) trans 30064893586 rc 0/0 00000100:00100000:0.0:1651529344.594015:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152723 00000100:00100000:0.0:1651529344.594033:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458112 00000100:00100000:0.0:1651529344.594043:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458048 00000100:00100000:0.0:1651529344.594048:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152726 00000100:00100000:0.0:1651529344.594050:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1016:39030:x1731745946458112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.594055:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177519 count 1 00010000:00010000:0.0:1651529344.594059:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594064:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 2/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1047 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594067:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594068:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594068:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 4/0,1 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594075:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 3/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1047 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594079:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 4/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1047 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594083:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966648832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594089:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594096:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.594104:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.594104:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966648704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594105:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594108:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 3/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594113:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 1/0,0 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594116:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bec43 lrc: 0/0,0 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594124:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594125:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152727 00000100:00100000:1.0:1651529344.594127:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1016:39029:x1731745946458048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.594133:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177518 count 1 00010000:00010000:1.0:1651529344.594136:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594141:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 2/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1047 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594144:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594144:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594145:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 4/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594152:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 3/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1047 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594155:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1047 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594160:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966648896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594183:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.594190:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339008 00010000:00010000:1.0:1651529344.594196:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1048 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594211:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11686 00000100:00100000:1.0:1651529344.594213:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41278:x1731746396339008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.594216:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.594217:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1048 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.594224:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 3/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1048 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.594229:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003124aecc/0xa29a79078f3bc403 lrc: 0/0,0 mode: --/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d20 expref: 1048 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.594232:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594233:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594234:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594243:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 4/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594252:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.594259:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1047:41278:x1731746396339008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.594260:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594262:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11686 00000100:00100000:1.0:1651529344.594274:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458624 00000100:00100000:1.0:1651529344.594283:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152728 00000100:00100000:1.0:1651529344.594291:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1017:39030:x1731745946458624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.594296:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177521 count 1 00010000:00010000:1.0:1651529344.594300:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594304:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 2/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1046 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594307:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594308:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594309:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 4/0,1 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594315:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 3/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1046 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.594319:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.594326:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 4/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594330:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966648960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594338:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.594342:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594352:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966648768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594357:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594368:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594370:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458560 00010000:00010000:0.0:1651529344.594372:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594375:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594380:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458752 00000100:00100000:1.0:1651529344.594385:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458688 00010000:00010000:0.0:1651529344.594388:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594389:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152729 00000100:00100000:1.0:1651529344.594390:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1020:39029:x1731745946458560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.594400:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177520 count 1 00010000:00010000:1.0:1651529344.594404:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594411:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 2/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594414:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594415:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594415:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 4/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594421:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 3/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1046 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594425:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1046 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594429:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966649024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594442:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.594447:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594450:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb916809 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.594452:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594454:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 3/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594456:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1021:39030:x1731745946457856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1216us total) trans 30064893587 rc 0/0 00000100:00100000:0.0:1651529344.594459:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152724 00010000:00010000:1.0:1651529344.594461:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 1/0,0 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594464:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb916809/0xa29a79078f3bec4a lrc: 0/0,0 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594465:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152730 00000100:00100000:0.0:1651529344.594467:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1020:39030:x1731745946458752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.594471:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177523 count 1 00010000:00010000:0.0:1651529344.594475:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594482:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 2/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1046 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594486:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594486:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594487:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 4/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594494:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 3/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1046 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594497:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594516:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966649088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.594526:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.594533:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152731 00000100:00100000:0.0:1651529344.594535:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1020:39029:x1731745946458688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.594540:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177522 count 1 00000100:00100000:1.0:1651529344.594542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.594544:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594548:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 2/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1046 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594551:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594552:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594552:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 4/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594559:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 3/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1046 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594562:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1046 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594566:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.594573:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.594590:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339136 00010000:00010000:0.0:1651529344.594595:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1047 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.594623:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339264 00000100:00100000:1.0:1651529344.594626:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11687 00010000:00010000:0.0:1651529344.594627:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 5/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1048 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594628:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41279:x1731746396339136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.594632:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.594637:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11688 00010000:00010000:1.0:1651529344.594639:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1048 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594639:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41279:x1731746396339264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.594642:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.594643:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 3/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1048 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.594643:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 5/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.594647:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 4/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1048 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.594649:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd453522/0xa29a79078f3b7da8 lrc: 0/0,0 mode: --/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb89 expref: 1048 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.594653:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594653:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594654:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594654:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594655:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594658:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 4/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594660:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 4/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594662:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.594666:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.594674:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1047:41279:x1731746396339264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.594676:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11688 00000100:00100000:1.0:1651529344.594679:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396339136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.594682:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11687 00000100:00100000:0.0:1651529344.594684:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458880 00000100:00100000:0.0:1651529344.594690:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152732 00000100:00100000:0.0:1651529344.594691:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1021:39030:x1731745946458880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.594693:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966648896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594696:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.594696:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177524 count 1 00010000:00010000:0.0:1651529344.594700:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594703:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966648960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.594704:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 2/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1045 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594706:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594707:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594708:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594709:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 4/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594711:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594714:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594717:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594718:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 3/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1045 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594720:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594721:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594725:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966649216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.594749:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.594755:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594758:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011187589 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.594759:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594762:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 3/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594767:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 1/0,0 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594770:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011187589/0xa29a79078f3bec51 lrc: 0/0,0 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594771:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1022:39030:x1731745946457920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1173us (1305us total) trans 30064893588 rc 0/0 00000100:00100000:1.0:1651529344.594775:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152725 00010000:00010000:0.0:1651529344.594782:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3b9f20 lrc: 0/0,0 mode: --/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa89 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.594788:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966648832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.594791:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594794:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594797:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594830:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594834:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594854:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594858:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000713ed9ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.594859:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594862:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 3/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594867:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 1/0,0 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594870:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713ed9ec/0xa29a79078f3bec58 lrc: 0/0,0 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.594920:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1022:39030:x1731745946458112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 853us (947us total) trans 30064893589 rc 0/0 00000100:00100000:0.0:1651529344.594923:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152726 00000100:00100000:0.0:1651529344.594932:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339328 00010000:00010000:0.0:1651529344.594937:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.594958:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11689 00000100:00100000:0.0:1651529344.594961:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1045:41279:x1731746396339328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.594964:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.594965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.594966:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.594976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.594976:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 3/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.594990:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294b8839/0xa29a79078f3bb67a lrc: 0/0,0 mode: --/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5837 expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.594999:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594999:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.595000:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966649024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.595000:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595003:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 4/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595005:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595012:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595019:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339712 00010000:00010000:1.0:1651529344.595029:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1045 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595035:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339392 00010000:00010000:1.0:1651529344.595037:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 4/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1046 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595042:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11690 00000100:00100000:1.0:1651529344.595043:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396339712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.595046:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595047:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1046 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595047:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396339328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.595050:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11689 00010000:00010000:1.0:1651529344.595059:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 3/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1045 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595061:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11691 00000100:00100000:0.0:1651529344.595063:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1045:41278:x1731746396339392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.595065:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001171b05/0xa29a79078f3b908d lrc: 0/0,0 mode: --/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc529 expref: 1045 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.595065:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.595067:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 4/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1045 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595068:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595069:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595070:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595073:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 4/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595080:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595087:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1044:41279:x1731746396339712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595090:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11690 00010000:00010000:0.0:1651529344.595091:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 3/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1044 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595097:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595097:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005051be3/0xa29a79078f3ba651 lrc: 0/0,0 mode: --/PR res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d185e expref: 1043 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595101:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595102:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595104:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595105:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 4/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595106:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595115:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.595123:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1042:41278:x1731746396339392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.595126:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11691 00000100:00100000:0.0:1651529344.595137:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.595141:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595149:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966649088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.595151:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1022:39029:x1731745946458048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1157us total) trans 30064893590 rc 0/0 00010000:00010000:0.0:1651529344.595152:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595154:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152727 00000100:00100000:1.0:1651529344.595158:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459072 00000100:00100000:1.0:1651529344.595165:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152733 00000100:00100000:1.0:1651529344.595167:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1022:39029:x1731745946459072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.595172:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177525 count 1 00010000:00010000:1.0:1651529344.595175:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.595182:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 2/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1041 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595185:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595186:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595187:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 4/0,1 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595193:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 3/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1041 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595197:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 4/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1041 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595201:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966649280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.595228:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.595232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.595234:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595237:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006781115f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.595238:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595241:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 3/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.595248:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 1/0,0 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595251:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006781115f/0xa29a79078f3bec5f lrc: 0/0,0 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595257:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595262:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.595272:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595275:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595275:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966649216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.595278:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595278:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595291:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339904 00010000:00010000:0.0:1651529344.595296:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1042 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595306:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339840 00010000:00010000:0.0:1651529344.595309:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1043 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595313:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340032 00010000:00010000:0.0:1651529344.595315:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1044 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595320:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11692 00000100:00100000:0.0:1651529344.595321:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1044:41278:x1731746396339904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.595324:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.595325:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1044 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595331:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946458624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1039us (1072us total) trans 30064893591 rc 0/0 00000100:00100000:1.0:1651529344.595334:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152728 00000100:00100000:1.0:1651529344.595340:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459136 00010000:00010000:0.0:1651529344.595343:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 3/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1044 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595348:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152734 00000100:00100000:1.0:1651529344.595349:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946459136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.595354:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177526 count 1 00010000:00010000:0.0:1651529344.595354:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022b9edc4/0xa29a79078f3b87aa lrc: 0/0,0 mode: --/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc09f expref: 1044 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595358:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595371:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 2/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1044 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595373:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595373:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595374:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595374:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595374:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595375:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 4/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595378:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 4/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595382:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 3/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1043 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595384:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.595385:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1043 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595389:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966649344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.595392:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1043:41278:x1731746396339904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.595395:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11692 00000100:00100000:1.0:1651529344.595397:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.595400:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11693 00000100:00100000:0.0:1651529344.595401:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1042:41278:x1731746396339840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.595404:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.595405:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1042 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595406:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11694 00000100:00100000:1.0:1651529344.595407:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1042:41278:x1731746396340032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.595409:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 3/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1042 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595410:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595412:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1042 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595416:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 3/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1042 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.595423:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000627f9b2b/0xa29a79078f3ba13b lrc: 0/0,0 mode: --/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02ee expref: 1042 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.595427:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595427:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595428:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595431:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b630e56/0xa29a79078f3b9e39 lrc: 0/0,0 mode: --/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf764 expref: 1041 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.595431:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 4/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595435:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595436:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595437:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595437:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.595440:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 4/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595448:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595455:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1040:41278:x1731746396340032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595458:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11694 00010000:00010000:1.0:1651529344.595465:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595466:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1039:41278:x1731746396339840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.595469:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595469:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11693 00010000:00010000:1.0:1651529344.595472:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595474:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595477:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595480:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fecda833 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.595481:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595484:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 3/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595488:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 1/0,0 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595494:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fecda833/0xa29a79078f3bec66 lrc: 0/0,0 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595498:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595500:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000944167f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.595501:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595504:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 3/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595507:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 1/0,0 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595510:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944167f1/0xa29a79078f3bec6d lrc: 0/0,0 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595513:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1024:39029:x1731745946458560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1122us (1194us total) trans 30064893592 rc 0/0 00000100:00100000:1.0:1651529344.595516:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152729 00010000:00010000:0.0:1651529344.595516:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595518:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595521:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595524:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.595569:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1024:39029:x1731745946458688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1033us (1226us total) trans 30064893593 rc 0/0 00000100:00100000:0.0:1651529344.595572:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152731 00000100:00100000:0.0:1651529344.595577:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459264 00000100:00100000:0.0:1651529344.595584:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152735 00000100:00100000:0.0:1651529344.595586:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1024:39030:x1731745946459264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.595588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.595590:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177527 count 1 00010000:00010000:0.0:1651529344.595594:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595599:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 2/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1038 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595603:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 4/0,1 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595609:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 3/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1038 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595613:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 4/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595620:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.595633:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.595639:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595640:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595642:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595645:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067ce9b4a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.595645:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595646:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595649:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 3/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595654:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 1/0,0 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595657:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ce9b4a/0xa29a79078f3bec7b lrc: 0/0,0 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595664:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595667:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340224 00010000:00010000:1.0:1651529344.595671:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 5/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1039 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.595683:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11695 00000100:00100000:1.0:1651529344.595685:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1039:41279:x1731746396340224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.595688:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595689:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 5/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1039 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595693:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 4/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1039 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.595698:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595699:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595699:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595702:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 4/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595707:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.595710:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1025:39030:x1731745946458880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1017us (1095us total) trans 30064893594 rc 0/0 00000100:00100000:0.0:1651529344.595713:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152732 00000100:00100000:1.0:1651529344.595714:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1039:41279:x1731746396340224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595716:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11695 00010000:00010000:0.0:1651529344.595721:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595724:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bd2c64b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.595726:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3b9f6d lrc: 0/0,0 mode: --/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbcb expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.595726:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595728:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 3/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595740:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966649280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.595744:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595745:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 1/0,0 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595748:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bd2c64b/0xa29a79078f3bec82 lrc: 0/0,0 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595750:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595752:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595755:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595758:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595765:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595768:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000759f3d5a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.595769:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595772:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 3/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595776:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 1/0,0 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595778:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000759f3d5a/0xa29a79078f3bec89 lrc: 0/0,0 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595796:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595798:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1025:39029:x1731745946459072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 630us (832us total) trans 30064893595 rc 0/0 00010000:00010000:0.0:1651529344.595799:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595800:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152733 00010000:00010000:0.0:1651529344.595831:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595834:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.595882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.595886:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1025:39030:x1731745946458752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1418us (1558us total) trans 30064893596 rc 0/0 00000100:00100000:0.0:1651529344.595896:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152730 00000100:00100000:0.0:1651529344.595902:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459392 00000100:00100000:0.0:1651529344.595907:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459328 00000100:00100000:0.0:1651529344.595915:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152736 00000100:00100000:0.0:1651529344.595917:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946459392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.595921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.595922:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177529 count 1 00010000:00010000:0.0:1651529344.595926:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595930:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 2/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1037 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.595933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.595933:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595934:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595935:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 4/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595948:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 3/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1037 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595952:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1037 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.595956:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966649472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.595961:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595965:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a11aab2a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.595966:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595970:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.595976:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459456 00010000:00010000:1.0:1651529344.595977:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 3/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595985:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152737 00010000:00010000:1.0:1651529344.595986:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 1/0,0 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595987:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1027:39029:x1731745946459328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.595989:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a11aab2a/0xa29a79078f3bec74 lrc: 0/0,0 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.595991:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177528 count 1 00010000:00010000:0.0:1651529344.595995:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596000:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966649344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596000:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 2/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1037 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596002:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596003:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596004:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596004:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 4/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596010:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 3/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1037 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.596011:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152738 00000100:00100000:1.0:1651529344.596013:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1027:39030:x1731745946459456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.596019:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177530 count 1 00010000:00010000:1.0:1651529344.596023:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596027:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 2/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1037 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596030:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596031:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596031:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 4/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596031:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1037 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596038:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966649536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596050:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 3/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1037 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596054:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1037 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596055:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596058:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966649600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596063:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340288 00000100:00100000:1.0:1651529344.596067:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.596068:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596080:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11696 00000100:00100000:0.0:1651529344.596082:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1038:41278:x1731746396340288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.596085:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.596086:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596090:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 3/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596115:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f307277/0xa29a79078f3b93f1 lrc: 0/0,0 mode: --/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd8e expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596119:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596120:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596121:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.596124:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 4/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596135:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.596143:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1037:41278:x1731746396340288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.596146:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11696 00000100:00100000:0.0:1651529344.596156:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340352 00000100:00100000:1.0:1651529344.596158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.596174:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 5/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1037 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596185:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11697 00000100:00100000:0.0:1651529344.596187:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1037:41279:x1731746396340352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.596190:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.596192:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 5/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1037 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596195:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 4/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1037 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.596198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.596201:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596202:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596202:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.596205:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 4/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596215:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596219:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596223:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596226:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596227:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.596249:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1037:41279:x1731746396340352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.596253:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11697 00000100:00100000:0.0:1651529344.596261:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459904 00000100:00100000:0.0:1651529344.596267:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459968 00000100:00100000:0.0:1651529344.596270:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460032 00000100:00100000:0.0:1651529344.596274:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152739 00000100:00100000:1.0:1651529344.596275:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946459136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (1096us total) trans 30064893597 rc 0/0 00000100:00100000:0.0:1651529344.596275:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946459904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.596280:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177531 count 1 00010000:00010000:0.0:1651529344.596284:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596288:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152734 00010000:00010000:0.0:1651529344.596289:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 2/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596292:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596292:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596293:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 4/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596294:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152740 00000100:00100000:1.0:1651529344.596296:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946459968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.596300:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177532 count 1 00010000:00010000:1.0:1651529344.596305:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596310:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 2/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596313:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596313:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596313:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 3/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596314:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 4/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596317:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596321:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 3/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.596321:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966649664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596325:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.596329:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966649728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596330:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596337:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596344:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152741 00000100:00100000:1.0:1651529344.596346:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1030:39030:x1731745946460032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.596351:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177533 count 1 00010000:00010000:1.0:1651529344.596355:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596356:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596359:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 2/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596360:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002af60ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.596361:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596362:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596362:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596363:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 4/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596364:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 3/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596369:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 3/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1036 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596373:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 4/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.596376:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966649792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596378:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 1/0,0 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596381:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af60ac3/0xa29a79078f3bec90 lrc: 0/0,0 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596382:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.596393:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001632c3c2/0xa29a79078f3bb585 lrc: 0/0,0 mode: --/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d550b expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596396:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596406:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596409:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596417:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596429:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596432:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596474:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946459264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 887us (933us total) trans 30064893598 rc 0/0 00000100:00100000:0.0:1651529344.596477:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152735 00000100:00100000:0.0:1651529344.596488:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966649536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596492:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596501:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966649472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596503:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596504:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596508:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006bbc2bd2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.596509:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596512:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 3/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596517:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 1/0,0 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596520:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bbc2bd2/0xa29a79078f3bec97 lrc: 0/0,0 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596531:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966649600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596535:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.596605:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460160 00000100:00100000:0.0:1651529344.596615:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152742 00000100:00100000:0.0:1651529344.596616:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946460160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.596622:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177534 count 1 00010000:00010000:0.0:1651529344.596626:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596630:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 2/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1035 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596641:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596642:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596642:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 4/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596650:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 3/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1035 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596686:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596691:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596705:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.596720:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460224 00000100:00100000:1.0:1651529344.596741:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152743 00000100:00100000:1.0:1651529344.596743:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1032:39030:x1731745946460224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.596748:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177535 count 1 00010000:00010000:1.0:1651529344.596752:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596757:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 2/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1035 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.596765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.596769:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596769:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596770:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 4/0,1 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.596782:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.596785:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 3/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1035 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596789:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 4/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596790:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340544 00000100:00100000:1.0:1651529344.596793:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966649920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.596817:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.596828:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.596829:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340672 00000100:00100000:0.0:1651529344.596838:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340608 00010000:00010000:1.0:1651529344.596839:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1037 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596841:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.596846:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11698 00000100:00100000:1.0:1651529344.596848:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11699 00000100:00100000:0.0:1651529344.596848:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1038:41278:x1731746396340544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.596850:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1038:41278:x1731746396340672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.596851:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.596852:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596853:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.596854:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596856:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 3/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596858:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 3/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596862:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43ffde5/0xa29a79078f3ba635 lrc: 0/0,0 mode: --/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1826 expref: 1038 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596864:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3b975c lrc: 0/0,0 mode: --/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb80 expref: 1038 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596865:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596866:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596867:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596867:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596868:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596869:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596870:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 4/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596872:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 4/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596876:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.596878:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.596884:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41278:x1731746396340544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.596885:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41278:x1731746396340672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.596886:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11698 00000100:00100000:1.0:1651529344.596888:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11699 00000100:00100000:0.0:1651529344.596891:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11700 00000100:00100000:0.0:1651529344.596893:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1034:41278:x1731746396340608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.596895:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.596897:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596898:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596902:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596903:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 3/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.596905:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596907:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596907:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec521fa/0xa29a79078f3baf7a lrc: 0/0,0 mode: --/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c6f expref: 1034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.596910:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596911:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596912:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596915:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 4/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596920:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.596925:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1033:41278:x1731746396340608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.596927:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11700 00010000:00010000:0.0:1651529344.596933:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596937:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596940:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596945:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596947:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1033:39030:x1731745946459456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 933us (1014us total) trans 30064893599 rc 0/0 00000100:00100000:1.0:1651529344.596950:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152738 00010000:00010000:1.0:1651529344.596957:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596973:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbeb2c63 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.596974:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596977:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 3/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596982:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 1/0,0 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596983:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1033:39029:x1731745946459328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 995us (1101us total) trans 30064893600 rc 0/0 00010000:00010000:1.0:1651529344.596984:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbeb2c63/0xa29a79078f3becac lrc: 0/0,0 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596986:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152737 00010000:00010000:1.0:1651529344.596989:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596992:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.596992:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596994:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596995:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 3/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596998:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 1/0,0 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596998:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597001:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597003:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3beca5 lrc: 0/0,0 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597003:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 2/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597007:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597010:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000891ea48d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.597016:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 2/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597019:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 3/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597023:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 1/0,0 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597025:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000891ea48d/0xa29a79078f3bec9e lrc: 0/0,0 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597040:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1033:39030:x1731745946459392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1123us (1181us total) trans 30064893601 rc 0/0 00000100:00100000:0.0:1651529344.597043:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152736 00000100:00100000:0.0:1651529344.597061:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966649664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.597064:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.597157:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966649856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.597167:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.597179:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341120 00000100:00100000:1.0:1651529344.597182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.597183:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597189:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341184 00000100:00100000:1.0:1651529344.597190:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966649728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.597191:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1034 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.597195:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597195:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341248 00010000:00010000:0.0:1651529344.597197:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 5/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597201:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341312 00010000:00010000:0.0:1651529344.597203:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.597205:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966649792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.597207:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597207:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11701 00000100:00100000:0.0:1651529344.597209:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41279:x1731746396341120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.597211:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.597212:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.597214:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11702 00000100:00100000:1.0:1651529344.597216:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41278:x1731746396341184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.597219:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597221:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.597224:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 3/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597227:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 3/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.597229:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94594ab/0xa29a79078f3b9ecc lrc: 0/0,0 mode: --/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf91d expref: 1036 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.597233:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597233:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597234:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597234:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffd0bf6/0xa29a79078f3bb2de lrc: 0/0,0 mode: --/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a76 expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597237:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597238:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 4/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597238:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597239:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597242:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 4/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597244:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597262:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1034:41278:x1731746396341184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.597265:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11702 00010000:00010000:0.0:1651529344.597266:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597270:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11703 00000100:00100000:1.0:1651529344.597272:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1033:41279:x1731746396341248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.597275:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.597275:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1033:41279:x1731746396341120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.597276:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 4/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597278:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11701 00010000:00010000:1.0:1651529344.597280:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 3/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597284:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11704 00010000:00010000:1.0:1651529344.597285:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cc11860/0xa29a79078f3bb761 lrc: 0/0,0 mode: --/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b94 expref: 1032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597285:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1032:41278:x1731746396341312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.597288:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597289:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597290:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597290:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597290:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.597293:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 4/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597299:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597304:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1031:41279:x1731746396341248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.597306:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 3/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.597307:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11703 00010000:00010000:0.0:1651529344.597321:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f7c097/0xa29a79078f3bc35b lrc: 0/0,0 mode: --/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8aaa expref: 1030 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597324:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597325:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597325:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597326:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597329:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597329:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 4/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597332:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597334:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597336:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.597348:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41278:x1731746396341312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.597351:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11704 00010000:00010000:0.0:1651529344.597358:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597361:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597364:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597367:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597376:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1033:39030:x1731745946460032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1029us (1170us total) trans 30064893602 rc 0/0 00000100:00100000:1.0:1651529344.597379:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152741 00010000:00010000:1.0:1651529344.597395:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597398:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009d399be8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.597399:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597402:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 3/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597407:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 1/0,0 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597412:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d399be8/0xa29a79078f3becc1 lrc: 0/0,0 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597416:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597418:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1033:39030:x1731745946459904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1260us total) trans 30064893603 rc 0/0 00010000:00010000:1.0:1651529344.597419:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.597420:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597421:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152739 00010000:00010000:1.0:1651529344.597423:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 3/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597426:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 1/0,0 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597428:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3becb3 lrc: 0/0,0 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597430:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597434:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597434:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597436:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597437:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597439:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597439:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597442:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597483:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1034:39030:x1731745946460160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 865us (888us total) trans 30064893604 rc 0/0 00000100:00100000:0.0:1651529344.597485:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152742 00000100:00100000:1.0:1651529344.597487:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1034:39029:x1731745946459968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1191us (1289us total) trans 30064893605 rc 0/0 00000100:00100000:1.0:1651529344.597490:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152740 00010000:00010000:0.0:1651529344.597492:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597495:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b3aa030 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.597496:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597498:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597499:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 3/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597501:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3e6e49f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.597502:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597505:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 3/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597509:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 1/0,0 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597512:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e6e49f/0xa29a79078f3becba lrc: 0/0,0 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597513:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 1/0,0 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597516:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3becc8 lrc: 0/0,0 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597554:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.597558:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.597569:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341504 00010000:00010000:0.0:1651529344.597581:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 5/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1029 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597589:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11705 00000100:00100000:0.0:1651529344.597590:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396341504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.597593:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.597594:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 5/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597598:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 4/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1029 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597604:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597604:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597605:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597608:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 4/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597613:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.597625:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396341504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.597628:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11705 00010000:00010000:1.0:1651529344.597637:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3babde lrc: 0/0,0 mode: --/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dff expref: 1028 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.597645:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966649920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.597648:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597652:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597654:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597657:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597660:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.597706:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1033:39030:x1731745946460224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 962us (992us total) trans 30064893606 rc 0/0 00000100:00100000:1.0:1651529344.597709:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152743 00000100:00100000:1.0:1651529344.597714:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460416 00000100:00100000:1.0:1651529344.597721:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460480 00000100:00100000:0.0:1651529344.597741:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460544 00000100:00100000:1.0:1651529344.597746:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152744 00000100:00100000:1.0:1651529344.597748:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1035:39030:x1731745946460416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.597751:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152745 00002000:00080000:1.0:1651529344.597753:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177536 count 1 00000100:00100000:0.0:1651529344.597753:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1035:39029:x1731745946460480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.597757:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.597758:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177537 count 1 00010000:00010000:1.0:1651529344.597762:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 2/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.597763:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597765:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597766:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597767:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 4/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597768:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 2/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.597771:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597772:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597773:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 3/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.597773:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 4/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597777:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.597780:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 3/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.597782:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966649984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.597783:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597790:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966650048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597796:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.597801:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597821:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa2c2b0a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.597822:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597826:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 3/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597833:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 1/0,0 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597836:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c2b0a/0xa29a79078f3beccf lrc: 0/0,0 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597844:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152746 00000100:00100000:1.0:1651529344.597846:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1035:39030:x1731745946460544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.597846:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.597851:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177538 count 1 00010000:00010000:1.0:1651529344.597854:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597858:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 2/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597861:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597862:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597862:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 4/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597869:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 3/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.597874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.597882:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.597890:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966650112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597898:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.597908:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460992 00000100:00100000:1.0:1651529344.597927:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460928 00000100:00100000:0.0:1651529344.597927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.597942:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461056 00000100:00100000:1.0:1651529344.597949:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152747 00000100:00100000:1.0:1651529344.597951:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1038:39029:x1731745946460992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.597962:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177540 count 1 00000100:00100000:0.0:1651529344.597962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.597966:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597969:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.597970:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 2/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597973:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597974:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597974:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 4/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597975:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461120 00010000:00010000:1.0:1651529344.597981:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 3/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.597981:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461248 00010000:00010000:1.0:1651529344.597984:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.597984:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152748 00000100:00100000:0.0:1651529344.597985:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946460928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.597988:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966650176:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.597991:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177539 count 1 00010000:00010000:0.0:1651529344.597996:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598002:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.598008:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 2/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.598009:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152749 00000100:00100000:1.0:1651529344.598011:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946461056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.598011:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598012:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598012:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 4/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.598015:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177541 count 1 00010000:00010000:1.0:1651529344.598019:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598020:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 3/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598023:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 2/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598026:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598026:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598027:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598027:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 4/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598030:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966650240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598034:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 3/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598037:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.598041:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966650304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.598048:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.598054:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.598062:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152750 00000100:00100000:0.0:1651529344.598063:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1040:39029:x1731745946461120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.598068:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177542 count 1 00010000:00010000:0.0:1651529344.598072:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598077:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 2/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.598080:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598080:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.598094:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966649984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598101:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 4/0,1 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598103:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598109:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 3/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.598113:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 4/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598120:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966650368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.598138:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.598145:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152751 00000100:00100000:0.0:1651529344.598147:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946461248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.598170:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177543 count 1 00010000:00010000:0.0:1651529344.598175:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598179:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 2/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.598182:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966650112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598182:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598183:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598184:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 4/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598186:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598190:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 3/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.598193:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598197:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966650432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.598209:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.598219:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966650048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598224:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598293:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966650176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598297:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598375:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966650304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598378:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598396:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966650240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598401:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598408:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966650368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598410:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598699:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.598701:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966650432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.598708:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.598744:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.598754:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341568 00010000:00010000:0.0:1651529344.598759:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1028 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.598765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.598765:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341696 00010000:00010000:0.0:1651529344.598767:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1029 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598771:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341824 00010000:00010000:0.0:1651529344.598773:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1030 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.598780:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342080 00000100:00100000:0.0:1651529344.598780:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342208 00010000:00010000:0.0:1651529344.598782:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1032 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598785:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342464 00010000:00010000:1.0:1651529344.598786:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1032 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598788:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1033 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.598792:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342400 00000100:00100000:0.0:1651529344.598792:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342272 00010000:00010000:0.0:1651529344.598794:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598795:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 4/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598799:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11706 00000100:00100000:0.0:1651529344.598800:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1035:41278:x1731746396341568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.598812:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11707 00000100:00100000:1.0:1651529344.598815:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1035:41278:x1731746396341696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.598819:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598821:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598822:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598824:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598825:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 3/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598828:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 3/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598831:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3ba42f lrc: 0/0,0 mode: --/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eda expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598834:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9b64ab2/0xa29a79078f3bb696 lrc: 0/0,0 mode: --/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a7 expref: 1035 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598835:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598836:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598837:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598838:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598839:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598840:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598840:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 4/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598843:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 4/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598848:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.598857:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598865:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1033:41278:x1731746396341696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.598865:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1033:41278:x1731746396341568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.598868:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11706 00000100:00100000:1.0:1651529344.598869:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11707 00000100:00100000:0.0:1651529344.598873:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11708 00000100:00100000:1.0:1651529344.598875:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11709 00000100:00100000:0.0:1651529344.598875:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1031:41278:x1731746396341824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.598877:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1031:41278:x1731746396342208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.598878:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598880:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598880:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598881:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598884:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 3/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598885:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 3/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598889:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b4c3ec/0xa29a79078f3ba46e lrc: 0/0,0 mode: --/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fe4 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598890:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3ba41a lrc: 0/0,0 mode: --/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ea2 expref: 1031 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598892:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598893:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598893:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598894:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598895:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598898:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 4/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598899:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 4/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598904:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.598908:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.598914:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41278:x1731746396341824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598915:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41278:x1731746396342208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.598917:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11708 00000100:00100000:1.0:1651529344.598918:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11709 00000100:00100000:0.0:1651529344.598921:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11710 00000100:00100000:1.0:1651529344.598923:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11711 00000100:00100000:0.0:1651529344.598923:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1027:41278:x1731746396342080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.598925:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1027:41278:x1731746396342464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.598925:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598927:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598928:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598929:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598930:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 3/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598933:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 3/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598935:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006848055e/0xa29a79078f3bb0e6 lrc: 0/0,0 mode: --/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4234 expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598938:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3b991c lrc: 0/0,0 mode: --/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce24f expref: 1027 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598939:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598939:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598940:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598941:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598942:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598943:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598943:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 4/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598946:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 4/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598954:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598960:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1025:41278:x1731746396342464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598962:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11711 00010000:00010000:0.0:1651529344.598966:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598973:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11712 00000100:00100000:0.0:1651529344.598973:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1024:41278:x1731746396342080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598975:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1024:41279:x1731746396342272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.598975:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11710 00010000:00010000:1.0:1651529344.598977:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598979:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598982:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 3/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.598985:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11713 00000100:00100000:0.0:1651529344.598987:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1023:41279:x1731746396342400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.598989:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598991:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 4/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.598995:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 3/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.598996:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f083c6b2/0xa29a79078f3ba961 lrc: 0/0,0 mode: --/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24ac expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.599000:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599000:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000293bbadd/0xa29a79078f3ba31e lrc: 0/0,0 mode: --/PR res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a9d expref: 1022 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.599001:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599001:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599003:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599004:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 4/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599004:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599005:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599008:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 4/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599013:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.599019:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41279:x1731746396342272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (267us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.599019:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.599022:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11712 00000100:00100000:0.0:1651529344.599026:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1020:41279:x1731746396342400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.599033:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599036:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599036:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11713 00010000:00010000:1.0:1651529344.599039:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599042:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599044:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599047:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599051:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599053:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599087:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946460416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1533us total) trans 30064893607 rc 0/0 00000100:00100000:1.0:1651529344.599090:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152744 00010000:00010000:1.0:1651529344.599097:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599097:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1041:39029:x1731745946460480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1343us (1454us total) trans 30064893608 rc 0/0 00000100:00100000:0.0:1651529344.599100:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152745 00010000:00010000:1.0:1651529344.599101:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599104:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599106:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599108:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599111:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b27ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.599112:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599114:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 3/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599119:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 1/0,0 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599130:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3becd6 lrc: 0/0,0 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599134:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599137:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000260e1672 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.599138:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599139:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946461056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1127us (1212us total) trans 30064893609 rc 0/0 00010000:00010000:0.0:1651529344.599141:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 3/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599142:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152749 00010000:00010000:0.0:1651529344.599144:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 1/0,0 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599147:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3becdd lrc: 0/0,0 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599148:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599150:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599152:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599153:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ca427590 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.599153:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599155:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599163:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 3/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599166:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 1/0,0 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599168:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599169:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3becf9 lrc: 0/0,0 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599173:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599175:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.599176:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599179:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 3/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599181:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 1/0,0 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599184:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3bece4 lrc: 0/0,0 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599190:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599193:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599196:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599199:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599200:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946460544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1354us (1511us total) trans 30064893610 rc 0/0 00000100:00100000:1.0:1651529344.599203:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152746 00010000:00010000:1.0:1651529344.599210:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599213:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599216:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599219:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599236:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1042:39029:x1731745946461120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1274us total) trans 30064893611 rc 0/0 00000100:00100000:0.0:1651529344.599239:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152750 00010000:00010000:0.0:1651529344.599246:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599249:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1041:39029:x1731745946460992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1297us (1375us total) trans 30064893612 rc 0/0 00010000:00010000:0.0:1651529344.599250:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599252:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152747 00010000:00010000:0.0:1651529344.599252:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599255:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599259:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599262:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3236877 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.599263:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599267:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 3/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599272:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 1/0,0 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599274:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bed00 lrc: 0/0,0 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599279:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599281:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.599282:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599285:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 3/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599286:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946460928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1299us (1397us total) trans 30064893613 rc 0/0 00010000:00010000:1.0:1651529344.599288:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 1/0,0 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599290:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152748 00010000:00010000:1.0:1651529344.599291:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3beceb lrc: 0/0,0 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599294:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599297:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003300a3f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.599297:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599298:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599301:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 3/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599301:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599303:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599304:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 1/0,0 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599306:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3becf2 lrc: 0/0,0 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599306:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599310:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599312:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bd5505b5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.599313:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599316:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 3/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599319:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 1/0,0 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599332:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bed07 lrc: 0/0,0 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599335:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946461248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1187us (1365us total) trans 30064893614 rc 0/0 00000100:00100000:0.0:1651529344.599337:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152751 00000100:00100000:0.0:1651529344.599643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599659:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461952 00000100:00100000:0.0:1651529344.599671:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461888 00000100:00100000:0.0:1651529344.599675:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152752 00000100:00100000:0.0:1651529344.599677:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913fbcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946461952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.599681:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152753 00000100:00100000:1.0:1651529344.599683:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946461888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.599683:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177545 count 1 00010000:00010000:0.0:1651529344.599687:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.599689:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177544 count 1 00010000:00010000:0.0:1651529344.599692:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 2/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599693:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599696:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599696:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599697:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 4/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599698:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 2/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599701:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599701:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599702:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 4/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599704:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 3/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599708:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.599709:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 3/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.599712:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966650496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599713:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.599717:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966650560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599726:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599743:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.599796:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599798:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462080 00000100:00100000:1.0:1651529344.599823:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599832:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462016 00000100:00100000:1.0:1651529344.599835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599836:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462208 00000100:00100000:0.0:1651529344.599840:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462336 00000100:00100000:1.0:1651529344.599842:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599849:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462144 00000100:00100000:1.0:1651529344.599853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599854:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152754 00000100:00100000:0.0:1651529344.599855:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946462080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.599860:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462272 00002000:00080000:0.0:1651529344.599861:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177547 count 1 00010000:00010000:0.0:1651529344.599865:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599867:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152755 00000100:00100000:1.0:1651529344.599868:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1048:39029:x1731745946462016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.599870:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 2/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1019 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.599874:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177546 count 1 00010000:00010000:0.0:1651529344.599875:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599876:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599877:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 4/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599878:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599883:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 2/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599883:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 3/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1019 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599886:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599886:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599887:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 4/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599887:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1019 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.599891:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966650624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599894:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 3/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599897:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.599901:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966650688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599902:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.599908:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152756 00000100:00100000:1.0:1651529344.599910:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.599910:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946462208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.599914:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177549 count 1 00000100:00100000:1.0:1651529344.599917:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152757 00010000:00010000:0.0:1651529344.599917:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599918:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946462336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.599921:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 2/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.599923:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177551 count 1 00010000:00010000:0.0:1651529344.599924:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599925:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599925:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 4/0,1 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599926:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599930:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 2/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599933:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599934:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599934:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 4/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599934:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 3/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599938:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 4/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.599941:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 3/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.599942:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966650752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599945:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.599948:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966650816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599948:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.599954:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152758 00000100:00100000:1.0:1651529344.599955:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.599955:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1048:39029:x1731745946462144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.599959:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177548 count 1 00000100:00100000:1.0:1651529344.599960:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152759 00000100:00100000:1.0:1651529344.599962:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1048:39029:x1731745946462272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.599962:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.599966:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177550 count 1 00010000:00010000:0.0:1651529344.599967:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 2/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599969:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599969:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599970:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599970:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 4/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599976:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 2/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599976:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 3/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599979:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599979:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599980:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 4/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599980:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.599984:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966650880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599986:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 3/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1019 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599989:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.599990:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599993:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966650944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.599999:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.600089:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966650560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600094:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600118:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966650496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600123:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.600152:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342720 00000100:00100000:1.0:1651529344.600154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.600163:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1020 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600173:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342784 00010000:00010000:0.0:1651529344.600176:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600177:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11714 00000100:00100000:1.0:1651529344.600179:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41279:x1731746396342720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.600185:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11715 00010000:00010000:1.0:1651529344.600187:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.600187:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41278:x1731746396342784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.600189:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600190:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600191:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600194:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 3/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600195:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 3/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600200:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddde7db6/0xa29a79078f3bbe0d lrc: 0/0,0 mode: --/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d751e expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600201:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000790a0b38/0xa29a79078f3bb1db lrc: 0/0,0 mode: --/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d461d expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600204:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600204:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600205:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600205:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600205:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600208:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 4/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600214:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.600220:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600226:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41279:x1731746396342720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.600229:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11714 00010000:00010000:1.0:1651529344.600238:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600243:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 4/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600246:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600250:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600251:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.600253:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600259:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1018:41278:x1731746396342784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 72us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600262:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11715 00010000:00010000:0.0:1651529344.600282:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600286:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600289:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600292:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600293:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1049:39030:x1731745946461888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 609us (640us total) trans 30064893615 rc 0/0 00000100:00100000:1.0:1651529344.600296:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152753 00010000:00010000:1.0:1651529344.600312:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600315:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.600316:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600319:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 3/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600324:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 1/0,0 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600327:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bed15 lrc: 0/0,0 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600331:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600334:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000439b8d89 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.600335:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600338:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 3/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600341:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 1/0,0 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600344:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bed0e lrc: 0/0,0 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600356:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913fbcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1049:39030:x1731745946461952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 678us (713us total) trans 30064893616 rc 0/0 00000100:00100000:0.0:1651529344.600359:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152752 00000100:00100000:0.0:1651529344.600394:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966650624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600399:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600411:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966650752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600414:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600446:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966650880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.600447:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966650688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600450:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600452:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600460:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966650816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600462:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.600628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600653:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966650944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600656:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.600669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.600679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600680:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462592 00000100:00100000:0.0:1651529344.600687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600695:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462656 00000100:00100000:0.0:1651529344.600698:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600702:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152760 00000100:00100000:1.0:1651529344.600704:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1050:39030:x1731745946462592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.600709:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177552 count 1 00000100:00100000:0.0:1651529344.600710:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152761 00000100:00100000:0.0:1651529344.600712:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1050:39029:x1731745946462656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.600713:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600717:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 2/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1017 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.600718:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177553 count 1 00010000:00010000:1.0:1651529344.600720:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600721:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600722:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 4/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600723:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600727:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 2/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1017 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.600728:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 3/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1017 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.600741:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600743:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600744:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.600745:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600745:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 4/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600752:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 3/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1017 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.600756:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600759:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.600766:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343104 00000100:00100000:0.0:1651529344.600766:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966651072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600770:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1018 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600776:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343232 00000100:00100000:0.0:1651529344.600776:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.600778:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600783:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343488 00000100:00100000:0.0:1651529344.600783:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343360 00010000:00010000:1.0:1651529344.600785:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600788:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 4/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1021 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600789:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343424 00010000:00010000:1.0:1651529344.600791:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1022 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600794:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343552 00000100:00100000:1.0:1651529344.600796:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11716 00010000:00010000:0.0:1651529344.600797:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.600798:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1023:41278:x1731746396343104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.600800:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.600802:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11717 00010000:00010000:1.0:1651529344.600813:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1023 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600818:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 3/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1023 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600821:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1023:41278:x1731746396343232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.600824:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.600826:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600829:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4643481/0xa29a79078f3b79f7 lrc: 0/0,0 mode: --/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb98a expref: 1023 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600830:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 3/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1023 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600833:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600833:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600834:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600836:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c23aac/0xa29a79078f3bc00c lrc: 0/0,0 mode: --/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ccd expref: 1022 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600840:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 4/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600840:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600840:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600841:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600844:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 4/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600849:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600856:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41278:x1731746396343104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.600859:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600864:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11716 00000100:00100000:0.0:1651529344.600866:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41278:x1731746396343232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600869:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11717 00000100:00100000:1.0:1651529344.600870:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11718 00000100:00100000:1.0:1651529344.600872:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41278:x1731746396343488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.600875:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600876:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600879:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11719 00010000:00010000:1.0:1651529344.600880:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 3/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600881:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41278:x1731746396343360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.600884:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600885:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fd2893c/0xa29a79078f3bb6f1 lrc: 0/0,0 mode: --/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59e9 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600885:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 4/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1019 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600889:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600889:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600889:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 3/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1018 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600890:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600893:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 4/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600894:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000001b198/0xa29a79078f3bb7d8 lrc: 0/0,0 mode: --/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d69 expref: 1018 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600898:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600898:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600899:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600902:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600909:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1017:41278:x1731746396343488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.600909:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 4/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600911:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11718 00010000:00010000:0.0:1651529344.600915:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600916:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11720 00000100:00100000:1.0:1651529344.600918:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1016:41279:x1731746396343424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.600920:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600921:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1016 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600921:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1016:41278:x1731746396343360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600924:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11719 00010000:00010000:1.0:1651529344.600925:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 3/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1016 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600929:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11721 00010000:00010000:1.0:1651529344.600930:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016acfe1/0xa29a79078f3bb31d lrc: 0/0,0 mode: --/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4baa expref: 1015 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.600930:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1015:41279:x1731746396343552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.600933:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600933:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600934:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600934:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1014 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600935:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600937:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 4/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600938:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 3/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1014 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.600942:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0b1eb6/0xa29a79078f3bb9c9 lrc: 0/0,0 mode: --/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64ee expref: 1014 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.600943:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600948:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1013:41279:x1731746396343424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.600948:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600948:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600949:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600951:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11720 00010000:00010000:0.0:1651529344.600952:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 4/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600961:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.600967:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600967:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1012:41279:x1731746396343552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600969:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11721 00010000:00010000:1.0:1651529344.600971:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600974:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600976:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600977:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600979:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600982:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600991:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601028:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946462016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1159us (1232us total) trans 30064893617 rc 0/0 00000100:00100000:1.0:1651529344.601031:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152755 00010000:00010000:1.0:1651529344.601039:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601042:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601044:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946462208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1133us (1220us total) trans 30064893618 rc 0/0 00010000:00010000:1.0:1651529344.601045:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601047:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601049:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152756 00010000:00010000:0.0:1651529344.601057:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601060:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7fda0ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.601062:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601065:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 3/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601069:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 1/0,0 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601072:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bed23 lrc: 0/0,0 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601076:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601079:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d0435fb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.601080:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601083:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 3/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601089:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 1/0,0 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601091:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bed2a lrc: 0/0,0 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601095:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601097:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.601098:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601101:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946462336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1182us (1265us total) trans 30064893619 rc 0/0 00010000:00010000:0.0:1651529344.601101:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 3/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601104:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152757 00010000:00010000:0.0:1651529344.601104:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 1/0,0 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601106:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bed31 lrc: 0/0,0 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601111:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601114:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601115:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601117:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601118:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601120:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601121:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601123:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601156:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946462144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1199us (1313us total) trans 30064893620 rc 0/0 00000100:00100000:1.0:1651529344.601157:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946462272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1194us (1303us total) trans 30064893621 rc 0/0 00000100:00100000:0.0:1651529344.601159:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152758 00000100:00100000:1.0:1651529344.601160:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152759 00010000:00010000:0.0:1651529344.601166:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601167:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601169:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601170:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f0efca already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.601171:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601172:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601174:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 3/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601174:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601193:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 1/0,0 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601196:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bed38 lrc: 0/0,0 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601200:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601203:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8285924 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.601203:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601206:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 3/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601209:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 1/0,0 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601212:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bed3f lrc: 0/0,0 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601212:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946462080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1355us (1449us total) trans 30064893622 rc 0/0 00010000:00010000:1.0:1651529344.601215:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601215:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152754 00010000:00010000:1.0:1651529344.601218:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001090ca5e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.601219:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601222:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 3/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601225:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 1/0,0 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601227:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bed1c lrc: 0/0,0 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.601540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.601565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.601574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601580:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966651072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.601582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.601584:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601594:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.601597:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343744 00010000:00010000:1.0:1651529344.601599:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601602:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1012 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.601606:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463104 00000100:00100000:1.0:1651529344.601613:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463232 00000100:00100000:1.0:1651529344.601619:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463168 00000100:00100000:1.0:1651529344.601623:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463296 00000100:00100000:1.0:1651529344.601629:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152762 00000100:00100000:1.0:1651529344.601630:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1054:39030:x1731745946463104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.601641:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343808 00010000:00010000:0.0:1651529344.601645:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.601649:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177554 count 1 00000100:00100000:0.0:1651529344.601653:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11722 00000100:00100000:0.0:1651529344.601655:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1013:41278:x1731746396343744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.601658:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601658:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.601659:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.601663:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 3/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.601669:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be668200/0xa29a79078f3baf34 lrc: 0/0,0 mode: --/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b2d expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.601671:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 2/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1013 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601673:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601673:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601674:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601674:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601675:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601675:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 4/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601677:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 4/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601683:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1012 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601686:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.601692:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1012 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.601696:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1012:41278:x1731746396343744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.601699:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11722 00000100:00100000:1.0:1651529344.601701:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966651136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.601704:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11723 00000100:00100000:0.0:1651529344.601705:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1011:41279:x1731746396343808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.601708:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.601709:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1011 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.601711:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.601713:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 3/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1011 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.601717:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152763 00010000:00010000:0.0:1651529344.601718:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022ce49f3/0xa29a79078f3bb26e lrc: 0/0,0 mode: --/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4823 expref: 1011 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.601719:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1054:39030:x1731745946463232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.601721:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601722:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601723:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.601724:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177556 count 1 00010000:00010000:0.0:1651529344.601725:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 4/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601728:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601742:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.601743:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 2/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1010 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601746:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601747:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601747:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 4/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601749:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1010:41279:x1731746396343808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.601751:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11723 00010000:00010000:1.0:1651529344.601755:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 3/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601759:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.601760:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152764 00000100:00100000:0.0:1651529344.601761:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1054:39030:x1731745946463168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.601762:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966651200:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.601767:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177555 count 1 00000100:00100000:1.0:1651529344.601770:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.601771:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601775:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 2/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.601777:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152765 00010000:00010000:0.0:1651529344.601778:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601778:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.601779:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1054:39029:x1731745946463296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.601779:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 4/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.601783:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177557 count 1 00010000:00010000:0.0:1651529344.601786:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 3/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601787:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601789:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.601791:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 2/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601794:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601794:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.601794:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966651264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.601795:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 4/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601801:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 3/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.601802:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.601827:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601831:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601834:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 4/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.601834:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601837:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601839:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966651328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.601847:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.601853:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601856:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601859:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601862:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601878:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1055:39029:x1731745946462656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1165us (1247us total) trans 30064893623 rc 0/0 00000100:00100000:0.0:1651529344.601881:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152761 00010000:00010000:0.0:1651529344.601889:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601892:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000414c5ef5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.601893:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601896:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 3/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601901:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946462592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1196us (1279us total) trans 30064893624 rc 0/0 00010000:00010000:0.0:1651529344.601901:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 1/0,0 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601904:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152760 00010000:00010000:0.0:1651529344.601907:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bed4d lrc: 0/0,0 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601911:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601913:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf7a79e8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.601914:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601917:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 3/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601920:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 1/0,0 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.601923:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bed46 lrc: 0/0,0 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601933:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463424 00000100:00100000:0.0:1651529344.601945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.601956:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463360 00000100:00100000:1.0:1651529344.601963:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152766 00000100:00100000:1.0:1651529344.601965:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1056:39029:x1731745946463424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.601978:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177559 count 1 00010000:00010000:1.0:1651529344.601982:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601987:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 2/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.601995:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152767 00000100:00100000:0.0:1651529344.601997:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1056:39030:x1731745946463360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.602002:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177558 count 1 00010000:00010000:0.0:1651529344.602007:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602010:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602014:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 2/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.602016:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602016:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 4/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602017:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602018:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602018:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 4/0,1 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602025:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 3/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602025:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 3/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.602029:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 4/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602029:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 4/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.602033:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.602033:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966651456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.602048:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.602072:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.602185:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966651136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.602190:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602213:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966651200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.602216:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.602288:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463680 00000100:00100000:1.0:1651529344.602289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.602301:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463744 00000100:00100000:0.0:1651529344.602306:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152768 00000100:00100000:0.0:1651529344.602308:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946463680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.602313:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177560 count 1 00010000:00010000:0.0:1651529344.602317:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602321:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 2/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1009 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602327:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602328:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602328:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 4/0,1 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602335:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 3/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1009 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602339:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 4/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1009 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.602343:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966651520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.602354:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.602359:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152769 00000100:00100000:0.0:1651529344.602361:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946463744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.602365:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177561 count 1 00010000:00010000:0.0:1651529344.602368:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602373:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 2/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602376:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602376:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602377:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 4/0,1 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602385:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 3/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1009 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602389:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 4/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.602393:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966651584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.602399:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.602719:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966651264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602724:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602749:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966651456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.602758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602758:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602765:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344448 00000100:00100000:1.0:1651529344.602770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602770:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1010 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.602778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602782:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344384 00000100:00100000:1.0:1651529344.602783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602784:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1011 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.602794:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344576 00000100:00100000:1.0:1651529344.602799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602801:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 5/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1012 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.602821:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602821:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344512 00010000:00010000:0.0:1651529344.602824:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.602829:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344704 00000100:00100000:1.0:1651529344.602830:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966651328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602831:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 4/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1014 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602834:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602835:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344640 00010000:00010000:0.0:1651529344.602837:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 5/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1015 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.602840:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344896 00000100:00100000:1.0:1651529344.602842:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602842:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 5/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1016 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602844:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602846:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344832 00010000:00010000:0.0:1651529344.602848:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 5/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1017 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.602851:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11724 00000100:00100000:1.0:1651529344.602853:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1017:41279:x1731746396344448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.602854:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11725 00010000:00010000:1.0:1651529344.602856:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.602856:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1017:41278:x1731746396344384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.602858:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602858:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.602860:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602864:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 3/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602866:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602870:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f3b73b2/0xa29a79078f3ba619 lrc: 0/0,0 mode: --/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1785 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602872:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d213dc89/0xa29a79078f3bb172 lrc: 0/0,0 mode: --/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4441 expref: 1017 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602874:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602874:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602875:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602876:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602876:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602877:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602878:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 4/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602880:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 4/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602884:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.602889:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602903:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1015:41279:x1731746396344448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.602906:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11724 00000100:00100000:0.0:1651529344.602907:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1015:41278:x1731746396344384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.602910:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11725 00000100:00100000:0.0:1651529344.602916:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11726 00000100:00100000:0.0:1651529344.602917:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1013:41279:x1731746396344576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.602918:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11727 00000100:00100000:1.0:1651529344.602920:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1013:41278:x1731746396344512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.602920:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602922:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.602922:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 4/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602924:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602925:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 3/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602928:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 3/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602931:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092cc9d0f/0xa29a79078f3bbb89 lrc: 0/0,0 mode: --/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bd2 expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602934:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004446e986/0xa29a79078f3baa02 lrc: 0/0,0 mode: --/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d268f expref: 1013 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602934:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602935:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602935:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602937:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602938:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602939:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602939:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 4/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602942:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 4/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602948:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.602957:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.602959:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1011:41279:x1731746396344576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.602962:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11726 00000100:00100000:1.0:1651529344.602964:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1011:41278:x1731746396344512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.602967:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11727 00000100:00100000:0.0:1651529344.602968:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11728 00000100:00100000:0.0:1651529344.602970:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1009:41279:x1731746396344704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.602972:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11729 00000100:00100000:1.0:1651529344.602973:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1009:41278:x1731746396344640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.602973:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.602974:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 4/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602976:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602977:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 4/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602978:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 3/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602981:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 3/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602982:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e421f727/0xa29a79078f3ba555 lrc: 0/0,0 mode: --/PR res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1452 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.602986:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef6f004/0xa29a79078f3bbfbf lrc: 0/0,0 mode: --/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bfb expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.602988:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602989:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602992:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602992:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 4/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602993:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602994:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602996:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 4/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602998:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.603002:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.603003:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1007:41279:x1731746396344704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.603005:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11728 00000100:00100000:1.0:1651529344.603007:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1006:41278:x1731746396344640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.603009:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11730 00000100:00100000:1.0:1651529344.603011:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11729 00000100:00100000:0.0:1651529344.603011:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1006:41279:x1731746396344896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.603013:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.603014:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 5/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1005 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.603015:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11731 00000100:00100000:1.0:1651529344.603016:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1005:41278:x1731746396344832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.603018:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 4/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1005 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.603019:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.603020:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 5/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1005 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.603022:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603023:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603024:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 4/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1005 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.603024:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603028:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603029:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603029:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603029:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 4/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603033:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.603037:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1005:41279:x1731746396344896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.603040:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11730 00010000:00010000:1.0:1651529344.603043:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 4/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603046:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603048:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.603050:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603053:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603054:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1004:41278:x1731746396344832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (233us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.603055:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603057:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11731 00010000:00010000:1.0:1651529344.603076:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603080:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603083:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603085:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603112:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946463360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1114us (1167us total) trans 30064893625 rc 0/0 00000100:00100000:0.0:1651529344.603115:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152767 00010000:00010000:0.0:1651529344.603137:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603141:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603142:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1059:39030:x1731745946463232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1422us (1577us total) trans 30064893626 rc 0/0 00000100:00100000:1.0:1651529344.603146:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152763 00010000:00010000:0.0:1651529344.603152:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603153:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603155:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603157:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603160:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603163:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603194:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946463168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1432us (1620us total) trans 30064893627 rc 0/0 00000100:00100000:1.0:1651529344.603197:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946463104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1565us (1657us total) trans 30064893628 rc 0/0 00000100:00100000:0.0:1651529344.603197:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152764 00000100:00100000:1.0:1651529344.603200:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152762 00010000:00010000:0.0:1651529344.603204:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603207:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603208:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea1a6d66 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.603209:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603210:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005d294e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603211:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603212:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 3/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603214:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 3/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603217:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 1/0,0 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603219:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 1/0,0 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603220:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bed77 lrc: 0/0,0 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603221:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d294e5/0xa29a79078f3bed5b lrc: 0/0,0 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603224:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603226:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603229:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594b0e00 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603230:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603232:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 3/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603234:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ef8b7cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603235:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 1/0,0 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603235:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603238:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594b0e00/0xa29a79078f3bed54 lrc: 0/0,0 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603238:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 3/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603242:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 1/0,0 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603243:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603244:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bed62 lrc: 0/0,0 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603246:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603249:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603252:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603254:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003006eb41/0xa29a79078f3bbcaf lrc: 0/0,0 mode: --/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7040 expref: 1003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.603258:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966651584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603262:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603265:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603267:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603279:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603281:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603284:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1059:39029:x1731745946463424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1318us (1363us total) trans 30064893629 rc 0/0 00000100:00100000:1.0:1651529344.603299:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152766 00010000:00010000:1.0:1651529344.603306:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603309:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b3aa030 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603310:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603313:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 3/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603317:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 1/0,0 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603320:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3aa030/0xa29a79078f3bed70 lrc: 0/0,0 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603323:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1059:39029:x1731745946463744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1033us total) trans 30064893630 rc 0/0 00010000:00010000:1.0:1651529344.603324:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603326:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152769 00010000:00010000:1.0:1651529344.603327:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000484854f5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603328:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603331:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 3/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603336:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 1/0,0 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603337:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdffcc1/0xa29a79078f3b93e3 lrc: 0/0,0 mode: --/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd56 expref: 1002 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.603339:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3bed85 lrc: 0/0,0 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603341:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966651520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.603344:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603344:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603347:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603348:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603350:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603350:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603353:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603353:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603369:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603398:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946463296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1619us (1816us total) trans 30064893631 rc 0/0 00000100:00100000:1.0:1651529344.603401:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152765 00010000:00010000:1.0:1651529344.603408:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603410:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1059:39029:x1731745946463680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1102us (1133us total) trans 30064893632 rc 0/0 00010000:00010000:1.0:1651529344.603412:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008368e776 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.603413:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603413:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152768 00010000:00010000:1.0:1651529344.603416:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 3/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603420:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 1/0,0 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603421:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603423:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008368e776/0xa29a79078f3bed69 lrc: 0/0,0 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603424:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006edccc33 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.603425:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603428:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 3/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603433:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 1/0,0 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603435:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bed7e lrc: 0/0,0 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.603761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.603770:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603772:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464320 00000100:00100000:0.0:1651529344.603776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603786:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464448 00000100:00100000:0.0:1651529344.603787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603791:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464384 00000100:00100000:0.0:1651529344.603793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603819:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464576 00000100:00100000:1.0:1651529344.603827:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464512 00000100:00100000:1.0:1651529344.603832:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464704 00000100:00100000:0.0:1651529344.603834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603836:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152770 00000100:00100000:1.0:1651529344.603837:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1064:39029:x1731745946464320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.603841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.603843:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177562 count 1 00010000:00010000:1.0:1651529344.603847:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603847:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464640 00010000:00010000:1.0:1651529344.603852:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 2/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.603853:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464768 00010000:00010000:1.0:1651529344.603855:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603856:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603856:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 4/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603856:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152771 00000100:00100000:0.0:1651529344.603858:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1066:39029:x1731745946464448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.603864:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177564 count 1 00010000:00010000:0.0:1651529344.603868:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603873:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 2/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603874:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603876:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603877:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603878:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 4/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603879:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.603883:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966651648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603885:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 3/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603888:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.603893:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966651712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603895:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.603901:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152772 00000100:00100000:0.0:1651529344.603902:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.603903:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946464384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.603908:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177563 count 1 00000100:00100000:0.0:1651529344.603909:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152773 00010000:00010000:1.0:1651529344.603911:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603911:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1066:39029:x1731745946464576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.603915:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177566 count 1 00010000:00010000:1.0:1651529344.603916:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 2/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603919:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603919:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603920:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603920:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 4/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603923:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 2/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603926:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 3/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603926:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603927:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603928:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 4/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603930:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.603934:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603934:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 3/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603938:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.603941:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.603941:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966651840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603946:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152774 00000100:00100000:1.0:1651529344.603948:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946464512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.603948:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.603952:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177565 count 1 00000100:00100000:0.0:1651529344.603954:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152775 00010000:00010000:1.0:1651529344.603955:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603956:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1066:39029:x1731745946464704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.603959:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 2/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.603960:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177568 count 1 00010000:00010000:1.0:1651529344.603963:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603963:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603963:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603964:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 4/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603969:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 3/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603970:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 2/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 1001 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603972:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603973:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 4/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.603973:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603974:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 4/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603977:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966651904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603979:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 3/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 1001 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.603983:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.603983:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 1001 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.603987:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966651968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603989:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152776 00000100:00100000:1.0:1651529344.603991:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946464640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.603993:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.603995:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177567 count 1 00010000:00010000:1.0:1651529344.603997:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603999:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152777 00000100:00100000:0.0:1651529344.604000:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946464768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.604002:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 2/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.604005:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604005:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.604005:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177569 count 1 00010000:00010000:1.0:1651529344.604006:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 4/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604008:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604011:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 3/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.604012:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 2/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.604015:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 4/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604015:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604016:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604016:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 4/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604019:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966652032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604022:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 3/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 1001 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.604025:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.604026:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.604030:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.604036:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.604286:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966651648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604291:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604316:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966651776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604320:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604350:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966651712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604355:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604356:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966651904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604359:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604362:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966651840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604365:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604610:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966651968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.604619:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.604619:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604626:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604629:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.604639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.604647:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604649:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345472 00000100:00100000:1.0:1651529344.604652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.604655:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1002 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604660:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345600 00010000:00010000:0.0:1651529344.604663:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1003 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.604667:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345728 00010000:00010000:0.0:1651529344.604669:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 4/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1004 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604671:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604673:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345536 00010000:00010000:0.0:1651529344.604675:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1005 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.604679:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345856 00010000:00010000:0.0:1651529344.604681:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 5/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1006 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.604684:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345664 00010000:00010000:0.0:1651529344.604686:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1007 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604688:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966652032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.604690:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345792 00010000:00010000:1.0:1651529344.604692:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604692:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 1008 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.604698:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11732 00000100:00100000:1.0:1651529344.604699:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345920 00000100:00100000:0.0:1651529344.604700:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1008:41279:x1731746396345472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.604703:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604704:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604704:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604708:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604711:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11733 00000100:00100000:1.0:1651529344.604712:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1009:41279:x1731746396345600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.604713:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b35f7b/0xa29a79078f3ba6c8 lrc: 0/0,0 mode: --/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a72 expref: 1009 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.604715:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604717:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1008 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604718:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604721:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 3/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1008 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604721:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 4/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604727:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3ba491 lrc: 0/0,0 mode: --/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d108c expref: 1008 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604738:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.604744:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604744:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604745:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604749:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 4/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604749:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1007:41279:x1731746396345472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604752:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11732 00010000:00010000:1.0:1651529344.604755:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604757:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11734 00000100:00100000:0.0:1651529344.604759:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1006:41279:x1731746396345728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.604762:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1006:41279:x1731746396345600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.604762:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604764:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 4/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1006 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604765:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11733 00010000:00010000:0.0:1651529344.604767:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 3/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1006 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604771:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11735 00000100:00100000:1.0:1651529344.604772:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1005:41278:x1731746396345536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.604772:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad7923b/0xa29a79078f3bb9fa lrc: 0/0,0 mode: --/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ce expref: 1005 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.604775:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604776:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604776:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604777:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1004 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604777:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604780:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 3/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1004 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604780:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 4/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604785:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091212d16/0xa29a79078f3bbe30 lrc: 0/0,0 mode: --/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d761a expref: 1004 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604789:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604795:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1004:41279:x1731746396345728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.604796:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604797:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604798:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604798:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11734 00010000:00010000:1.0:1651529344.604801:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 4/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604822:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604822:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11736 00000100:00100000:0.0:1651529344.604825:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1002:41279:x1731746396345856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.604828:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1002:41278:x1731746396345536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.604828:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604830:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 4/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1002 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604831:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11735 00010000:00010000:0.0:1651529344.604833:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 3/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1002 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604836:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11737 00000100:00100000:1.0:1651529344.604838:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1001:41278:x1731746396345664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.604839:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bb01b lrc: 0/0,0 mode: --/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f2b expref: 1001 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.604841:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604842:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1000 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604842:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604842:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604843:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604846:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 3/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1000 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604846:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 4/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604851:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a51427cd/0xa29a79078f3bb7ca lrc: 0/0,0 mode: --/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d31 expref: 1000 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604854:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604861:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1000:41279:x1731746396345856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604863:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11736 00010000:00010000:1.0:1651529344.604864:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604865:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604866:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604868:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11738 00010000:00010000:1.0:1651529344.604869:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 4/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604870:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+998:41278:x1731746396345792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.604873:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604874:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 998 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.604877:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.604883:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+998:41278:x1731746396345664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.604884:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 3/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 998 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604886:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11737 00010000:00010000:0.0:1651529344.604889:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c8dca16/0xa29a79078f3b84fc lrc: 0/0,0 mode: --/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf41 expref: 997 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.604890:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11739 00000100:00100000:1.0:1651529344.604892:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+997:41278:x1731746396345920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.604893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604893:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604894:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604894:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604896:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 996 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604897:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 4/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604899:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 3/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 996 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.604902:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.604904:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c48138e/0xa29a79078f3bc297 lrc: 0/0,0 mode: --/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87bd expref: 996 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.604907:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.604908:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+995:41278:x1731746396345792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604911:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11738 00010000:00010000:1.0:1651529344.604916:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604916:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604920:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 4/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604920:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604923:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604928:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.604932:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604935:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+994:41278:x1731746396345920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.604936:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604937:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11739 00010000:00010000:1.0:1651529344.604953:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604956:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604960:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604962:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605004:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1068:39029:x1731745946464576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1091us (1226us total) trans 30064893633 rc 0/0 00000100:00100000:0.0:1651529344.605007:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152773 00010000:00010000:0.0:1651529344.605015:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605017:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1067:39030:x1731745946464384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1113us (1246us total) trans 30064893634 rc 0/0 00010000:00010000:0.0:1651529344.605018:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605020:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152772 00010000:00010000:0.0:1651529344.605022:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605024:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605028:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605034:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605037:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605040:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605061:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1068:39030:x1731745946464768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1219us total) trans 30064893635 rc 0/0 00000100:00100000:0.0:1651529344.605064:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152777 00010000:00010000:0.0:1651529344.605071:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605072:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1067:39030:x1731745946464512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1123us (1285us total) trans 30064893636 rc 0/0 00010000:00010000:0.0:1651529344.605074:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f056b2da already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.605075:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152774 00010000:00010000:0.0:1651529344.605075:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605078:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 3/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605083:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 1/0,0 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605085:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605086:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beda1 lrc: 0/0,0 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605088:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061d4b0cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.605089:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605091:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605092:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 3/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605093:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001988a229 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.605094:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605097:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 1/0,0 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605097:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 3/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605099:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d4b0cc/0xa29a79078f3bed9a lrc: 0/0,0 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605100:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 1/0,0 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605113:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605116:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4ebe75a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.605117:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605117:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bedbd lrc: 0/0,0 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605120:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 3/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605123:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 1/0,0 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605124:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605126:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ebe75a/0xa29a79078f3beda8 lrc: 0/0,0 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605127:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605130:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605132:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605133:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605135:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605138:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605140:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605169:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1068:39029:x1731745946464448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1310us (1407us total) trans 30064893637 rc 0/0 00000100:00100000:0.0:1651529344.605172:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152771 00000100:00100000:1.0:1651529344.605178:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1067:39030:x1731745946464640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1187us (1353us total) trans 30064893638 rc 0/0 00010000:00010000:0.0:1651529344.605179:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605181:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152776 00010000:00010000:0.0:1651529344.605182:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605185:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605188:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605189:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605193:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605202:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605205:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605226:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1068:39029:x1731745946464704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1270us (1433us total) trans 30064893639 rc 0/0 00000100:00100000:0.0:1651529344.605229:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152775 00010000:00010000:0.0:1651529344.605236:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605238:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1067:39029:x1731745946464320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1400us (1486us total) trans 30064893640 rc 0/0 00000100:00100000:1.0:1651529344.605241:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152770 00010000:00010000:1.0:1651529344.605248:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605250:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd31d915 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.605251:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605252:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ca427590 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.605253:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605254:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 3/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605255:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 3/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605258:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 1/0,0 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605261:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bed93 lrc: 0/0,0 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605266:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605268:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a34f4c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.605269:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 1/0,0 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605269:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605272:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca427590/0xa29a79078f3bedb6 lrc: 0/0,0 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605272:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 3/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605275:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 1/0,0 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605276:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605279:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d2fe6db already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.605280:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605283:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 3/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605285:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bedaf lrc: 0/0,0 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605286:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 1/0,0 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605288:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2fe6db/0xa29a79078f3bed8c lrc: 0/0,0 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605558:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605578:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465344 00000100:00100000:1.0:1651529344.605590:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152778 00000100:00100000:1.0:1651529344.605592:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1067:39029:x1731745946465344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.605604:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177570 count 1 00010000:00010000:1.0:1651529344.605615:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605624:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 2/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.605628:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605629:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605635:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 4/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605637:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.605643:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 3/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.605647:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.605654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605657:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.605660:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605672:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.605674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605678:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465472 00000100:00100000:1.0:1651529344.605688:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465408 00000100:00100000:1.0:1651529344.605701:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465600 00000100:00100000:1.0:1651529344.605708:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465536 00000100:00100000:1.0:1651529344.605711:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465728 00000100:00100000:1.0:1651529344.605713:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465664 00000100:00100000:1.0:1651529344.605716:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152779 00000100:00100000:1.0:1651529344.605717:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1073:39029:x1731745946465472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.605720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.605727:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465792 00002000:00080000:1.0:1651529344.605728:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177572 count 1 00010000:00010000:1.0:1651529344.605741:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605742:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152780 00000100:00100000:0.0:1651529344.605743:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1074:39030:x1731745946465408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.605747:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 2/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.605749:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177571 count 1 00010000:00010000:1.0:1651529344.605750:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605750:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605751:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 4/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605754:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605758:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 3/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605760:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 2/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605761:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.605763:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605763:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605764:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 4/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605765:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966652224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.605771:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 3/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.605778:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.605785:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152781 00000100:00100000:1.0:1651529344.605787:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de606674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1074:39029:x1731745946465600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.605787:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 4/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.605791:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966652288:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.605792:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177574 count 1 00010000:00010000:1.0:1651529344.605795:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605800:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 2/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605802:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.605820:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605821:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605821:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 4/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605827:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152782 00010000:00010000:1.0:1651529344.605829:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605829:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1074:39030:x1731745946465536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.605832:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.605834:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177573 count 1 00000100:00100000:1.0:1651529344.605836:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966652352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.605838:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605843:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 2/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.605844:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.605846:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605846:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605847:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 4/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605851:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152783 00000100:00100000:1.0:1651529344.605852:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1074:39029:x1731745946465728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.605854:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 3/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.605857:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177576 count 1 00010000:00010000:0.0:1651529344.605857:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.605860:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605864:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 2/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 993 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605867:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605868:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605868:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 4/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605872:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966652416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605874:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 3/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 993 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605880:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.605889:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 993 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.605893:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966652480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.605901:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.605906:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152784 00000100:00100000:0.0:1651529344.605908:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1074:39030:x1731745946465664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.605913:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177575 count 1 00010000:00010000:0.0:1651529344.605917:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605921:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 2/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605924:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605925:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605925:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 4/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.605940:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 3/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 993 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605944:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.605948:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.605956:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.605962:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152785 00000100:00100000:0.0:1651529344.605964:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1074:39030:x1731745946465792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.605969:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177577 count 1 00010000:00010000:0.0:1651529344.605972:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605976:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 2/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 993 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605979:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605979:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605980:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 4/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605986:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 993 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605989:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 4/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 993 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.605993:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966652608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606002:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.606006:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.606012:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606028:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346304 00010000:00010000:0.0:1651529344.606034:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 994 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.606052:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11740 00000100:00100000:1.0:1651529344.606059:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+994:41279:x1731746396346304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.606063:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606065:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 994 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606069:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 3/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 994 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606075:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e26c1fa/0xa29a79078f3ba873 lrc: 0/0,0 mode: --/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2156 expref: 994 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606079:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606079:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606090:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606094:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 4/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606100:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.606107:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966652288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606119:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+993:41279:x1731746396346304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606122:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11740 00010000:00010000:0.0:1651529344.606131:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606134:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966652224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606138:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606143:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606146:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606155:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606158:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606173:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606177:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b27ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.606179:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606182:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 3/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606187:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 1/0,0 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606190:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b27ac/0xa29a79078f3bedc4 lrc: 0/0,0 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606212:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946465344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 619us (654us total) trans 30064893641 rc 0/0 00000100:00100000:1.0:1651529344.606217:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152778 00000100:00100000:1.0:1651529344.606228:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966652352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606239:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.606396:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466176 00000100:00100000:1.0:1651529344.606406:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152786 00000100:00100000:1.0:1651529344.606408:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1075:39030:x1731745946466176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.606413:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177578 count 1 00010000:00010000:1.0:1651529344.606418:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606422:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 2/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 992 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.606425:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606426:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606427:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 4/0,1 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606448:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 3/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 992 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.606452:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 4/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 992 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.606463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.606464:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.606469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.606478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.606479:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.606486:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966652480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606489:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606496:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346560 00000100:00100000:0.0:1651529344.606502:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.606507:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.606509:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 993 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.606515:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346688 00010000:00010000:1.0:1651529344.606517:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 994 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.606521:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346816 00000100:00100000:0.0:1651529344.606522:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966652416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606523:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 995 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.606527:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346624 00010000:00010000:0.0:1651529344.606527:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606529:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 4/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 996 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.606533:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346944 00000100:00100000:0.0:1651529344.606534:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606535:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 5/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 997 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606537:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606541:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346752 00010000:00010000:1.0:1651529344.606543:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 998 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606543:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966652608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.606545:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606547:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346880 00010000:00010000:1.0:1651529344.606549:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606552:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11741 00000100:00100000:0.0:1651529344.606554:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+999:41278:x1731746396346560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.606555:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11742 00000100:00100000:1.0:1651529344.606556:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+999:41278:x1731746396346688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.606557:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606559:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.606559:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606560:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606563:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 3/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606564:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606569:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d397eb01/0xa29a79078f3b9ce2 lrc: 0/0,0 mode: --/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf208 expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606569:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4db90ae/0xa29a79078f3bb817 lrc: 0/0,0 mode: --/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e8f expref: 999 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606573:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606573:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606573:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606574:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606574:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606575:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606578:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 4/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606579:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 4/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606585:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.606589:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.606598:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+997:41278:x1731746396346560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606599:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+997:41278:x1731746396346688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.606601:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11741 00000100:00100000:1.0:1651529344.606603:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11742 00000100:00100000:0.0:1651529344.606607:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11743 00000100:00100000:1.0:1651529344.606609:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11744 00000100:00100000:0.0:1651529344.606609:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+995:41278:x1731746396346816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.606611:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+995:41279:x1731746396346624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.606612:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.606613:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 995 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606614:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606615:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 4/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606617:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 3/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 995 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606619:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 3/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606622:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022445e4b/0xa29a79078f3b8cd5 lrc: 0/0,0 mode: --/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc346 expref: 995 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606624:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e4bf7c3/0xa29a79078f3bae5b lrc: 0/0,0 mode: --/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37fa expref: 995 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606625:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606626:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606627:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606628:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606628:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606629:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606630:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 4/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606632:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 4/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606642:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606647:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+993:41279:x1731746396346624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606650:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11744 00010000:00010000:0.0:1651529344.606655:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606662:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11745 00000100:00100000:0.0:1651529344.606662:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41278:x1731746396346816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606663:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41278:x1731746396346944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.606665:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11743 00010000:00010000:1.0:1651529344.606666:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606668:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 4/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 992 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606670:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11746 00010000:00010000:1.0:1651529344.606671:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 991 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606672:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+991:41279:x1731746396346752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.606675:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606676:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001503e644/0xa29a79078f3b964b lrc: 0/0,0 mode: --/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd743 expref: 991 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606677:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 991 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606680:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606680:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606680:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 3/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 990 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606681:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606684:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 4/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606685:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000586b8164/0xa29a79078f3bad0b lrc: 0/0,0 mode: --/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3377 expref: 990 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.606689:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606689:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606690:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606693:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606698:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+989:41278:x1731746396346944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (197us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.606700:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 4/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606701:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11745 00010000:00010000:0.0:1651529344.606706:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606710:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11747 00000100:00100000:1.0:1651529344.606711:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+988:41279:x1731746396346880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.606712:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+988:41279:x1731746396346752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.606714:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.606715:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 988 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606719:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 3/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 988 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.606721:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11746 00010000:00010000:1.0:1651529344.606724:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cd5cf7b/0xa29a79078f3bb6d5 lrc: 0/0,0 mode: --/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5987 expref: 988 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.606727:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606728:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606729:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606729:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606740:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606741:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 4/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606744:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606746:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606749:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606755:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41279:x1731746396346880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606764:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11747 00010000:00010000:1.0:1651529344.606772:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606775:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.606776:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606779:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 3/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606784:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 1/0,0 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606786:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bedd2 lrc: 0/0,0 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606792:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606795:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606796:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1076:39030:x1731745946465408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1051us (1158us total) trans 30064893642 rc 0/0 00010000:00010000:1.0:1651529344.606798:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606799:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152780 00010000:00010000:1.0:1651529344.606801:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606823:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606842:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606845:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606848:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606855:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1076:39029:x1731745946465472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1240us total) trans 30064893643 rc 0/0 00000100:00100000:1.0:1651529344.606858:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152779 00010000:00010000:1.0:1651529344.606865:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606871:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2ce7284 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.606872:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606875:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 3/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606879:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 1/0,0 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606882:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ce7284/0xa29a79078f3bedcb lrc: 0/0,0 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606885:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606888:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.606889:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606892:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 3/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606895:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 1/0,0 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606900:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bedf5 lrc: 0/0,0 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606905:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1076:39030:x1731745946465792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 940us (1185us total) trans 30064893644 rc 0/0 00010000:00010000:1.0:1651529344.606907:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606908:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152785 00010000:00010000:1.0:1651529344.606910:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606913:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606916:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606917:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606920:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606923:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606926:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606959:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1077:39029:x1731745946465728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1106us (1298us total) trans 30064893645 rc 0/0 00000100:00100000:1.0:1651529344.606962:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152783 00000100:00100000:0.0:1651529344.606965:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1076:39030:x1731745946465664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1057us (1291us total) trans 30064893646 rc 0/0 00000100:00100000:0.0:1651529344.606968:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152784 00010000:00010000:1.0:1651529344.606969:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606973:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606975:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606976:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606979:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606981:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606982:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606998:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607018:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de606674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1077:39029:x1731745946465600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1230us (1373us total) trans 30064893647 rc 0/0 00000100:00100000:1.0:1651529344.607021:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152781 00000100:00100000:0.0:1651529344.607032:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1076:39030:x1731745946465536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1202us (1377us total) trans 30064893648 rc 0/0 00000100:00100000:0.0:1651529344.607035:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152782 00010000:00010000:1.0:1651529344.607042:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607043:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607046:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8285924 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.607046:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008658fa4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.607047:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607047:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607049:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 3/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607050:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 3/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607054:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 1/0,0 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607055:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 1/0,0 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607057:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8285924/0xa29a79078f3bede7 lrc: 0/0,0 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607058:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bedee lrc: 0/0,0 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607061:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607062:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607064:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000076eb73c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.607065:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607065:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000553813a7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.607066:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607068:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 3/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607069:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 3/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607071:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 1/0,0 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607072:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 1/0,0 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607073:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb73c4/0xa29a79078f3bedd9 lrc: 0/0,0 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607074:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bede0 lrc: 0/0,0 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.607205:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347072 00010000:00010000:1.0:1651529344.607211:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 5/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607220:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11748 00000100:00100000:1.0:1651529344.607221:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41278:x1731746396347072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.607224:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607225:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 5/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.607229:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 4/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.607234:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607235:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607235:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607239:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 4/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607243:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.607256:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41278:x1731746396347072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.607259:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11748 00010000:00010000:1.0:1651529344.607269:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3b9ff9 lrc: 0/0,0 mode: --/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdbc expref: 985 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607274:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.607290:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607293:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.607296:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607299:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607302:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607303:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.607312:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466560 00000100:00100000:0.0:1651529344.607319:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466496 00000100:00100000:0.0:1651529344.607326:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152787 00000100:00100000:0.0:1651529344.607327:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1077:39030:x1731745946466560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.607333:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177580 count 1 00010000:00010000:0.0:1651529344.607338:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607342:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 2/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607346:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607346:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607347:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 4/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607354:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.607359:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1078:39030:x1731745946466176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 949us (993us total) trans 30064893649 rc 0/0 00000100:00100000:1.0:1651529344.607362:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152786 00010000:00010000:0.0:1651529344.607365:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607367:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152788 00000100:00100000:1.0:1651529344.607369:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1077:39030:x1731745946466496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.607370:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966652736:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.607374:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177579 count 1 00010000:00010000:1.0:1651529344.607378:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607383:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 2/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607386:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607386:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607387:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 4/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607394:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 3/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607397:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607408:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607409:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607417:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.607422:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607426:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf7a79e8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.607427:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607429:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 3/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607434:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 1/0,0 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607437:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7a79e8/0xa29a79078f3bedfc lrc: 0/0,0 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.607453:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466624 00000100:00100000:1.0:1651529344.607461:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152789 00000100:00100000:1.0:1651529344.607463:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1078:39029:x1731745946466624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.607466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.607474:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177581 count 1 00010000:00010000:1.0:1651529344.607477:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.607482:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 2/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607485:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607486:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607486:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 4/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607493:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 3/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.607500:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.607508:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.607510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.607513:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966652864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607517:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466752 00000100:00100000:1.0:1651529344.607526:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.607529:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466688 00000100:00100000:1.0:1651529344.607532:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466880 00000100:00100000:0.0:1651529344.607534:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466816 00000100:00100000:0.0:1651529344.607538:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152790 00000100:00100000:0.0:1651529344.607540:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1082:39029:x1731745946466752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.607541:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152791 00000100:00100000:1.0:1651529344.607542:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1082:39030:x1731745946466688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.607545:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177583 count 1 00002000:00080000:1.0:1651529344.607547:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177582 count 1 00010000:00010000:0.0:1651529344.607550:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607551:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607554:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 2/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607555:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 2/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607558:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607559:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607559:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 4/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607560:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607560:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607561:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 4/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607565:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607568:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 3/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607572:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.607576:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.607580:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607584:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966652928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.607592:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607599:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152792 00000100:00100000:0.0:1651529344.607600:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607601:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1082:39030:x1731745946466816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.607605:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177584 count 1 00000100:00100000:0.0:1651529344.607608:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152793 00010000:00010000:1.0:1651529344.607609:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607609:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1082:39029:x1731745946466880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.607613:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 2/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 984 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.607614:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177585 count 1 00010000:00010000:1.0:1651529344.607616:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607617:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607617:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 4/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607618:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607622:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 2/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607623:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 984 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607625:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607626:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 984 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.607626:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607627:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 4/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607636:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607639:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607641:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.607648:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.607659:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966653120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607667:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607672:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.607685:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467200 00000100:00100000:0.0:1651529344.607692:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152794 00000100:00100000:0.0:1651529344.607693:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1083:39029:x1731745946467200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.607698:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177586 count 1 00010000:00010000:0.0:1651529344.607701:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607706:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 2/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607709:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607709:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607710:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 4/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607716:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 3/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 984 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607739:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.607743:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966653184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607756:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.607927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.607935:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966652800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.607944:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607948:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966652736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.607952:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347584 00010000:00010000:0.0:1651529344.607953:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607956:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 985 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.607967:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347456 00010000:00010000:1.0:1651529344.607970:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.607971:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11749 00000100:00100000:0.0:1651529344.607973:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41279:x1731746396347584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.607978:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11750 00000100:00100000:1.0:1651529344.607980:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41279:x1731746396347456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.607982:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607983:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607984:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.607984:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.607988:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.607988:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 3/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.607994:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe6d116d/0xa29a79078f3bbc8c lrc: 0/0,0 mode: --/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fec expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.607997:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3ba09a lrc: 0/0,0 mode: --/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0001 expref: 985 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.607997:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608001:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608002:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608002:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608005:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608006:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 4/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608006:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608014:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.608023:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396347456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.608026:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11750 00010000:00010000:0.0:1651529344.608027:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 4/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608045:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608054:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+983:41279:x1731746396347584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 80us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608057:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11749 00010000:00010000:0.0:1651529344.608066:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608069:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608073:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608075:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608107:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966652928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.608112:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608122:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1084:39030:x1731745946466560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 793us (827us total) trans 30064893650 rc 0/0 00000100:00100000:0.0:1651529344.608125:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152787 00000100:00100000:1.0:1651529344.608127:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966652864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.608130:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608132:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608135:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608141:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608144:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608145:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f04051da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.608146:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608147:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608149:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 3/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608154:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 1/0,0 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608156:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bee03 lrc: 0/0,0 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608161:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608164:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad1fd304 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.608165:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608167:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 3/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608171:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 1/0,0 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608180:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fd304/0xa29a79078f3bee0a lrc: 0/0,0 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608187:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1084:39030:x1731745946466496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 817us (884us total) trans 30064893651 rc 0/0 00000100:00100000:1.0:1651529344.608190:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152788 00000100:00100000:1.0:1651529344.608368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.608376:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.608411:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.608416:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467328 00010000:00010000:1.0:1651529344.608421:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608428:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467392 00000100:00100000:0.0:1651529344.608440:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152795 00000100:00100000:0.0:1651529344.608442:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1085:39030:x1731745946467328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.608443:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152796 00000100:00100000:1.0:1651529344.608445:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1085:39029:x1731745946467392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.608448:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177587 count 1 00002000:00080000:1.0:1651529344.608450:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177588 count 1 00010000:00010000:0.0:1651529344.608452:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608454:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608457:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 2/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 982 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.608460:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 2/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 982 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608460:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608461:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608461:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 4/0,1 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608463:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608464:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608465:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 4/0,1 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608469:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 3/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 982 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.608471:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 3/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 982 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608472:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 4/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 982 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.608475:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 4/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 982 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608476:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966653248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.608479:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966653312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.608485:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.608488:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.608494:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966652992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608498:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608505:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966653120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608507:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.608514:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966653184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608516:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608533:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347904 00000100:00100000:1.0:1651529344.608536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608538:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 983 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608554:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347840 00010000:00010000:0.0:1651529344.608557:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608565:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11751 00000100:00100000:0.0:1651529344.608567:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396347904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.608570:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.608571:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608577:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608583:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e03483c/0xa29a79078f3baa87 lrc: 0/0,0 mode: --/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28e2 expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608587:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608587:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608588:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608591:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 4/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608595:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348032 00010000:00010000:0.0:1651529344.608599:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.608606:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 984 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608610:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396347904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608612:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11751 00000100:00100000:1.0:1651529344.608617:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348160 00000100:00100000:0.0:1651529344.608617:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348288 00010000:00010000:1.0:1651529344.608620:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 985 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608621:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 985 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608624:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348352 00010000:00010000:1.0:1651529344.608626:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608626:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11752 00000100:00100000:0.0:1651529344.608628:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41278:x1731746396347840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.608630:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.608631:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11753 00010000:00010000:0.0:1651529344.608631:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608633:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41279:x1731746396348032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.608635:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.608635:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 3/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.608637:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608640:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000313ad28d/0xa29a79078f3bb291 lrc: 0/0,0 mode: --/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4877 expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.608641:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 3/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 986 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608643:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608644:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608647:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7faa98/0xa29a79078f3ba731 lrc: 0/0,0 mode: --/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c7f expref: 985 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608647:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 4/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608650:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608651:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608652:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608655:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608660:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41278:x1731746396347840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.608661:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 4/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608663:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11752 00010000:00010000:1.0:1651529344.608670:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608679:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11754 00000100:00100000:0.0:1651529344.608681:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+983:41279:x1731746396348160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.608683:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.608685:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 983 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608686:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+983:41279:x1731746396348032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.608689:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11753 00010000:00010000:0.0:1651529344.608689:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 983 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608694:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11755 00010000:00010000:0.0:1651529344.608694:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032b5d5ef/0xa29a79078f3b92e7 lrc: 0/0,0 mode: --/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc92e expref: 982 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.608696:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+982:41279:x1731746396348288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.608698:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.608698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608699:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608700:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 981 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608702:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 4/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608704:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 3/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 981 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608711:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.608715:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d040e3b/0xa29a79078f3ba35d lrc: 0/0,0 mode: --/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ba7 expref: 981 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.608717:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+981:41279:x1731746396348160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (138us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.608719:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608720:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.608720:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11754 00010000:00010000:1.0:1651529344.608721:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608724:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 4/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608725:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11756 00000100:00100000:0.0:1651529344.608726:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+979:41278:x1731746396348352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.608729:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608738:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.608744:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+979:41279:x1731746396348288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.608747:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11755 00010000:00010000:1.0:1651529344.608762:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608765:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.608766:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608770:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.608776:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e314e78/0xa29a79078f3bc3a1 lrc: 0/0,0 mode: --/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b8a expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.608777:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608780:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608789:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608790:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608790:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608793:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 4/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608801:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608822:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+977:41278:x1731746396348352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608825:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11756 00010000:00010000:0.0:1651529344.608833:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608836:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608837:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1086:39030:x1731745946466688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1294us (1357us total) trans 30064893652 rc 0/0 00010000:00010000:0.0:1651529344.608839:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608840:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152791 00010000:00010000:0.0:1651529344.608842:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608848:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608851:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608854:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608857:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608891:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1087:39029:x1731745946466624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1428us (1446us total) trans 30064893654 rc 0/0 00000100:00100000:0.0:1651529344.608894:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1087:39029:x1731745946467200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1199us (1222us total) trans 30064893653 rc 0/0 00000100:00100000:0.0:1651529344.608897:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152794 00000100:00100000:1.0:1651529344.608905:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152789 00010000:00010000:0.0:1651529344.608912:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608913:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608915:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d0435fb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.608916:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608917:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608919:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 3/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608920:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608923:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608924:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 1/0,0 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608927:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0435fb1/0xa29a79078f3bee1f lrc: 0/0,0 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608931:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608934:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456f128f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.608935:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608938:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 3/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608941:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 1/0,0 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608951:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bee34 lrc: 0/0,0 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608955:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1086:39030:x1731745946466816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1353us (1444us total) trans 30064893655 rc 0/0 00010000:00010000:0.0:1651529344.608955:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608957:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7fda0ee already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.608958:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152792 00010000:00010000:0.0:1651529344.608958:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608961:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 3/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608964:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 1/0,0 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608965:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608967:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7fda0ee/0xa29a79078f3bee11 lrc: 0/0,0 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608968:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001090ca5e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.608969:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608972:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 3/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608972:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608975:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608977:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 1/0,0 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608978:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608986:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608987:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001090ca5e/0xa29a79078f3bee26 lrc: 0/0,0 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608992:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608994:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008986c686 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.608995:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608998:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 3/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609002:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 1/0,0 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609004:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bee2d lrc: 0/0,0 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609032:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946466880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1414us (1524us total) trans 30064893656 rc 0/0 00000100:00100000:0.0:1651529344.609035:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152793 00010000:00010000:0.0:1651529344.609042:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609045:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.609048:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609056:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.609093:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946466752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1552us (1626us total) trans 30064893657 rc 0/0 00000100:00100000:0.0:1651529344.609096:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152790 00000100:00100000:0.0:1651529344.609104:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348480 00010000:00010000:0.0:1651529344.609109:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 5/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609119:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348544 00010000:00010000:0.0:1651529344.609122:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 5/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609127:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11757 00000100:00100000:0.0:1651529344.609129:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41278:x1731746396348480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.609132:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.609133:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 5/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609136:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 4/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609143:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609144:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609147:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 4/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609151:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.609162:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41278:x1731746396348480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.609165:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11758 00000100:00100000:0.0:1651529344.609167:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11757 00000100:00100000:1.0:1651529344.609168:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41279:x1731746396348544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.609171:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609173:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 5/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609174:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609177:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001089898c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.609178:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609181:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 3/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609185:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 4/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609185:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 1/0,0 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609188:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bee18 lrc: 0/0,0 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609191:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609191:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609192:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609195:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 4/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609198:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948d80cc/0xa29a79078f3ba8e3 lrc: 0/0,0 mode: --/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22ec expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.609200:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.609201:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966653248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609207:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+976:41279:x1731746396348544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.609210:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11758 00010000:00010000:0.0:1651529344.609221:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609223:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea319fe/0xa29a79078f3b9c17 lrc: 0/0,0 mode: --/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee5e expref: 975 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609225:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609227:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966653312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609228:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609231:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609234:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609237:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609241:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609246:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609247:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609250:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609294:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946467328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 851us (926us total) trans 30064893658 rc 0/0 00000100:00100000:0.0:1651529344.609297:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152795 00000100:00100000:1.0:1651529344.609300:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946467392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 855us (924us total) trans 30064893659 rc 0/0 00000100:00100000:1.0:1651529344.609303:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152796 00010000:00010000:0.0:1651529344.609304:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609307:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7862504 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.609308:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609311:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609311:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 3/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609315:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f0efca already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.609316:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609316:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 1/0,0 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609319:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 3/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609319:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bee3b lrc: 0/0,0 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609323:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 1/0,0 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609326:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f0efca/0xa29a79078f3bee42 lrc: 0/0,0 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.609422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.609432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.609432:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467840 00000100:00100000:1.0:1651529344.609440:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.609453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.609454:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467904 00000100:00100000:0.0:1651529344.609458:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467968 00000100:00100000:1.0:1651529344.609461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.609464:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468032 00000100:00100000:0.0:1651529344.609474:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468160 00000100:00100000:1.0:1651529344.609476:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468096 00000100:00100000:0.0:1651529344.609479:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152797 00000100:00100000:0.0:1651529344.609481:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1091:39029:x1731745946467840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.609483:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152798 00000100:00100000:1.0:1651529344.609485:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1091:39029:x1731745946467904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.609487:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177589 count 1 00002000:00080000:1.0:1651529344.609490:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177590 count 1 00010000:00010000:0.0:1651529344.609491:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609494:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609495:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 2/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609499:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 2/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609499:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609499:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609500:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 4/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609502:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609503:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609504:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 4/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609507:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 3/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609511:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 3/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609511:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 4/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.609514:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 4/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609515:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966653376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609519:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609533:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.609550:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.609552:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152799 00000100:00100000:1.0:1651529344.609554:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1091:39030:x1731745946467968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.609557:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152800 00002000:00080000:1.0:1651529344.609559:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177591 count 1 00000100:00100000:0.0:1651529344.609559:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1091:39029:x1731745946468032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.609562:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.609564:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177592 count 1 00010000:00010000:1.0:1651529344.609567:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 2/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609568:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609570:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609571:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609571:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 4/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609575:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 2/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609577:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609578:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609578:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609579:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 4/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609581:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 4/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.609585:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966653504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609585:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 3/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609589:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.609593:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.609593:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966653568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609599:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152801 00000100:00100000:1.0:1651529344.609600:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1091:39029:x1731745946468160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.609600:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.609604:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177594 count 1 00000100:00100000:0.0:1651529344.609606:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152802 00010000:00010000:1.0:1651529344.609607:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609607:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1091:39029:x1731745946468096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.609612:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177593 count 1 00010000:00010000:1.0:1651529344.609614:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 2/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609615:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609617:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609617:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609618:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 4/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609619:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 2/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 974 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609621:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609622:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609623:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 4/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609624:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 3/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609628:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.609629:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 3/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 974 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.609631:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966653632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609632:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 974 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609636:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966653696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609637:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.609642:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.609650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.609664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.609697:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468288 00000100:00100000:0.0:1651529344.609705:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468352 00000100:00100000:0.0:1651529344.609710:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152803 00000100:00100000:0.0:1651529344.609711:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946468288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.609716:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177595 count 1 00010000:00010000:0.0:1651529344.609744:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609749:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 2/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609752:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609753:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609754:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 4/0,1 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609761:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 3/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609764:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 4/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609768:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966653760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.609782:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.609789:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152804 00000100:00100000:0.0:1651529344.609791:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946468352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.609795:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177596 count 1 00010000:00010000:0.0:1651529344.609799:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609821:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 2/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609824:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609825:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609826:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 4/0,1 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609832:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 3/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 974 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609836:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 4/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.609842:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966653824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.609852:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.610061:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966653376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.610062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.610070:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.610078:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610079:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966653568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610082:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610083:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610095:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348992 00010000:00010000:0.0:1651529344.610105:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 5/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 975 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610107:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610111:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610111:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349056 00010000:00010000:0.0:1651529344.610113:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 4/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 976 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610117:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349120 00010000:00010000:0.0:1651529344.610119:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 5/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610121:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966653504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610123:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349184 00010000:00010000:1.0:1651529344.610124:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610125:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610131:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11759 00000100:00100000:1.0:1651529344.610133:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41278:x1731746396348992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.610134:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11760 00000100:00100000:0.0:1651529344.610135:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41279:x1731746396349056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.610136:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.610137:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 4/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610138:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610140:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 4/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610141:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 3/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610143:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 3/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610147:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3ba08c lrc: 0/0,0 mode: --/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffec expref: 978 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610151:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610151:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610152:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610155:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 4/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610162:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.610174:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007377c8d3/0xa29a79078f3b8fec lrc: 0/0,0 mode: --/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4e3 expref: 977 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610178:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610178:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610179:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610182:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 4/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610184:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+976:41278:x1731746396348992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.610188:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11759 00010000:00010000:0.0:1651529344.610188:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610196:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+975:41279:x1731746396349056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.610198:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11761 00000100:00100000:1.0:1651529344.610200:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+975:41278:x1731746396349120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.610200:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11760 00010000:00010000:1.0:1651529344.610203:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.610204:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 4/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610205:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11762 00000100:00100000:0.0:1651529344.610207:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41279:x1731746396349184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.610208:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610210:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610211:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610214:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f7f3486/0xa29a79078f3baa9c lrc: 0/0,0 mode: --/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2928 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610215:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 3/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610217:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610218:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610219:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610220:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3bafdc lrc: 0/0,0 mode: --/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e3d expref: 973 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610222:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 4/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610223:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610224:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610225:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610227:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 4/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610228:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.610233:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+972:41278:x1731746396349120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.610233:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.610236:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11761 00000100:00100000:0.0:1651529344.610238:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+972:41279:x1731746396349184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.610246:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11762 00000100:00100000:1.0:1651529344.610256:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966653632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610258:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966653696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610259:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610261:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610265:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610268:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610269:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610271:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610272:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610274:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610276:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610278:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610313:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946467968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 758us (880us total) trans 30064893660 rc 0/0 00000100:00100000:1.0:1651529344.610316:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152799 00000100:00100000:0.0:1651529344.610319:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946468032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 759us (878us total) trans 30064893661 rc 0/0 00000100:00100000:0.0:1651529344.610322:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152800 00010000:00010000:1.0:1651529344.610323:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610326:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000439b8d89 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.610327:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610329:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610330:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 3/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610333:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc379d70 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.610334:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610336:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 3/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610341:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 1/0,0 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610343:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 1/0,0 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610344:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bee5e lrc: 0/0,0 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610346:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000439b8d89/0xa29a79078f3bee57 lrc: 0/0,0 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610350:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610352:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610353:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610355:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610355:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610359:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610361:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610374:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610396:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1095:39029:x1731745946467904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 910us (974us total) trans 30064893662 rc 0/0 00000100:00100000:1.0:1651529344.610399:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152798 00010000:00010000:1.0:1651529344.610406:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610409:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000260e1672 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.610410:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610414:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946467840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 932us (1026us total) trans 30064893663 rc 0/0 00000100:00100000:0.0:1651529344.610417:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152797 00010000:00010000:1.0:1651529344.610421:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 3/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610424:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610426:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 1/0,0 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610428:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260e1672/0xa29a79078f3bee50 lrc: 0/0,0 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610428:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d587a03 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.610429:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610432:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 3/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610437:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 1/0,0 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610440:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bee49 lrc: 0/0,0 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.610519:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349248 00000100:00100000:0.0:1651529344.610521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.610525:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 971 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610527:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349312 00000100:00100000:1.0:1651529344.610533:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349376 00010000:00010000:0.0:1651529344.610533:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 972 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610535:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 5/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 973 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610539:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349440 00000100:00100000:1.0:1651529344.610540:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11763 00010000:00010000:0.0:1651529344.610541:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 5/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610542:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41278:x1731746396349248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.610545:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.610546:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610546:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11764 00000100:00100000:0.0:1651529344.610548:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41279:x1731746396349312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.610550:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 3/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610556:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df97231c/0xa29a79078f3bb1c6 lrc: 0/0,0 mode: --/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d0 expref: 974 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610560:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610560:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610561:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610564:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 4/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610566:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610568:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 973 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610570:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.610572:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 3/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 973 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610578:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+973:41278:x1731746396349248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.610580:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c32a613/0xa29a79078f3b78ae lrc: 0/0,0 mode: --/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb85d expref: 973 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610581:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11763 00010000:00010000:0.0:1651529344.610584:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610584:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610585:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610586:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11765 00000100:00100000:1.0:1651529344.610587:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+971:41278:x1731746396349376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.610588:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 4/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610590:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.610591:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 5/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 971 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610595:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 4/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 971 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610595:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.610599:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610600:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610601:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610603:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+971:41279:x1731746396349312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (111us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.610604:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 4/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610606:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11764 00010000:00010000:1.0:1651529344.610608:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610611:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11766 00000100:00100000:1.0:1651529344.610612:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+970:41278:x1731746396349376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.610613:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+970:41279:x1731746396349440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.610615:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11765 00010000:00010000:0.0:1651529344.610615:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610616:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 5/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 970 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610620:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 4/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610621:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610624:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610625:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610625:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610626:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610627:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610629:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 4/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610630:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610633:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610638:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+969:41279:x1731746396349440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.610640:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11766 00010000:00010000:0.0:1651529344.610653:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de157668/0xa29a79078f3ba3c6 lrc: 0/0,0 mode: --/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d21 expref: 968 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610657:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966653824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610661:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610664:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610667:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610670:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610675:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946468160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1226us total) trans 30064893664 rc 0/0 00000100:00100000:1.0:1651529344.610678:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152801 00010000:00010000:1.0:1651529344.610685:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610691:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bd5505b5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.610692:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610695:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 3/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610700:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 1/0,0 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610701:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610702:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5505b5/0xa29a79078f3bee65 lrc: 0/0,0 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610757:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946468352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 965us (1092us total) trans 30064893665 rc 0/0 00000100:00100000:0.0:1651529344.610760:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152804 00000100:00100000:1.0:1651529344.610761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610775:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468864 00000100:00100000:1.0:1651529344.610776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610781:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468992 00000100:00100000:0.0:1651529344.610789:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468928 00000100:00100000:1.0:1651529344.610792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610793:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152805 00000100:00100000:0.0:1651529344.610799:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1096:39030:x1731745946468864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.610818:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177597 count 1 00010000:00010000:0.0:1651529344.610822:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610827:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 2/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610830:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610831:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610831:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 4/0,1 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610838:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 3/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610842:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 4/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.610849:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610849:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966653888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610854:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ef8b7cf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.610855:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610858:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 3/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610863:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.610869:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610870:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 1/0,0 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610872:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610873:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3bee7a lrc: 0/0,0 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610881:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469056 00000100:00100000:1.0:1651529344.610888:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152806 00000100:00100000:1.0:1651529344.610890:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946468992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.610890:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610893:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.610895:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177599 count 1 00010000:00010000:1.0:1651529344.610898:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610903:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 2/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610906:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610906:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610907:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 4/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610914:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 3/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610917:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.610924:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610932:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1098:39029:x1731745946468096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1323us (1470us total) trans 30064893666 rc 0/0 00000100:00100000:1.0:1651529344.610933:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.610935:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152802 00000100:00100000:1.0:1651529344.610940:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152807 00000100:00100000:1.0:1651529344.610942:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1097:39029:x1731745946468928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.610942:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152808 00000100:00100000:0.0:1651529344.610944:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1097:39029:x1731745946469056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.610946:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177598 count 1 00002000:00080000:0.0:1651529344.610948:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177600 count 1 00010000:00010000:1.0:1651529344.610949:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610952:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610953:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 2/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610956:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610957:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610957:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 2/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610958:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 4/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610962:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610963:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 3/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610963:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610964:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 4/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610966:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.610970:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 3/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.610971:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966654016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.610976:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.610991:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.610996:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966654080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.610998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.611005:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.611012:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469184 00000100:00100000:0.0:1651529344.611024:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152809 00000100:00100000:0.0:1651529344.611026:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1098:39029:x1731745946469184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.611031:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177601 count 1 00010000:00010000:0.0:1651529344.611034:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611039:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 2/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 967 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.611042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.611042:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611043:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611043:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 4/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611050:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 3/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 967 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611053:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 967 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611057:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966654144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611069:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.611076:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469248 00000100:00100000:0.0:1651529344.611084:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152810 00000100:00100000:0.0:1651529344.611086:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000421c7007 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1099:39030:x1731745946469248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.611091:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177602 count 1 00010000:00010000:0.0:1651529344.611094:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611098:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 2/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 967 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611116:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611117:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611118:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 4/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611125:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 3/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 967 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611131:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 967 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611135:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611161:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.611167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.611170:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f283cb5/0xa29a79078f3bbc23 lrc: 0/0,0 mode: --/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e02 expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611174:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966653760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611178:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611181:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611184:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611187:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611189:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611202:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469504 00000100:00100000:1.0:1651529344.611209:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152811 00000100:00100000:1.0:1651529344.611211:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1101:39030:x1731745946469504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.611216:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177603 count 1 00010000:00010000:1.0:1651529344.611220:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611225:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 2/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 966 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611228:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611229:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611229:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 4/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611234:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1101:39029:x1731745946468288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1522us (1584us total) trans 30064893667 rc 0/0 00000100:00100000:0.0:1651529344.611238:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152803 00010000:00010000:1.0:1651529344.611243:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 3/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 966 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611245:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611247:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 966 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.611249:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ee2d952 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.611250:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611251:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966654272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611253:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 3/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611258:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 1/0,0 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611259:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.611261:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bee6c lrc: 0/0,0 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611264:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611269:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006edccc33 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.611271:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611273:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 3/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611278:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 1/0,0 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611281:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3bee73 lrc: 0/0,0 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611408:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966653952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611408:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.611412:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611420:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966654016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.611423:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.611444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.611458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.611461:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349824 00010000:00010000:0.0:1651529344.611472:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 5/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.611473:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469568 00000100:00100000:0.0:1651529344.611485:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349952 00000100:00100000:1.0:1651529344.611486:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152812 00000100:00100000:1.0:1651529344.611488:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1101:39029:x1731745946469568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.611488:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 968 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.611493:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177604 count 1 00000100:00100000:0.0:1651529344.611495:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350016 00010000:00010000:1.0:1651529344.611497:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611497:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611501:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 2/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 969 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611504:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611505:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611505:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 4/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611512:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 3/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 969 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611515:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611516:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11767 00000100:00100000:0.0:1651529344.611517:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+969:41279:x1731746396349824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.611519:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966654336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611521:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.611522:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 5/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.611526:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 4/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.611530:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.611532:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611533:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611534:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611536:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11768 00010000:00010000:0.0:1651529344.611537:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 4/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611538:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+969:41279:x1731746396349952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.611541:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611542:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.611542:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.611549:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 3/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 969 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611549:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+969:41279:x1731746396349824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.611551:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11767 00010000:00010000:1.0:1651529344.611555:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283d536b/0xa29a79078f3bb5b6 lrc: 0/0,0 mode: --/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5589 expref: 968 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611556:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11769 00000100:00100000:0.0:1651529344.611557:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+968:41278:x1731746396350016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.611558:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611559:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611559:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611560:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.611561:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611563:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 4/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611565:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 3/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611568:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.611569:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000296cdfbe/0xa29a79078f3ba253 lrc: 0/0,0 mode: --/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d077f expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.611572:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611573:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.611574:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41279:x1731746396349952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.611574:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611577:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11768 00010000:00010000:0.0:1651529344.611577:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 4/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611586:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.611592:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611592:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+965:41278:x1731746396350016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.611595:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11769 00010000:00010000:1.0:1651529344.611596:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611599:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611604:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611606:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966654080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611609:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611619:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3ba00e lrc: 0/0,0 mode: --/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe02 expref: 964 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611623:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966653888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611625:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611628:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611631:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611634:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611637:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611643:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946468992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 752us (882us total) trans 30064893668 rc 0/0 00000100:00100000:1.0:1651529344.611646:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152806 00010000:00010000:1.0:1651529344.611653:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611656:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611660:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611662:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611676:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946468864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 880us (930us total) trans 30064893669 rc 0/0 00000100:00100000:0.0:1651529344.611679:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152805 00010000:00010000:0.0:1651529344.611687:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611692:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003300a3f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.611693:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611695:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946468928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 753us (919us total) trans 30064893670 rc 0/0 00010000:00010000:0.0:1651529344.611696:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 3/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611698:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152807 00010000:00010000:0.0:1651529344.611701:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 1/0,0 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611704:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003300a3f1/0xa29a79078f3bee88 lrc: 0/0,0 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611705:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611708:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a34f4c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.611708:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611709:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611710:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3236877 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.611711:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611712:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 3/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611714:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 3/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611717:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 1/0,0 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611717:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 1/0,0 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611719:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3bee81 lrc: 0/0,0 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611722:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3236877/0xa29a79078f3bee8f lrc: 0/0,0 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611800:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966654144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611829:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.611888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.611904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.611906:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966654272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.611920:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611924:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.611927:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350144 00010000:00010000:0.0:1651529344.611928:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611932:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 964 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611935:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350272 00000100:00100000:1.0:1651529344.611938:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350336 00010000:00010000:1.0:1651529344.611940:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 966 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.611944:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350400 00010000:00010000:1.0:1651529344.611946:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.611951:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11770 00000100:00100000:1.0:1651529344.611958:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+967:41278:x1731746396350144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.611958:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 967 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611961:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611962:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611965:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11771 00010000:00010000:1.0:1651529344.611966:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 3/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.611967:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+967:41278:x1731746396350336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.611970:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611972:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3ba2df lrc: 0/0,0 mode: --/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09af expref: 967 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611976:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611976:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611977:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611980:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 4/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611984:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 966 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.611990:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.611996:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 3/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 966 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.611997:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41278:x1731746396350144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612000:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11770 00010000:00010000:0.0:1651529344.612002:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007181d386/0xa29a79078f3b9262 lrc: 0/0,0 mode: --/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc760 expref: 965 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612005:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11772 00000100:00100000:1.0:1651529344.612006:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+964:41278:x1731746396350400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.612006:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612007:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612008:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612009:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612010:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 964 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612011:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 4/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612017:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.612022:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 3/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 964 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612027:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e89911/0xa29a79078f3bb38d lrc: 0/0,0 mode: --/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d08 expref: 964 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612032:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612035:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 4/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612035:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+963:41278:x1731746396350336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.612038:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11771 00010000:00010000:1.0:1651529344.612042:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.612043:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11773 00000100:00100000:0.0:1651529344.612045:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+962:41278:x1731746396350272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.612048:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+962:41278:x1731746396350400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.612048:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612049:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 962 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612051:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11772 00010000:00010000:0.0:1651529344.612053:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 3/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 961 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612058:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612059:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afca5087/0xa29a79078f3b92ee lrc: 0/0,0 mode: --/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc935 expref: 961 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612061:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612062:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612063:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612063:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612064:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612066:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 4/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612073:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.612076:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612078:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+960:41278:x1731746396350272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.612081:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11773 00010000:00010000:0.0:1651529344.612091:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612094:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612097:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612100:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612124:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946469504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 912us (957us total) trans 30064893671 rc 0/0 00000100:00100000:1.0:1651529344.612127:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152811 00010000:00010000:1.0:1651529344.612134:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612138:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.612139:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612142:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 3/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612146:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 1/0,0 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612149:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3beeab lrc: 0/0,0 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612150:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946469056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1206us (1363us total) trans 30064893672 rc 0/0 00010000:00010000:1.0:1651529344.612153:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612153:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152808 00010000:00010000:1.0:1651529344.612156:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd31d915 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.612161:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612164:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612165:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612167:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612168:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 3/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612170:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612172:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 1/0,0 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612175:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3bee96 lrc: 0/0,0 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612179:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612181:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001988a229 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.612182:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612185:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 3/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612188:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 1/0,0 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612191:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bee9d lrc: 0/0,0 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612203:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946469184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1176us (1204us total) trans 30064893673 rc 0/0 00000100:00100000:0.0:1651529344.612205:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152809 00010000:00010000:0.0:1651529344.612212:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612216:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612218:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612224:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.612264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612274:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000421c7007 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1102:39030:x1731745946469248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1180us (1225us total) trans 30064893674 rc 0/0 00000100:00100000:0.0:1651529344.612277:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152810 00000100:00100000:1.0:1651529344.612287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.612300:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469824 00000100:00100000:0.0:1651529344.612310:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469760 00000100:00100000:1.0:1651529344.612314:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612315:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152813 00000100:00100000:0.0:1651529344.612316:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946469824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.612322:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177606 count 1 00010000:00010000:0.0:1651529344.612326:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612331:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 2/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612334:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612334:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612335:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 4/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612341:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 3/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612345:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.612349:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.612358:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.612364:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469888 00000100:00100000:0.0:1651529344.612371:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152814 00000100:00100000:0.0:1651529344.612372:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1104:39030:x1731745946469760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.612377:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177605 count 1 00010000:00010000:0.0:1651529344.612380:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612384:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 2/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612387:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612387:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612388:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 4/0,1 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612394:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 3/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 959 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.612397:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966654336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.612397:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 4/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612401:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612401:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966654464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612410:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152815 00000100:00100000:1.0:1651529344.612412:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1104:39030:x1731745946469888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.612417:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177607 count 1 00010000:00010000:1.0:1651529344.612421:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612426:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 2/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 959 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612429:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612429:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612430:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 4/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612433:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.612443:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350720 00010000:00010000:1.0:1651529344.612444:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 3/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 960 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612448:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 4/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612448:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612452:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966654528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.612458:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11774 00000100:00100000:0.0:1651529344.612460:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+960:41279:x1731746396350720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.612462:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612464:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612466:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.612467:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 3/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612472:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612473:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c47000a/0xa29a79078f3bb7b5 lrc: 0/0,0 mode: --/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ceb expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612475:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f056b2da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.612476:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612477:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612478:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612479:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 3/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612481:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 4/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612484:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 1/0,0 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612487:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3beea4 lrc: 0/0,0 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612489:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.612497:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+959:41279:x1731746396350720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.612499:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612500:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11774 00010000:00010000:1.0:1651529344.612502:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612505:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612510:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612558:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1105:39029:x1731745946469568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1069us (1122us total) trans 30064893675 rc 0/0 00000100:00100000:1.0:1651529344.612561:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152812 00010000:00010000:1.0:1651529344.612568:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612572:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.612573:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612575:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 3/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612580:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 1/0,0 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612583:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3beeb2 lrc: 0/0,0 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.612613:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469952 00000100:00100000:0.0:1651529344.612616:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.612624:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470016 00000100:00100000:1.0:1651529344.612631:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152816 00000100:00100000:1.0:1651529344.612633:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1106:39029:x1731745946469952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.612633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.612638:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177608 count 1 00000100:00100000:0.0:1651529344.612640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.612641:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612651:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.612652:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 2/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612655:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612656:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612656:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 4/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612658:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470144 00010000:00010000:1.0:1651529344.612663:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 3/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612667:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 4/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612671:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966654592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612679:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.612679:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470080 00000100:00100000:0.0:1651529344.612683:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152817 00000100:00100000:0.0:1651529344.612685:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1108:39030:x1731745946470016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.612686:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152818 00000100:00100000:1.0:1651529344.612688:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1108:39030:x1731745946470144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.612690:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177609 count 1 00002000:00080000:1.0:1651529344.612692:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177611 count 1 00010000:00010000:0.0:1651529344.612694:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612695:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612699:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 2/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612700:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 2/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612702:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612703:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612703:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612704:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612704:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 4/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612704:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 4/0,1 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612710:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612711:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 3/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 958 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612713:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612714:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 4/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612717:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966654656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.612718:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966654720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612723:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.612728:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.612729:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152819 00000100:00100000:1.0:1651529344.612740:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1108:39029:x1731745946470080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.612745:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177610 count 1 00010000:00010000:1.0:1651529344.612748:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612750:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.612752:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 2/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 958 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612754:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612755:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612756:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612757:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 4/0,1 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612761:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350912 00010000:00010000:0.0:1651529344.612765:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.612773:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 3/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 959 pid: 142993 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.612773:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11775 00000100:00100000:0.0:1651529344.612774:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+959:41279:x1731746396350912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.612777:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 4/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 959 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612777:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612778:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612781:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966654784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.612782:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 3/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612789:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.612802:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3ba2d1 lrc: 0/0,0 mode: --/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0969 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612821:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612822:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612823:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612826:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 4/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612837:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.612857:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396350912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.612860:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11775 00000100:00100000:1.0:1651529344.612861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.612867:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350976 00010000:00010000:0.0:1651529344.612870:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 5/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.612882:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11776 00000100:00100000:0.0:1651529344.612883:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396350976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.612885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.612886:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612887:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 5/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612905:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 4/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612911:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612912:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612913:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612916:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 4/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612920:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.612927:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396350976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612930:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11776 00000100:00100000:0.0:1651529344.612942:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351040 00010000:00010000:0.0:1651529344.612946:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 5/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.612951:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11777 00000100:00100000:0.0:1651529344.612953:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41278:x1731746396351040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.612956:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612957:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 5/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.612966:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966654528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.612971:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612974:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 3/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612980:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4e5cda/0xa29a79078f3bb40b lrc: 0/0,0 mode: --/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f70 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.612984:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612984:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612985:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612988:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 4/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612998:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.613000:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613004:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613008:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+957:41278:x1731746396351040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.613011:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613011:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11777 00010000:00010000:1.0:1651529344.613014:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613019:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470656 00000100:00100000:0.0:1651529344.613025:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152820 00000100:00100000:0.0:1651529344.613027:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1109:39030:x1731745946470656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.613038:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177612 count 1 00010000:00010000:0.0:1651529344.613042:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613047:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 2/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 956 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613050:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613050:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613051:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 4/0,1 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613057:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 3/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 956 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613061:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 4/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 956 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.613065:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946469888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 652us (756us total) trans 30064893676 rc 0/0 00000100:00100000:0.0:1651529344.613065:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966654848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.613068:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152815 00000100:00100000:0.0:1651529344.613073:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.613079:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613084:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008986c686 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.613085:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613088:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 3/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613093:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 1/0,0 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613095:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3beec7 lrc: 0/0,0 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613105:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be21fe6b/0xa29a79078f3ba72a lrc: 0/0,0 mode: --/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c24 expref: 956 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613109:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966654464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613112:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613115:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613118:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613123:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613126:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613138:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613143:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000484854f5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.613144:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613147:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 3/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613152:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 1/0,0 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613154:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3beec0 lrc: 0/0,0 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613174:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946469760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 801us (910us total) trans 30064893677 rc 0/0 00000100:00100000:0.0:1651529344.613178:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152814 00010000:00010000:0.0:1651529344.613186:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613189:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613192:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613195:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613205:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613209:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea1a6d66 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.613210:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613216:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 3/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613220:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 1/0,0 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613223:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3beeb9 lrc: 0/0,0 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.613274:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1110:39029:x1731745946469824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 950us (1030us total) trans 30064893678 rc 0/0 00000100:00100000:0.0:1651529344.613277:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152813 00000100:00100000:0.0:1651529344.613282:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470784 00000100:00100000:0.0:1651529344.613288:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152821 00000100:00100000:0.0:1651529344.613290:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1110:39030:x1731745946470784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.613295:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177613 count 1 00010000:00010000:0.0:1651529344.613299:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613304:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 2/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 955 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613307:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613308:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613308:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 4/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613315:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 3/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 955 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613319:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 955 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613341:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.613346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.613350:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.613357:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470848 00000100:00100000:0.0:1651529344.613364:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152822 00000100:00100000:0.0:1651529344.613366:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1111:39030:x1731745946470848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.613370:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177614 count 1 00010000:00010000:0.0:1651529344.613374:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613389:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 2/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 955 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613393:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613393:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613394:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 4/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613401:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 3/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 955 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613434:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 955 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613439:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966654976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.613449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.613449:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.613455:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470912 00000100:00100000:0.0:1651529344.613462:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152823 00000100:00100000:0.0:1651529344.613464:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946470912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.613469:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177615 count 1 00010000:00010000:0.0:1651529344.613472:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613477:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 2/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 955 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613490:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613491:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613492:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 4/0,1 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613499:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 3/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 955 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613503:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 4/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 955 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613507:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.613519:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.613627:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966654592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613637:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613645:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966654656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613648:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613669:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966654784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613672:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.613683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.613713:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.613722:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351104 00000100:00100000:0.0:1651529344.613723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.613740:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 4/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 956 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.613746:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351232 00010000:00010000:1.0:1651529344.613749:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 4/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 957 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.613753:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351168 00010000:00010000:1.0:1651529344.613755:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 958 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.613759:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351296 00010000:00010000:1.0:1651529344.613761:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 4/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 959 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613761:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966654720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.613765:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351424 00010000:00010000:1.0:1651529344.613766:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 5/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 960 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.613766:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613771:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11778 00000100:00100000:1.0:1651529344.613772:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+960:41279:x1731746396351104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.613774:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11779 00010000:00010000:1.0:1651529344.613775:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.613776:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 4/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613776:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+960:41279:x1731746396351232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.613779:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.613780:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 3/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613788:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b865a2b/0xa29a79078f3bb1cd lrc: 0/0,0 mode: --/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45d7 expref: 960 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613793:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613793:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613797:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 4/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613824:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 4/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 959 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613828:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.613829:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 3/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 959 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.613834:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082541e82/0xa29a79078f3b7a13 lrc: 0/0,0 mode: --/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9a6 expref: 959 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.613841:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396351104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 67us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.613843:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.613844:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11778 00010000:00010000:0.0:1651529344.613844:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613845:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613848:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 4/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613849:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11780 00000100:00100000:1.0:1651529344.613851:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+957:41279:x1731746396351168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.613853:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.613857:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.613861:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 957 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613865:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 957 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613865:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+957:41279:x1731746396351232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 89us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.613868:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11779 00010000:00010000:1.0:1651529344.613870:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1d08de/0xa29a79078f3bb3be lrc: 0/0,0 mode: --/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dc5 expref: 957 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.613875:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11781 00010000:00010000:1.0:1651529344.613876:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.613876:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+955:41279:x1731746396351296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.613877:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613878:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613879:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.613881:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 4/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613881:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 4/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 955 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.613885:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 3/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 955 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613886:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.613892:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+955:41279:x1731746396351168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.613895:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11780 00000100:00100000:1.0:1651529344.613904:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11782 00000100:00100000:1.0:1651529344.613906:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+954:41278:x1731746396351424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.613908:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.613909:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 5/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 954 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613913:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 4/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 954 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.613921:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9a7dc7b/0xa29a79078f3bc2e4 lrc: 0/0,0 mode: --/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88e3 expref: 954 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.613925:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613926:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613927:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613927:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613927:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613928:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613930:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 4/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613934:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 4/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613937:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.613938:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.613944:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41279:x1731746396351296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.613945:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41278:x1731746396351424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.613947:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11781 00000100:00100000:1.0:1651529344.613949:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11782 00010000:00010000:1.0:1651529344.613957:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613958:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ffcb59/0xa29a79078f3b7899 lrc: 0/0,0 mode: --/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7fb expref: 951 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.613960:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613962:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966654848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613963:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613965:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613966:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613969:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613971:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613987:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613990:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614025:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1114:39030:x1731745946470144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1336us (1384us total) trans 30064893679 rc 0/0 00000100:00100000:1.0:1651529344.614028:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152818 00010000:00010000:1.0:1651529344.614035:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614037:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1113:39030:x1731745946470656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1009us (1106us total) trans 30064893680 rc 0/0 00010000:00010000:1.0:1651529344.614039:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000553813a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614040:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614040:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152820 00010000:00010000:1.0:1651529344.614043:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 3/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614048:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 1/0,0 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614050:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3beedc lrc: 0/0,0 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614051:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966654976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.614054:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614055:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614057:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022eaf1ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614058:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614060:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 3/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614062:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614064:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 1/0,0 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614065:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614066:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3beeea lrc: 0/0,0 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614068:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614071:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614086:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614089:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000414c5ef5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614090:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614093:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 3/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614096:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 1/0,0 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614099:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3beed5 lrc: 0/0,0 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614105:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614108:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614110:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1113:39030:x1731745946470016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1424us (1494us total) trans 30064893681 rc 0/0 00010000:00010000:1.0:1651529344.614111:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614113:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614120:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152817 00000100:00100000:0.0:1651529344.614139:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966654912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.614143:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614149:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614152:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008658fa4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.614153:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614156:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 3/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614159:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1113:39029:x1731745946470080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1427us (1508us total) trans 30064893682 rc 0/0 00010000:00010000:0.0:1651529344.614161:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 1/0,0 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614162:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152819 00010000:00010000:0.0:1651529344.614163:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3beee3 lrc: 0/0,0 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614170:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614173:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614176:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614179:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.614193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.614218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.614227:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1113:39029:x1731745946469952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1587us (1637us total) trans 30064893683 rc 0/0 00000100:00100000:1.0:1651529344.614231:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152816 00000100:00100000:1.0:1651529344.614238:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352000 00010000:00010000:1.0:1651529344.614243:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 951 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614258:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351936 00010000:00010000:1.0:1651529344.614265:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 952 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.614280:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.614284:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614293:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352064 00000100:00100000:0.0:1651529344.614300:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11783 00010000:00010000:1.0:1651529344.614302:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 4/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 953 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.614316:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41279:x1731746396352000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.614317:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11784 00000100:00100000:1.0:1651529344.614319:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41278:x1731746396351936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.614321:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.614323:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 953 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.614326:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 3/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 953 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.614329:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.614331:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 953 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.614332:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed335e5/0xa29a79078f3b9414 lrc: 0/0,0 mode: --/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce28 expref: 953 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.614335:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614335:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 3/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 952 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.614336:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614337:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614340:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 4/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614341:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3cf80f1/0xa29a79078f3bbbac lrc: 0/0,0 mode: --/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c88 expref: 952 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.614345:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614345:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614346:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614350:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.614356:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 4/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614360:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+951:41278:x1731746396351936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.614363:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11784 00010000:00010000:0.0:1651529344.614367:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.614368:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11785 00000100:00100000:1.0:1651529344.614369:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+950:41278:x1731746396352064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.614372:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.614373:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 4/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 950 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.614374:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+950:41279:x1731746396352000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.614377:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 3/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 950 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.614377:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11783 00010000:00010000:1.0:1651529344.614382:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009277497c/0xa29a79078f3bc03d lrc: 0/0,0 mode: --/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dc9 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.614385:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614386:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614386:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614387:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614390:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 4/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614398:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.614401:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614403:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+948:41278:x1731746396352064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.614405:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614406:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11785 00010000:00010000:0.0:1651529344.614407:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614422:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614425:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f04051da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614426:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614429:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 3/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614433:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 1/0,0 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614436:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3beece lrc: 0/0,0 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614440:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614443:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676a17a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614444:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614446:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 3/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614449:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1113:39030:x1731745946470848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1082us (1103us total) trans 30064893684 rc 0/0 00010000:00010000:1.0:1651529344.614450:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 1/0,0 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614452:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152822 00010000:00010000:1.0:1651529344.614454:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3beef8 lrc: 0/0,0 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614460:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614463:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614466:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614469:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614522:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1113:39030:x1731745946470912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1056us (1072us total) trans 30064893685 rc 0/0 00000100:00100000:0.0:1651529344.614541:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152823 00000100:00100000:0.0:1651529344.614546:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471488 00000100:00100000:1.0:1651529344.614550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614573:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471616 00000100:00100000:1.0:1651529344.614577:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152824 00000100:00100000:1.0:1651529344.614579:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1114:39029:x1731745946471488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.614582:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152825 00002000:00080000:1.0:1651529344.614584:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177617 count 1 00000100:00100000:0.0:1651529344.614584:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1114:39029:x1731745946471616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.614589:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.614589:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177619 count 1 00010000:00010000:1.0:1651529344.614594:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 2/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614594:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614597:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614597:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614598:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 4/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614599:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 2/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614603:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 4/0,1 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614605:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 3/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614609:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614613:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966655104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.614624:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 3/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614628:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 4/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614631:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614633:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.614642:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.614648:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614662:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d110885d already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.614663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.614663:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614666:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 3/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614671:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 1/0,0 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614674:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3beeff lrc: 0/0,0 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614691:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471424 00000100:00100000:0.0:1651529344.614711:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471552 00000100:00100000:1.0:1651529344.614715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614717:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152826 00000100:00100000:0.0:1651529344.614718:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946471424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.614726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.614741:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.614747:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471680 00002000:00080000:0.0:1651529344.614749:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177616 count 1 00000100:00100000:1.0:1651529344.614752:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471744 00010000:00010000:0.0:1651529344.614753:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614754:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471872 00000100:00100000:1.0:1651529344.614757:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152827 00010000:00010000:0.0:1651529344.614757:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 2/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614759:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1119:39029:x1731745946471552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.614761:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614761:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.614764:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177618 count 1 00010000:00010000:1.0:1651529344.614768:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614769:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 4/0,1 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614773:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 2/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614776:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614776:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614776:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 3/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614777:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 4/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614780:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 4/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.614783:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 3/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.614784:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966655232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.614787:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 4/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.614797:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614818:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152828 00000100:00100000:1.0:1651529344.614820:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966655296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.614820:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1119:39029:x1731745946471680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.614825:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177620 count 1 00000100:00100000:1.0:1651529344.614829:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.614829:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614833:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 2/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614836:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152829 00010000:00010000:0.0:1651529344.614836:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.614837:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1119:39029:x1731745946471744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.614837:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614837:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 4/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.614842:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177621 count 1 00010000:00010000:0.0:1651529344.614843:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614846:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614850:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 2/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614853:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614854:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614855:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 4/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614861:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614864:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 4/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614868:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966655424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.614869:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614874:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614874:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966655360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.614880:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152830 00000100:00100000:0.0:1651529344.614883:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.614891:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1119:39030:x1731745946471872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.614893:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.614895:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177622 count 1 00010000:00010000:0.0:1651529344.614896:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614899:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614900:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614902:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614903:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 2/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 947 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614906:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614907:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614907:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 4/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614920:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 3/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 947 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614924:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 4/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 947 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.614928:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966655488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.614936:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.614942:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614946:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdd9c2a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.614947:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614957:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946470784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1666us (1694us total) trans 30064893686 rc 0/0 00010000:00010000:1.0:1651529344.614960:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 3/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614960:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152821 00010000:00010000:1.0:1651529344.614965:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 1/0,0 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614968:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beef1 lrc: 0/0,0 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615021:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966655104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.615025:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615035:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615039:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.615138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.615139:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352384 00000100:00100000:1.0:1651529344.615148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.615150:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 4/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 948 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615156:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352192 00000100:00100000:0.0:1651529344.615161:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11786 00000100:00100000:0.0:1651529344.615163:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+949:41279:x1731746396352384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.615166:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615166:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615168:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 4/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615172:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 3/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615178:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11787 00000100:00100000:1.0:1651529344.615179:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+949:41278:x1731746396352192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.615182:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615183:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bad19 lrc: 0/0,0 mode: --/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33a1 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615184:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 949 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615187:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615188:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615189:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615191:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 3/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 948 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615191:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 4/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615196:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6fb4ad8/0xa29a79078f3bad12 lrc: 0/0,0 mode: --/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3393 expref: 948 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615197:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.615200:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615200:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615201:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615204:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 4/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615210:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41279:x1731746396352384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.615213:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11786 00010000:00010000:1.0:1651529344.615215:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.615222:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471936 00000100:00100000:1.0:1651529344.615223:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+946:41278:x1731746396352192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615226:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11787 00000100:00100000:0.0:1651529344.615228:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152831 00000100:00100000:0.0:1651529344.615229:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946471936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.615234:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177623 count 1 00010000:00010000:1.0:1651529344.615237:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615238:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615240:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615243:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615243:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 2/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.615246:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615246:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615247:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 4/0,1 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615248:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615254:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 3/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 945 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.615257:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 4/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.615261:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966655552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.615269:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.615276:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615279:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615285:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615287:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615289:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1121:39029:x1731745946471488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 709us (771us total) trans 30064893687 rc 0/0 00000100:00100000:1.0:1651529344.615292:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152824 00010000:00010000:1.0:1651529344.615299:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615302:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d587a03 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.615303:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615306:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 3/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615311:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 1/0,0 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615313:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bef06 lrc: 0/0,0 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615317:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615320:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050b6d714 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.615321:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615324:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 3/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615327:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 1/0,0 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615330:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bef0d lrc: 0/0,0 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615340:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1121:39029:x1731745946471616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 755us (790us total) trans 30064893688 rc 0/0 00000100:00100000:0.0:1651529344.615344:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152825 00000100:00100000:0.0:1651529344.615404:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966655232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615408:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615426:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352704 00000100:00100000:1.0:1651529344.615427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.615432:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 5/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 946 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615436:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966655296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.615442:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352640 00010000:00010000:1.0:1651529344.615445:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615445:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 4/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.615452:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11788 00000100:00100000:0.0:1651529344.615453:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396352704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.615454:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11789 00000100:00100000:1.0:1651529344.615456:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41279:x1731746396352640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.615456:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615457:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 4/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615459:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615461:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 4/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615461:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 3/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615464:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 3/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615467:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eeb4d15/0xa29a79078f3bb714 lrc: 0/0,0 mode: --/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5aad expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615471:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615471:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615472:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c8e90f/0xa29a79078f3baa79 lrc: 0/0,0 mode: --/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d283a expref: 946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615472:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615475:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 4/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615476:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615477:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615478:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615481:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 4/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615484:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.615496:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.615506:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41279:x1731746396352640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615509:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11789 00000100:00100000:0.0:1651529344.615522:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+944:41278:x1731746396352704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 67us (106us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.615523:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615525:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11788 00010000:00010000:1.0:1651529344.615527:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615530:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615533:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615533:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615536:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615539:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615545:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615579:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1122:39029:x1731745946471552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 819us (901us total) trans 30064893689 rc 0/0 00000100:00100000:1.0:1651529344.615582:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152827 00000100:00100000:0.0:1651529344.615587:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1121:39029:x1731745946471424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 868us (924us total) trans 30064893690 rc 0/0 00010000:00010000:1.0:1651529344.615590:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615590:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152826 00010000:00010000:1.0:1651529344.615593:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc379d70 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.615594:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615597:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 3/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615601:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 1/0,0 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615604:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bef1b lrc: 0/0,0 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615608:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615611:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cda455b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.615612:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615617:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 3/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615620:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 1/0,0 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615623:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bef14 lrc: 0/0,0 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.615650:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472000 00000100:00100000:0.0:1651529344.615665:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152832 00000100:00100000:0.0:1651529344.615667:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1121:39029:x1731745946472000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.615672:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177624 count 1 00010000:00010000:0.0:1651529344.615677:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615687:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.615699:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 2/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.615702:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615703:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615704:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 4/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615711:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 3/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 943 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.615714:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 943 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.615724:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966655616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.615738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615751:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.615754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.615763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615770:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966655360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615778:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615785:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352832 00000100:00100000:1.0:1651529344.615787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.615790:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 5/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 944 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.615796:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352896 00010000:00010000:0.0:1651529344.615798:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 945 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.615802:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353024 00000100:00100000:1.0:1651529344.615820:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966655424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615823:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 5/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 946 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615825:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615828:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353088 00010000:00010000:0.0:1651529344.615830:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 5/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615833:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966655488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.615835:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11790 00010000:00010000:1.0:1651529344.615836:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615836:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396352832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.615839:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615841:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 4/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615844:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11791 00010000:00010000:0.0:1651529344.615845:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.615846:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396352896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.615850:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615850:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f469945/0xa29a79078f3bb554 lrc: 0/0,0 mode: --/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5447 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615852:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 947 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615853:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615854:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615855:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615855:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615861:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5793fab/0xa29a79078f3bb259 lrc: 0/0,0 mode: --/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47a5 expref: 946 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615865:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615866:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615867:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615870:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 4/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615878:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 4/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615891:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.615891:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.615900:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396352832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615901:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396352896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.615903:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11790 00000100:00100000:1.0:1651529344.615904:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11791 00000100:00100000:0.0:1651529344.615908:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11792 00000100:00100000:1.0:1651529344.615910:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11793 00000100:00100000:0.0:1651529344.615910:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+943:41278:x1731746396353024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.615912:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+943:41279:x1731746396353088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.615912:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615914:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 4/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 943 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615915:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615916:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 5/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615918:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 3/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 943 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615923:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 4/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 943 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.615923:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002246e6a6/0xa29a79078f3b921c lrc: 0/0,0 mode: --/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc61e expref: 943 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615927:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615927:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615928:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615928:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615929:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615931:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 4/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615931:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 4/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615935:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.615941:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.615947:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+942:41278:x1731746396353024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615948:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+942:41279:x1731746396353088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.615950:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11792 00000100:00100000:1.0:1651529344.615951:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11793 00010000:00010000:1.0:1651529344.615958:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615961:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615961:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b513e563/0xa29a79078f3ba803 lrc: 0/0,0 mode: --/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fc0 expref: 940 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.615964:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615965:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966655552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.615967:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615968:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615971:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615974:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615984:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615987:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616017:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1123:39030:x1731745946471872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1126us (1276us total) trans 30064893691 rc 0/0 00000100:00100000:1.0:1651529344.616020:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152830 00000100:00100000:1.0:1651529344.616025:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472064 00000100:00100000:0.0:1651529344.616030:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1123:39030:x1731745946471936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 800us (891us total) trans 30064893692 rc 0/0 00000100:00100000:1.0:1651529344.616032:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152833 00000100:00100000:1.0:1651529344.616034:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1123:39029:x1731745946472064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.616034:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152831 00002000:00080000:1.0:1651529344.616039:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177625 count 1 00010000:00010000:0.0:1651529344.616042:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616043:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616045:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001089898c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.616046:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616048:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 2/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616049:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 3/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616051:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616051:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616052:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 4/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616054:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 1/0,0 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616057:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bef30 lrc: 0/0,0 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616059:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 3/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616061:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616062:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 939 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616064:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039b7eb20 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.616065:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616066:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966655680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616068:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 3/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616071:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 1/0,0 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616073:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bef37 lrc: 0/0,0 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616075:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.616078:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616081:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616083:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616084:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616086:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616086:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616089:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616092:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616132:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1124:39029:x1731745946471680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1312us (1417us total) trans 30064893693 rc 0/0 00000100:00100000:0.0:1651529344.616136:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152828 00000100:00100000:1.0:1651529344.616141:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1123:39029:x1731745946471744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1302us (1414us total) trans 30064893694 rc 0/0 00010000:00010000:0.0:1651529344.616143:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616144:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152829 00010000:00010000:0.0:1651529344.616146:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e32eeb69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.616147:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616150:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 3/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616152:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616155:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7862504 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.616155:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 1/0,0 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616156:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616157:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bef22 lrc: 0/0,0 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616159:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 3/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616164:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 1/0,0 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616169:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bef29 lrc: 0/0,0 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.616219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.616230:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472320 00000100:00100000:1.0:1651529344.616238:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472256 00000100:00100000:1.0:1651529344.616255:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152834 00000100:00100000:1.0:1651529344.616257:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946472320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.616270:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152835 00000100:00100000:0.0:1651529344.616272:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1124:39029:x1731745946472256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.616277:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177627 count 1 00010000:00010000:1.0:1651529344.616285:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616290:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 2/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616293:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.616293:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177626 count 1 00010000:00010000:1.0:1651529344.616294:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616295:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 4/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616297:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616301:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 3/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616302:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 2/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616305:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 939 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616308:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616308:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.616309:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966655744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616309:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 4/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616323:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.616334:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 3/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616338:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 939 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.616342:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.616357:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.616415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.616421:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472640 00000100:00100000:0.0:1651529344.616432:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472704 00000100:00100000:0.0:1651529344.616437:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152836 00000100:00100000:0.0:1651529344.616439:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1126:39029:x1731745946472640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.616444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.616444:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177628 count 1 00010000:00010000:0.0:1651529344.616453:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.616458:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 2/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.616465:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472768 00010000:00010000:0.0:1651529344.616466:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616467:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616468:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 4/0,1 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616474:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472832 00000100:00100000:1.0:1651529344.616478:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152837 00010000:00010000:0.0:1651529344.616479:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 3/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.616480:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1128:39030:x1731745946472704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.616483:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 4/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 939 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.616485:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177629 count 1 00000100:00100000:0.0:1651529344.616487:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966655872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616489:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616493:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 2/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616496:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616497:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616498:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 4/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616498:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.616504:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 3/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616508:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 939 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.616512:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966655936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.616520:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152838 00000100:00100000:1.0:1651529344.616521:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.616522:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1128:39029:x1731745946472768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.616527:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152839 00002000:00080000:0.0:1651529344.616527:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177630 count 1 00000100:00100000:1.0:1651529344.616529:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d7c3719 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1128:39030:x1731745946472832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.616531:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.616533:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177631 count 1 00010000:00010000:0.0:1651529344.616535:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 2/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616536:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616538:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616539:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616540:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 2/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616540:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 4/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616543:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616544:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616545:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 4/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616546:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 939 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616550:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 939 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616554:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 939 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.616557:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.616571:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.616576:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 939 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.616581:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.616589:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616621:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966655680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616625:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616639:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966655616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616643:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.616658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.616659:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353280 00010000:00010000:0.0:1651529344.616664:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 940 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.616670:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353344 00000100:00100000:0.0:1651529344.616676:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11794 00000100:00100000:0.0:1651529344.616678:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+941:41279:x1731746396353280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.616680:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 941 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616680:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.616682:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616686:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 3/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.616691:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11795 00000100:00100000:1.0:1651529344.616693:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+941:41278:x1731746396353344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.616696:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.616697:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 941 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616697:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3bafb2 lrc: 0/0,0 mode: --/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d79 expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.616701:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 3/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 941 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616703:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616704:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616705:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616707:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7b4d32/0xa29a79078f3b945a lrc: 0/0,0 mode: --/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccefa expref: 940 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616707:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 4/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616710:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616711:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616712:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616713:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.616715:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 4/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616721:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+939:41279:x1731746396353280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (74us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.616724:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.616724:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11794 00000100:00100000:1.0:1651529344.616740:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+939:41278:x1731746396353344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.616743:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11795 00000100:00100000:1.0:1651529344.616759:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966655744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616763:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616765:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616769:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616769:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616772:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616773:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616775:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616776:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616778:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616839:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1130:39029:x1731745946472000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1170us (1197us total) trans 30064893695 rc 0/0 00000100:00100000:0.0:1651529344.616842:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152832 00000100:00100000:1.0:1651529344.616844:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1130:39029:x1731745946472064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 809us (1157us total) trans 30064893696 rc 0/0 00000100:00100000:1.0:1651529344.616847:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152833 00010000:00010000:1.0:1651529344.616855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616860:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ce37d88 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.616861:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616864:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 3/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616864:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616868:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.616869:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 1/0,0 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616869:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616871:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bef3e lrc: 0/0,0 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616872:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 3/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616877:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 1/0,0 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616880:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bef45 lrc: 0/0,0 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.616959:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353472 00010000:00010000:0.0:1651529344.616971:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 938 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.616982:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11796 00000100:00100000:0.0:1651529344.616984:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+938:41279:x1731746396353472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.616985:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966655936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616987:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.616988:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.616990:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616992:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 3/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.616998:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ddfc6d/0xa29a79078f3b9ee8 lrc: 0/0,0 mode: --/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf98d expref: 938 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617002:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617003:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617004:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617007:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 4/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617015:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.617018:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617021:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617024:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617024:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+937:41279:x1731746396353472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.617027:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11796 00010000:00010000:1.0:1651529344.617029:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617037:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966655808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617040:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617047:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966655872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617050:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617068:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1129:39030:x1731745946472320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 811us (890us total) trans 30064893697 rc 0/0 00000100:00100000:1.0:1651529344.617072:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152834 00010000:00010000:1.0:1651529344.617085:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617095:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.617097:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617100:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 3/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617105:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 1/0,0 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617107:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bef4c lrc: 0/0,0 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617170:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473088 00000100:00100000:1.0:1651529344.617182:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152840 00000100:00100000:1.0:1651529344.617183:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1129:39030:x1731745946473088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.617189:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177632 count 1 00010000:00010000:1.0:1651529344.617192:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.617197:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 2/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 936 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617201:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617201:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617202:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 4/0,1 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617208:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 3/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 936 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617212:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 4/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 936 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617216:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.617230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617234:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.617237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.617242:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.617246:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617253:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473152 00000100:00100000:0.0:1651529344.617259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.617269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.617274:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473216 00000100:00100000:1.0:1651529344.617281:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152841 00000100:00100000:1.0:1651529344.617283:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1131:39029:x1731745946473152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.617287:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.617288:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177633 count 1 00000100:00100000:0.0:1651529344.617298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.617302:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617305:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152842 00010000:00010000:1.0:1651529344.617307:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 2/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 936 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.617307:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946473216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.617310:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617311:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617311:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 4/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.617313:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177634 count 1 00010000:00010000:0.0:1651529344.617317:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617318:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 3/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 936 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617321:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 936 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617322:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 2/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 936 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.617325:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966656192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617325:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617325:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617326:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 4/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617333:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 3/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 936 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.617337:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 936 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617340:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617347:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353792 00000100:00100000:0.0:1651529344.617348:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966656256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.617352:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 4/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 937 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617357:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354048 00000100:00100000:0.0:1651529344.617357:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.617359:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 938 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617363:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353728 00010000:00010000:1.0:1651529344.617365:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 939 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.617365:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617369:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617376:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353856 00000100:00100000:1.0:1651529344.617377:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354112 00010000:00010000:1.0:1651529344.617380:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617385:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11797 00000100:00100000:1.0:1651529344.617386:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+941:41279:x1731746396353792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.617389:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617390:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 4/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617394:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 3/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617397:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 941 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617399:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b89a6dfb/0xa29a79078f3bbb82 lrc: 0/0,0 mode: --/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bbd expref: 941 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617403:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617403:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617404:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617404:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11798 00000100:00100000:0.0:1651529344.617405:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+940:41279:x1731746396354048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.617407:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 4/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617409:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.617410:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 940 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617414:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 940 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617416:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.617423:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+940:41279:x1731746396353792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617426:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11797 00010000:00010000:0.0:1651529344.617427:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6644793/0xa29a79078f3b93b2 lrc: 0/0,0 mode: --/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc99 expref: 940 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617431:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11799 00010000:00010000:0.0:1651529344.617431:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617431:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617432:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617433:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+938:41278:x1731746396353728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.617435:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617436:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 938 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617440:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 3/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 938 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617445:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007447cb01/0xa29a79078f3b92d9 lrc: 0/0,0 mode: --/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8e1 expref: 938 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617445:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 4/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617448:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617449:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617450:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617453:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 4/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617458:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.617468:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.617472:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+937:41279:x1731746396354048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617474:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+937:41278:x1731746396353728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.617475:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11798 00000100:00100000:1.0:1651529344.617477:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11799 00000100:00100000:0.0:1651529344.617481:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11800 00000100:00100000:0.0:1651529344.617482:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+935:41278:x1731746396354112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.617483:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11801 00000100:00100000:1.0:1651529344.617484:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+935:41278:x1731746396353856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.617485:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617487:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.617487:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 935 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617488:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 935 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617491:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 935 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617492:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 3/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 935 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617496:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002185eab8/0xa29a79078f3ba666 lrc: 0/0,0 mode: --/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b2 expref: 935 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617497:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4efa44/0xa29a79078f3b9533 lrc: 0/0,0 mode: --/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd25e expref: 935 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.617500:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617500:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617500:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617501:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617501:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617502:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617504:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 4/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617504:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 4/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617509:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.617510:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.617515:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+933:41278:x1731746396354112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617516:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+933:41278:x1731746396353856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617518:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11801 00010000:00010000:1.0:1651529344.617525:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617527:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11800 00010000:00010000:1.0:1651529344.617528:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617534:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617536:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617541:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617544:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617548:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617550:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617573:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d7c3719 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1133:39030:x1731745946472832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1044us (1117us total) trans 30064893698 rc 0/0 00000100:00100000:1.0:1651529344.617576:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152839 00010000:00010000:1.0:1651529344.617583:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617587:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ee2d952 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.617588:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617591:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 3/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617591:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1132:39029:x1731745946472640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1151us (1186us total) trans 30064893699 rc 0/0 00000100:00100000:0.0:1651529344.617594:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152836 00010000:00010000:1.0:1651529344.617595:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 1/0,0 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617598:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bef6f lrc: 0/0,0 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617600:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617602:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617604:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617605:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fd34cc1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.617606:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617607:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617608:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 3/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617609:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617611:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 1/0,0 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617614:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bef5a lrc: 0/0,0 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617619:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617622:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617624:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617634:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617657:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1133:39029:x1731745946472256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1385us (1438us total) trans 30064893700 rc 0/0 00000100:00100000:0.0:1651529344.617661:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152835 00010000:00010000:0.0:1651529344.617668:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617670:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946472704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1255us total) trans 30064893701 rc 0/0 00010000:00010000:0.0:1651529344.617671:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e933c72d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.617672:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617675:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 3/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617680:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 1/0,0 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617682:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bef53 lrc: 0/0,0 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617683:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152837 00010000:00010000:0.0:1651529344.617687:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617689:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456f128f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.617690:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617703:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 3/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617707:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 1/0,0 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617710:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bef61 lrc: 0/0,0 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617716:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617719:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617722:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.617724:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617774:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1132:39029:x1731745946472768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1250us (1329us total) trans 30064893702 rc 0/0 00000100:00100000:0.0:1651529344.617777:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152838 00000100:00100000:0.0:1651529344.617798:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354240 00010000:00010000:0.0:1651529344.617823:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 5/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 932 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.617839:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11802 00000100:00100000:0.0:1651529344.617841:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41278:x1731746396354240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.617844:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.617845:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 5/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 932 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617849:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 4/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 932 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.617855:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617855:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617856:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617859:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 4/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617864:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617864:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.617869:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d94c312c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.617870:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617873:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 3/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617883:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 1/0,0 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617886:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bef68 lrc: 0/0,0 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617897:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bc6a01e/0xa29a79078f3bac55 lrc: 0/0,0 mode: --/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ff7 expref: 932 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.617900:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.617901:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+931:41278:x1731746396354240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.617904:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617905:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11802 00010000:00010000:1.0:1651529344.617907:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617918:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617922:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617924:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617975:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946473088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 791us (826us total) trans 30064893703 rc 0/0 00000100:00100000:1.0:1651529344.617979:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152840 00000100:00100000:1.0:1651529344.617985:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473792 00000100:00100000:0.0:1651529344.617991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.618005:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473728 00000100:00100000:1.0:1651529344.618012:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152843 00000100:00100000:1.0:1651529344.618014:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1133:39029:x1731745946473792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.618019:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177636 count 1 00010000:00010000:1.0:1651529344.618023:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618028:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 2/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.618029:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152844 00010000:00010000:1.0:1651529344.618031:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.618031:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1133:39030:x1731745946473728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.618032:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618032:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 4/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.618039:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177635 count 1 00010000:00010000:0.0:1651529344.618043:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618047:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 3/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618051:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.618055:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618061:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 2/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.618064:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.618069:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618072:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f056b2da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.618072:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618073:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618073:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618074:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 4/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618076:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 3/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618081:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 1/0,0 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618082:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 3/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618084:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f056b2da/0xa29a79078f3bef76 lrc: 0/0,0 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618086:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618090:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.618094:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966656192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.618099:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.618105:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618108:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966656256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618111:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.618155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.618166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.618183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.618193:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473856 00000100:00100000:0.0:1651529344.618195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.618208:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473984 00000100:00100000:1.0:1651529344.618212:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474048 00000100:00100000:1.0:1651529344.618218:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152845 00000100:00100000:1.0:1651529344.618220:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1136:39030:x1731745946473856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.618225:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177637 count 1 00010000:00010000:1.0:1651529344.618229:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618233:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 2/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618236:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618237:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618238:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 4/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618241:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473920 00000100:00100000:0.0:1651529344.618250:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152846 00000100:00100000:0.0:1651529344.618251:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1137:39029:x1731745946473984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.618257:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177639 count 1 00010000:00010000:1.0:1651529344.618261:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 3/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618261:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618265:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618266:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 2/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618269:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618269:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618270:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 4/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618277:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966656448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618277:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 3/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618281:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618285:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966656512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.618291:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.618298:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152847 00000100:00100000:1.0:1651529344.618300:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946474048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.618301:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.618304:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177640 count 1 00010000:00010000:1.0:1651529344.618308:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618308:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152848 00000100:00100000:0.0:1651529344.618310:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1137:39029:x1731745946473920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.618313:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 2/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.618314:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177638 count 1 00010000:00010000:1.0:1651529344.618316:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618316:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618317:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 4/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618318:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618323:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 3/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618324:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 2/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618327:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618327:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618328:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618329:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 4/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618331:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618335:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 3/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 930 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.618338:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.618338:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618342:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966656640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.618349:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.618355:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354304 00010000:00010000:0.0:1651529344.618359:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 931 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618377:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354368 00010000:00010000:0.0:1651529344.618381:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 932 pid: 142996 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618390:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11803 00000100:00100000:0.0:1651529344.618391:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41279:x1731746396354304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.618394:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.618396:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 932 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618399:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 3/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 932 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.618406:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11804 00000100:00100000:1.0:1651529344.618415:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41279:x1731746396354368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.618421:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df6ec07c/0xa29a79078f3b95e9 lrc: 0/0,0 mode: --/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd601 expref: 932 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618424:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.618425:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618426:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 931 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618426:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618426:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618429:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 4/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618430:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 3/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 931 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618437:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.618441:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007978e3ea/0xa29a79078f3b7c27 lrc: 0/0,0 mode: --/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbabe expref: 931 pid: 142996 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618445:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618446:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618447:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618450:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 4/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618456:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41279:x1731746396354304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (289us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.618459:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.618466:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11803 00000100:00100000:1.0:1651529344.618467:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41279:x1731746396354368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618469:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11804 00010000:00010000:0.0:1651529344.618475:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618478:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618479:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618482:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618485:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618488:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618494:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618497:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618529:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1139:39030:x1731745946473216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1221us (1299us total) trans 30064893704 rc 0/0 00000100:00100000:0.0:1651529344.618531:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152842 00010000:00010000:0.0:1651529344.618538:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618541:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1138:39029:x1731745946473152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1257us (1349us total) trans 30064893705 rc 0/0 00010000:00010000:0.0:1651529344.618542:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070fbb7c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.618543:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618544:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152841 00010000:00010000:0.0:1651529344.618546:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 3/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618550:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 1/0,0 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618552:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618553:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bef84 lrc: 0/0,0 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618555:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001988a229 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.618556:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618559:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 3/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618564:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 1/0,0 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618567:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001988a229/0xa29a79078f3bef7d lrc: 0/0,0 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618576:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.618580:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618584:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618588:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618654:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354944 00010000:00010000:1.0:1651529344.618659:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 929 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.618670:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354880 00010000:00010000:1.0:1651529344.618673:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618674:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11805 00000100:00100000:0.0:1651529344.618676:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41279:x1731746396354944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.618681:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11806 00000100:00100000:1.0:1651529344.618683:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41278:x1731746396354880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.618684:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.618686:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618687:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618688:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618691:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 3/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618692:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 3/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618696:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bffc8190/0xa29a79078f3b9962 lrc: 0/0,0 mode: --/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce367 expref: 930 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618697:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3b88f3 lrc: 0/0,0 mode: --/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc140 expref: 930 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.618700:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618701:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618701:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618701:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618701:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618702:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618704:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 4/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618705:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 4/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618711:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.618712:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.618719:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41278:x1731746396354880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.618719:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396354944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618722:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11806 00000100:00100000:0.0:1651529344.618723:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11805 00010000:00010000:0.0:1651529344.618739:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618740:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966656448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618743:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618744:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618746:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618749:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618750:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618753:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618762:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618765:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618832:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1139:39029:x1731745946473792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 817us (875us total) trans 30064893706 rc 0/0 00000100:00100000:1.0:1651529344.618835:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152843 00010000:00010000:1.0:1651529344.618842:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618845:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c101868 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.618846:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618846:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1138:39030:x1731745946473728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 814us (854us total) trans 30064893707 rc 0/0 00010000:00010000:1.0:1651529344.618849:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 3/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618849:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152844 00010000:00010000:1.0:1651529344.618854:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 1/0,0 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618857:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bef92 lrc: 0/0,0 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618861:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618864:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000414c5ef5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.618865:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618867:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 3/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618870:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 1/0,0 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618875:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414c5ef5/0xa29a79078f3bef8b lrc: 0/0,0 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.618907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.618925:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966656512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618936:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618942:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.618943:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474176 00010000:00010000:1.0:1651529344.618946:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618953:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474240 00000100:00100000:0.0:1651529344.618958:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152849 00000100:00100000:0.0:1651529344.618960:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1139:39030:x1731745946474176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.618961:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152850 00000100:00100000:1.0:1651529344.618963:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1139:39030:x1731745946474240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.618965:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177641 count 1 00002000:00080000:1.0:1651529344.618969:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177642 count 1 00010000:00010000:0.0:1651529344.618969:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618972:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618974:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 2/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 926 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618977:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 2/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 926 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618977:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618977:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618978:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 4/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618980:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618980:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618981:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 4/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618984:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 926 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618988:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 3/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 926 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.618988:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.618991:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 926 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.618992:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.618998:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966656768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.619006:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.619014:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.619028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619046:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966656640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619051:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619058:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355072 00010000:00010000:0.0:1651529344.619062:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.619103:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11807 00000100:00100000:0.0:1651529344.619105:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+927:41279:x1731746396355072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.619108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.619108:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.619110:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619114:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 3/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.619120:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b27de855/0xa29a79078f3ba785 lrc: 0/0,0 mode: --/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dac expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619128:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474432 00010000:00010000:0.0:1651529344.619130:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619131:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619132:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619137:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474496 00010000:00010000:0.0:1651529344.619139:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 4/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619143:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152851 00000100:00100000:1.0:1651529344.619145:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1141:39029:x1731745946474432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.619150:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177643 count 1 00010000:00010000:0.0:1651529344.619153:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.619160:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619163:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+926:41279:x1731746396355072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.619166:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11807 00010000:00010000:1.0:1651529344.619169:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 2/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 925 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619172:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619173:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619173:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 4/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619176:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152852 00000100:00100000:0.0:1651529344.619177:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1141:39030:x1731745946474496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.619180:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 3/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 925 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.619183:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177644 count 1 00010000:00010000:1.0:1651529344.619184:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619187:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619191:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619191:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 2/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 925 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619194:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619194:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619195:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 4/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619199:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.619202:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 3/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 925 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619204:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619205:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619207:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619209:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966656896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.619210:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619213:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619217:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.619248:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619251:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea1a6d66 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.619252:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619255:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1142:39030:x1731745946473856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1035us (1118us total) trans 30064893708 rc 0/0 00000100:00100000:1.0:1651529344.619258:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152845 00010000:00010000:0.0:1651529344.619258:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 3/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619263:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 1/0,0 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619265:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a6d66/0xa29a79078f3bef99 lrc: 0/0,0 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619309:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355136 00010000:00010000:0.0:1651529344.619315:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.619323:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11808 00000100:00100000:0.0:1651529344.619324:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+926:41278:x1731746396355136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.619327:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.619328:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619332:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 3/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619337:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082f0c82a/0xa29a79078f3bb3e8 lrc: 0/0,0 mode: --/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ec8 expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619343:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619344:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619345:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619347:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 4/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619357:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.619360:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619364:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619368:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+925:41278:x1731746396355136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.619370:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11808 00010000:00010000:1.0:1651529344.619371:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619377:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619411:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.619423:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1142:39030:x1731745946474048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1123us (1228us total) trans 30064893709 rc 0/0 00000100:00100000:1.0:1651529344.619433:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152847 00010000:00010000:1.0:1651529344.619439:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619443:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000484854f5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.619444:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619447:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 3/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619452:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 1/0,0 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619455:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484854f5/0xa29a79078f3befa7 lrc: 0/0,0 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619472:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966656768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.619474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.619476:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619495:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355200 00000100:00100000:0.0:1651529344.619496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.619504:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619515:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355264 00000100:00100000:0.0:1651529344.619516:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966656704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.619517:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 926 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619520:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619521:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355328 00010000:00010000:1.0:1651529344.619523:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619527:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355392 00000100:00100000:0.0:1651529344.619528:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11809 00010000:00010000:1.0:1651529344.619529:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 928 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.619530:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396355200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.619533:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11810 00010000:00010000:0.0:1651529344.619533:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.619535:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41278:x1731746396355264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.619535:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619538:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.619539:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619539:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 3/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619543:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 3/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619544:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3ba7e0 lrc: 0/0,0 mode: --/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f2d expref: 928 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619548:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bad58 lrc: 0/0,0 mode: --/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3496 expref: 927 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619548:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619548:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619549:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619552:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619553:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619554:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619557:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 4/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619567:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.619577:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+926:41278:x1731746396355264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.619580:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11810 00010000:00010000:0.0:1651529344.619583:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 4/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619590:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.619592:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11811 00000100:00100000:1.0:1651529344.619594:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+925:41279:x1731746396355328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.619596:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.619598:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619602:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619607:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033151b12/0xa29a79078f3b9b8b lrc: 0/0,0 mode: --/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebcc expref: 925 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619610:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619611:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619612:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619618:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+924:41279:x1731746396355200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 87us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.619621:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 4/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619621:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11809 00000100:00100000:0.0:1651529344.619627:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11812 00010000:00010000:1.0:1651529344.619630:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.619636:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41279:x1731746396355328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.619636:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41279:x1731746396355392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.619639:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11811 00010000:00010000:0.0:1651529344.619639:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.619640:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 923 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.619645:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 3/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 922 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619650:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966656832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619650:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3b9724 lrc: 0/0,0 mode: --/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaa0 expref: 922 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.619654:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619654:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619655:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619655:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619658:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 4/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619660:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474944 00010000:00010000:0.0:1651529344.619668:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.619673:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152853 00000100:00100000:1.0:1651529344.619675:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1142:39030:x1731745946474944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.619675:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+921:41279:x1731746396355392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.619678:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11812 00002000:00080000:1.0:1651529344.619680:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177645 count 1 00010000:00010000:1.0:1651529344.619684:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619685:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619688:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 2/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619688:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619691:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619691:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619692:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619692:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 4/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619694:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619699:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 3/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619709:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.619713:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.619721:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.619726:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619729:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d3b1de6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.619740:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619743:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 3/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619747:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1143:39029:x1731745946473920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1436us (1591us total) trans 30064893710 rc 0/0 00010000:00010000:1.0:1651529344.619748:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 1/0,0 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619750:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3befae lrc: 0/0,0 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619750:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152848 00010000:00010000:1.0:1651529344.619758:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619758:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619761:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619763:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619765:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619766:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619767:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619769:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619802:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1144:39029:x1731745946473984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1550us (1624us total) trans 30064893711 rc 0/0 00000100:00100000:0.0:1651529344.619823:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152846 00000100:00100000:1.0:1651529344.619828:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1143:39030:x1731745946474240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 864us (921us total) trans 30064893712 rc 0/0 00010000:00010000:0.0:1651529344.619830:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619832:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152850 00010000:00010000:0.0:1651529344.619833:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4be8f08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.619835:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619838:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 3/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619839:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619842:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd31d915 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.619843:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619843:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 1/0,0 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619846:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 3/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619846:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3befa0 lrc: 0/0,0 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619851:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 1/0,0 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619851:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619854:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd31d915/0xa29a79078f3befbc lrc: 0/0,0 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619854:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619857:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619860:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619907:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1143:39030:x1731745946474176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (1018us total) trans 30064893713 rc 0/0 00000100:00100000:0.0:1651529344.619916:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152849 00000100:00100000:1.0:1651529344.619920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619921:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475008 00000100:00100000:0.0:1651529344.619927:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152854 00000100:00100000:0.0:1651529344.619929:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1143:39030:x1731745946475008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.619934:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177646 count 1 00010000:00010000:0.0:1651529344.619938:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619943:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 2/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619946:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619947:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619947:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 4/0,1 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619954:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 3/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619957:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 4/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.619961:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966657024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.619970:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.619978:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966656896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619981:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619989:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355456 00000100:00100000:1.0:1651529344.619996:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355584 00010000:00010000:1.0:1651529344.620007:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620011:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.620015:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11813 00000100:00100000:1.0:1651529344.620017:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396355584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.620020:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.620020:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11814 00010000:00010000:1.0:1651529344.620021:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620022:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396355456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.620025:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 3/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620025:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.620026:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620030:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 3/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620031:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beab33e1/0xa29a79078f3b9ea9 lrc: 0/0,0 mode: --/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8bb expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620034:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620035:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620035:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620035:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3ba9ae lrc: 0/0,0 mode: --/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d258c expref: 921 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620039:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 4/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620039:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620039:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620040:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620051:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.620060:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+920:41279:x1731746396355584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.620062:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 4/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620063:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11813 00010000:00010000:1.0:1651529344.620069:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620072:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.620079:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676a17a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.620080:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620080:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41279:x1731746396355456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.620083:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 3/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620083:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11814 00010000:00010000:1.0:1651529344.620087:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 1/0,0 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620090:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3befb5 lrc: 0/0,0 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620091:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620094:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620096:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620099:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620099:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620102:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 2/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620104:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620107:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620157:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946474432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1011us (1050us total) trans 30064893715 rc 0/0 00000100:00100000:0.0:1651529344.620159:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1145:39030:x1731745946474496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1041us total) trans 30064893714 rc 0/0 00000100:00100000:1.0:1651529344.620160:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152851 00010000:00010000:1.0:1651529344.620167:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 2/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620170:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022eaf1ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.620171:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 2/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620173:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152852 00010000:00010000:1.0:1651529344.620174:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 3/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620178:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 1/0,0 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620181:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3befca lrc: 0/0,0 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620185:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620188:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a34f4c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.620189:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620191:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 3/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620194:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 1/0,0 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620197:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a34f4c/0xa29a79078f3befc3 lrc: 0/0,0 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620249:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.620280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.620300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.620310:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475200 00000100:00100000:0.0:1651529344.620316:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475264 00000100:00100000:1.0:1651529344.620317:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475392 00000100:00100000:1.0:1651529344.620323:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475328 00000100:00100000:1.0:1651529344.620328:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152855 00000100:00100000:1.0:1651529344.620330:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1147:39029:x1731745946475200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.620332:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152856 00000100:00100000:0.0:1651529344.620333:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1147:39030:x1731745946475392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.620335:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177647 count 1 00010000:00010000:1.0:1651529344.620339:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.620339:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177650 count 1 00010000:00010000:1.0:1651529344.620344:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 2/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 918 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620344:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620349:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620349:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 2/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620350:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620350:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 4/0,1 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620352:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620352:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620353:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 4/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620357:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 3/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 918 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620360:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 4/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 918 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620360:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 3/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.620364:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966657088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620364:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 918 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620368:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966657152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.620376:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.620377:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.620381:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152857 00000100:00100000:1.0:1651529344.620383:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1147:39030:x1731745946475264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.620384:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152858 00000100:00100000:0.0:1651529344.620386:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1147:39029:x1731745946475328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.620388:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177648 count 1 00002000:00080000:0.0:1651529344.620390:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177649 count 1 00010000:00010000:1.0:1651529344.620391:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620393:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620395:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 2/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620398:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620398:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 2/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620399:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620399:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 4/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620401:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620401:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620402:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 4/0,1 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620408:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 3/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620408:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 3/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 918 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620412:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 918 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.620416:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966657216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.620422:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.620430:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966656960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620431:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 4/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 918 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620434:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620437:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966657280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.620440:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356096 00010000:00010000:1.0:1651529344.620444:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620445:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.620455:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356160 00010000:00010000:1.0:1651529344.620457:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 5/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620462:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11815 00000100:00100000:0.0:1651529344.620464:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+920:41279:x1731746396356096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.620466:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11816 00010000:00010000:0.0:1651529344.620467:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.620468:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+920:41278:x1731746396356160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.620469:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620471:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.620472:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 5/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620473:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 3/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620476:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 4/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 920 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.620478:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d66c1a/0xa29a79078f3b9e6a lrc: 0/0,0 mode: --/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7e2 expref: 920 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620482:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620482:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620482:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620483:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620483:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620483:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620486:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 4/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620486:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 4/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620491:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.620496:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.620503:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41279:x1731746396356096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.620505:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41278:x1731746396356160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.620508:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11815 00000100:00100000:1.0:1651529344.620509:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11816 00010000:00010000:1.0:1651529344.620520:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620523:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620523:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b5ccef3/0xa29a79078f3b93c0 lrc: 0/0,0 mode: --/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccc3 expref: 917 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.620526:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620527:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966657024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.620529:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620531:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620534:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620537:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620540:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620542:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620569:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1149:39030:x1731745946474944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (1082us total) trans 30064893716 rc 0/0 00000100:00100000:1.0:1651529344.620572:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152853 00010000:00010000:1.0:1651529344.620579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620583:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006edccc33 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.620583:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1148:39030:x1731745946475008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 652us (707us total) trans 30064893717 rc 0/0 00010000:00010000:1.0:1651529344.620584:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620586:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152854 00010000:00010000:1.0:1651529344.620587:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 3/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620591:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 1/0,0 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620593:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620594:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edccc33/0xa29a79078f3befd1 lrc: 0/0,0 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620598:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d110885d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.620599:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620602:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 3/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620607:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 1/0,0 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.620610:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3befd8 lrc: 0/0,0 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620624:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475520 00000100:00100000:1.0:1651529344.620628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620642:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475456 00000100:00100000:0.0:1651529344.620647:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152859 00000100:00100000:0.0:1651529344.620649:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1149:39030:x1731745946475520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.620654:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177652 count 1 00010000:00010000:0.0:1651529344.620658:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620662:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 2/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620666:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620667:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 4/0,1 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620673:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 3/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620677:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 4/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620681:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966657344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.620690:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.620696:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152860 00000100:00100000:0.0:1651529344.620698:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1149:39029:x1731745946475456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.620702:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177651 count 1 00010000:00010000:0.0:1651529344.620705:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620709:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 2/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620712:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620713:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620713:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 4/0,1 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620718:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 3/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620724:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 4/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620751:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966657408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.620766:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.620846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.620862:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475648 00000100:00100000:0.0:1651529344.620863:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475584 00000100:00100000:1.0:1651529344.620874:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152861 00000100:00100000:1.0:1651529344.620880:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1151:39030:x1731745946475648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.620882:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152862 00000100:00100000:0.0:1651529344.620884:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1151:39029:x1731745946475584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.620885:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177654 count 1 00002000:00080000:0.0:1651529344.620889:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177653 count 1 00010000:00010000:1.0:1651529344.620890:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620893:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620894:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 2/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620898:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620898:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620898:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 2/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620899:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 4/0,1 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620901:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620902:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620902:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 4/0,1 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620906:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 3/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.620909:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 4/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.620914:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966657472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620927:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 3/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 916 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.620934:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.620947:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 4/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.620952:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966657536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.620973:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.620995:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966657152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620999:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621001:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966657088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.621005:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621013:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966657216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.621015:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.621345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.621355:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621356:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356352 00010000:00010000:0.0:1651529344.621368:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 917 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621383:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621384:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356288 00010000:00010000:0.0:1651529344.621387:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 4/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 918 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621391:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356416 00010000:00010000:0.0:1651529344.621393:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621397:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356544 00010000:00010000:0.0:1651529344.621399:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 5/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 920 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621403:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356672 00010000:00010000:0.0:1651529344.621405:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 5/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 921 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621411:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356480 00010000:00010000:0.0:1651529344.621414:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 5/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 922 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621417:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356736 00010000:00010000:0.0:1651529344.621419:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 5/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 923 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621423:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11817 00000100:00100000:1.0:1651529344.621426:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41279:x1731746396356352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.621429:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.621429:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11818 00000100:00100000:0.0:1651529344.621430:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41278:x1731746396356288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.621431:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 923 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.621433:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.621435:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 3/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 923 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.621435:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 4/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 923 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.621439:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 3/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 923 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621441:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135ce474/0xa29a79078f3bb9c2 lrc: 0/0,0 mode: --/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64e0 expref: 923 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621445:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621445:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621445:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a20a88f/0xa29a79078f3b9342 lrc: 0/0,0 mode: --/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccacb expref: 922 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621446:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621448:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621449:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 4/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621449:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621450:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621453:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 4/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621467:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.621468:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.621476:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+921:41279:x1731746396356352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.621476:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+921:41278:x1731746396356288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.621479:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11818 00000100:00100000:1.0:1651529344.621481:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11817 00000100:00100000:0.0:1651529344.621485:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11819 00000100:00100000:0.0:1651529344.621486:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41278:x1731746396356416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.621488:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11820 00000100:00100000:1.0:1651529344.621489:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41278:x1731746396356544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.621489:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.621491:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621492:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.621493:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 5/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621497:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 4/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621502:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621503:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621503:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621512:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 3/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621513:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 4/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621518:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.621518:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fb83adc/0xa29a79078f3bbb3c lrc: 0/0,0 mode: --/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a9e expref: 919 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.621521:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621522:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.621523:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+918:41278:x1731746396356544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.621523:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621526:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11820 00010000:00010000:0.0:1651529344.621526:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 4/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621530:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11821 00010000:00010000:0.0:1651529344.621533:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.621538:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+917:41278:x1731746396356672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.621540:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+917:41278:x1731746396356416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.621541:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.621542:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 5/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 917 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621543:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11819 00010000:00010000:1.0:1651529344.621546:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 4/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 917 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621549:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11822 00000100:00100000:0.0:1651529344.621550:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+916:41278:x1731746396356480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.621551:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621551:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621552:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621553:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.621554:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 5/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621555:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 4/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621558:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 4/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 916 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621559:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.621562:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621563:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.621564:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+916:41278:x1731746396356672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.621564:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621567:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11821 00010000:00010000:0.0:1651529344.621567:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 4/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621571:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11823 00010000:00010000:0.0:1651529344.621571:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.621573:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41278:x1731746396356736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.621575:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.621576:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41278:x1731746396356480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.621577:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 5/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 915 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621578:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11822 00010000:00010000:1.0:1651529344.621580:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 4/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 914 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.621585:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621585:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621586:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621589:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 4/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621593:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.621593:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a067623c/0xa29a79078f3bb394 lrc: 0/0,0 mode: --/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d1d expref: 914 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.621597:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+913:41278:x1731746396356736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.621597:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966657280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621600:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11823 00010000:00010000:0.0:1651529344.621600:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621604:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621606:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621609:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621610:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3ba0a8 lrc: 0/0,0 mode: --/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0032 expref: 912 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.621612:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621614:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966657472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.621617:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621628:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621631:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621634:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621637:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621655:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1152:39029:x1731745946475328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1268us (1360us total) trans 30064893718 rc 0/0 00000100:00100000:0.0:1651529344.621658:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152858 00010000:00010000:0.0:1651529344.621669:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b755249/0xa29a79078f3bb81e lrc: 0/0,0 mode: --/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e9d expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621673:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966657408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621676:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621679:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621684:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621688:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1152:39030:x1731745946475648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 808us (843us total) trans 30064893719 rc 0/0 00010000:00010000:0.0:1651529344.621688:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621690:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621692:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152861 00010000:00010000:1.0:1651529344.621699:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621703:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621706:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621709:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621725:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1153:39029:x1731745946475456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1097us total) trans 30064893720 rc 0/0 00000100:00100000:0.0:1651529344.621728:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152860 00010000:00010000:0.0:1651529344.621746:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621750:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621752:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1152:39029:x1731745946475200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1422us (1531us total) trans 30064893721 rc 0/0 00010000:00010000:0.0:1651529344.621753:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621755:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621756:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152855 00010000:00010000:1.0:1651529344.621763:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621766:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621772:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621774:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621788:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1153:39030:x1731745946475392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1454us (1515us total) trans 30064893722 rc 0/0 00000100:00100000:0.0:1651529344.621793:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152856 00010000:00010000:0.0:1651529344.621800:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621816:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdd9c2a7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.621817:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621820:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 3/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621825:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 1/0,0 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621826:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1152:39030:x1731745946475264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1441us (1577us total) trans 30064893723 rc 0/0 00010000:00010000:0.0:1651529344.621828:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3beff4 lrc: 0/0,0 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621829:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152857 00010000:00010000:0.0:1651529344.621832:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621835:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e32eeb69 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.621836:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621836:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621839:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001089898c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.621839:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 3/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621840:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621843:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 3/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621844:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 1/0,0 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621847:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf009 lrc: 0/0,0 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621848:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 1/0,0 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621851:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf002 lrc: 0/0,0 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621851:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621853:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ef8b7cf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.621854:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621857:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 3/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621860:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 1/0,0 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621862:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef8b7cf/0xa29a79078f3befdf lrc: 0/0,0 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621866:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050b6d714 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.621866:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621867:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621868:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ce37d88 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.621869:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 3/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621873:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 1/0,0 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621875:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3befe6 lrc: 0/0,0 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621877:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621880:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 3/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621884:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 1/0,0 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621886:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3befed lrc: 0/0,0 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621903:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de99a94b/0xa29a79078f3ba62e lrc: 0/0,0 mode: --/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17fc expref: 910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.621906:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966657344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.621910:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621919:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621921:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621924:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621935:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621976:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1152:39030:x1731745946475520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1326us (1368us total) trans 30064893724 rc 0/0 00000100:00100000:0.0:1651529344.621979:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152859 00000100:00100000:0.0:1651529344.621987:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356800 00010000:00010000:0.0:1651529344.621992:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 5/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622003:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11824 00000100:00100000:0.0:1651529344.622005:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+910:41278:x1731746396356800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.622008:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.622021:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 5/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 910 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622026:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 4/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 910 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622031:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622032:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622033:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622035:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622036:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 4/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622039:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7862504 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.622040:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622043:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 3/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622048:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 1/0,0 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622060:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3beffb lrc: 0/0,0 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622061:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.622086:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+910:41278:x1731746396356800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.622089:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11824 00010000:00010000:0.0:1651529344.622101:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7b1f28/0xa29a79078f3bb0fb lrc: 0/0,0 mode: --/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4288 expref: 909 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622105:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966657536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622108:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622112:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622114:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622117:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622120:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622131:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622135:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc379d70 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.622136:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622138:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 3/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622143:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 1/0,0 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622146:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf010 lrc: 0/0,0 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.622178:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.622187:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476352 00000100:00100000:0.0:1651529344.622192:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1153:39029:x1731745946475584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1307us (1338us total) trans 30064893725 rc 0/0 00000100:00100000:1.0:1651529344.622202:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476416 00000100:00100000:1.0:1651529344.622207:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152863 00000100:00100000:1.0:1651529344.622209:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1154:39029:x1731745946476352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.622214:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177655 count 1 00010000:00010000:1.0:1651529344.622225:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622228:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152862 00010000:00010000:1.0:1651529344.622238:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 2/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622241:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622242:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622243:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 4/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622243:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152864 00000100:00100000:0.0:1651529344.622245:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1153:39030:x1731745946476416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.622250:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 3/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622254:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 4/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.622258:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966657600:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.622258:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177656 count 1 00010000:00010000:0.0:1651529344.622263:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622268:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.622268:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 2/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622271:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622272:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622272:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 4/0,1 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622279:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 3/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622283:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 4/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622287:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966657664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.622292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.622296:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.622303:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476480 00000100:00100000:0.0:1651529344.622311:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152865 00000100:00100000:0.0:1651529344.622312:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1154:39029:x1731745946476480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.622326:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177657 count 1 00000100:00100000:1.0:1651529344.622329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622330:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622334:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 2/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622338:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622338:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622339:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 4/0,1 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622345:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 3/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622355:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 4/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622360:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966657728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.622368:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.622374:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476544 00000100:00100000:0.0:1651529344.622391:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476608 00000100:00100000:0.0:1651529344.622395:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476736 00000100:00100000:0.0:1651529344.622399:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152866 00000100:00100000:0.0:1651529344.622400:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1157:39030:x1731745946476544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.622405:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177658 count 1 00010000:00010000:0.0:1651529344.622408:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.622417:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476672 00010000:00010000:0.0:1651529344.622421:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 2/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.622424:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152867 00000100:00100000:1.0:1651529344.622426:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1158:39029:x1731745946476608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.622431:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177659 count 1 00010000:00010000:0.0:1651529344.622446:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622446:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622447:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622447:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 4/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622452:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 2/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622455:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622455:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 3/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622456:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622456:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 4/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622459:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 4/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622463:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966657792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.622464:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 3/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622467:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622471:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622472:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966657856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.622478:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152868 00000100:00100000:1.0:1651529344.622480:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.622480:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b387ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1158:39029:x1731745946476736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.622485:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177661 count 1 00000100:00100000:1.0:1651529344.622487:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152869 00000100:00100000:1.0:1651529344.622489:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1158:39029:x1731745946476672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.622489:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.622493:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177660 count 1 00010000:00010000:0.0:1651529344.622493:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 2/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622496:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622496:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622501:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 2/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622504:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622505:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 4/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622506:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622507:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622507:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 4/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622512:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 3/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622513:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 3/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622516:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.622517:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622520:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966657920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.622521:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966657984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.622528:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622529:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.622574:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476800 00000100:00100000:0.0:1651529344.622582:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152870 00000100:00100000:0.0:1651529344.622584:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1159:39030:x1731745946476800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.622589:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177662 count 1 00010000:00010000:0.0:1651529344.622593:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622597:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 2/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622600:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622601:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622616:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 4/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622640:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 3/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 908 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622668:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 4/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.622673:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966658048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.622684:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.622700:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966657728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622704:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622712:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357440 00010000:00010000:0.0:1651529344.622716:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 5/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 909 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.622718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.622729:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357376 00010000:00010000:0.0:1651529344.622740:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 5/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 910 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.622741:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.622752:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357504 00000100:00100000:1.0:1651529344.622754:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966657600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622756:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 4/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.622758:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622761:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11825 00000100:00100000:0.0:1651529344.622762:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+911:41278:x1731746396357440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.622765:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.622766:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11826 00010000:00010000:0.0:1651529344.622767:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 5/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.622768:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+911:41279:x1731746396357376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.622770:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 4/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.622772:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.622774:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 4/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622776:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622777:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 3/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622777:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622777:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622780:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 4/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622783:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a080ac77/0xa29a79078f3bbb51 lrc: 0/0,0 mode: --/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aeb expref: 911 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622785:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.622787:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622787:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622788:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622791:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 4/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622797:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+910:41278:x1731746396357440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.622800:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11825 00010000:00010000:1.0:1651529344.622813:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.622821:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11827 00000100:00100000:1.0:1651529344.622822:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+909:41279:x1731746396357376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.622823:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+909:41279:x1731746396357504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.622825:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11826 00010000:00010000:0.0:1651529344.622826:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.622828:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 4/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.622832:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 3/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.622833:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622837:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622837:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b23b6d08/0xa29a79078f3bbbdd lrc: 0/0,0 mode: --/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d4c expref: 908 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.622840:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622841:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622841:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622842:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622843:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622845:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 4/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622858:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.622865:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+907:41279:x1731746396357504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.622868:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11827 00010000:00010000:0.0:1651529344.622875:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622886:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1160:39029:x1731745946476352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 676us (719us total) trans 30064893726 rc 0/0 00000100:00100000:1.0:1651529344.622889:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152863 00010000:00010000:0.0:1651529344.622894:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c101868 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.622895:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622898:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 3/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622903:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 1/0,0 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622911:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf017 lrc: 0/0,0 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.622920:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622937:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622941:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622943:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622986:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1160:39029:x1731745946476480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 672us (694us total) trans 30064893727 rc 0/0 00000100:00100000:0.0:1651529344.622989:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152865 00000100:00100000:0.0:1651529344.623000:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966657792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.623004:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623011:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623012:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afeed51d/0xa29a79078f3bb339 lrc: 0/0,0 mode: --/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be9 expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623015:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f04051da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623016:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623016:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966657664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.623018:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623019:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 3/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623023:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623024:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 1/0,0 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623026:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623027:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf025 lrc: 0/0,0 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623029:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623037:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966657856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623041:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623051:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.623071:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623074:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d587a03 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623075:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623078:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 3/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623082:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 1/0,0 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623084:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf01e lrc: 0/0,0 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623091:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357632 00010000:00010000:1.0:1651529344.623102:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 4/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623108:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946476416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 862us (929us total) trans 30064893728 rc 0/0 00000100:00100000:1.0:1651529344.623109:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357760 00000100:00100000:0.0:1651529344.623111:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152864 00010000:00010000:1.0:1651529344.623112:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623116:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11828 00000100:00100000:1.0:1651529344.623126:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+907:41279:x1731746396357632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.623127:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11829 00010000:00010000:1.0:1651529344.623129:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.623129:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+907:41279:x1731746396357760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.623131:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 4/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.623132:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.623134:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623135:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 3/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.623138:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 3/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623140:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a431274/0xa29a79078f3bb482 lrc: 0/0,0 mode: --/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5106 expref: 907 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623143:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623144:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623144:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0749781/0xa29a79078f3b9e16 lrc: 0/0,0 mode: --/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf692 expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623145:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623148:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 4/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623148:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623148:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623149:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623152:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 4/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623157:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.623164:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+905:41279:x1731746396357632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (245us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.623167:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.623173:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11828 00010000:00010000:1.0:1651529344.623181:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623184:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623195:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+904:41279:x1731746396357760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.623197:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623198:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11829 00010000:00010000:1.0:1651529344.623200:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623216:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623220:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d94c312c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.623221:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623224:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 3/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623229:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 1/0,0 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623232:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf033 lrc: 0/0,0 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623240:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623243:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1160:39029:x1731745946476608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 816us (900us total) trans 30064893729 rc 0/0 00010000:00010000:0.0:1651529344.623243:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623246:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152867 00010000:00010000:0.0:1651529344.623246:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623248:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.623301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.623332:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946476544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1003us total) trans 30064893730 rc 0/0 00000100:00100000:0.0:1651529344.623335:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152866 00000100:00100000:0.0:1651529344.623341:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477248 00000100:00100000:0.0:1651529344.623346:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477312 00000100:00100000:0.0:1651529344.623353:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152871 00000100:00100000:0.0:1651529344.623355:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1161:39030:x1731745946477248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.623359:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177663 count 1 00010000:00010000:0.0:1651529344.623364:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623368:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 2/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 903 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623374:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623374:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623375:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 4/0,1 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623382:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 3/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 903 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623385:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 4/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 903 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623389:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.623405:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.623409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.623432:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966657920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.623436:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.623444:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152872 00000100:00100000:0.0:1651529344.623446:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1161:39030:x1731745946477312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.623447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.623451:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177664 count 1 00010000:00010000:1.0:1651529344.623453:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623454:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623456:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000553813a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623461:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 3/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623466:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 1/0,0 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623476:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 2/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 903 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623481:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623482:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf02c lrc: 0/0,0 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623482:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623482:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 4/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623489:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 3/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 903 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623493:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 903 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623494:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966657984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.623497:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966658176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623498:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623504:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357824 00000100:00100000:0.0:1651529344.623505:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.623509:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 904 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623514:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357952 00010000:00010000:1.0:1651529344.623516:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 905 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623520:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358080 00010000:00010000:1.0:1651529344.623523:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 5/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623527:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11830 00000100:00100000:0.0:1651529344.623527:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966658048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.623529:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+906:41279:x1731746396357824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.623531:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623532:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623533:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623539:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11831 00000100:00100000:0.0:1651529344.623541:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+906:41279:x1731746396357952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.623544:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623547:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 3/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623553:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3b99c4 lrc: 0/0,0 mode: --/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4fd expref: 906 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623557:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623557:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623558:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623560:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 905 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623561:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 4/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623564:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 3/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 905 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623570:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623576:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2ccb740/0xa29a79078f3b9b53 lrc: 0/0,0 mode: --/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb5c expref: 905 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.623578:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+905:41279:x1731746396357824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.623580:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.623581:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11830 00010000:00010000:0.0:1651529344.623581:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623581:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623584:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 4/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623586:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11832 00000100:00100000:1.0:1651529344.623587:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41279:x1731746396358080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.623590:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.623593:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.623598:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 4/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 903 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623601:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41279:x1731746396357952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.623602:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 3/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 903 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623604:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11831 00010000:00010000:1.0:1651529344.623608:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba4fe780/0xa29a79078f3bb205 lrc: 0/0,0 mode: --/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46b7 expref: 902 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623611:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623612:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623612:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623615:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 4/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623623:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623627:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623629:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+901:41279:x1731746396358080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.623631:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623632:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11832 00010000:00010000:0.0:1651529344.623634:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623637:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623639:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623642:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623651:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623654:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623698:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1163:39029:x1731745946476672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1209us (1287us total) trans 30064893732 rc 0/0 00000100:00100000:1.0:1651529344.623701:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152869 00000100:00100000:0.0:1651529344.623705:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b387ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1162:39029:x1731745946476736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1224us (1331us total) trans 30064893731 rc 0/0 00010000:00010000:1.0:1651529344.623708:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623709:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152868 00010000:00010000:1.0:1651529344.623712:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008658fa4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623713:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623716:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 3/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623720:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 1/0,0 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623723:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf03a lrc: 0/0,0 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623727:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623739:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fd34cc1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623740:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623740:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623744:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623745:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 3/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623748:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623749:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 1/0,0 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623750:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 2/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623752:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf041 lrc: 0/0,0 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623755:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623764:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008986c686 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.623765:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 2/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623768:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 3/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623771:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 1/0,0 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623774:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf048 lrc: 0/0,0 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623790:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1162:39030:x1731745946476800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1205us (1246us total) trans 30064893733 rc 0/0 00000100:00100000:0.0:1651529344.623793:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152870 00000100:00100000:1.0:1651529344.623825:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.623850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.623864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.623878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.623891:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477504 00000100:00100000:0.0:1651529344.623905:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477568 00000100:00100000:0.0:1651529344.623912:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477632 00000100:00100000:0.0:1651529344.623918:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152873 00000100:00100000:0.0:1651529344.623919:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1164:39030:x1731745946477504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.623925:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177665 count 1 00010000:00010000:0.0:1651529344.623930:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623934:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152874 00010000:00010000:0.0:1651529344.623934:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 2/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 900 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.623937:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1164:39030:x1731745946477568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.623943:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177666 count 1 00010000:00010000:1.0:1651529344.623947:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623952:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 2/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623952:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623953:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623954:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 4/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623955:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623955:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623956:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 4/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623961:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 900 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.623963:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 3/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.623965:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.623967:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.623970:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966658240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.623971:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966658304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.623984:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.623990:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.623992:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152875 00000100:00100000:0.0:1651529344.623993:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1164:39030:x1731745946477632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.623998:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177667 count 1 00010000:00010000:0.0:1651529344.624002:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624007:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 2/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 900 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624012:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624013:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624013:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 4/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624019:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 3/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 900 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624043:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 900 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624047:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966658368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624076:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.624100:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966658176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624105:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624113:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358400 00000100:00100000:1.0:1651529344.624115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.624118:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 5/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 901 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624122:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358592 00000100:00100000:0.0:1651529344.624128:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11833 00000100:00100000:0.0:1651529344.624130:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41279:x1731746396358400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.624133:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 902 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624133:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.624134:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 5/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 902 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624138:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 4/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 902 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624143:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624144:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624145:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624148:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 4/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624155:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11834 00000100:00100000:1.0:1651529344.624157:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41279:x1731746396358592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.624160:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624161:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 902 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624165:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 3/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 902 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624176:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aca7d99/0xa29a79078f3b8fc9 lrc: 0/0,0 mode: --/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c7 expref: 902 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624176:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.624181:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624181:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624182:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624184:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+901:41279:x1731746396358400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (320us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.624185:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 4/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624187:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11833 00010000:00010000:1.0:1651529344.624194:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.624202:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41279:x1731746396358592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (87us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.624202:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624204:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11834 00010000:00010000:0.0:1651529344.624206:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624209:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624211:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624264:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1165:39030:x1731745946477312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 817us (962us total) trans 30064893734 rc 0/0 00000100:00100000:0.0:1651529344.624267:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152872 00010000:00010000:0.0:1651529344.624275:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624278:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.624279:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624282:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 3/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624287:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 1/0,0 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624290:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf056 lrc: 0/0,0 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624300:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d04eab/0xa29a79078f3bb427 lrc: 0/0,0 mode: --/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fe0 expref: 899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624303:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624306:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624312:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624315:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624339:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624341:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.624384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.624388:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1165:39030:x1731745946477248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1032us (1103us total) trans 30064893735 rc 0/0 00000100:00100000:0.0:1651529344.624391:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152871 00000100:00100000:1.0:1651529344.624424:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966658304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624433:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624434:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966658368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624438:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624440:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624443:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456f128f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.624444:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624445:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966658240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624447:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 3/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624448:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624452:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 1/0,0 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624454:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf04f lrc: 0/0,0 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624461:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358656 00000100:00100000:0.0:1651529344.624461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.624466:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624470:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.624482:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358720 00010000:00010000:1.0:1651529344.624485:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.624493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.624499:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358848 00010000:00010000:1.0:1651529344.624501:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 901 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624506:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11835 00000100:00100000:1.0:1651529344.624508:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+901:41279:x1731746396358656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.624510:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624512:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 901 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624515:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 901 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624520:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e1e1a7/0xa29a79078f3bbf2c lrc: 0/0,0 mode: --/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79c4 expref: 901 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624524:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624524:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624525:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.624538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.624548:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 4/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624548:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11836 00000100:00100000:0.0:1651529344.624551:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41279:x1731746396358720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.624554:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624557:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.624562:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624568:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41279:x1731746396358656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (219us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.624571:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 3/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 900 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624572:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11835 00000100:00100000:1.0:1651529344.624577:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11837 00010000:00010000:0.0:1651529344.624577:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031940f08/0xa29a79078f3b7eab lrc: 0/0,0 mode: --/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc0e expref: 899 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624578:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+899:41279:x1731746396358848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.624581:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.624581:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624581:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624582:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 898 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624582:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624586:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 3/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 898 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624586:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 4/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624591:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002463fdd4/0xa29a79078f3b7c20 lrc: 0/0,0 mode: --/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbab0 expref: 898 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.624594:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.624601:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624602:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624602:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624602:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+897:41279:x1731746396358720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.624605:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 4/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624605:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11836 00010000:00010000:1.0:1651529344.624613:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.624620:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41279:x1731746396358848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.624622:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11837 00010000:00010000:0.0:1651529344.624622:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624626:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624629:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624630:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477824 00010000:00010000:0.0:1651529344.624632:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624638:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477952 00000100:00100000:1.0:1651529344.624649:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477888 00000100:00100000:1.0:1651529344.624655:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478144 00000100:00100000:1.0:1651529344.624658:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478208 00000100:00100000:1.0:1651529344.624660:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152876 00000100:00100000:1.0:1651529344.624662:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1169:39030:x1731745946477824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.624667:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177668 count 1 00010000:00010000:1.0:1651529344.624671:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624676:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 2/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624679:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624679:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624680:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 4/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624686:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 3/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.624686:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1170:39030:x1731745946477632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 691us (807us total) trans 30064893736 rc 0/0 00000100:00100000:0.0:1651529344.624689:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152875 00010000:00010000:1.0:1651529344.624690:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.624694:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966658432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624694:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152877 00000100:00100000:0.0:1651529344.624695:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1169:39030:x1731745946477952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.624700:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177670 count 1 00000100:00100000:1.0:1651529344.624703:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.624705:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624709:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152878 00010000:00010000:0.0:1651529344.624710:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 2/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.624711:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1169:39029:x1731745946477888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.624713:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624713:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624714:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 4/0,1 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.624717:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177669 count 1 00010000:00010000:1.0:1651529344.624720:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624723:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 3/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624724:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 2/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624727:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624727:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 4/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624728:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624728:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 4/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624741:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966658496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624744:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 3/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624748:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624750:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624752:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966658560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624757:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152879 00000100:00100000:1.0:1651529344.624759:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.624759:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1169:39030:x1731745946478144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.624764:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177671 count 1 00000100:00100000:1.0:1651529344.624766:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152880 00000100:00100000:1.0:1651529344.624767:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1169:39030:x1731745946478208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.624767:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624771:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 2/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.624772:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177672 count 1 00010000:00010000:0.0:1651529344.624774:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624775:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624775:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624776:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 4/0,1 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624779:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 2/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624782:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624782:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 3/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624783:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624783:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 4/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624785:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 4/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.624789:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 3/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.624790:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966658624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624793:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.624796:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624797:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966658688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.624823:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.624825:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624827:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624829:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624831:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.624832:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624832:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624834:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624835:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 3/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624839:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 1/0,0 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624852:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf06b lrc: 0/0,0 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624857:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624859:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ee2d952 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.624860:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624863:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 3/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624867:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 1/0,0 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624869:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf05d lrc: 0/0,0 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624872:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1170:39030:x1731745946477504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1047us total) trans 30064893737 rc 0/0 00000100:00100000:0.0:1651529344.624875:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152873 00010000:00010000:1.0:1651529344.624876:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624879:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624881:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624890:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624952:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1170:39030:x1731745946477568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1015us (1101us total) trans 30064893738 rc 0/0 00000100:00100000:1.0:1651529344.624955:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152874 00010000:00010000:1.0:1651529344.624963:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624973:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039b7eb20 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.624974:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624977:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 3/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624982:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 1/0,0 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624984:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf064 lrc: 0/0,0 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.625098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.625103:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478592 00000100:00100000:0.0:1651529344.625105:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478656 00000100:00100000:1.0:1651529344.625115:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152881 00000100:00100000:1.0:1651529344.625116:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1171:39030:x1731745946478592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.625121:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177673 count 1 00010000:00010000:1.0:1651529344.625132:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625137:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 2/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.625146:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152882 00000100:00100000:0.0:1651529344.625148:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1171:39030:x1731745946478656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.625154:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177674 count 1 00010000:00010000:1.0:1651529344.625155:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625156:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625157:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 4/0,1 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625159:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625165:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 3/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625166:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 2/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.625169:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 4/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625169:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625170:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625171:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 4/0,1 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625173:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966658752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625178:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 3/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 895 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625181:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 4/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625188:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.625192:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625202:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.625203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.625215:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478784 00000100:00100000:0.0:1651529344.625222:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152883 00000100:00100000:0.0:1651529344.625224:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1172:39029:x1731745946478784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.625228:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177675 count 1 00010000:00010000:0.0:1651529344.625232:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625237:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 2/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 895 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625251:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625252:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625252:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 4/0,1 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625259:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 3/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 895 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625263:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 4/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 895 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.625267:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966658880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625280:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.625364:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966658432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.625374:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625391:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966658560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.625394:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.625407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625413:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966658688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.625417:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625421:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966658624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.625423:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359168 00010000:00010000:0.0:1651529344.625426:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625428:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 5/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 896 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.625433:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359296 00000100:00100000:1.0:1651529344.625434:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359104 00010000:00010000:1.0:1651529344.625436:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625438:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 4/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 898 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625441:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359232 00010000:00010000:1.0:1651529344.625443:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 899 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625447:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359360 00010000:00010000:1.0:1651529344.625448:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625454:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11838 00000100:00100000:1.0:1651529344.625456:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41279:x1731746396359168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.625456:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11839 00000100:00100000:0.0:1651529344.625458:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41278:x1731746396359104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.625459:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625460:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 5/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625461:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.625463:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625467:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 3/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625472:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efcfcbd/0xa29a79078f3bbab7 lrc: 0/0,0 mode: --/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6836 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625474:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 4/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 900 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625476:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625477:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625478:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625480:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625481:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625481:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 4/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625482:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625485:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 4/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625495:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.625504:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+899:41279:x1731746396359168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.625507:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11838 00010000:00010000:0.0:1651529344.625508:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.625512:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11840 00000100:00100000:1.0:1651529344.625514:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+898:41278:x1731746396359232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.625516:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+898:41278:x1731746396359104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.625517:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625518:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625522:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 3/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 898 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625526:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3bb092 lrc: 0/0,0 mode: --/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d411c expref: 898 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.625529:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11839 00000100:00100000:0.0:1651529344.625536:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11841 00010000:00010000:1.0:1651529344.625540:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625540:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625541:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625544:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 4/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625545:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41279:x1731746396359296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.625549:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.625550:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 4/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 896 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625551:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.625557:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41278:x1731746396359232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.625560:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11840 00000100:00100000:1.0:1651529344.625564:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11842 00000100:00100000:1.0:1651529344.625566:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+895:41278:x1731746396359360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.625568:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625570:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625575:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 3/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625580:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b60a0c33/0xa29a79078f3bbcf5 lrc: 0/0,0 mode: --/PR res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d712e expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625582:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 3/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625584:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625585:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625586:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625587:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b3bfb5/0xa29a79078f3bbb12 lrc: 0/0,0 mode: --/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69cc expref: 894 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625589:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 4/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625591:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625596:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.625598:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625599:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625602:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 4/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625603:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396359296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.625605:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11841 00010000:00010000:1.0:1651529344.625608:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.625612:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625615:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+892:41278:x1731746396359360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.625615:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625618:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11842 00010000:00010000:1.0:1651529344.625624:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625628:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625628:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625631:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625631:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625634:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625680:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946478144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 920us (1154us total) trans 30064893739 rc 0/0 00000100:00100000:0.0:1651529344.625683:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152879 00000100:00100000:1.0:1651529344.625684:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946478208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (1146us total) trans 30064893740 rc 0/0 00000100:00100000:1.0:1651529344.625687:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152880 00010000:00010000:0.0:1651529344.625691:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625694:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b744bd8d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.625695:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625695:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625698:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 3/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625703:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 1/0,0 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625706:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf087 lrc: 0/0,0 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625709:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e933c72d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.625710:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625713:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 3/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625717:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e1cd9ef/0xa29a79078f3ba387 lrc: 0/0,0 mode: --/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c17 expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625718:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 1/0,0 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625721:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf08e lrc: 0/0,0 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625721:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966658496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625724:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625727:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625728:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625740:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625741:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625743:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625745:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625746:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625747:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625783:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946477824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1120us (1321us total) trans 30064893741 rc 0/0 00000100:00100000:1.0:1651529344.625787:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152876 00000100:00100000:0.0:1651529344.625787:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946477952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1090us (1300us total) trans 30064893742 rc 0/0 00000100:00100000:0.0:1651529344.625790:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152877 00010000:00010000:1.0:1651529344.625794:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625797:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cda455b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.625798:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625798:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625801:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 3/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625801:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006dcbcfa2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.625802:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625823:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 1/0,0 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625824:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 3/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625826:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf072 lrc: 0/0,0 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625829:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 1/0,0 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625832:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf079 lrc: 0/0,0 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625835:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625837:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625841:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625843:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625886:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1173:39029:x1731745946477888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1392us total) trans 30064893743 rc 0/0 00000100:00100000:1.0:1651529344.625889:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152878 00000100:00100000:0.0:1651529344.625894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625898:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359616 00010000:00010000:1.0:1651529344.625903:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 5/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.625904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625920:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359808 00000100:00100000:0.0:1651529344.625922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.625923:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 5/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 892 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625928:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359680 00010000:00010000:1.0:1651529344.625930:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 5/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.625935:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11843 00000100:00100000:1.0:1651529344.625936:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396359616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.625939:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625940:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 5/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 893 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625955:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 4/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.625966:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11844 00000100:00100000:0.0:1651529344.625968:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396359808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.625972:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.625974:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 5/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 893 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.625978:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 4/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 893 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.625984:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625984:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625984:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625985:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625985:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625986:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625989:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 4/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625990:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 4/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625995:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.625995:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.626004:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396359616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.626004:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396359808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.626007:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11844 00000100:00100000:1.0:1651529344.626008:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11843 00000100:00100000:0.0:1651529344.626012:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11845 00010000:00010000:1.0:1651529344.626021:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626024:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070fbb7c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.626025:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626028:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 3/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626032:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 1/0,0 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626032:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+891:41278:x1731746396359680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.626035:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf080 lrc: 0/0,0 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626035:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.626037:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 5/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.626041:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 4/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.626045:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966658752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626046:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bac01 lrc: 0/0,0 mode: --/PR res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e8b expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.626049:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626050:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626050:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626051:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626054:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 4/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626062:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626062:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.626065:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626068:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626068:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+890:41278:x1731746396359680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.626071:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626071:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11845 00010000:00010000:0.0:1651529344.626082:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b63fcb1/0xa29a79078f3b935e lrc: 0/0,0 mode: --/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb49 expref: 889 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.626086:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966658880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626089:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626092:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626095:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626098:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626101:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626110:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1173:39030:x1731745946478592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1026us total) trans 30064893744 rc 0/0 00000100:00100000:1.0:1651529344.626113:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152881 00010000:00010000:1.0:1651529344.626119:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626123:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d3b1de6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.626124:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626126:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 3/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626142:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 1/0,0 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626145:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf095 lrc: 0/0,0 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626149:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626152:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068c3a11c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.626153:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626156:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 3/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626157:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1173:39029:x1731745946478784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 917us (939us total) trans 30064893745 rc 0/0 00010000:00010000:1.0:1651529344.626159:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 1/0,0 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626162:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf0a3 lrc: 0/0,0 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626170:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152883 00000100:00100000:1.0:1651529344.626193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.626194:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bad51 lrc: 0/0,0 mode: --/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d345e expref: 888 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.626204:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626208:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.626212:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626214:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626217:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626220:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.626238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.626270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.626270:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1173:39030:x1731745946478656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1172us total) trans 30064893746 rc 0/0 00000100:00100000:0.0:1651529344.626273:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152882 00000100:00100000:0.0:1651529344.626278:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478976 00000100:00100000:0.0:1651529344.626288:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479040 00000100:00100000:0.0:1651529344.626293:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479104 00000100:00100000:0.0:1651529344.626297:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479168 00000100:00100000:0.0:1651529344.626300:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479232 00000100:00100000:0.0:1651529344.626304:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152884 00000100:00100000:0.0:1651529344.626305:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1177:39030:x1731745946478976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.626310:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177676 count 1 00010000:00010000:0.0:1651529344.626314:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626319:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 2/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626322:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626323:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626323:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 4/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626326:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626330:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cb06c19 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.626330:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 3/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626331:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626334:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 3/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626334:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 4/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 887 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.626338:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.626339:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 1/0,0 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626341:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf09c lrc: 0/0,0 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626352:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.626355:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152885 00000100:00100000:1.0:1651529344.626357:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1177:39029:x1731745946479040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.626359:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152886 00000100:00100000:0.0:1651529344.626361:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1177:39030:x1731745946479104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.626363:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177677 count 1 00010000:00010000:1.0:1651529344.626367:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626371:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 2/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626374:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626375:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626376:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 4/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.626380:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177678 count 1 00010000:00010000:0.0:1651529344.626384:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626389:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 2/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626391:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626392:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626393:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626394:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 4/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626395:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 4/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.626399:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966659008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626400:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 3/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626404:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.626408:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.626408:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966659072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.626415:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152887 00000100:00100000:1.0:1651529344.626417:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1177:39029:x1731745946479168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.626421:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177679 count 1 00010000:00010000:1.0:1651529344.626425:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626428:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.626429:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 2/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626433:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626433:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626434:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 4/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626435:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152888 00000100:00100000:0.0:1651529344.626436:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1177:39030:x1731745946479232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.626440:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.626441:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177680 count 1 00010000:00010000:1.0:1651529344.626443:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.626445:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626449:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 2/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.626455:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.626463:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.626467:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626468:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626469:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 4/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626476:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 3/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626479:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.626483:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966659200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.626491:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.626495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.626507:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479360 00000100:00100000:1.0:1651529344.626512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.626523:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479296 00000100:00100000:0.0:1651529344.626527:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152889 00000100:00100000:0.0:1651529344.626529:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1179:39030:x1731745946479360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.626532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.626533:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177682 count 1 00010000:00010000:0.0:1651529344.626537:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626541:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 2/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626544:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626545:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626546:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 4/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626552:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 3/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 887 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626555:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.626559:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966659264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.626575:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.626581:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479424 00000100:00100000:1.0:1651529344.626584:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152890 00000100:00100000:1.0:1651529344.626586:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1180:39030:x1731745946479296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.626588:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152891 00000100:00100000:0.0:1651529344.626589:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1180:39029:x1731745946479424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.626592:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177681 count 1 00010000:00010000:1.0:1651529344.626596:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626601:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 2/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626604:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626604:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626605:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 4/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.626610:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177683 count 1 00010000:00010000:1.0:1651529344.626612:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 3/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 887 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626614:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626615:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.626619:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 2/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 887 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.626620:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966659328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626622:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626622:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626623:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 4/0,1 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626629:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 3/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 887 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626635:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 4/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 887 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.626637:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.626639:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966659392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.626647:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.626704:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966658944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626708:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626771:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966659072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626775:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626792:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966659008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.626796:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626825:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.626828:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626877:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966659200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626882:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626889:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966659264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626891:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627224:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966659392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.627226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.627228:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.627241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627244:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360192 00000100:00100000:1.0:1651529344.627248:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.627249:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 4/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 888 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627255:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360320 00000100:00100000:1.0:1651529344.627258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.627258:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 889 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.627262:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360128 00000100:00100000:1.0:1651529344.627263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.627264:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 4/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 890 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.627268:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360448 00010000:00010000:0.0:1651529344.627270:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 891 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627271:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966659328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.627274:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360256 00010000:00010000:1.0:1651529344.627275:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627275:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 892 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.627279:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360576 00010000:00010000:0.0:1651529344.627281:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 893 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627282:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360384 00000100:00100000:0.0:1651529344.627285:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360640 00010000:00010000:1.0:1651529344.627287:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 895 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627287:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 4/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 895 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627293:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11846 00000100:00100000:1.0:1651529344.627303:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+895:41279:x1731746396360192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.627304:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11847 00010000:00010000:1.0:1651529344.627306:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.627306:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+895:41279:x1731746396360320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.627308:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 4/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 895 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627309:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627310:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627312:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 895 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627314:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627318:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4615799/0xa29a79078f3b94df lrc: 0/0,0 mode: --/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0d6 expref: 895 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627320:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d86b56/0xa29a79078f3ba2e6 lrc: 0/0,0 mode: --/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09cb expref: 895 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627321:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627322:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627323:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627323:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627324:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627325:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627326:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 4/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627328:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 4/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627333:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.627337:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.627347:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396360192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.627347:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+893:41279:x1731746396360320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.627349:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11847 00000100:00100000:1.0:1651529344.627351:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11846 00000100:00100000:0.0:1651529344.627354:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11848 00000100:00100000:0.0:1651529344.627356:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+891:41278:x1731746396360128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.627357:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11849 00000100:00100000:1.0:1651529344.627358:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+891:41279:x1731746396360448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.627359:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627360:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 4/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627361:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627362:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 891 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627364:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 3/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627369:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a60594/0xa29a79078f3bb3b0 lrc: 0/0,0 mode: --/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d78 expref: 891 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627372:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627373:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627374:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 3/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 890 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627374:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627376:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 4/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627380:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae40ac8c/0xa29a79078f3b9429 lrc: 0/0,0 mode: --/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce7c expref: 890 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627382:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.627383:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627384:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627385:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627387:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+889:41278:x1731746396360128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.627388:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 4/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627389:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11848 00000100:00100000:0.0:1651529344.627393:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11850 00010000:00010000:1.0:1651529344.627396:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.627401:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41278:x1731746396360256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.627403:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41279:x1731746396360448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.627404:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627405:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 888 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627406:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11849 00010000:00010000:0.0:1651529344.627410:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 3/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627411:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11851 00000100:00100000:1.0:1651529344.627413:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+887:41279:x1731746396360576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.627414:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c258ead4/0xa29a79078f3b9437 lrc: 0/0,0 mode: --/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce98 expref: 887 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627416:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627417:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 887 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627419:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627421:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 3/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 886 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627422:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 4/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627427:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.627432:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009265d88d/0xa29a79078f3b9ebe lrc: 0/0,0 mode: --/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf901 expref: 886 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.627433:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+886:41278:x1731746396360256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.627435:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11850 00010000:00010000:1.0:1651529344.627436:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627436:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627437:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627440:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 4/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627444:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11852 00000100:00100000:0.0:1651529344.627445:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+884:41278:x1731746396360384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.627446:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.627448:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627449:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 884 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627452:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+884:41279:x1731746396360576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.627453:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 3/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 884 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627455:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11851 00010000:00010000:0.0:1651529344.627458:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f890649c/0xa29a79078f3b980b lrc: 0/0,0 mode: --/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde66 expref: 883 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.627460:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11853 00010000:00010000:0.0:1651529344.627461:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.627462:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+882:41278:x1731746396360640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.627462:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627462:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627464:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627465:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 4/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627466:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 4/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 882 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.627469:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 3/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 882 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.627471:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.627474:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fb37c5/0xa29a79078f3b7806 lrc: 0/0,0 mode: --/PR res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb59a expref: 882 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.627476:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+882:41278:x1731746396360384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.627478:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11852 00010000:00010000:1.0:1651529344.627480:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627481:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627481:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627484:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 4/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627485:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627488:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627492:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.627498:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41278:x1731746396360640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (235us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.627498:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627501:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11853 00010000:00010000:0.0:1651529344.627501:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627508:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627517:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627520:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627523:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627566:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1182:39030:x1731745946479104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1204us (1343us total) trans 30064893747 rc 0/0 00000100:00100000:0.0:1651529344.627569:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152886 00000100:00100000:1.0:1651529344.627574:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946479040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1216us (1362us total) trans 30064893748 rc 0/0 00000100:00100000:1.0:1651529344.627577:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152885 00010000:00010000:0.0:1651529344.627577:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627581:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a97d5a3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.627582:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627584:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627585:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 3/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627588:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627590:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 1/0,0 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627591:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627593:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627593:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf0b8 lrc: 0/0,0 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627597:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627599:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4be8f08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.627600:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627606:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 3/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627609:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 1/0,0 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627612:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf0b1 lrc: 0/0,0 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627615:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627618:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d110885d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.627618:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627621:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 3/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627624:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 1/0,0 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627626:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d110885d/0xa29a79078f3bf0bf lrc: 0/0,0 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627627:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946479168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1210us (1389us total) trans 30064893749 rc 0/0 00000100:00100000:1.0:1651529344.627630:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152887 00010000:00010000:0.0:1651529344.627632:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627635:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627638:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627638:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627641:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627642:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627645:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627647:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627676:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1182:39030:x1731745946479232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1239us (1407us total) trans 30064893750 rc 0/0 00000100:00100000:0.0:1651529344.627679:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152888 00000100:00100000:1.0:1651529344.627681:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1182:39030:x1731745946479296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1094us (1168us total) trans 30064893751 rc 0/0 00000100:00100000:1.0:1651529344.627684:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152890 00010000:00010000:0.0:1651529344.627687:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627691:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627691:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627694:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000426608f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.627694:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627695:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627696:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627698:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 3/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627710:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 1/0,0 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627713:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf0c6 lrc: 0/0,0 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627718:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627720:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022eaf1ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.627721:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627724:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 3/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627739:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 1/0,0 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627743:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022eaf1ba/0xa29a79078f3bf0d4 lrc: 0/0,0 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627745:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946479424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1154us (1212us total) trans 30064893752 rc 0/0 00010000:00010000:1.0:1651529344.627746:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627749:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000972da1e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.627750:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627750:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152891 00010000:00010000:1.0:1651529344.627753:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 3/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627756:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 1/0,0 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627757:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627759:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf0db lrc: 0/0,0 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627760:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627763:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627766:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627819:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1181:39030:x1731745946479360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1289us (1323us total) trans 30064893753 rc 0/0 00000100:00100000:0.0:1651529344.627822:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152889 00010000:00010000:0.0:1651529344.627829:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627832:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072ce6845 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.627833:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627836:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 3/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627841:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 1/0,0 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627844:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf0cd lrc: 0/0,0 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627850:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627852:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627856:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627858:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627894:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1181:39030:x1731745946478976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1588us (1707us total) trans 30064893754 rc 0/0 00000100:00100000:0.0:1651529344.627897:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152884 00010000:00010000:1.0:1651529344.627912:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d4c772d6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.627925:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627928:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 3/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627932:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 1/0,0 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627935:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf0aa lrc: 0/0,0 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.628041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628041:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480192 00000100:00100000:0.0:1651529344.628077:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480128 00000100:00100000:0.0:1651529344.628085:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152892 00000100:00100000:0.0:1651529344.628087:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1182:39030:x1731745946480192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.628089:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152893 00000100:00100000:1.0:1651529344.628091:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946480128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.628092:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177685 count 1 00002000:00080000:1.0:1651529344.628097:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177684 count 1 00010000:00010000:0.0:1651529344.628097:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628101:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628104:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 2/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628106:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 2/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628107:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628108:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628109:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628109:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 4/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628110:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628111:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 4/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628116:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 3/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628118:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 3/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628120:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 4/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628124:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966659456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628131:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.628136:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966659520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628138:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.628151:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.628155:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628168:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480256 00000100:00100000:0.0:1651529344.628174:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480320 00000100:00100000:0.0:1651529344.628181:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152894 00000100:00100000:1.0:1651529344.628195:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152895 00000100:00100000:1.0:1651529344.628197:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1184:39030:x1731745946480320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.628199:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1184:39030:x1731745946480256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.628202:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177687 count 1 00002000:00080000:0.0:1651529344.628205:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177686 count 1 00010000:00010000:1.0:1651529344.628206:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628211:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 2/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628214:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628215:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628215:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 4/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628221:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628222:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 3/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628225:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628234:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 2/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 879 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628237:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628238:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628239:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 4/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628241:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.628246:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 3/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 879 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628250:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 879 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.628251:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.628254:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966659648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628262:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.628282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628299:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480384 00000100:00100000:1.0:1651529344.628300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628314:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480448 00000100:00100000:0.0:1651529344.628320:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152896 00000100:00100000:1.0:1651529344.628321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628321:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1186:39030:x1731745946480384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.628331:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177688 count 1 00000100:00100000:1.0:1651529344.628332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.628341:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480512 00010000:00010000:0.0:1651529344.628342:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628347:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 2/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.628348:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480576 00010000:00010000:0.0:1651529344.628350:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628350:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.628351:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152897 00010000:00010000:0.0:1651529344.628351:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 4/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628353:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f4cf210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1188:39029:x1731745946480448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.628358:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177689 count 1 00010000:00010000:0.0:1651529344.628358:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 3/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628362:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628362:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628366:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966659712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628367:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 2/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628370:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628371:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628371:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 4/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628378:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628382:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628396:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.628400:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966659776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.628409:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.628414:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152898 00000100:00100000:1.0:1651529344.628417:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152899 00000100:00100000:0.0:1651529344.628417:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1188:39030:x1731745946480512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.628419:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1188:39029:x1731745946480576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.628422:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177690 count 1 00002000:00080000:1.0:1651529344.628424:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177691 count 1 00010000:00010000:0.0:1651529344.628426:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628427:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628430:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 2/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628431:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 2/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628433:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628434:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628434:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628434:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 4/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628435:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628435:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 4/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628441:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 3/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628442:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 879 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628446:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628447:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.628449:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966659904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628451:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966659840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.628456:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.628458:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.628495:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966659456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.628499:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628539:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966659520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628544:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.628591:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966659648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.628598:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.628601:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628604:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.628608:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361344 00000100:00100000:1.0:1651529344.628612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.628613:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 880 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.628623:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628625:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361472 00010000:00010000:1.0:1651529344.628627:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628628:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 881 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628632:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361280 00000100:00100000:1.0:1651529344.628634:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361408 00010000:00010000:0.0:1651529344.628634:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 4/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 882 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628639:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 883 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.628645:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11854 00000100:00100000:1.0:1651529344.628647:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+883:41279:x1731746396361344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.628650:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.628651:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 883 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628651:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11855 00000100:00100000:0.0:1651529344.628652:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+883:41279:x1731746396361472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.628655:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 3/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 883 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628655:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.628657:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 883 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628660:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc9609b7/0xa29a79078f3b9c25 lrc: 0/0,0 mode: --/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee7a expref: 883 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628661:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 3/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 883 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628666:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041889282/0xa29a79078f3b89ef lrc: 0/0,0 mode: --/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1be expref: 882 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628667:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628667:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628668:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628670:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628670:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628671:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 4/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628671:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628674:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 4/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628677:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.628681:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.628689:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+881:41279:x1731746396361344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.628692:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11854 00000100:00100000:0.0:1651529344.628695:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+881:41279:x1731746396361472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.628697:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11856 00000100:00100000:1.0:1651529344.628699:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41278:x1731746396361408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.628699:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11855 00010000:00010000:1.0:1651529344.628702:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.628704:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628705:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11857 00010000:00010000:1.0:1651529344.628707:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 3/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.628707:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+879:41278:x1731746396361280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.628709:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.628711:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 4/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628712:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051074ca7/0xa29a79078f3b7868 lrc: 0/0,0 mode: --/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb722 expref: 879 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628715:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628715:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 3/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 879 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.628716:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628717:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628720:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 4/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628720:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000013b5aaa/0xa29a79078f3b9ccd lrc: 0/0,0 mode: --/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf18a expref: 878 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.628723:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628724:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628724:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628725:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.628727:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 4/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628740:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41278:x1731746396361408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.628742:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11856 00010000:00010000:0.0:1651529344.628743:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.628749:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+876:41278:x1731746396361280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.628750:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628752:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11857 00010000:00010000:1.0:1651529344.628753:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628756:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628759:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628764:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628773:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628779:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628782:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628828:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1190:39029:x1731745946480128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 735us (785us total) trans 30064893755 rc 0/0 00000100:00100000:1.0:1651529344.628831:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152893 00010000:00010000:1.0:1651529344.628838:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628844:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050b6d714 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.628845:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628848:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 3/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628852:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 1/0,0 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628855:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b6d714/0xa29a79078f3bf0e9 lrc: 0/0,0 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628873:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628876:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6741c7 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.628876:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1189:39030:x1731745946480256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 676us (721us total) trans 30064893756 rc 0/0 00010000:00010000:1.0:1651529344.628877:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628879:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152894 00010000:00010000:1.0:1651529344.628880:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 3/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628883:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 1/0,0 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628889:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf0f7 lrc: 0/0,0 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628889:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628893:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628895:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628896:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628898:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628898:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628901:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628904:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628959:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1190:39030:x1731745946480192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 872us (930us total) trans 30064893757 rc 0/0 00000100:00100000:1.0:1651529344.628962:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1190:39030:x1731745946480320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 764us (798us total) trans 30064893758 rc 0/0 00000100:00100000:0.0:1651529344.628963:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152892 00000100:00100000:1.0:1651529344.628965:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152895 00010000:00010000:0.0:1651529344.628970:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628972:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628976:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676a17a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.628976:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc9fb9dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.628977:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628977:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628980:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 3/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628980:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 3/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628984:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 1/0,0 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628985:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 1/0,0 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628987:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000676a17a2/0xa29a79078f3bf0f0 lrc: 0/0,0 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628988:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf0e2 lrc: 0/0,0 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629060:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966659776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.629064:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629108:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966659840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629112:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629120:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966659712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629122:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629128:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361600 00000100:00100000:1.0:1651529344.629130:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966659904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.629134:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629148:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 876 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629160:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361728 00000100:00100000:1.0:1651529344.629163:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11858 00010000:00010000:0.0:1651529344.629163:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.629165:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41279:x1731746396361600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.629171:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11859 00010000:00010000:1.0:1651529344.629173:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.629173:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41279:x1731746396361728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.629175:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629176:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.629178:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.629179:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629181:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 3/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.629185:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065571f69/0xa29a79078f3bb9de lrc: 0/0,0 mode: --/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6588 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629187:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb1f42e4/0xa29a79078f3ba594 lrc: 0/0,0 mode: --/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1508 expref: 877 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.629189:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629189:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629190:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629191:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629191:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629192:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629193:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 4/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629195:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 4/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629199:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.629202:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.629207:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396361600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.629209:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396361728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629210:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11858 00000100:00100000:0.0:1651529344.629212:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11859 00010000:00010000:1.0:1651529344.629217:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629219:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629220:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629222:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629223:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629225:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629226:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629228:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629269:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f4cf210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1190:39029:x1731745946480448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 915us (974us total) trans 30064893759 rc 0/0 00000100:00100000:1.0:1651529344.629272:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152897 00010000:00010000:1.0:1651529344.629279:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629283:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000861beeb1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.629284:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629286:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1189:39030:x1731745946480512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 869us (965us total) trans 30064893760 rc 0/0 00010000:00010000:1.0:1651529344.629287:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 3/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629291:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 1/0,0 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629294:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861beeb1/0xa29a79078f3bf105 lrc: 0/0,0 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629299:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629301:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fd34cc1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.629302:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629302:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152898 00010000:00010000:1.0:1651529344.629305:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 3/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629308:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 1/0,0 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629313:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd34cc1/0xa29a79078f3bf10c lrc: 0/0,0 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629319:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629349:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361536 00010000:00010000:0.0:1651529344.629354:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.629357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.629365:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361664 00010000:00010000:0.0:1651529344.629368:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629378:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11860 00000100:00100000:0.0:1651529344.629380:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396361536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.629383:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.629384:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 875 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629388:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 3/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 875 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629393:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007177c03d/0xa29a79078f3bc3d2 lrc: 0/0,0 mode: --/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c5c expref: 875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.629394:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.629397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629398:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.629401:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 4/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.629418:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11861 00000100:00100000:1.0:1651529344.629420:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396361664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.629424:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629426:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629427:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.629430:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.629436:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086aa4dd9/0xa29a79078f3b9954 lrc: 0/0,0 mode: --/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce33d expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629440:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396361536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.629443:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11860 00010000:00010000:1.0:1651529344.629445:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629446:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629447:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629450:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 4/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629450:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629454:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629458:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.629459:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629462:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629466:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+872:41279:x1731746396361664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629468:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11861 00000100:00100000:1.0:1651529344.629476:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481088 00000100:00100000:1.0:1651529344.629486:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481216 00000100:00100000:1.0:1651529344.629491:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481280 00000100:00100000:1.0:1651529344.629496:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481344 00000100:00100000:1.0:1651529344.629502:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152900 00000100:00100000:1.0:1651529344.629503:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1193:39029:x1731745946481088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.629509:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177692 count 1 00010000:00010000:1.0:1651529344.629513:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629515:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1193:39030:x1731745946480384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1233us total) trans 30064893761 rc 0/0 00010000:00010000:1.0:1651529344.629517:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 2/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 871 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.629518:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152896 00010000:00010000:1.0:1651529344.629520:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629521:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629522:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 4/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629528:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 3/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 871 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.629532:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 871 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629536:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152901 00000100:00100000:0.0:1651529344.629537:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1192:39029:x1731745946481216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.629542:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177693 count 1 00000100:00100000:1.0:1651529344.629547:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629547:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629551:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 2/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629555:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629555:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.629556:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.629556:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 4/0,1 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629561:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629562:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 3/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.629565:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629568:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629570:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629579:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 4/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629583:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966660032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.629592:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.629598:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629601:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d94c312c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.629602:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629605:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 3/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629609:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 1/0,0 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629610:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1193:39029:x1731745946480576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1277us total) trans 30064893762 rc 0/0 00010000:00010000:0.0:1651529344.629612:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94c312c/0xa29a79078f3bf0fe lrc: 0/0,0 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629613:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152899 00010000:00010000:0.0:1651529344.629617:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629618:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152902 00010000:00010000:0.0:1651529344.629619:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdd9c2a7 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.629620:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1192:39030:x1731745946481280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.629624:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177694 count 1 00010000:00010000:0.0:1651529344.629627:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629628:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629630:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 3/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629632:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 2/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629634:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 1/0,0 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629636:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd9c2a7/0xa29a79078f3bf113 lrc: 0/0,0 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629645:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152903 00010000:00010000:1.0:1651529344.629646:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629646:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.629646:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1192:39029:x1731745946481344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.629647:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 4/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.629652:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177695 count 1 00010000:00010000:1.0:1651529344.629655:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 3/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629655:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629659:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.629659:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 2/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629662:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.629663:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966660096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629663:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629664:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 4/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629670:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.629670:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 3/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629683:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.629687:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966660160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.629695:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.629942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.629958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.629966:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481536 00000100:00100000:0.0:1651529344.629973:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481600 00000100:00100000:0.0:1651529344.629977:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152904 00000100:00100000:0.0:1651529344.629978:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1194:39030:x1731745946481536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.629983:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177696 count 1 00010000:00010000:0.0:1651529344.629988:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629993:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 2/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629996:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629996:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629997:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 4/0,1 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630003:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 3/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630045:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 4/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630051:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966660224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.630064:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.630069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630070:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152905 00000100:00100000:0.0:1651529344.630072:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1194:39029:x1731745946481600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.630077:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177697 count 1 00010000:00010000:0.0:1651529344.630081:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.630103:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 2/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 871 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630106:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630107:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630108:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 4/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630134:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481664 00010000:00010000:0.0:1651529344.630140:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 3/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 871 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630144:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 871 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630148:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481728 00000100:00100000:1.0:1651529344.630152:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152906 00000100:00100000:1.0:1651529344.630154:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1196:39030:x1731745946481664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.630159:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177698 count 1 00000100:00100000:0.0:1651529344.630163:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966660288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630164:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630169:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 2/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 871 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.630173:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.630179:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152907 00000100:00100000:0.0:1651529344.630181:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1196:39029:x1731745946481728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.630182:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630183:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630183:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 4/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.630187:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177699 count 1 00010000:00010000:1.0:1651529344.630191:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 3/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 871 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630191:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630194:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 4/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 871 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630195:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 2/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630198:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.630199:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630199:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630199:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 4/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630206:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 3/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 871 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.630208:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.630217:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966659968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630221:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630225:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630228:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966660096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.630230:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966660416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630231:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630238:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.630247:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966660160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.630260:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630274:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362240 00000100:00100000:1.0:1651529344.630279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.630280:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 872 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630291:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362368 00010000:00010000:0.0:1651529344.630293:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 873 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.630311:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362304 00010000:00010000:0.0:1651529344.630314:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 5/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630319:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11862 00000100:00100000:0.0:1651529344.630321:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396362240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.630323:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630325:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 874 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.630329:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 3/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 874 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630334:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e25712/0xa29a79078f3b7be1 lrc: 0/0,0 mode: --/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaa2 expref: 874 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.630351:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630352:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630353:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630355:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362432 00010000:00010000:0.0:1651529344.630356:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 4/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630360:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630365:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.630373:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362624 00000100:00100000:0.0:1651529344.630376:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396362240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.630379:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11862 00010000:00010000:1.0:1651529344.630380:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 5/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 875 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630384:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11863 00000100:00100000:0.0:1651529344.630386:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396362368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.630388:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11864 00000100:00100000:1.0:1651529344.630389:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41278:x1731746396362304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.630389:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630390:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.630392:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.630394:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 5/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630394:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 3/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.630398:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 4/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630399:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085b90b32/0xa29a79078f3bc0ad lrc: 0/0,0 mode: --/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fb3 expref: 874 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630402:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630404:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630404:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630405:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630408:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 4/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630409:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630410:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630413:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.630413:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 4/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630421:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.630426:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+873:41278:x1731746396362304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.630428:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+873:41279:x1731746396362368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.630430:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11864 00000100:00100000:0.0:1651529344.630431:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11863 00000100:00100000:1.0:1651529344.630435:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11865 00000100:00100000:1.0:1651529344.630437:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+871:41278:x1731746396362432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.630439:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.630441:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630441:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11866 00000100:00100000:0.0:1651529344.630442:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+871:41278:x1731746396362624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.630445:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 3/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630445:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630446:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 5/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.630449:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5428f98/0xa29a79078f3bb8e2 lrc: 0/0,0 mode: --/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61bb expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630450:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 4/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 871 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.630453:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630454:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630455:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630455:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630456:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630456:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630458:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 4/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630459:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 4/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630463:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.630467:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.630473:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41278:x1731746396362432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.630475:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11865 00000100:00100000:0.0:1651529344.630477:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41278:x1731746396362624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.630479:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11866 00010000:00010000:1.0:1651529344.630483:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630486:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630486:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630490:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630490:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630492:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630493:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630496:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630540:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1198:39029:x1731745946481088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1035us (1183us total) trans 30064893763 rc 0/0 00000100:00100000:0.0:1651529344.630542:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1198:39029:x1731745946481344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (1134us total) trans 30064893764 rc 0/0 00000100:00100000:1.0:1651529344.630543:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152900 00010000:00010000:1.0:1651529344.630550:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630553:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630556:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630559:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630578:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152903 00010000:00010000:0.0:1651529344.630597:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630601:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ee2d952 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.630602:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1197:39030:x1731745946481280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 982us (1201us total) trans 30064893765 rc 0/0 00010000:00010000:0.0:1651529344.630602:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630605:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 3/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630607:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152902 00010000:00010000:0.0:1651529344.630613:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 1/0,0 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630614:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630616:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf11a lrc: 0/0,0 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630618:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ce37d88 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.630619:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630620:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630622:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 3/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630623:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.630624:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630627:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 1/0,0 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630627:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 3/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630629:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce37d88/0xa29a79078f3bf12f lrc: 0/0,0 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630630:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 1/0,0 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630632:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf128 lrc: 0/0,0 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630643:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c8230f6/0xa29a79078f3b9e32 lrc: 0/0,0 mode: --/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf73a expref: 868 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630652:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966660224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630657:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630660:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630667:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630671:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630673:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.630699:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.630719:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1197:39030:x1731745946481536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 740us (778us total) trans 30064893766 rc 0/0 00000100:00100000:1.0:1651529344.630721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.630723:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152904 00000100:00100000:0.0:1651529344.630744:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966660416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630748:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630756:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966660288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630758:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630768:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362688 00010000:00010000:0.0:1651529344.630772:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 868 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630778:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362816 00010000:00010000:0.0:1651529344.630780:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 869 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630784:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362752 00010000:00010000:0.0:1651529344.630786:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 5/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 870 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630790:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11867 00000100:00100000:0.0:1651529344.630792:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41278:x1731746396362688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.630795:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630796:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 870 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630799:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 3/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 870 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630820:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630824:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630831:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630836:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e32eeb69 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.630837:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630840:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 3/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630840:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ddaa228/0xa29a79078f3b9a65 lrc: 0/0,0 mode: --/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce765 expref: 870 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630844:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630845:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 1/0,0 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630845:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630846:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630847:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32eeb69/0xa29a79078f3bf136 lrc: 0/0,0 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630849:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 4/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630855:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11868 00010000:00010000:0.0:1651529344.630856:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.630857:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+869:41278:x1731746396362816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.630860:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.630862:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 869 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630869:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+869:41278:x1731746396362688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 76us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.630872:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 3/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 869 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.630872:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11867 00010000:00010000:1.0:1651529344.630878:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64d313c/0xa29a79078f3bc42d lrc: 0/0,0 mode: --/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dc8 expref: 869 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.630884:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630885:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630886:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630888:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 4/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630889:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11869 00000100:00100000:0.0:1651529344.630891:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+867:41279:x1731746396362752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.630894:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.630898:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.630902:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 4/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 867 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630905:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+867:41278:x1731746396362816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.630907:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 3/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 867 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.630908:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11868 00010000:00010000:0.0:1651529344.630912:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8de1c3f/0xa29a79078f3b9373 lrc: 0/0,0 mode: --/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb81 expref: 866 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.630916:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630916:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630917:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630923:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 4/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630942:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.630949:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+865:41279:x1731746396362752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.630952:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11869 00000100:00100000:1.0:1651529344.630959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.630973:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630977:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630980:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630983:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.631015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.631022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.631029:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631033:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631036:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631039:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631069:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1198:39029:x1731745946481728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 886us (968us total) trans 30064893767 rc 0/0 00000100:00100000:0.0:1651529344.631072:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152907 00000100:00100000:0.0:1651529344.631078:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482240 00000100:00100000:0.0:1651529344.631086:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482368 00000100:00100000:0.0:1651529344.631090:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482304 00000100:00100000:0.0:1651529344.631095:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482432 00000100:00100000:0.0:1651529344.631098:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152908 00000100:00100000:1.0:1651529344.631100:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1201:39030:x1731745946481664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 944us (1031us total) trans 30064893768 rc 0/0 00000100:00100000:0.0:1651529344.631100:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1201:39030:x1731745946482240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.631103:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152906 00002000:00080000:0.0:1651529344.631105:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177700 count 1 00000100:00100000:1.0:1651529344.631109:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152909 00010000:00010000:0.0:1651529344.631110:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631111:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1200:39029:x1731745946482368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.631114:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 2/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.631116:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177702 count 1 00010000:00010000:0.0:1651529344.631117:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631118:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631119:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 4/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631120:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631124:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 2/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631125:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 3/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631128:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631128:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631129:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 4/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631129:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 4/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631133:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966660480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631136:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 3/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631139:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631142:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.631144:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631149:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152910 00000100:00100000:0.0:1651529344.631151:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1200:39029:x1731745946482304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.631152:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.631155:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177701 count 1 00010000:00010000:1.0:1651529344.631158:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631158:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631161:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e933c72d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.631162:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631165:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 3/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631165:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 2/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 864 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631168:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631168:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631169:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 1/0,0 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631169:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 4/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631172:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e933c72d/0xa29a79078f3bf14b lrc: 0/0,0 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631175:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 3/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 864 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631176:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631178:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 864 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631179:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.631180:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631182:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966660608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631183:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 3/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631186:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 1/0,0 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631189:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.631191:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf144 lrc: 0/0,0 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631194:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631197:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631198:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152911 00000100:00100000:1.0:1651529344.631200:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1200:39029:x1731745946482432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.631201:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631203:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.631204:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177703 count 1 00010000:00010000:1.0:1651529344.631207:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631218:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 2/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631222:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631222:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631223:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 4/0,1 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631230:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 3/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 864 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631233:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 4/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.631237:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966660672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631244:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1201:39029:x1731745946481600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1171us (1285us total) trans 30064893769 rc 0/0 00000100:00100000:1.0:1651529344.631245:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.631247:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152905 00010000:00010000:1.0:1651529344.631251:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631254:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cda455b0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.631255:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631258:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 3/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631259:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079326f2d/0xa29a79078f3baf6c lrc: 0/0,0 mode: --/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c53 expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631263:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 1/0,0 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631264:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966660032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631265:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda455b0/0xa29a79078f3bf13d lrc: 0/0,0 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631267:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631270:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631273:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631276:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631279:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631313:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1201:39029:x1731745946481216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1775us (1919us total) trans 30064893770 rc 0/0 00000100:00100000:0.0:1651529344.631316:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152901 00010000:00010000:0.0:1651529344.631323:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631326:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c101868 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.631327:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631330:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 3/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631335:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 1/0,0 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631337:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c101868/0xa29a79078f3bf121 lrc: 0/0,0 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.631511:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482624 00000100:00100000:1.0:1651529344.631518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.631519:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152912 00000100:00100000:0.0:1651529344.631520:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1201:39029:x1731745946482624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.631528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.631535:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177705 count 1 00000100:00100000:1.0:1651529344.631537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.631540:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631549:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 2/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 863 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631552:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631565:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631566:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 4/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631583:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 3/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 863 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631587:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 863 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631592:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966660736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631618:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.631625:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482560 00000100:00100000:0.0:1651529344.631634:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482752 00000100:00100000:0.0:1651529344.631639:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482688 00000100:00100000:0.0:1651529344.631643:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152913 00000100:00100000:0.0:1651529344.631644:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1204:39030:x1731745946482560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.631649:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177704 count 1 00010000:00010000:0.0:1651529344.631653:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631657:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 2/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631681:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631682:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631682:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 4/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631689:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 3/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631699:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 863 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.631700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.631708:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966660800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.631710:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.631721:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.631725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.631729:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966660608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.631741:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631749:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152914 00000100:00100000:0.0:1651529344.631751:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1204:39029:x1731745946482752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.631756:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177707 count 1 00010000:00010000:0.0:1651529344.631759:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631764:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 2/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631767:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631767:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631768:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 4/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.631774:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 3/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.631777:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152915 00000100:00100000:1.0:1651529344.631779:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1204:39030:x1731745946482688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.631785:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177706 count 1 00010000:00010000:1.0:1651529344.631789:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631801:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 863 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631812:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 2/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631820:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.631820:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966660864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631821:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631822:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 4/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631829:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.631830:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 3/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 863 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631833:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 863 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.631838:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966660928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631839:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966660480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.631842:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631846:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.631856:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631859:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631865:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363456 00000100:00100000:1.0:1651529344.631866:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363392 00010000:00010000:0.0:1651529344.631870:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 865 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631871:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 4/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 865 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.631876:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363520 00010000:00010000:1.0:1651529344.631879:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 866 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.631883:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363584 00010000:00010000:1.0:1651529344.631885:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 5/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 867 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631887:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11870 00000100:00100000:0.0:1651529344.631889:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+867:41278:x1731746396363392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.631890:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11871 00000100:00100000:1.0:1651529344.631892:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+867:41278:x1731746396363520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.631892:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631894:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.631894:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 4/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 867 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631896:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 867 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.631898:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 3/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 867 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631899:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 3/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 867 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.631903:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1afa8fe/0xa29a79078f3bb12c lrc: 0/0,0 mode: --/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d433e expref: 867 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631905:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a89e92/0xa29a79078f3b96c2 lrc: 0/0,0 mode: --/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8d9 expref: 867 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631908:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631909:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631909:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631910:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631910:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631911:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631913:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 4/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631914:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 4/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631921:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.631924:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.631931:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+865:41278:x1731746396363520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631934:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11871 00000100:00100000:0.0:1651529344.631935:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+865:41278:x1731746396363392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631939:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11872 00000100:00100000:1.0:1651529344.631940:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+864:41278:x1731746396363456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.631943:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631944:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631948:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 3/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 864 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631949:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11870 00010000:00010000:1.0:1651529344.631953:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016024feb/0xa29a79078f3baad4 lrc: 0/0,0 mode: --/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a6a expref: 863 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631954:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11873 00010000:00010000:1.0:1651529344.631956:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.631956:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41279:x1731746396363584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.631957:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631957:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631959:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631960:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 4/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631961:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 5/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 862 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.631965:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 4/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 862 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.631966:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.631970:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.631971:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41278:x1731746396363456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (271us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.631971:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631972:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631974:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11872 00010000:00010000:0.0:1651529344.631977:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 4/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631981:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.631988:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90d65fc/0xa29a79078f3b99d9 lrc: 0/0,0 mode: --/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce535 expref: 861 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.631988:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+861:41279:x1731746396363584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.631990:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11873 00000100:00100000:1.0:1651529344.631992:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966660672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631995:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631997:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631998:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632000:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632001:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632003:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632004:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632006:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632007:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632049:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1206:39029:x1731745946482304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 897us (1033us total) trans 30064893771 rc 0/0 00000100:00100000:0.0:1651529344.632052:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152910 00000100:00100000:1.0:1651529344.632059:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946482432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 858us (1037us total) trans 30064893772 rc 0/0 00010000:00010000:0.0:1651529344.632059:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632062:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152911 00010000:00010000:0.0:1651529344.632062:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632065:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632068:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632074:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632077:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039b7eb20 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.632078:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632083:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 3/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632088:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 1/0,0 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632091:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b7eb20/0xa29a79078f3bf160 lrc: 0/0,0 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632095:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632098:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008986c686 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.632099:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632099:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1205:39030:x1731745946482240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 998us (1141us total) trans 30064893773 rc 0/0 00010000:00010000:1.0:1651529344.632101:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 3/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632102:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152908 00010000:00010000:1.0:1651529344.632105:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 1/0,0 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632107:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf167 lrc: 0/0,0 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632109:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632112:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4be8f08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.632113:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632113:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632116:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632116:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 3/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632119:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632120:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 1/0,0 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632122:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632123:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4be8f08/0xa29a79078f3bf152 lrc: 0/0,0 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632127:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632130:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456f128f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.632131:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632134:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 3/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632137:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 1/0,0 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632140:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf159 lrc: 0/0,0 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632156:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946482368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1044us (1151us total) trans 30064893774 rc 0/0 00000100:00100000:1.0:1651529344.632159:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152909 00000100:00100000:0.0:1651529344.632181:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632221:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966660800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632225:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632240:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966660736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632243:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632249:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363648 00010000:00010000:0.0:1651529344.632254:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 860 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632267:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11874 00000100:00100000:0.0:1651529344.632269:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+860:41279:x1731746396363648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.632272:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.632273:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 860 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632277:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 3/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 860 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632282:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3b8da7 lrc: 0/0,0 mode: --/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3b6 expref: 860 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632300:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632301:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632302:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632314:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 4/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632321:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.632347:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41279:x1731746396363648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.632350:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11874 00000100:00100000:1.0:1651529344.632354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.632358:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632374:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632377:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632380:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632394:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.632404:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483264 00000100:00100000:1.0:1651529344.632411:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483328 00000100:00100000:1.0:1651529344.632418:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152916 00000100:00100000:1.0:1651529344.632419:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1207:39029:x1731745946483264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.632425:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177708 count 1 00010000:00010000:1.0:1651529344.632429:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632440:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 2/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 858 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632443:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632444:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632444:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 4/0,1 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632452:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 3/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 858 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632455:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 4/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 858 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632458:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1207:39029:x1731745946482624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (959us total) trans 30064893775 rc 0/0 00000100:00100000:1.0:1651529344.632460:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632462:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152912 00000100:00100000:0.0:1651529344.632467:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152917 00000100:00100000:1.0:1651529344.632469:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.632469:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1206:39029:x1731745946483328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.632474:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.632474:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177709 count 1 00010000:00010000:1.0:1651529344.632477:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d3b1de6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.632478:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632478:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632481:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 3/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632482:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 2/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 858 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632485:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632486:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 1/0,0 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632486:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632487:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 4/0,1 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632488:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1de6/0xa29a79078f3bf16e lrc: 0/0,0 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632496:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 3/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 858 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632500:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 4/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 858 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632504:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966661056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632512:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.632534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632585:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483456 00000100:00100000:0.0:1651529344.632595:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483392 00000100:00100000:1.0:1651529344.632604:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152918 00000100:00100000:1.0:1651529344.632606:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1208:39030:x1731745946483456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.632607:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152919 00000100:00100000:0.0:1651529344.632608:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1208:39029:x1731745946483392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.632612:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177711 count 1 00002000:00080000:0.0:1651529344.632614:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177710 count 1 00010000:00010000:1.0:1651529344.632616:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632618:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632621:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 2/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 858 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632622:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 2/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632624:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632625:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632625:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 4/0,1 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632626:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632626:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632627:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 4/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632632:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 3/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 858 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632635:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 4/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.632639:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.632650:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632662:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 3/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632667:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632671:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966661184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632680:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.632688:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966660864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632692:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632699:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363712 00010000:00010000:0.0:1651529344.632711:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632722:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11875 00000100:00100000:0.0:1651529344.632724:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396363712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.632727:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.632728:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632740:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 3/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632748:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9e49e6f/0xa29a79078f3ba5e8 lrc: 0/0,0 mode: --/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16f2 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.632751:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632752:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632753:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632756:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 4/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632763:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.632774:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41278:x1731746396363712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.632776:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11875 00010000:00010000:0.0:1651529344.632783:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632787:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632790:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632792:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632874:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946482560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1229us (1355us total) trans 30064893776 rc 0/0 00000100:00100000:0.0:1651529344.632878:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152913 00000100:00100000:0.0:1651529344.632883:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483584 00000100:00100000:0.0:1651529344.632891:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152920 00000100:00100000:0.0:1651529344.632893:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946483584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.632913:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177712 count 1 00010000:00010000:0.0:1651529344.632918:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632923:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 2/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632926:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632927:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632927:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 4/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632948:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 3/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 857 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632952:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 857 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.632956:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966661248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632971:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632977:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632980:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070fbb7c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.632981:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632984:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 3/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632989:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 1/0,0 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632992:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fbb7c6/0xa29a79078f3bf175 lrc: 0/0,0 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.633022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.633030:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966660928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633047:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633059:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364096 00010000:00010000:1.0:1651529344.633065:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633075:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364160 00010000:00010000:1.0:1651529344.633078:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.633085:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11876 00000100:00100000:1.0:1651529344.633087:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396364096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.633087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.633090:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633091:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633100:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 3/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.633106:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002532627f/0xa29a79078f3bb316 lrc: 0/0,0 mode: --/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b95 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633110:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.633110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.633111:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633112:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.633122:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966661184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633124:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 4/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633127:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633133:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.633141:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633144:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41278:x1731746396364096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.633147:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11876 00010000:00010000:0.0:1651529344.633148:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633151:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633152:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364416 00010000:00010000:0.0:1651529344.633154:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633155:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 5/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 858 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633159:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364544 00010000:00010000:1.0:1651529344.633168:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 5/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 859 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633173:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364672 00010000:00010000:1.0:1651529344.633175:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 860 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633179:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364608 00010000:00010000:1.0:1651529344.633181:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 5/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 861 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633185:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11877 00000100:00100000:1.0:1651529344.633186:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+861:41278:x1731746396364160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.633196:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633198:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 861 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633202:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 3/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 861 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633206:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d91024a/0xa29a79078f3bbda4 lrc: 0/0,0 mode: --/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7388 expref: 861 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633210:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633210:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633211:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633214:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 4/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633219:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1210:39029:x1731745946482752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1467us (1690us total) trans 30064893777 rc 0/0 00010000:00010000:1.0:1651529344.633221:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.633222:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152914 00000100:00100000:1.0:1651529344.633227:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+860:41278:x1731746396364160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.633227:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483648 00000100:00100000:1.0:1651529344.633229:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11877 00000100:00100000:0.0:1651529344.633237:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152921 00000100:00100000:0.0:1651529344.633238:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1210:39030:x1731745946483648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.633240:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11878 00000100:00100000:1.0:1651529344.633242:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396364416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00002000:00080000:0.0:1651529344.633243:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177713 count 1 00010000:00010000:1.0:1651529344.633245:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633246:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 5/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 859 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633247:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633250:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 4/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 859 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633252:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 2/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 859 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633255:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633255:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633255:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633256:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633256:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633256:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 4/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633259:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 4/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633263:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.633264:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 3/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 859 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633267:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 859 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633268:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396364416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.633270:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11878 00000100:00100000:0.0:1651529344.633271:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966661312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633278:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11879 00000100:00100000:0.0:1651529344.633279:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.633280:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41279:x1731746396364544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.633282:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633284:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 5/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 858 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633287:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 4/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 858 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633287:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11880 00000100:00100000:0.0:1651529344.633289:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41279:x1731746396364672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.633291:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633292:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633292:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633292:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.633293:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633297:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 3/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.633298:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 4/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633301:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.633303:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073350bd1/0xa29a79078f3bbd81 lrc: 0/0,0 mode: --/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7326 expref: 858 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633306:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41279:x1731746396364544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.633307:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633307:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.633308:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11879 00010000:00010000:0.0:1651529344.633308:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633311:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11881 00010000:00010000:0.0:1651529344.633311:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 4/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633313:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+856:41278:x1731746396364608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.633315:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633316:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 5/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 856 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633317:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.633320:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 4/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 856 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633323:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+856:41279:x1731746396364672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.633324:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633324:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633325:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633325:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11880 00010000:00010000:1.0:1651529344.633328:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 4/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633332:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.633332:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633336:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+855:41278:x1731746396364608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.633336:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633339:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633341:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633347:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11881 00010000:00010000:1.0:1651529344.633364:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008145273/0xa29a79078f3b944c lrc: 0/0,0 mode: --/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccede expref: 854 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.633368:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966660992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633371:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633375:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633377:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633380:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633383:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633397:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1211:39029:x1731745946483392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 781us (818us total) trans 30064893778 rc 0/0 00000100:00100000:0.0:1651529344.633401:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152919 00010000:00010000:0.0:1651529344.633408:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633411:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a97d5a3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.633412:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633415:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 3/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633420:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 1/0,0 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633423:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf17c lrc: 0/0,0 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633427:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633429:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1211:39029:x1731745946483264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1008us (1075us total) trans 30064893779 rc 0/0 00010000:00010000:0.0:1651529344.633430:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d4c772d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.633431:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633432:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152916 00010000:00010000:0.0:1651529344.633433:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 3/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633436:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 1/0,0 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633439:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf19f lrc: 0/0,0 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633444:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ec32507/0xa29a79078f3baa6b lrc: 0/0,0 mode: --/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2809 expref: 853 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633445:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633447:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000553813a7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.633448:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633450:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.633451:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 3/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633454:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633454:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 1/0,0 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633456:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf18a lrc: 0/0,0 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633457:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633460:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633463:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633465:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633466:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3b97ef lrc: 0/0,0 mode: --/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde04 expref: 852 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633469:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966661056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.633479:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633483:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633488:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633491:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633493:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633503:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1211:39030:x1731745946483456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 896us (968us total) trans 30064893780 rc 0/0 00000100:00100000:1.0:1651529344.633506:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152918 00010000:00010000:1.0:1651529344.633513:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633516:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d587a03 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.633517:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633528:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1211:39029:x1731745946483328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1059us (1135us total) trans 30064893781 rc 0/0 00010000:00010000:1.0:1651529344.633530:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 3/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633531:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152917 00010000:00010000:1.0:1651529344.633535:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 1/0,0 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633538:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf198 lrc: 0/0,0 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633539:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633542:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006dcbcfa2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.633543:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633546:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633546:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 3/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633549:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633550:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 1/0,0 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633552:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633553:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf191 lrc: 0/0,0 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633555:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633581:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.633591:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1211:39030:x1731745946482688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1811us (2053us total) trans 30064893782 rc 0/0 00000100:00100000:1.0:1651529344.633594:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152915 00010000:00010000:1.0:1651529344.633600:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633606:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008658fa4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.633607:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633610:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 3/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633621:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 1/0,0 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633625:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf183 lrc: 0/0,0 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633652:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966661248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.633656:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633663:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364736 00010000:00010000:0.0:1651529344.633667:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 852 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633695:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11882 00000100:00100000:0.0:1651529344.633697:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41279:x1731746396364736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.633711:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.633713:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 852 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633717:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 3/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 852 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633722:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002809f630/0xa29a79078f3b9d28 lrc: 0/0,0 mode: --/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2e8 expref: 852 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.633726:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633726:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633727:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633741:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 4/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633749:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.633757:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41279:x1731746396364736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.633760:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11882 00010000:00010000:0.0:1651529344.633767:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633770:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633773:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633776:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 2/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633796:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633817:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc9fb9dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.633818:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633825:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 3/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633831:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 1/0,0 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633836:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf1a6 lrc: 0/0,0 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633872:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1211:39030:x1731745946483584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 977us (1174us total) trans 30064893783 rc 0/0 00000100:00100000:1.0:1651529344.633875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633875:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152920 00000100:00100000:0.0:1651529344.633882:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484160 00000100:00100000:0.0:1651529344.633892:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152922 00000100:00100000:0.0:1651529344.633894:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1211:39029:x1731745946484160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.633899:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177714 count 1 00010000:00010000:0.0:1651529344.633904:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633908:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 2/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633919:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633919:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633920:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 4/0,1 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633927:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 3/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633931:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 4/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 850 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.633935:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966661376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633950:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.633958:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966661312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.633962:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633968:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484224 00000100:00100000:0.0:1651529344.633980:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152923 00000100:00100000:1.0:1651529344.633981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633982:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1212:39030:x1731745946484224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.633986:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177715 count 1 00000100:00100000:1.0:1651529344.633989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.633990:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.634000:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 2/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.634008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.634008:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634009:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634009:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 4/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634017:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484352 00010000:00010000:0.0:1651529344.634020:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.634026:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484288 00000100:00100000:1.0:1651529344.634029:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484416 00010000:00010000:0.0:1651529344.634029:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 4/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 850 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.634031:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484480 00000100:00100000:0.0:1651529344.634033:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966661440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634034:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152924 00000100:00100000:1.0:1651529344.634036:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1216:39030:x1731745946484352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.634041:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177717 count 1 00000100:00100000:0.0:1651529344.634046:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.634051:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634056:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 2/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.634060:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634060:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634061:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 4/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634067:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152925 00000100:00100000:0.0:1651529344.634069:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1216:39029:x1731745946484288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.634070:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 3/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 850 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.634074:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 850 pid: 161133 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.634074:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177716 count 1 00010000:00010000:0.0:1651529344.634078:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634079:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966661504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634088:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.634094:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152926 00010000:00010000:0.0:1651529344.634094:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 2/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.634096:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac1125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1216:39029:x1731745946484416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.634100:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177718 count 1 00010000:00010000:0.0:1651529344.634100:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634101:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634102:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 4/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634104:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634108:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 2/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 850 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634108:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 3/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.634111:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634111:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634112:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 4/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634112:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 850 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634116:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966661568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.634118:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 3/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 850 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.634122:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 4/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 850 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634123:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.634126:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.634130:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152927 00000100:00100000:0.0:1651529344.634132:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1216:39030:x1731745946484480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.634133:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.634137:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177719 count 1 00010000:00010000:0.0:1651529344.634140:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634144:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 2/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634147:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634148:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634148:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 4/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634164:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 3/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634168:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 850 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634172:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966661696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.634180:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.634186:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484544 00000100:00100000:0.0:1651529344.634197:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152928 00000100:00100000:0.0:1651529344.634199:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1217:39030:x1731745946484544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.634203:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177720 count 1 00010000:00010000:0.0:1651529344.634207:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634211:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 2/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634214:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634215:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634215:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 4/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634221:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 3/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 850 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634236:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 850 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634240:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966661760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.634252:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.634276:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364864 00010000:00010000:0.0:1651529344.634282:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 851 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634293:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11883 00000100:00100000:0.0:1651529344.634295:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41279:x1731746396364864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.634298:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634300:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634303:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 3/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634326:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d783cfaa/0xa29a79078f3bb642 lrc: 0/0,0 mode: --/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5757 expref: 851 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634330:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634330:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634331:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.634347:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365312 00010000:00010000:1.0:1651529344.634351:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 5/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634361:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 4/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634364:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11884 00000100:00100000:1.0:1651529344.634366:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41278:x1731746396365312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.634368:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.634369:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634371:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 5/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634374:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 4/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634376:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41279:x1731746396364864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.634379:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11883 00010000:00010000:1.0:1651529344.634380:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634381:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634382:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634385:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 4/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634386:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634392:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.634399:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+850:41278:x1731746396365312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.634402:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11884 00010000:00010000:0.0:1651529344.634413:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634417:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634420:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634466:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1218:39030:x1731745946483648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1227us (1394us total) trans 30064893784 rc 0/0 00000100:00100000:0.0:1651529344.634470:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152921 00010000:00010000:0.0:1651529344.634484:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634488:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072ce6845 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.634496:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634500:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 3/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634504:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 1/0,0 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634507:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf1ad lrc: 0/0,0 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634508:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966661504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.634513:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634518:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966661568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634520:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634522:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634523:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634530:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000857410b/0xa29a79078f3b986d lrc: 0/0,0 mode: --/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfb6 expref: 849 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634533:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966661376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634536:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634539:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634542:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634551:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634554:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634565:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634568:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000972da1e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.634569:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634572:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 3/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634577:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 1/0,0 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634582:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf1b4 lrc: 0/0,0 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634598:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1218:39029:x1731745946484160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 703us (722us total) trans 30064893785 rc 0/0 00000100:00100000:0.0:1651529344.634601:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152922 00000100:00100000:0.0:1651529344.634635:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966661440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634637:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.634639:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634660:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.634680:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966661696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634684:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.634691:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966661760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634699:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634699:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.634710:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365376 00000100:00100000:1.0:1651529344.634712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634715:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 4/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 849 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.634718:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365504 00010000:00010000:1.0:1651529344.634723:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 850 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634723:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365440 00010000:00010000:0.0:1651529344.634726:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.634729:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365632 00000100:00100000:0.0:1651529344.634738:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365568 00010000:00010000:1.0:1651529344.634740:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 4/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 853 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634742:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 853 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.634745:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365696 00000100:00100000:0.0:1651529344.634747:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11885 00010000:00010000:1.0:1651529344.634748:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 854 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634749:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+854:41278:x1731746396365376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.634752:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11886 00000100:00100000:1.0:1651529344.634754:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+854:41278:x1731746396365504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.634757:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634758:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 854 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634762:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 3/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 854 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634768:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004222ed4c/0xa29a79078f3ba11f lrc: 0/0,0 mode: --/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d027e expref: 854 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634771:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634772:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634773:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634779:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634780:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 4/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 853 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634785:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 853 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634790:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 4/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634791:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057e1cae8/0xa29a79078f3b9763 lrc: 0/0,0 mode: --/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb9c expref: 853 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634794:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634795:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634796:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634799:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.634821:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 4/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634823:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41278:x1731746396365504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.634826:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11886 00010000:00010000:0.0:1651529344.634828:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.634831:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11887 00000100:00100000:1.0:1651529344.634832:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41279:x1731746396365440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.634835:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.634836:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41278:x1731746396365376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 87us (176us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.634837:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634839:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11885 00010000:00010000:1.0:1651529344.634841:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 3/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 851 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634846:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ecb0a70/0xa29a79078f3b98eb lrc: 0/0,0 mode: --/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1ae expref: 850 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634849:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11888 00010000:00010000:1.0:1651529344.634850:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634850:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634851:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634851:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+849:41278:x1731746396365632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.634854:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 4/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634854:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634856:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 4/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 849 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634859:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 3/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 849 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634860:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.634865:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a44c328/0xa29a79078f3bc418 lrc: 0/0,0 mode: --/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d58 expref: 849 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.634866:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+849:41279:x1731746396365440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.634868:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11887 00010000:00010000:0.0:1651529344.634868:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634869:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634870:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634872:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11889 00010000:00010000:0.0:1651529344.634872:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 4/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634874:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+847:41279:x1731746396365568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.634877:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634878:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 847 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634882:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.634888:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+847:41278:x1731746396365632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.634889:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 3/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 847 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634891:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11888 00010000:00010000:1.0:1651529344.634894:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7ba371/0xa29a79078f3bb04c lrc: 0/0,0 mode: --/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fd3 expref: 846 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.634896:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11890 00000100:00100000:0.0:1651529344.634897:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+846:41279:x1731746396365696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.634900:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634900:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634901:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634901:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634902:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634904:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 4/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634905:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 3/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.634909:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af031a75/0xa29a79078f3bc29e lrc: 0/0,0 mode: --/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87e0 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.634913:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.634919:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+845:41279:x1731746396365568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.634920:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634920:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634921:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634922:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11889 00010000:00010000:0.0:1651529344.634924:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 4/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634929:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634929:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.634933:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634935:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+843:41279:x1731746396365696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.634936:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634938:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634938:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11890 00010000:00010000:0.0:1651529344.634945:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634948:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634951:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634954:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634980:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946484352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 943us (1004us total) trans 30064893786 rc 0/0 00000100:00100000:1.0:1651529344.634983:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152924 00000100:00100000:1.0:1651529344.634988:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484736 00000100:00100000:0.0:1651529344.634993:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946484480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 860us (984us total) trans 30064893787 rc 0/0 00000100:00100000:1.0:1651529344.634998:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152929 00000100:00100000:1.0:1651529344.635000:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946484736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.635004:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152927 00002000:00080000:1.0:1651529344.635005:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177721 count 1 00010000:00010000:1.0:1651529344.635009:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635012:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635014:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 2/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635015:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f04051da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.635016:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635017:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635017:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635018:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 4/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635019:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 3/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635023:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 1/0,0 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635024:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 3/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635026:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04051da/0xa29a79078f3bf1c2 lrc: 0/0,0 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635028:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.635032:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966661824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635039:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635041:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.635042:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068c3a11c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.635043:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635045:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 3/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635046:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635049:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635049:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 1/0,0 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635051:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf1d7 lrc: 0/0,0 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635054:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635057:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635057:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635060:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635063:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635065:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635093:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac1125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1220:39029:x1731745946484416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 996us (1093us total) trans 30064893788 rc 0/0 00000100:00100000:1.0:1651529344.635096:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152926 00010000:00010000:1.0:1651529344.635103:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635106:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc379d70 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.635107:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635108:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1219:39029:x1731745946484288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1038us (1118us total) trans 30064893789 rc 0/0 00010000:00010000:1.0:1651529344.635110:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 3/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635111:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152925 00010000:00010000:1.0:1651529344.635115:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 1/0,0 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635118:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc379d70/0xa29a79078f3bf1d0 lrc: 0/0,0 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635118:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635122:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cb06c19 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.635123:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635125:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 3/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635130:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 1/0,0 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.635133:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf1c9 lrc: 0/0,0 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635147:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635150:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635153:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635163:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635202:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946484544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1002us (1028us total) trans 30064893790 rc 0/0 00000100:00100000:0.0:1651529344.635205:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152928 00000100:00100000:0.0:1651529344.635210:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484800 00000100:00100000:0.0:1651529344.635219:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152930 00000100:00100000:0.0:1651529344.635221:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946484800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.635226:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177722 count 1 00010000:00010000:0.0:1651529344.635246:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635252:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 2/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635255:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635255:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635256:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 4/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635259:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635263:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 3/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635264:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b744bd8d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.635265:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635267:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.635268:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 3/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635273:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 1/0,0 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635275:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf1de lrc: 0/0,0 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635282:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966661888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.635323:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.635332:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635335:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635338:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635341:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 2/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635351:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635355:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000426608f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.635356:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 3/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635359:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 4/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635368:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 1/0,0 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635373:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf1bb lrc: 0/0,0 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.635414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635435:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1220:39030:x1731745946484224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1452us (1497us total) trans 30064893791 rc 0/0 00000100:00100000:1.0:1651529344.635442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635446:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152923 00000100:00100000:1.0:1651529344.635456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.635467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.635476:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485312 00000100:00100000:0.0:1651529344.635476:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485248 00000100:00100000:0.0:1651529344.635486:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485440 00000100:00100000:0.0:1651529344.635489:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485376 00000100:00100000:0.0:1651529344.635491:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485504 00000100:00100000:1.0:1651529344.635494:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152931 00000100:00100000:1.0:1651529344.635496:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1224:39030:x1731745946485248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.635496:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152932 00000100:00100000:0.0:1651529344.635497:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1224:39029:x1731745946485312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.635501:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177723 count 1 00002000:00080000:0.0:1651529344.635502:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177724 count 1 00010000:00010000:1.0:1651529344.635505:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635507:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635510:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 2/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635512:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 2/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635513:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635514:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635514:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 4/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635515:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635516:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635517:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 4/0,1 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635521:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 3/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635523:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 3/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635525:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635527:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 4/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.635529:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635540:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.635547:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966661824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.635556:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966662016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.635567:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635567:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.635574:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152933 00000100:00100000:1.0:1651529344.635576:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152934 00000100:00100000:0.0:1651529344.635576:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1224:39029:x1731745946485440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.635578:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1224:39029:x1731745946485376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.635581:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177726 count 1 00002000:00080000:1.0:1651529344.635583:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177725 count 1 00010000:00010000:0.0:1651529344.635584:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635586:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635589:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 2/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 842 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635590:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 2/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635592:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635593:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635593:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635593:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 4/0,1 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635594:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635595:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 4/0,1 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635600:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 3/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 842 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635601:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 3/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635603:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 4/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 842 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.635604:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 4/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.635607:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966662080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635611:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.635614:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.635619:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.635620:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152935 00000100:00100000:0.0:1651529344.635622:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1224:39030:x1731745946485504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.635626:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177727 count 1 00010000:00010000:0.0:1651529344.635629:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635633:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.635633:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 2/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635636:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635637:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635637:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 4/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635643:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 3/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635649:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.635671:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635679:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485632 00000100:00100000:0.0:1651529344.635680:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.635685:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152936 00000100:00100000:1.0:1651529344.635687:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1225:39030:x1731745946485632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.635692:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177728 count 1 00010000:00010000:1.0:1651529344.635696:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635700:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 2/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635703:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635704:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635705:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 4/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635711:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 3/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 842 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635714:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.635725:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966662272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635743:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.635747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.635762:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966661888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635767:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635774:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365952 00010000:00010000:0.0:1651529344.635779:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.635786:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11891 00000100:00100000:0.0:1651529344.635788:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+843:41278:x1731746396365952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.635791:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.635792:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635796:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 3/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635801:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f191e1db/0xa29a79078f3bba1d lrc: 0/0,0 mode: --/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6668 expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635821:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635822:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635823:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635826:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 4/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635833:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.635836:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635840:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635844:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41278:x1731746396365952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.635847:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11891 00010000:00010000:1.0:1651529344.635848:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635851:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.635900:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1226:39030:x1731745946484736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (1257us total) trans 30064893792 rc 0/0 00000100:00100000:1.0:1651529344.635904:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152929 00010000:00010000:0.0:1651529344.635909:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635913:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000abf3474b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.635914:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635917:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 3/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635921:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 1/0,0 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635924:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3474b/0xa29a79078f3bf1e5 lrc: 0/0,0 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635941:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366080 00010000:00010000:0.0:1651529344.635945:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.635955:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11892 00000100:00100000:0.0:1651529344.635957:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41278:x1731746396366080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.635961:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.635962:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635966:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 3/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635971:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac33c7f/0xa29a79078f3b9564 lrc: 0/0,0 mode: --/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd322 expref: 842 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.635974:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635975:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635975:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635978:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 4/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635985:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.635993:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+841:41278:x1731746396366080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.636003:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11892 00010000:00010000:0.0:1651529344.636034:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.636050:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636054:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636064:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.636130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.636137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.636143:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1226:39030:x1731745946484800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (1009us total) trans 30064893793 rc 0/0 00000100:00100000:1.0:1651529344.636144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.636146:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152930 00000100:00100000:0.0:1651529344.636152:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485824 00000100:00100000:0.0:1651529344.636159:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152937 00000100:00100000:0.0:1651529344.636160:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1226:39030:x1731745946485824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.636165:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177729 count 1 00010000:00010000:0.0:1651529344.636170:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.636182:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 2/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 840 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.636187:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636191:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6741c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636192:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636195:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636197:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 3/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636202:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 1/0,0 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636205:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf1ec lrc: 0/0,0 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636212:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636213:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 4/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636222:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 3/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 840 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.636223:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966661952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.636226:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636227:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636230:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966662336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.636235:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636238:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636239:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.636244:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366464 00000100:00100000:0.0:1651529344.636247:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966662080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636248:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 841 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636251:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636254:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366592 00010000:00010000:1.0:1651529344.636256:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 4/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 842 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.636258:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.636261:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636263:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366528 00010000:00010000:1.0:1651529344.636265:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 5/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.636268:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366656 00000100:00100000:1.0:1651529344.636269:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366720 00010000:00010000:1.0:1651529344.636271:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636273:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 4/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.636275:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11893 00000100:00100000:1.0:1651529344.636277:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+845:41279:x1731746396366464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.636279:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636281:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636284:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 3/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636289:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db00737b/0xa29a79078f3bbde3 lrc: 0/0,0 mode: --/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7476 expref: 845 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.636290:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11894 00000100:00100000:0.0:1651529344.636292:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+845:41279:x1731746396366592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.636293:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636293:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636294:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636297:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 4/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636304:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636311:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+844:41279:x1731746396366464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.636312:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.636314:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11893 00010000:00010000:0.0:1651529344.636314:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 4/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 844 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636318:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 3/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 843 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.636319:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11895 00000100:00100000:1.0:1651529344.636320:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+843:41279:x1731746396366528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.636323:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636324:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 5/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 843 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636324:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1e3b3aa/0xa29a79078f3b7e57 lrc: 0/0,0 mode: --/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbe4 expref: 843 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636328:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 4/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 842 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636328:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636328:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636329:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636332:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 4/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636333:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636333:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636334:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636337:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 4/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636339:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.636341:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636347:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41279:x1731746396366528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.636347:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41279:x1731746396366592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.636349:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11895 00000100:00100000:0.0:1651529344.636351:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11894 00000100:00100000:1.0:1651529344.636353:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11896 00000100:00100000:1.0:1651529344.636354:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+840:41279:x1731746396366720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.636356:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.636356:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11897 00010000:00010000:1.0:1651529344.636358:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.636358:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+840:41279:x1731746396366656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.636361:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 3/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636361:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.636362:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 4/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636365:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006889a470/0xa29a79078f3bac40 lrc: 0/0,0 mode: --/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fbf expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636366:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 3/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 840 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636368:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636369:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636370:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636371:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d04357/0xa29a79078f3ba56a lrc: 0/0,0 mode: --/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d147c expref: 839 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636372:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 4/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636375:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636375:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636376:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636379:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 4/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636382:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636388:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+838:41279:x1731746396366720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.636390:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11896 00010000:00010000:0.0:1651529344.636395:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.636402:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+837:41279:x1731746396366656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (257us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.636403:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636404:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11897 00010000:00010000:1.0:1651529344.636406:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636411:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636412:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636414:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636415:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636420:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636423:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636455:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1228:39029:x1731745946485376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 877us (999us total) trans 30064893794 rc 0/0 00000100:00100000:1.0:1651529344.636458:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152934 00000100:00100000:0.0:1651529344.636463:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946485440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 886us (1020us total) trans 30064893795 rc 0/0 00010000:00010000:1.0:1651529344.636466:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636466:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152933 00010000:00010000:1.0:1651529344.636469:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001089898c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636470:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636473:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 3/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636473:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636476:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000442d2c3b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636477:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 1/0,0 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636477:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636480:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001089898c/0xa29a79078f3bf208 lrc: 0/0,0 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636480:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 3/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636484:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 1/0,0 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636486:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636487:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf201 lrc: 0/0,0 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636489:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636492:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636493:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636494:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636496:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636499:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636501:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636538:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1228:39030:x1731745946485248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1123us total) trans 30064893796 rc 0/0 00000100:00100000:1.0:1651529344.636541:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152931 00000100:00100000:0.0:1651529344.636541:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1228:39030:x1731745946485504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 918us (1073us total) trans 30064893797 rc 0/0 00000100:00100000:0.0:1651529344.636544:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152935 00010000:00010000:1.0:1651529344.636547:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636551:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7862504 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636552:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636554:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 3/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636555:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b88f56db/0xa29a79078f3bacf6 lrc: 0/0,0 mode: --/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32cf expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636559:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 1/0,0 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636559:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966662016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636561:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7862504/0xa29a79078f3bf1f3 lrc: 0/0,0 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636562:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636565:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636565:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636568:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085e6ff56 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.636568:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636569:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636572:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 3/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636573:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636575:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 1/0,0 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636576:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636578:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf20f lrc: 0/0,0 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636581:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636584:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8f9e680 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636585:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636587:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 3/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636593:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 1/0,0 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636596:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf1fa lrc: 0/0,0 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636610:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946485312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1208us total) trans 30064893798 rc 0/0 00000100:00100000:0.0:1651529344.636613:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152932 00000100:00100000:1.0:1651529344.636625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.636645:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966662272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.636653:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.636663:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636670:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366848 00010000:00010000:1.0:1651529344.636675:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.636682:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485888 00000100:00100000:0.0:1651529344.636692:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152938 00000100:00100000:0.0:1651529344.636694:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946485888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.636699:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177730 count 1 00010000:00010000:0.0:1651529344.636703:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636711:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11898 00000100:00100000:1.0:1651529344.636713:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+836:41279:x1731746396366848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.636715:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 2/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 836 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.636717:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636718:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.636718:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636719:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636719:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 4/0,1 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636722:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 3/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636728:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bd388d/0xa29a79078f3baed2 lrc: 0/0,0 mode: --/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39e4 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.636739:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636740:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636740:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 3/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 835 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.636741:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636744:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 4/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636751:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636758:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41279:x1731746396366848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (105us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.636758:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 4/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.636761:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11898 00000100:00100000:0.0:1651529344.636763:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966662400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636768:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636771:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636773:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.636774:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636777:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636843:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1228:39030:x1731745946485632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1155us (1210us total) trans 30064893799 rc 0/0 00000100:00100000:1.0:1651529344.636846:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152936 00010000:00010000:1.0:1651529344.636853:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636857:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c32319d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.636858:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636861:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 3/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636873:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 1/0,0 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636877:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c32319d/0xa29a79078f3bf216 lrc: 0/0,0 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.636979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.636986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.636995:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486208 00000100:00100000:1.0:1651529344.636996:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486144 00000100:00100000:1.0:1651529344.637003:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486272 00000100:00100000:0.0:1651529344.637005:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152939 00000100:00100000:0.0:1651529344.637007:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1230:39030:x1731745946486144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.637009:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152940 00000100:00100000:1.0:1651529344.637011:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1230:39029:x1731745946486208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.637013:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177731 count 1 00002000:00080000:1.0:1651529344.637017:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177732 count 1 00010000:00010000:0.0:1651529344.637017:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637021:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637022:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 2/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637025:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 2/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637029:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637029:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637030:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 4/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637037:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 3/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637039:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637040:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 4/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637040:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637041:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 4/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637045:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966662464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637049:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 3/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.637056:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.637062:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152941 00000100:00100000:1.0:1651529344.637063:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1230:39030:x1731745946486272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.637065:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.637068:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177733 count 1 00010000:00010000:1.0:1651529344.637071:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637075:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 2/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637078:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637079:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637079:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 4/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637081:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637088:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 3/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.637090:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.637091:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 4/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637095:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966662592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637101:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.637126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637153:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486592 00000100:00100000:1.0:1651529344.637157:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486656 00000100:00100000:0.0:1651529344.637160:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486720 00000100:00100000:1.0:1651529344.637169:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152942 00000100:00100000:1.0:1651529344.637171:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1233:39029:x1731745946486592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.637175:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152943 00002000:00080000:1.0:1651529344.637176:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177734 count 1 00000100:00100000:0.0:1651529344.637177:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1233:39030:x1731745946486656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.637180:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.637182:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177735 count 1 00010000:00010000:1.0:1651529344.637184:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 2/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637187:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637187:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637188:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637188:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 4/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637191:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 2/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637194:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637195:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 3/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637195:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637196:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 4/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637201:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637202:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 3/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.637205:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637206:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.637213:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966662720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637215:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.637221:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152944 00000100:00100000:0.0:1651529344.637221:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.637223:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1233:39029:x1731745946486720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.637227:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177736 count 1 00010000:00010000:1.0:1651529344.637230:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637234:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 2/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637237:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637237:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637238:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 4/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637244:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 3/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 834 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637247:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637254:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966662784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637261:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.637338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.637345:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.637355:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367104 00000100:00100000:0.0:1651529344.637357:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966662336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637361:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637361:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637369:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367232 00000100:00100000:0.0:1651529344.637371:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11899 00010000:00010000:1.0:1651529344.637372:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 5/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.637373:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+836:41279:x1731746396367104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.637377:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11900 00010000:00010000:0.0:1651529344.637377:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.637378:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637379:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+836:41279:x1731746396367232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.637382:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.637382:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 3/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637384:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 5/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637387:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 4/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637388:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b0580c/0xa29a79078f3bbf41 lrc: 0/0,0 mode: --/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79f5 expref: 836 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637392:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637392:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637393:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637393:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637393:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637394:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637397:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 4/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637398:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 4/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637402:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.637405:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.637411:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41279:x1731746396367232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.637412:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41279:x1731746396367104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.637414:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11900 00000100:00100000:0.0:1651529344.637416:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11899 00010000:00010000:0.0:1651529344.637427:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637431:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637434:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637436:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637459:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637463:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b1015fe2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.637464:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637467:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 3/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637472:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 1/0,0 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637475:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf21d lrc: 0/0,0 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637481:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946485824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1441us total) trans 30064893800 rc 0/0 00000100:00100000:0.0:1651529344.637484:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152937 00010000:00010000:0.0:1651529344.637513:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafa06d2/0xa29a79078f3ba968 lrc: 0/0,0 mode: --/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24c1 expref: 833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.637517:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966662400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637521:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637524:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637527:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637530:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637533:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637589:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1234:39029:x1731745946485888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (963us total) trans 30064893801 rc 0/0 00000100:00100000:0.0:1651529344.637592:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152938 00010000:00010000:0.0:1651529344.637620:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637631:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3658389 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.637633:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637636:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 3/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637643:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 1/0,0 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637646:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf224 lrc: 0/0,0 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.637676:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.637680:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.637688:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367424 00010000:00010000:0.0:1651529344.637692:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 5/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 833 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.637709:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367360 00010000:00010000:0.0:1651529344.637712:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637713:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966662464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.637716:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367488 00010000:00010000:1.0:1651529344.637718:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637718:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 5/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.637723:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11901 00000100:00100000:0.0:1651529344.637724:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41278:x1731746396367424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.637727:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.637728:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966662592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637729:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 4/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637739:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637740:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 3/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637746:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6dda281/0xa29a79078f3b9caa lrc: 0/0,0 mode: --/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf136 expref: 835 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637747:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11902 00000100:00100000:1.0:1651529344.637749:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+834:41279:x1731746396367360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.637749:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637750:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637751:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637752:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.637754:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637757:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 3/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637763:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d2d7bb2/0xa29a79078f3b9df3 lrc: 0/0,0 mode: --/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5f8 expref: 834 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637767:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637770:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 4/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637773:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637774:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637779:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.637781:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 4/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637791:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.637818:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+833:41278:x1731746396367424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.637821:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+833:41279:x1731746396367360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.637840:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11901 00000100:00100000:1.0:1651529344.637849:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11902 00000100:00100000:0.0:1651529344.637851:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11903 00000100:00100000:0.0:1651529344.637852:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+831:41279:x1731746396367488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.637856:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.637857:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 4/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.637861:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966662784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637862:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 3/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.637865:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637867:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093370ca7/0xa29a79078f3ba126 lrc: 0/0,0 mode: --/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d028c expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.637871:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637871:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637872:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637875:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637875:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 4/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637877:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637884:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.637889:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637891:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+830:41279:x1731746396367488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.637893:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637894:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11903 00010000:00010000:1.0:1651529344.637896:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637899:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637901:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637904:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637907:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637910:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637948:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1235:39029:x1731745946486208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 935us (976us total) trans 30064893802 rc 0/0 00000100:00100000:1.0:1651529344.637951:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152940 00000100:00100000:0.0:1651529344.637955:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946486144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (975us total) trans 30064893803 rc 0/0 00010000:00010000:1.0:1651529344.637958:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637958:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152939 00000100:00100000:0.0:1651529344.637969:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966662720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637970:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008658fa4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.637972:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637973:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637975:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 3/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637979:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 1/0,0 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637982:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008658fa4e/0xa29a79078f3bf232 lrc: 0/0,0 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637986:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637989:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095fe8399 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.637990:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637993:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 3/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638003:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 1/0,0 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638014:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf22b lrc: 0/0,0 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638014:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.638022:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638024:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638028:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638036:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 2/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.638078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.638087:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 2/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638091:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d587a03 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.638092:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 2/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638095:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 3/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638103:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946486272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1038us (1116us total) trans 30064893804 rc 0/0 00010000:00010000:0.0:1651529344.638105:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 1/0,0 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638106:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152941 00010000:00010000:0.0:1651529344.638108:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d587a03/0xa29a79078f3bf239 lrc: 0/0,0 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638111:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487040 00000100:00100000:1.0:1651529344.638119:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487104 00000100:00100000:1.0:1651529344.638123:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152945 00000100:00100000:1.0:1651529344.638125:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1235:39030:x1731745946487040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.638126:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152946 00000100:00100000:0.0:1651529344.638128:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1235:39029:x1731745946487104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.638130:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177737 count 1 00010000:00010000:1.0:1651529344.638134:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.638134:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177738 count 1 00010000:00010000:0.0:1651529344.638138:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638142:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 2/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 829 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638145:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638146:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638146:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 4/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638148:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 2/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 829 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638151:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638152:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638152:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 4/0,1 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638153:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 3/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 829 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638157:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 4/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 829 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638159:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 3/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 829 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.638161:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638163:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 4/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 829 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.638167:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966662912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.638170:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.638176:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.638177:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367552 00010000:00010000:0.0:1651529344.638182:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 830 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.638183:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367616 00010000:00010000:1.0:1651529344.638187:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638190:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367744 00010000:00010000:0.0:1651529344.638193:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 832 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.638194:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11904 00000100:00100000:1.0:1651529344.638195:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41278:x1731746396367552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638198:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638199:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 832 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638213:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 3/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 832 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638216:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11905 00000100:00100000:0.0:1651529344.638218:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41279:x1731746396367616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.638219:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e032d62/0xa29a79078f3b9970 lrc: 0/0,0 mode: --/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce39f expref: 832 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.638221:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638222:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638223:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638223:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638224:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638226:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 3/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638227:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 4/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638232:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3ba007 lrc: 0/0,0 mode: --/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdd8 expref: 831 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638234:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.638236:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638236:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638237:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638240:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+830:41278:x1731746396367552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.638240:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 4/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638243:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11904 00010000:00010000:0.0:1651529344.638247:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638248:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11906 00000100:00100000:1.0:1651529344.638250:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+829:41279:x1731746396367744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.638252:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638253:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 829 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638255:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+829:41279:x1731746396367616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.638257:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 3/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 829 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638258:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11905 00010000:00010000:0.0:1651529344.638264:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638268:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638269:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c2bd4/0xa29a79078f3bae31 lrc: 0/0,0 mode: --/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3752 expref: 828 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.638271:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638272:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638273:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638273:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638274:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638277:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 4/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638288:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638295:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+827:41279:x1731746396367744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638298:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11906 00010000:00010000:1.0:1651529344.638308:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638312:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638315:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638317:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638326:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1236:39030:x1731745946486656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1188us total) trans 30064893805 rc 0/0 00000100:00100000:0.0:1651529344.638329:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152943 00000100:00100000:0.0:1651529344.638343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.638356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.638367:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1236:39029:x1731745946486592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1195us (1241us total) trans 30064893806 rc 0/0 00000100:00100000:1.0:1651529344.638370:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152942 00000100:00100000:1.0:1651529344.638376:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487168 00000100:00100000:1.0:1651529344.638385:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487232 00000100:00100000:1.0:1651529344.638401:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152947 00000100:00100000:1.0:1651529344.638402:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1237:39030:x1731745946487168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.638407:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177739 count 1 00010000:00010000:1.0:1651529344.638411:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638419:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152948 00000100:00100000:0.0:1651529344.638421:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1237:39029:x1731745946487232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.638427:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177740 count 1 00010000:00010000:0.0:1651529344.638432:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638440:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 2/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638444:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638444:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638445:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 4/0,1 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638452:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 3/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638454:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 2/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638455:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 4/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.638459:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.638468:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638469:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638469:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 4/0,1 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638478:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 3/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.638481:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.638486:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638488:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 4/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638490:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638492:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966663040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638493:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638495:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638507:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.638512:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638515:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d1f444b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.638516:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638519:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 3/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638524:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 1/0,0 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638536:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf247 lrc: 0/0,0 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638538:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1238:39029:x1731745946486720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1315us (1392us total) trans 30064893807 rc 0/0 00010000:00010000:0.0:1651529344.638541:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638542:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152944 00010000:00010000:0.0:1651529344.638543:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008986c686 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.638544:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638547:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 3/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638549:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638551:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 1/0,0 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638552:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ee2d952 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.638553:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638553:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008986c686/0xa29a79078f3bf240 lrc: 0/0,0 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638556:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 3/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638561:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 1/0,0 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638574:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee2d952/0xa29a79078f3bf24e lrc: 0/0,0 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.638653:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.638666:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487616 00000100:00100000:0.0:1651529344.638673:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487552 00000100:00100000:0.0:1651529344.638683:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152949 00000100:00100000:0.0:1651529344.638684:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1239:39029:x1731745946487616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.638688:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.638689:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177742 count 1 00010000:00010000:0.0:1651529344.638694:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.638706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.638708:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 2/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.638712:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487680 00010000:00010000:0.0:1651529344.638712:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638712:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638713:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 4/0,1 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638724:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152950 00000100:00100000:1.0:1651529344.638725:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1240:39030:x1731745946487552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.638725:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 3/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638729:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 4/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.638739:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177741 count 1 00010000:00010000:1.0:1651529344.638743:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638748:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 2/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638751:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638752:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638753:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 4/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638759:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966663104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638766:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 3/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638769:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638770:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.638777:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152951 00000100:00100000:0.0:1651529344.638779:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1240:39030:x1731745946487680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.638782:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966663168:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.638784:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177743 count 1 00010000:00010000:0.0:1651529344.638788:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638791:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.638793:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 2/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 826 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638796:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.638798:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368256 00010000:00010000:1.0:1651529344.638819:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 5/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 827 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.638822:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638823:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 4/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638827:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368192 00010000:00010000:1.0:1651529344.638831:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 5/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 828 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.638832:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 3/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 828 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638835:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 828 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.638840:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11907 00000100:00100000:1.0:1651529344.638841:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+828:41279:x1731746396368256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.638844:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638846:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 5/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 828 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638846:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638849:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 4/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 828 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638855:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638855:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.638855:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.638856:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638859:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 4/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638863:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966662848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638871:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638878:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+828:41279:x1731746396368256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638881:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11907 00000100:00100000:1.0:1651529344.638886:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11908 00000100:00100000:1.0:1651529344.638887:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+827:41278:x1731746396368192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.638890:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.638890:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638891:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 4/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 827 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638905:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 3/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 827 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.638910:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416e957f/0xa29a79078f3b93ea lrc: 0/0,0 mode: --/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd80 expref: 827 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638913:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638914:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638914:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638917:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 4/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638931:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638938:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+826:41278:x1731746396368192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638948:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11908 00010000:00010000:1.0:1651529344.638960:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087f1c681/0xa29a79078f3bc028 lrc: 0/0,0 mode: --/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d75 expref: 825 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.638965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.638976:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966662912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638980:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638984:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.638996:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638997:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487744 00010000:00010000:1.0:1651529344.639000:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639003:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639005:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152952 00000100:00100000:0.0:1651529344.639007:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1241:39029:x1731745946487744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.639018:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177744 count 1 00010000:00010000:0.0:1651529344.639022:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639041:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 2/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 824 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639045:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639045:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.639049:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1242:39030:x1731745946487040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 923us (1050us total) trans 30064893808 rc 0/0 00010000:00010000:0.0:1651529344.639051:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 4/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639052:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152945 00000100:00100000:1.0:1651529344.639061:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368320 00010000:00010000:1.0:1651529344.639066:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 5/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 825 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.639069:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 3/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 825 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639073:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 825 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639075:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368384 00010000:00010000:1.0:1651529344.639077:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 5/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639077:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966663296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.639086:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11909 00000100:00100000:1.0:1651529344.639087:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+826:41278:x1731746396368320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.639090:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639091:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 5/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639095:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 4/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639101:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639101:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639102:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639102:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.639105:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 4/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639110:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.639111:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4549305/0xa29a79078f3bb68f lrc: 0/0,0 mode: --/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58a0 expref: 826 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639116:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+825:41278:x1731746396368320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.639116:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966663040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.639119:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11909 00010000:00010000:0.0:1651529344.639119:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639123:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11910 00000100:00100000:1.0:1651529344.639124:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+824:41279:x1731746396368384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.639127:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639128:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 5/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 824 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639131:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 4/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 824 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.639134:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639135:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639136:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639136:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639137:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639139:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 4/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639143:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.639143:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639145:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639147:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+824:41279:x1731746396368384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 22us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.639149:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11910 00010000:00010000:1.0:1651529344.639164:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639167:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000553813a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639168:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639171:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 3/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639176:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 1/0,0 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639179:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553813a7/0xa29a79078f3bf255 lrc: 0/0,0 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639183:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639186:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000403b01ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639186:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639190:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 3/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639191:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1242:39029:x1731745946487232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 769us (834us total) trans 30064893809 rc 0/0 00010000:00010000:1.0:1651529344.639193:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 1/0,0 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639194:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152948 00010000:00010000:1.0:1651529344.639195:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf26a lrc: 0/0,0 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639203:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639204:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da198be/0xa29a79078f3b9ace lrc: 0/0,0 mode: --/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce99c expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.639207:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639208:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966662976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.639210:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639211:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639212:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639215:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639217:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639226:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639229:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639251:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1243:39029:x1731745946487104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1123us (1225us total) trans 30064893810 rc 0/0 00000100:00100000:0.0:1651529344.639254:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152946 00000100:00100000:1.0:1651529344.639268:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1242:39030:x1731745946487168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 865us (925us total) trans 30064893811 rc 0/0 00000100:00100000:1.0:1651529344.639271:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152947 00010000:00010000:1.0:1651529344.639279:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639282:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7509585 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639290:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639293:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 3/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639301:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 1/0,0 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639304:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf25c lrc: 0/0,0 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639315:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639318:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000456f128f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639319:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639321:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 3/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639335:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.639341:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639342:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 1/0,0 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639348:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966663104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639350:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f128f/0xa29a79078f3bf263 lrc: 0/0,0 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639351:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639363:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966663168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639367:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639430:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368512 00010000:00010000:1.0:1651529344.639435:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639452:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11911 00000100:00100000:0.0:1651529344.639453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639454:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41279:x1731746396368512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.639462:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639464:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.639472:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 3/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639478:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008673fe78/0xa29a79078f3b9ac7 lrc: 0/0,0 mode: --/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce980 expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639480:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966663296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639482:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639482:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639483:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639484:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639486:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 4/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639491:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368448 00010000:00010000:1.0:1651529344.639492:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.639496:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 4/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639500:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41279:x1731746396368512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.639503:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11911 00000100:00100000:1.0:1651529344.639508:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368576 00010000:00010000:1.0:1651529344.639511:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639517:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11912 00000100:00100000:1.0:1651529344.639518:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41278:x1731746396368448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.639519:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11913 00010000:00010000:1.0:1651529344.639521:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639522:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 4/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639526:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 3/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639530:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3ba2a7 lrc: 0/0,0 mode: --/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08dd expref: 823 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639530:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41278:x1731746396368576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.639533:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639534:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639535:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639535:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 822 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639537:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 4/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639539:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 3/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 822 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639547:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.639552:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309aaf01/0xa29a79078f3bc15c lrc: 0/0,0 mode: --/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ca expref: 822 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639553:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+822:41278:x1731746396368448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.639556:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11912 00010000:00010000:0.0:1651529344.639556:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639556:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639557:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639560:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 4/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639563:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639566:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639566:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.639569:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639572:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639574:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396368576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.639577:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11913 00010000:00010000:0.0:1651529344.639594:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639598:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639601:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639603:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639611:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1242:39030:x1731745946487552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 885us (957us total) trans 30064893812 rc 0/0 00000100:00100000:1.0:1651529344.639621:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152950 00010000:00010000:1.0:1651529344.639628:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639631:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006dcbcfa2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639632:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639635:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 3/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639649:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1242:39030:x1731745946487680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 869us (961us total) trans 30064893813 rc 0/0 00010000:00010000:1.0:1651529344.639650:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 1/0,0 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639652:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152951 00010000:00010000:1.0:1651529344.639653:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf278 lrc: 0/0,0 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639657:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639660:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050bec487 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639661:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639661:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639664:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 3/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639664:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639667:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 1/0,0 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639667:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639669:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf27f lrc: 0/0,0 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639670:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 2/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639673:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639676:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be36d90 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.639684:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 2/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639687:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 3/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639691:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 1/0,0 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639693:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf271 lrc: 0/0,0 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639722:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1242:39029:x1731745946487616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1037us (1078us total) trans 30064893814 rc 0/0 00000100:00100000:0.0:1651529344.639725:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152949 00000100:00100000:1.0:1651529344.639737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.639754:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488128 00000100:00100000:1.0:1651529344.639759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.639762:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488064 00000100:00100000:0.0:1651529344.639770:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152953 00000100:00100000:0.0:1651529344.639772:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1243:39029:x1731745946488128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.639777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.639777:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177746 count 1 00010000:00010000:0.0:1651529344.639786:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639793:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.639793:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 2/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639801:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639802:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639816:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 4/0,1 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639824:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 3/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639828:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 4/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639832:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966663360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.639841:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.639847:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488256 00000100:00100000:0.0:1651529344.639854:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488192 00000100:00100000:0.0:1651529344.639861:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152954 00000100:00100000:0.0:1651529344.639863:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1245:39030:x1731745946488064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.639867:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177745 count 1 00010000:00010000:0.0:1651529344.639871:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639875:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 2/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.639877:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152955 00000100:00100000:1.0:1651529344.639879:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1245:39029:x1731745946488256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.639881:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639881:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639882:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 4/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.639884:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177748 count 1 00010000:00010000:1.0:1651529344.639888:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639888:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 3/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639891:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.639893:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 2/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.639895:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966663424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639896:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639897:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639898:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 4/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639914:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 3/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.639918:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.639922:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966663488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.639926:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.639934:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152956 00000100:00100000:0.0:1651529344.639936:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1245:39030:x1731745946488192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.639938:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.639941:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177747 count 1 00010000:00010000:0.0:1651529344.639944:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639949:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 2/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639952:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639953:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639953:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 4/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639962:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 3/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 819 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639979:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.639984:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966663552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.639998:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.640048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.640064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.640075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.640084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.640091:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368960 00000100:00100000:0.0:1651529344.640093:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488320 00010000:00010000:1.0:1651529344.640097:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.640103:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488448 00000100:00100000:0.0:1651529344.640109:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488384 00000100:00100000:0.0:1651529344.640113:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152957 00000100:00100000:1.0:1651529344.640114:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369216 00000100:00100000:0.0:1651529344.640115:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1248:39029:x1731745946488320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.640117:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 5/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 821 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.640120:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177749 count 1 00000100:00100000:1.0:1651529344.640123:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11914 00010000:00010000:0.0:1651529344.640124:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640125:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+821:41278:x1731746396368960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.640128:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640129:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640129:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 2/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 821 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640132:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640132:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640133:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 4/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640144:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 3/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640150:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be02170/0xa29a79078f3baf73 lrc: 0/0,0 mode: --/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c61 expref: 821 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640150:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 3/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 821 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640154:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640154:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640155:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640155:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640158:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640159:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 4/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640167:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.640178:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.640183:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396368960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.640184:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152958 00000100:00100000:1.0:1651529344.640186:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11914 00000100:00100000:0.0:1651529344.640186:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1248:39030:x1731745946488448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.640191:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11915 00002000:00080000:0.0:1651529344.640191:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177751 count 1 00000100:00100000:1.0:1651529344.640193:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41279:x1731746396369216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.640194:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640195:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640197:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 5/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640199:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 2/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 819 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640201:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 4/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640202:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640203:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640203:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 4/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640209:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 3/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 819 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640213:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640213:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 819 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640214:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640215:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640218:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 4/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640222:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.640224:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966663680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.640228:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41279:x1731746396369216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.640230:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11915 00000100:00100000:0.0:1651529344.640232:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.640238:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152959 00000100:00100000:1.0:1651529344.640240:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1248:39029:x1731745946488384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.640242:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.640245:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177750 count 1 00010000:00010000:1.0:1651529344.640248:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640253:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 2/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 818 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640256:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640256:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640257:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 4/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640264:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 3/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 818 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640279:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640279:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640283:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966663744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640283:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640286:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640292:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.640340:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1249:39029:x1731745946487744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1332us (1430us total) trans 30064893815 rc 0/0 00000100:00100000:1.0:1651529344.640341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.640343:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152952 00010000:00010000:0.0:1651529344.640350:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640353:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a59a7b3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.640354:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640357:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 3/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640370:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 1/0,0 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.640373:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf286 lrc: 0/0,0 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640384:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966663552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640388:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640395:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966663424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640398:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.640404:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074aadd20/0xa29a79078f3bba78 lrc: 0/0,0 mode: --/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d678e expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.640407:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966663360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640410:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640413:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640415:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640425:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640428:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640439:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966663488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640444:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640451:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369344 00010000:00010000:1.0:1651529344.640456:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.640461:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369280 00010000:00010000:1.0:1651529344.640463:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 819 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.640467:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369408 00010000:00010000:1.0:1651529344.640469:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.640474:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11916 00000100:00100000:1.0:1651529344.640484:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396369344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.640487:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640488:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640497:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 3/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640503:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caef34c8/0xa29a79078f3bc3a8 lrc: 0/0,0 mode: --/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bb4 expref: 820 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.640503:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1249:39029:x1731745946488128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 729us (772us total) trans 30064893816 rc 0/0 00000100:00100000:0.0:1651529344.640506:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152953 00010000:00010000:1.0:1651529344.640507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640508:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640512:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 4/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640518:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.640525:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41278:x1731746396369344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.640527:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11917 00000100:00100000:1.0:1651529344.640529:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11916 00000100:00100000:0.0:1651529344.640529:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41279:x1731746396369280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.640533:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.640534:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11918 00010000:00010000:0.0:1651529344.640535:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.640536:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+818:41279:x1731746396369408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.640538:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640539:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640539:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 3/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640546:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f03c8a6/0xa29a79078f3baca2 lrc: 0/0,0 mode: --/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3155 expref: 818 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640549:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640550:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640551:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640552:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 3/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.640556:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 4/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640557:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b14660c/0xa29a79078f3b9a11 lrc: 0/0,0 mode: --/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5d6 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640561:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640561:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640562:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640562:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.640565:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 4/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640569:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+816:41279:x1731746396369280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.640573:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.640579:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11917 00000100:00100000:1.0:1651529344.640580:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+816:41279:x1731746396369408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.640583:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11918 00010000:00010000:0.0:1651529344.640586:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640590:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640591:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640593:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640594:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9087fb6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.640595:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640595:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640598:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 3/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640613:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 1/0,0 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640616:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf28d lrc: 0/0,0 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640620:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640623:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c4ba74c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.640624:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640626:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 3/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640629:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 1/0,0 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640632:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf2a2 lrc: 0/0,0 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640638:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640641:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640649:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946488192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 712us (856us total) trans 30064893817 rc 0/0 00010000:00010000:1.0:1651529344.640650:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640653:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640670:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152956 00010000:00010000:0.0:1651529344.640677:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640681:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000426608f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.640682:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640685:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 3/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640690:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 1/0,0 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640692:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf29b lrc: 0/0,0 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640695:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1249:39029:x1731745946488256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 816us (918us total) trans 30064893818 rc 0/0 00010000:00010000:0.0:1651529344.640698:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640699:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152955 00010000:00010000:0.0:1651529344.640701:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640704:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640707:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640762:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946488064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 899us (1003us total) trans 30064893819 rc 0/0 00000100:00100000:0.0:1651529344.640765:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152954 00000100:00100000:0.0:1651529344.640790:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488832 00000100:00100000:0.0:1651529344.640797:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152960 00000100:00100000:0.0:1651529344.640799:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946488832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.640822:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177752 count 1 00010000:00010000:0.0:1651529344.640826:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.640831:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 2/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640834:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640835:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640835:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 4/0,1 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640842:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 3/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 814 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640846:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 4/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 814 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.640850:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966663808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640858:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.640859:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.640867:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966663680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640870:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640877:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640880:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.640896:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640900:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8ccde44 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.640901:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640904:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 3/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640920:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 1/0,0 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640933:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf294 lrc: 0/0,0 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640946:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966663744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640950:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640956:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369472 00010000:00010000:1.0:1651529344.640961:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 815 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.640971:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369536 00010000:00010000:1.0:1651529344.640974:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 816 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.640975:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369600 00000100:00100000:1.0:1651529344.640978:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11919 00000100:00100000:1.0:1651529344.640980:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+817:41278:x1731746396369472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.640981:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640983:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640984:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640988:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 3/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.640993:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c04982/0xa29a79078f3b9b61 lrc: 0/0,0 mode: --/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb78 expref: 817 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641000:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11920 00000100:00100000:0.0:1651529344.641002:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+817:41279:x1731746396369536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.641003:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641004:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641005:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641005:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.641007:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 816 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641008:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 4/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641011:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 3/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 816 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641016:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.641023:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f6c41e/0xa29a79078f3b7876 lrc: 0/0,0 mode: --/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb74c expref: 816 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.641024:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+816:41278:x1731746396369472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641027:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11919 00010000:00010000:0.0:1651529344.641027:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641028:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641029:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641032:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11921 00010000:00010000:0.0:1651529344.641032:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 4/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641034:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41278:x1731746396369600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.641036:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.641038:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 814 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641042:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 3/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 814 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641046:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3ba2c3 lrc: 0/0,0 mode: --/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0931 expref: 814 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641050:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641056:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641057:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641058:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.641060:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 4/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641066:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+813:41279:x1731746396369536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.641067:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.641069:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11920 00000100:00100000:1.0:1651529344.641074:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41278:x1731746396369600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641076:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11921 00010000:00010000:0.0:1651529344.641081:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641084:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641084:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641087:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641087:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641090:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641090:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641093:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 2/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641144:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1251:39029:x1731745946488384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 902us (1059us total) trans 30064893821 rc 0/0 00000100:00100000:1.0:1651529344.641147:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152959 00000100:00100000:0.0:1651529344.641151:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1250:39030:x1731745946488448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 964us (1075us total) trans 30064893820 rc 0/0 00010000:00010000:1.0:1651529344.641154:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641154:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152958 00010000:00010000:0.0:1651529344.641162:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 2/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641166:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b744bd8d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.641167:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 2/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641168:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c53ee2cd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.641169:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641172:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 3/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641177:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 1/0,0 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641180:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf2b0 lrc: 0/0,0 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641180:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 3/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641186:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 1/0,0 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641188:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf2b7 lrc: 0/0,0 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641195:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641203:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641207:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641209:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.641254:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641255:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1250:39029:x1731745946488320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1139us (1191us total) trans 30064893822 rc 0/0 00000100:00100000:0.0:1651529344.641258:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152957 00000100:00100000:0.0:1651529344.641264:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489088 00000100:00100000:1.0:1651529344.641265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.641274:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489152 00000100:00100000:0.0:1651529344.641286:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152961 00000100:00100000:0.0:1651529344.641288:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1251:39030:x1731745946489088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.641293:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177753 count 1 00010000:00010000:0.0:1651529344.641297:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.641302:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 2/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641311:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641312:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641312:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 4/0,1 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641320:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 3/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641324:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 4/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641328:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.641331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.641343:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.641349:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489216 00000100:00100000:0.0:1651529344.641359:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489280 00010000:00010000:1.0:1651529344.641371:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641376:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f198e1d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.641377:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641381:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152962 00000100:00100000:0.0:1651529344.641383:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1253:39030:x1731745946489152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.641384:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 3/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.641388:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177754 count 1 00010000:00010000:1.0:1651529344.641396:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 1/0,0 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641399:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf2a9 lrc: 0/0,0 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641407:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370176 00010000:00010000:0.0:1651529344.641409:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641412:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 5/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641414:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 2/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641417:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641417:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641418:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 4/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641420:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11922 00000100:00100000:1.0:1651529344.641421:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396370176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.641424:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.641425:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 5/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641425:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 3/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641429:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 4/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641429:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641433:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966663936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.641434:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641434:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641435:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641438:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 4/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641446:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.641461:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.641464:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396370176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641467:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11922 00000100:00100000:0.0:1651529344.641488:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152963 00000100:00100000:1.0:1651529344.641491:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152964 00000100:00100000:0.0:1651529344.641491:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1253:39029:x1731745946489216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.641496:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177755 count 1 00000100:00100000:1.0:1651529344.641500:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1253:39030:x1731745946489280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.641500:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.641505:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177756 count 1 00010000:00010000:0.0:1651529344.641505:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 2/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641509:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641510:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641511:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641511:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 4/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641514:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 2/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641517:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641518:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641518:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 4/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641525:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 3/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641528:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 4/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641529:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 3/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.641533:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641533:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641537:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966664064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.641541:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.641545:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.641555:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce51a90e/0xa29a79078f3bb611 lrc: 0/0,0 mode: --/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5693 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641566:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966663808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641570:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641573:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.641576:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641586:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641589:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.641624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.641630:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1254:39030:x1731745946488832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 830us (870us total) trans 30064893823 rc 0/0 00000100:00100000:0.0:1651529344.641633:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152960 00000100:00100000:0.0:1651529344.641638:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489472 00000100:00100000:0.0:1651529344.641647:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489408 00000100:00100000:0.0:1651529344.641653:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152965 00000100:00100000:0.0:1651529344.641655:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1255:39030:x1731745946489472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.641659:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177758 count 1 00010000:00010000:0.0:1651529344.641663:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641668:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 2/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641671:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641672:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641672:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 4/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.641691:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641695:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4df3b46 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.641696:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641699:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 3/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641701:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 3/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641705:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 1/0,0 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641705:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 4/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641707:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf2be lrc: 0/0,0 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641709:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966664128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.641715:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370240 00000100:00100000:0.0:1651529344.641723:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.641726:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 5/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641729:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489536 00000100:00100000:1.0:1651529344.641742:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11923 00000100:00100000:0.0:1651529344.641742:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152966 00000100:00100000:1.0:1651529344.641744:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41279:x1731746396370240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.641744:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1256:39029:x1731745946489408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.641748:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1651529344.641748:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177757 count 1 00010000:00010000:1.0:1651529344.641749:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 5/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641752:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641753:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 4/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 811 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.641756:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 2/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641758:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641758:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641759:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641761:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 4/0,1 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641762:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 4/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641767:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.641767:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 3/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 811 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641770:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 4/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.641774:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41279:x1731746396370240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641777:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11923 00000100:00100000:1.0:1651529344.641784:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152967 00000100:00100000:1.0:1651529344.641786:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1256:39029:x1731745946489536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.641791:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177759 count 1 00000100:00100000:0.0:1651529344.641793:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966664192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.641795:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641799:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 2/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 810 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.641802:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.641813:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641814:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641815:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 4/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641828:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 3/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 810 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641828:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023fe5e17/0xa29a79078f3b8a82 lrc: 0/0,0 mode: --/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc220 expref: 810 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.641832:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 4/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 810 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.641833:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966663872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.641836:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966664256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641837:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641840:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641843:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641844:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.641846:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641848:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.641915:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946489088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 626us (678us total) trans 30064893824 rc 0/0 00000100:00100000:0.0:1651529344.641919:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152961 00000100:00100000:0.0:1651529344.641924:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489728 00000100:00100000:0.0:1651529344.641934:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152968 00000100:00100000:0.0:1651529344.641936:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946489728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.641940:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177760 count 1 00010000:00010000:0.0:1651529344.641950:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641956:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 2/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 809 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641959:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641959:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641960:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 4/0,1 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.641977:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 3/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 809 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641981:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 4/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 809 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.641983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641985:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.641989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641996:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.642001:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642004:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1872a21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.642005:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642010:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 3/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642015:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 1/0,0 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642018:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf2c5 lrc: 0/0,0 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642026:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.642027:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966663936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642031:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642031:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642038:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370368 00000100:00100000:0.0:1651529344.642038:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966664064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642041:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642043:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642050:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370432 00000100:00100000:0.0:1651529344.642051:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370496 00010000:00010000:1.0:1651529344.642052:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 4/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642056:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642057:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11924 00000100:00100000:1.0:1651529344.642059:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41278:x1731746396370368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.642062:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642063:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.642063:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11925 00010000:00010000:1.0:1651529344.642066:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 3/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642072:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bb507 lrc: 0/0,0 mode: --/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e9 expref: 812 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642075:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642076:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642077:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642080:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 4/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642086:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41279:x1731746396370432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.642090:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.642092:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 4/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642096:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.642101:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 3/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642107:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41278:x1731746396370368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642110:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11924 00010000:00010000:0.0:1651529344.642112:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028a9e652/0xa29a79078f3bbc5b lrc: 0/0,0 mode: --/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f52 expref: 811 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642114:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11926 00000100:00100000:1.0:1651529344.642116:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+810:41278:x1731746396370496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.642119:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642120:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642124:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 3/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642126:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642127:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642128:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642129:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f492beb/0xa29a79078f3b9d83 lrc: 0/0,0 mode: --/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf415 expref: 809 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642132:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642132:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 4/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642133:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642133:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642136:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 4/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642141:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.642151:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.642154:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+808:41279:x1731746396370432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642157:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+808:41278:x1731746396370496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.642158:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11925 00000100:00100000:1.0:1651529344.642160:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11926 00010000:00010000:0.0:1651529344.642166:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642168:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642169:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642172:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642172:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642175:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642175:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642180:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642217:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1259:39030:x1731745946489152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 832us (951us total) trans 30064893825 rc 0/0 00000100:00100000:0.0:1651529344.642220:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152962 00010000:00010000:0.0:1651529344.642227:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642228:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1258:39030:x1731745946489280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 727us (897us total) trans 30064893826 rc 0/0 00010000:00010000:0.0:1651529344.642230:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642231:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152964 00010000:00010000:0.0:1651529344.642233:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642235:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642239:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642242:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b1015fe2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642243:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642246:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 3/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642251:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 1/0,0 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642254:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1015fe2/0xa29a79078f3bf2cc lrc: 0/0,0 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642258:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642261:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6741c7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642262:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642265:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 3/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642268:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 1/0,0 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642268:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1258:39029:x1731745946489216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 777us (968us total) trans 30064893827 rc 0/0 00010000:00010000:1.0:1651529344.642270:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6741c7/0xa29a79078f3bf2da lrc: 0/0,0 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642274:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642276:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8f9e680 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642277:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642279:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 3/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642282:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 1/0,0 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642285:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f9e680/0xa29a79078f3bf2d3 lrc: 0/0,0 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642285:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152963 00000100:00100000:0.0:1651529344.642311:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642357:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489984 00000100:00100000:0.0:1651529344.642366:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152969 00000100:00100000:0.0:1651529344.642368:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1258:39029:x1731745946489984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.642380:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177761 count 1 00000100:00100000:1.0:1651529344.642390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.642390:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.642403:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.642408:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 2/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.642410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.642411:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642412:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642418:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 4/0,1 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642422:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966664256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642426:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 3/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642427:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642430:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 4/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642434:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370560 00000100:00100000:0.0:1651529344.642434:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966664384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642439:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 5/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 807 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642444:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370624 00000100:00100000:0.0:1651529344.642445:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.642446:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 5/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 808 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642450:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370752 00010000:00010000:1.0:1651529344.642452:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 4/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 809 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.642452:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966664192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.642456:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370688 00010000:00010000:0.0:1651529344.642456:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642458:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 5/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642462:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11927 00000100:00100000:0.0:1651529344.642463:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966664128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.642464:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+810:41278:x1731746396370560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.642465:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642467:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642468:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 4/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642471:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 3/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.642472:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642474:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642477:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001420bda8/0xa29a79078f3ba32c lrc: 0/0,0 mode: --/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ac7 expref: 810 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642480:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642481:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.642481:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11928 00010000:00010000:1.0:1651529344.642482:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642483:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+809:41278:x1731746396370624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.642485:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 4/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642486:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.642488:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 4/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 809 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642492:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 3/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 809 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642494:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.642502:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+809:41278:x1731746396370560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642505:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11927 00010000:00010000:0.0:1651529344.642505:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b099315/0xa29a79078f3bbbeb lrc: 0/0,0 mode: --/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d76 expref: 809 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642509:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642510:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642510:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642513:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 4/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642514:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11929 00000100:00100000:1.0:1651529344.642515:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+807:41278:x1731746396370752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.642518:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642519:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 4/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 807 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642526:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 3/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 807 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642537:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.642538:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000225f1b8b/0xa29a79078f3b853b lrc: 0/0,0 mode: --/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf64 expref: 807 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642542:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642542:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642543:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642545:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+806:41278:x1731746396370624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.642546:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 4/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642548:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11928 00010000:00010000:1.0:1651529344.642551:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.642554:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11930 00000100:00100000:0.0:1651529344.642555:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41279:x1731746396370688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.642557:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41278:x1731746396370752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.642558:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.642560:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11929 00010000:00010000:0.0:1651529344.642560:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 4/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 805 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.642563:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 3/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642567:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642568:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da78748/0xa29a79078f3baaf0 lrc: 0/0,0 mode: --/PR res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ab0 expref: 804 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642570:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642572:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642572:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642573:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642573:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642576:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 4/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642578:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642582:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.642587:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+803:41279:x1731746396370688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.642589:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11930 00010000:00010000:0.0:1651529344.642596:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642599:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642602:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642605:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642625:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1259:39029:x1731745946489536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 838us (943us total) trans 30064893828 rc 0/0 00000100:00100000:1.0:1651529344.642628:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152967 00010000:00010000:1.0:1651529344.642635:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642638:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000972da1e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642639:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642642:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 3/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642647:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 1/0,0 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642647:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1259:39029:x1731745946489408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 902us (1022us total) trans 30064893829 rc 0/0 00010000:00010000:1.0:1651529344.642649:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000972da1e9/0xa29a79078f3bf2ef lrc: 0/0,0 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642650:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152966 00010000:00010000:1.0:1651529344.642654:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642656:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3658389 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.642657:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642660:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642663:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642666:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642666:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642669:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 3/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642673:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 1/0,0 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642675:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3658389/0xa29a79078f3bf2e8 lrc: 0/0,0 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642679:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642682:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085e6ff56 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642683:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642685:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 3/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642688:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 1/0,0 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642691:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e6ff56/0xa29a79078f3bf2e1 lrc: 0/0,0 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642697:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1259:39030:x1731745946489472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1041us (1122us total) trans 30064893830 rc 0/0 00000100:00100000:0.0:1651529344.642700:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152965 00010000:00010000:0.0:1651529344.642707:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642711:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642714:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642716:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.642765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642776:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1259:39030:x1731745946489728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 839us (913us total) trans 30064893831 rc 0/0 00000100:00100000:0.0:1651529344.642779:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152968 00000100:00100000:1.0:1651529344.642783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642784:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490240 00000100:00100000:0.0:1651529344.642793:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490304 00000100:00100000:0.0:1651529344.642797:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490368 00000100:00100000:0.0:1651529344.642801:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152970 00000100:00100000:0.0:1651529344.642819:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1261:39030:x1731745946490240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.642824:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177762 count 1 00010000:00010000:0.0:1651529344.642828:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642833:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 2/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642838:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642839:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642840:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 4/0,1 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642847:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 3/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642850:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 4/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.642854:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.642863:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.642870:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152971 00000100:00100000:0.0:1651529344.642871:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1261:39029:x1731745946490304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.642876:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177763 count 1 00010000:00010000:0.0:1651529344.642879:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642883:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 2/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642886:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642886:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642887:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 4/0,1 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642895:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 3/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642897:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642898:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 4/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.642901:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000442d2c3b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.642902:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642905:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 3/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642910:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 1/0,0 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642913:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442d2c3b/0xa29a79078f3bf2f6 lrc: 0/0,0 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642921:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152972 00000100:00100000:0.0:1651529344.642922:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966664512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.642923:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1261:39030:x1731745946490368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.642929:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177764 count 1 00010000:00010000:1.0:1651529344.642932:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642937:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.642944:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 2/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642955:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642955:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642956:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 4/0,1 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642971:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 3/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642975:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 4/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.642979:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.642994:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.643053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643078:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643088:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490560 00000100:00100000:1.0:1651529344.643089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643103:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490624 00000100:00100000:1.0:1651529344.643107:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490688 00000100:00100000:1.0:1651529344.643123:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490752 00000100:00100000:1.0:1651529344.643126:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152973 00000100:00100000:1.0:1651529344.643128:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1265:39029:x1731745946490560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.643129:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152974 00000100:00100000:0.0:1651529344.643131:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1265:39030:x1731745946490624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.643133:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177765 count 1 00010000:00010000:1.0:1651529344.643137:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643142:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 2/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 802 pid: 127526 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.643144:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177766 count 1 00010000:00010000:0.0:1651529344.643149:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643153:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643153:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643154:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 4/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643154:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 2/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643161:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 3/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 802 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643165:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 802 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643166:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643167:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643167:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 4/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643169:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966664640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643176:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 3/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.643180:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.643182:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643186:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152975 00000100:00100000:0.0:1651529344.643186:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966664704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.643188:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1265:39029:x1731745946490688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.643192:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177767 count 1 00000100:00100000:0.0:1651529344.643194:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.643196:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643200:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 2/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.643201:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152976 00010000:00010000:1.0:1651529344.643203:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.643203:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1265:39030:x1731745946490752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.643204:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643205:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 4/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.643207:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177768 count 1 00010000:00010000:0.0:1651529344.643211:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643215:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 2/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643218:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643219:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643220:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 4/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643222:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643225:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 3/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643226:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643229:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643230:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966664768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.643236:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966664832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.643237:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.643243:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.643290:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966664384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.643292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.643301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.643324:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.643334:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966664512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643336:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.643343:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371200 00010000:00010000:0.0:1651529344.643348:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 4/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 803 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.643354:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371264 00010000:00010000:0.0:1651529344.643356:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 5/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 804 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643359:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371328 00000100:00100000:0.0:1651529344.643360:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371392 00010000:00010000:0.0:1651529344.643362:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 5/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.643365:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 4/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.643367:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11931 00000100:00100000:0.0:1651529344.643368:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+806:41278:x1731746396371200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.643372:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11932 00000100:00100000:1.0:1651529344.643373:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+806:41279:x1731746396371264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.643373:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.643374:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 4/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.643376:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.643378:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 5/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643378:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 3/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.643382:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 4/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643383:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961ab01a/0xa29a79078f3ba7af lrc: 0/0,0 mode: --/PR res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e69 expref: 806 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643387:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643387:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643388:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643391:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 4/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643398:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.643399:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643399:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643400:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643403:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 4/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643404:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41278:x1731746396371200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.643407:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11931 00010000:00010000:1.0:1651529344.643408:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.643412:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11933 00000100:00100000:0.0:1651529344.643413:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41278:x1731746396371392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.643416:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41279:x1731746396371264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.643416:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.643417:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 5/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 804 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643419:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11932 00010000:00010000:0.0:1651529344.643423:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 4/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 803 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643424:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11934 00000100:00100000:1.0:1651529344.643426:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+803:41279:x1731746396371328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.643428:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.643428:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643428:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643429:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643430:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 4/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 803 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643432:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 4/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643433:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 3/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 803 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.643436:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.643438:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3ba070 lrc: 0/0,0 mode: --/PR res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff91 expref: 803 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.643441:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41278:x1731746396371392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.643442:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643442:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.643444:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11933 00010000:00010000:0.0:1651529344.643449:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643450:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643453:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 4/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643453:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643456:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643459:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643462:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.643468:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+801:41279:x1731746396371328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.643471:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11934 00010000:00010000:1.0:1651529344.643492:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff66a66c/0xa29a79078f3bb82c lrc: 0/0,0 mode: --/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ee3 expref: 800 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.643496:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.643500:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643503:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643506:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643509:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643511:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643516:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1266:39029:x1731745946489984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1147us (1204us total) trans 30064893832 rc 0/0 00000100:00100000:0.0:1651529344.643519:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152969 00010000:00010000:0.0:1651529344.643526:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643530:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643539:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643542:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643577:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1267:39030:x1731745946490368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 653us (794us total) trans 30064893833 rc 0/0 00000100:00100000:1.0:1651529344.643581:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152972 00010000:00010000:1.0:1651529344.643590:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643591:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1266:39029:x1731745946490304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 718us (825us total) trans 30064893834 rc 0/0 00010000:00010000:1.0:1651529344.643593:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006d0713ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.643594:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643594:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152971 00010000:00010000:1.0:1651529344.643597:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 3/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643602:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 1/0,0 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643602:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643605:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0713ad/0xa29a79078f3bf2fd lrc: 0/0,0 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643606:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006dcbcfa2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.643607:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643609:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643610:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 3/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643612:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000681676f2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.643613:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643615:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 1/0,0 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643618:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dcbcfa2/0xa29a79078f3bf312 lrc: 0/0,0 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643627:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 3/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643628:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd16c980/0xa29a79078f3bba39 lrc: 0/0,0 mode: --/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ca expref: 799 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.643630:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 1/0,0 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643631:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.643633:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681676f2/0xa29a79078f3bf30b lrc: 0/0,0 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643635:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643638:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643641:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643644:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643646:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643688:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1266:39030:x1731745946490240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 884us (941us total) trans 30064893835 rc 0/0 00000100:00100000:0.0:1651529344.643692:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152970 00010000:00010000:0.0:1651529344.643698:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643702:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095d57b9b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.643703:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643706:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 3/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643711:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 1/0,0 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643729:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d57b9b/0xa29a79078f3bf304 lrc: 0/0,0 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643891:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491072 00000100:00100000:1.0:1651529344.643892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643913:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491136 00000100:00100000:0.0:1651529344.643918:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491200 00000100:00100000:1.0:1651529344.643919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643922:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491264 00000100:00100000:0.0:1651529344.643926:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152977 00000100:00100000:0.0:1651529344.643927:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1269:39029:x1731745946491072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.643928:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152978 00000100:00100000:1.0:1651529344.643930:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1269:39030:x1731745946491136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.643932:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177769 count 1 00002000:00080000:1.0:1651529344.643936:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177770 count 1 00010000:00010000:0.0:1651529344.643937:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643940:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643942:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 2/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643945:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 2/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643945:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643946:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643946:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 4/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643948:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643948:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643949:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 4/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643953:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 3/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643957:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.643961:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.643968:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 3/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643972:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.643972:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.643976:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.643978:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152979 00000100:00100000:0.0:1651529344.643980:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1269:39029:x1731745946491200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.643985:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.643985:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177771 count 1 00010000:00010000:0.0:1651529344.643988:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643992:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152980 00010000:00010000:0.0:1651529344.643992:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 2/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.643994:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1269:39030:x1731745946491264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.643995:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643996:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643997:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 4/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.643998:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177772 count 1 00010000:00010000:1.0:1651529344.644002:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644006:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 2/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644009:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644010:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644011:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 4/0,1 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644024:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 3/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.644026:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 3/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 798 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644028:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 4/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 798 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644030:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644034:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.644039:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.644042:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.644047:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.644124:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966664704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.644133:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644141:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966664640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644146:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644160:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371968 00010000:00010000:1.0:1651529344.644166:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 799 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644170:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644179:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372032 00010000:00010000:1.0:1651529344.644183:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 800 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.644192:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11935 00000100:00100000:1.0:1651529344.644193:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+800:41279:x1731746396371968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.644196:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644197:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 800 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644201:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 3/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 800 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644210:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11936 00010000:00010000:1.0:1651529344.644212:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018ae472d/0xa29a79078f3b7995 lrc: 0/0,0 mode: --/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb959 expref: 800 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644213:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+800:41279:x1731746396372032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.644216:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.644218:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644222:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 3/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 800 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644228:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644228:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644228:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000836cc686/0xa29a79078f3bc2d6 lrc: 0/0,0 mode: --/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d889d expref: 799 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644229:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644232:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 4/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644239:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644250:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+799:41279:x1731746396371968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644253:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11935 00010000:00010000:0.0:1651529344.644254:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644255:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644256:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644259:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 4/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644261:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644264:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644265:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.644268:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644270:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644273:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+797:41279:x1731746396372032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.644276:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11936 00010000:00010000:0.0:1651529344.644283:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644287:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644290:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644293:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644318:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1271:39029:x1731745946490560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1189us (1264us total) trans 30064893836 rc 0/0 00000100:00100000:1.0:1651529344.644321:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152973 00010000:00010000:1.0:1651529344.644336:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644337:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1270:39030:x1731745946490624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1206us (1265us total) trans 30064893837 rc 0/0 00010000:00010000:1.0:1651529344.644340:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d4c772d6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.644341:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644341:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152974 00010000:00010000:1.0:1651529344.644344:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 3/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644348:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 1/0,0 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644351:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c772d6/0xa29a79078f3bf319 lrc: 0/0,0 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644355:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644358:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dc7c8ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.644359:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644362:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 3/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644371:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 1/0,0 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644382:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc7c8ad/0xa29a79078f3bf320 lrc: 0/0,0 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644393:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966664768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644397:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644457:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966664832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.644462:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.644481:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966664896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.644482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.644484:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644491:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.644492:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.644493:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.644500:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372096 00000100:00100000:1.0:1651529344.644505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.644505:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 797 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.644511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.644511:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372160 00010000:00010000:0.0:1651529344.644513:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 798 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644517:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372224 00010000:00010000:0.0:1651529344.644519:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 799 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.644520:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966664960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.644523:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372352 00010000:00010000:1.0:1651529344.644524:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644525:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 800 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.644531:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372288 00010000:00010000:1.0:1651529344.644535:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 801 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644541:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372416 00000100:00100000:1.0:1651529344.644542:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11937 00000100:00100000:1.0:1651529344.644543:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41279:x1731746396372096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.644544:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 5/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644546:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.644549:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11938 00000100:00100000:0.0:1651529344.644550:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41279:x1731746396372160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.644553:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644555:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644555:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644558:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 3/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644559:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644564:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000273b1f1a/0xa29a79078f3b968a lrc: 0/0,0 mode: --/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd815 expref: 802 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644565:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9eaa0e6/0xa29a79078f3ba6d6 lrc: 0/0,0 mode: --/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1acd expref: 802 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644567:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644568:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644569:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644569:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644569:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644570:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644572:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 4/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644573:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 4/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644580:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644592:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+800:41279:x1731746396372096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644594:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11937 00010000:00010000:0.0:1651529344.644603:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644606:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11939 00000100:00100000:1.0:1651529344.644608:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+799:41279:x1731746396372224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.644611:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.644611:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+799:41279:x1731746396372160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (128us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.644612:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 799 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644616:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 3/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 799 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644621:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11938 00000100:00100000:0.0:1651529344.644627:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11940 00010000:00010000:1.0:1651529344.644629:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549d7f96/0xa29a79078f3bc116 lrc: 0/0,0 mode: --/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8188 expref: 798 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644629:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+798:41279:x1731746396372352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.644632:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644632:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644633:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644633:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 797 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644634:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644637:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 4/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644637:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 3/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 797 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644643:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023587dff/0xa29a79078f3bbd50 lrc: 0/0,0 mode: --/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7270 expref: 797 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644645:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644652:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+797:41279:x1731746396372224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (159us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.644653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644653:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644654:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644655:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11939 00010000:00010000:0.0:1651529344.644657:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 4/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644660:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11941 00000100:00100000:1.0:1651529344.644661:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+795:41279:x1731746396372288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.644663:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.644664:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644665:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 795 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644669:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 3/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 795 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644669:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+795:41279:x1731746396372352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.644672:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11940 00010000:00010000:1.0:1651529344.644674:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000825bb202/0xa29a79078f3bae54 lrc: 0/0,0 mode: --/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ec expref: 795 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.644677:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11942 00000100:00100000:0.0:1651529344.644679:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+794:41279:x1731746396372416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.644680:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644680:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644681:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644681:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.644682:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 5/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 793 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644684:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 4/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644686:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 4/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 793 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.644690:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.644691:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644692:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644692:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644695:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+793:41279:x1731746396372288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.644695:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 4/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644697:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11941 00010000:00010000:0.0:1651529344.644699:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.644704:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+792:41279:x1731746396372416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.644706:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11942 00010000:00010000:1.0:1651529344.644711:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3babd0 lrc: 0/0,0 mode: --/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2db9 expref: 791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.644712:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644714:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.644715:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644718:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644718:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644721:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644723:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 2/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644724:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644727:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644730:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644780:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1271:39029:x1731745946491200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 799us (879us total) trans 30064893838 rc 0/0 00000100:00100000:1.0:1651529344.644781:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1271:39030:x1731745946491264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 787us (862us total) trans 30064893839 rc 0/0 00000100:00100000:0.0:1651529344.644783:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152979 00000100:00100000:1.0:1651529344.644785:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152980 00010000:00010000:0.0:1651529344.644791:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 2/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644793:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644794:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c67fba00 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.644795:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 2/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644797:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644798:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 3/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644800:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644802:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644815:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 1/0,0 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644819:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c67fba00/0xa29a79078f3bf343 lrc: 0/0,0 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644823:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644826:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cb06c19 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.644827:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644830:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 3/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644833:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 1/0,0 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644836:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb06c19/0xa29a79078f3bf34a lrc: 0/0,0 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644839:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644842:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a97d5a3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.644843:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644845:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 3/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644848:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 1/0,0 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644851:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a97d5a3/0xa29a79078f3bf327 lrc: 0/0,0 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644855:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1270:39029:x1731745946490688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1666us (1766us total) trans 30064893840 rc 0/0 00000100:00100000:1.0:1651529344.644858:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152975 00010000:00010000:0.0:1651529344.644859:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644862:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644865:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644867:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644868:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644871:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644876:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644879:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644905:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1271:39030:x1731745946490752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1701us (1805us total) trans 30064893841 rc 0/0 00000100:00100000:0.0:1651529344.644908:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152976 00000100:00100000:1.0:1651529344.644913:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1270:39030:x1731745946491136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 982us (1020us total) trans 30064893842 rc 0/0 00000100:00100000:1.0:1651529344.644915:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152978 00010000:00010000:0.0:1651529344.644915:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644918:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e97c5f1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.644919:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644922:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644922:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 3/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644925:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc9fb9dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.644926:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644927:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 1/0,0 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644929:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 3/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644934:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 1/0,0 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644937:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9fb9dd/0xa29a79078f3bf33c lrc: 0/0,0 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644938:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e97c5f1/0xa29a79078f3bf32e lrc: 0/0,0 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644944:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644947:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.644950:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644953:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.644999:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1270:39029:x1731745946491072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1125us total) trans 30064893843 rc 0/0 00000100:00100000:0.0:1651529344.645002:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152977 00000100:00100000:0.0:1651529344.645007:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491584 00000100:00100000:0.0:1651529344.645017:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491648 00000100:00100000:0.0:1651529344.645024:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152981 00000100:00100000:0.0:1651529344.645025:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1271:39029:x1731745946491584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.645030:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177773 count 1 00010000:00010000:0.0:1651529344.645034:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645054:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 2/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645057:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645057:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645058:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 4/0,1 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645089:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 3/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645092:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645093:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 4/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.645097:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b93e8363 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.645097:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966665152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.645098:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645101:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 3/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645106:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 1/0,0 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645108:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b93e8363/0xa29a79078f3bf335 lrc: 0/0,0 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645113:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.645120:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152982 00000100:00100000:0.0:1651529344.645122:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1271:39030:x1731745946491648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.645127:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177774 count 1 00010000:00010000:0.0:1651529344.645131:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645136:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 2/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645139:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645146:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645147:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 4/0,1 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645154:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 3/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645158:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 4/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.645162:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966665216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.645174:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.645273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645317:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492096 00000100:00100000:1.0:1651529344.645325:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152983 00000100:00100000:1.0:1651529344.645326:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1272:39029:x1731745946492096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.645331:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177776 count 1 00000100:00100000:0.0:1651529344.645339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.645347:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645353:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 2/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645356:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645357:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645358:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 4/0,1 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.645375:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 3/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.645376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.645379:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 4/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.645383:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.645383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645393:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645399:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492032 00000100:00100000:0.0:1651529344.645399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645415:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492224 00000100:00100000:1.0:1651529344.645421:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492160 00000100:00100000:1.0:1651529344.645427:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492352 00000100:00100000:1.0:1651529344.645437:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152984 00000100:00100000:1.0:1651529344.645439:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1276:39030:x1731745946492032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.645439:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.645449:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177775 count 1 00000100:00100000:0.0:1651529344.645450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.645453:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645457:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492416 00010000:00010000:1.0:1651529344.645458:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 2/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645461:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645462:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645462:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 4/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645464:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152985 00000100:00100000:0.0:1651529344.645466:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1277:39029:x1731745946492224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.645471:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 3/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.645471:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177778 count 1 00010000:00010000:1.0:1651529344.645474:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.645476:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.645478:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966665344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645481:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 2/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.645491:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645498:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372736 00010000:00010000:0.0:1651529344.645498:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645498:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645499:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 4/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645503:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 5/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.645508:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 3/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 791 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.645512:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372800 00010000:00010000:1.0:1651529344.645515:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 5/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 792 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.645517:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.645521:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11943 00000100:00100000:0.0:1651529344.645521:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966665408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645523:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+792:41278:x1731746396372736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.645526:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.645527:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 5/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 792 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.645531:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 4/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 792 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.645531:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.645537:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152986 00010000:00010000:1.0:1651529344.645539:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.645539:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1277:39030:x1731745946492160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.645540:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645540:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645544:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 4/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.645544:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177777 count 1 00010000:00010000:1.0:1651529344.645548:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.645548:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645552:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 2/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 792 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.645554:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+792:41278:x1731746396372736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.645557:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11943 00000100:00100000:1.0:1651529344.645561:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11944 00000100:00100000:1.0:1651529344.645563:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+791:41278:x1731746396372800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.645565:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.645566:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 5/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.645570:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 4/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 791 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.645571:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645572:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645573:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 4/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645574:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645574:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645575:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645580:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 4/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645584:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.645588:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+791:41278:x1731746396372800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.645590:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11944 00010000:00010000:0.0:1651529344.645591:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 3/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 791 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645594:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.645597:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152987 00000100:00100000:1.0:1651529344.645598:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1277:39029:x1731745946492352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.645598:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966665472:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.645603:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177779 count 1 00000100:00100000:0.0:1651529344.645606:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.645607:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645611:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 2/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645614:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645614:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.645614:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152988 00010000:00010000:1.0:1651529344.645615:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 4/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645616:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1277:39029:x1731745946492416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.645620:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177780 count 1 00010000:00010000:1.0:1651529344.645621:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 3/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 790 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645624:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 4/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.645624:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645628:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 2/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 790 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.645631:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966665536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645631:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645632:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645633:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 4/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.645638:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.645638:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 3/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 790 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645642:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 4/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 790 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.645654:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.645662:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.645671:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000815c1cc4/0xa29a79078f3bbe37 lrc: 0/0,0 mode: --/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7636 expref: 790 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.645675:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966665216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645679:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645682:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645685:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645688:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645690:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645741:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1278:39030:x1731745946491648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 618us (768us total) trans 30064893844 rc 0/0 00000100:00100000:0.0:1651529344.645744:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152982 00010000:00010000:0.0:1651529344.645757:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc16b06a/0xa29a79078f3baa09 lrc: 0/0,0 mode: --/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26a4 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.645768:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966665152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645772:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645775:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645778:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.645779:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372864 00010000:00010000:0.0:1651529344.645781:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645783:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645785:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 5/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.645794:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11945 00000100:00100000:1.0:1651529344.645795:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41279:x1731746396372864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.645798:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.645799:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 5/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.645813:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 4/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.645819:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645820:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645821:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645824:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 4/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645829:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.645838:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41279:x1731746396372864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.645840:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11945 00010000:00010000:1.0:1651529344.645847:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645850:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000daec32e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.645851:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645854:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 3/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645854:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1278:39029:x1731745946491584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 827us (903us total) trans 30064893845 rc 0/0 00000100:00100000:0.0:1651529344.645857:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152981 00010000:00010000:1.0:1651529344.645858:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 1/0,0 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645861:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daec32e5/0xa29a79078f3bf358 lrc: 0/0,0 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645864:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645868:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a5488aa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.645869:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645872:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035bf3a86/0xa29a79078f3b9c33 lrc: 0/0,0 mode: --/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee96 expref: 788 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.645875:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.645879:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645882:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645882:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 3/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645885:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645887:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 1/0,0 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645888:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645890:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5488aa/0xa29a79078f3bf351 lrc: 0/0,0 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645891:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 2/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645894:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645912:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068c3a11c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.645914:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 2/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645917:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 3/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645920:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 1/0,0 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645923:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c3a11c/0xa29a79078f3bf35f lrc: 0/0,0 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.645930:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1278:39029:x1731745946492096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 602us (657us total) trans 30064893846 rc 0/0 00000100:00100000:1.0:1651529344.645933:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152983 00000100:00100000:0.0:1651529344.645941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645979:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492608 00000100:00100000:1.0:1651529344.645990:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152989 00000100:00100000:1.0:1651529344.645992:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1278:39030:x1731745946492608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.645996:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177781 count 1 00010000:00010000:1.0:1651529344.646000:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646005:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 2/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 787 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.646008:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646009:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646009:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 4/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646019:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 3/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 787 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.646023:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 4/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646027:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.646040:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.646107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.646125:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966665408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.646134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.646135:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646145:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966665344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.646147:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492736 00010000:00010000:1.0:1651529344.646149:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646154:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492672 00000100:00100000:1.0:1651529344.646156:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373056 00000100:00100000:0.0:1651529344.646158:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152990 00000100:00100000:0.0:1651529344.646160:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1280:39029:x1731745946492736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.646161:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 788 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646167:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373120 00010000:00010000:1.0:1651529344.646170:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646176:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11946 00000100:00100000:1.0:1651529344.646178:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41278:x1731746396373056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00002000:00080000:0.0:1651529344.646183:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177783 count 1 00010000:00010000:1.0:1651529344.646186:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646188:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646188:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646192:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 3/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646193:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 2/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 789 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.646196:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646196:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646197:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ce4aca/0xa29a79078f3ba906 lrc: 0/0,0 mode: --/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2386 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646197:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 4/0,1 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646201:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646201:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646202:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646205:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 4/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646205:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 3/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 788 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.646208:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 4/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 788 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646211:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.646212:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966665728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.646218:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+788:41278:x1731746396373056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646221:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11946 00000100:00100000:0.0:1651529344.646222:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.646226:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11947 00000100:00100000:1.0:1651529344.646227:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41278:x1731746396373120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.646230:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646231:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646235:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 3/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646239:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d3b06cd/0xa29a79078f3ba276 lrc: 0/0,0 mode: --/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0835 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646242:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646243:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646244:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646244:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152991 00000100:00100000:0.0:1651529344.646246:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1280:39030:x1731745946492672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.646247:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 4/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.646251:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177782 count 1 00010000:00010000:1.0:1651529344.646256:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.646262:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+786:41278:x1731746396373120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646264:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11947 00010000:00010000:1.0:1651529344.646272:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646272:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646275:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646277:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 2/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 785 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.646278:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646280:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646281:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646281:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 4/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646283:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646288:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 3/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 785 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.646301:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 4/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 785 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.646305:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966665792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.646313:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.646319:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646321:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1281:39030:x1731745946492032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (961us total) trans 30064893847 rc 0/0 00010000:00010000:0.0:1651529344.646322:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646324:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152984 00010000:00010000:0.0:1651529344.646326:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646329:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646344:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646348:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072ce6845 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646349:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646352:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 3/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646356:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 1/0,0 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646359:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ce6845/0xa29a79078f3bf366 lrc: 0/0,0 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646363:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646366:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065480de5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646367:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646368:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1281:39029:x1731745946492224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 901us (991us total) trans 30064893848 rc 0/0 00010000:00010000:1.0:1651529344.646370:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 3/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646371:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152985 00010000:00010000:1.0:1651529344.646373:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 1/0,0 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646376:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065480de5/0xa29a79078f3bf36d lrc: 0/0,0 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646440:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966665536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.646444:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646462:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966665472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.646466:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646474:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.646476:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646508:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373376 00000100:00100000:1.0:1651529344.646511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.646514:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646528:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373568 00010000:00010000:0.0:1651529344.646531:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 4/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 787 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646535:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.646538:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373504 00010000:00010000:1.0:1651529344.646539:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646541:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 4/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 788 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.646545:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373760 00000100:00100000:1.0:1651529344.646547:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11948 00010000:00010000:0.0:1651529344.646547:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 4/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646549:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41279:x1731746396373376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.646551:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11949 00010000:00010000:1.0:1651529344.646553:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.646553:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41278:x1731746396373568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.646555:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646558:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 3/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646564:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a447616/0xa29a79078f3bb5ee lrc: 0/0,0 mode: --/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d563f expref: 789 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646568:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646568:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646569:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646570:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646572:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 4/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646572:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 4/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 788 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646576:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 3/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 788 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646582:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.646592:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+788:41279:x1731746396373376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646594:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11948 00010000:00010000:0.0:1651529344.646599:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ce9f31b/0xa29a79078f3b9024 lrc: 0/0,0 mode: --/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4ff expref: 787 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.646604:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11950 00010000:00010000:0.0:1651529344.646604:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646604:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.646606:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+786:41279:x1731746396373504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.646609:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646610:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 4/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646613:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646617:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 3/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646617:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 4/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646621:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006af38bad/0xa29a79078f3b9e47 lrc: 0/0,0 mode: --/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf787 expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646625:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646625:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646625:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.646626:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646629:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 4/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646633:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+785:41278:x1731746396373568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 79us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.646635:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.646636:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11949 00000100:00100000:1.0:1651529344.646640:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+784:41279:x1731746396373504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.646641:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11951 00000100:00100000:1.0:1651529344.646643:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11950 00000100:00100000:0.0:1651529344.646643:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+784:41279:x1731746396373760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.646646:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.646647:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 4/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646650:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646651:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 3/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.646653:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646656:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646656:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e5e7cf/0xa29a79078f3bbf80 lrc: 0/0,0 mode: --/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7af1 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.646660:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646660:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646661:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646661:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646664:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 4/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646674:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.646680:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+782:41279:x1731746396373760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.646683:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11951 00010000:00010000:0.0:1651529344.646690:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646693:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646696:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646699:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646708:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1281:39029:x1731745946492352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1108us (1318us total) trans 30064893849 rc 0/0 00000100:00100000:1.0:1651529344.646711:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152987 00010000:00010000:1.0:1651529344.646718:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646722:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4df3b46 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646723:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646725:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 3/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646745:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 1/0,0 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646749:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf37b lrc: 0/0,0 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646753:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646756:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095fe8399 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646757:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646760:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 3/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646763:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 1/0,0 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646766:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095fe8399/0xa29a79078f3bf382 lrc: 0/0,0 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646771:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1281:39029:x1731745946492416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1154us (1320us total) trans 30064893850 rc 0/0 00010000:00010000:1.0:1651529344.646772:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646774:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152988 00010000:00010000:1.0:1651529344.646775:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646778:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646781:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646783:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646786:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646789:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646792:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646841:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1282:39030:x1731745946492608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 848us (900us total) trans 30064893851 rc 0/0 00000100:00100000:1.0:1651529344.646844:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152989 00000100:00100000:0.0:1651529344.646851:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1281:39030:x1731745946492160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1311us (1467us total) trans 30064893852 rc 0/0 00010000:00010000:1.0:1651529344.646852:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646854:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152986 00010000:00010000:1.0:1651529344.646855:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f198e1d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646856:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646859:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 3/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646864:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 1/0,0 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646867:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf389 lrc: 0/0,0 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646871:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646874:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7509585 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.646874:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646877:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 3/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.646889:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 1/0,0 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646895:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509585/0xa29a79078f3bf374 lrc: 0/0,0 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.646926:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492800 00000100:00100000:0.0:1651529344.646932:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492864 00000100:00100000:0.0:1651529344.646939:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152992 00000100:00100000:0.0:1651529344.646941:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1282:39030:x1731745946492800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.646946:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177784 count 1 00010000:00010000:0.0:1651529344.646951:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646955:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 2/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 781 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.646958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.646959:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646959:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646960:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 4/0,1 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646967:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 3/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 781 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.646970:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 4/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 781 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.646977:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966665856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.646986:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.646987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646998:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373824 00000100:00100000:0.0:1651529344.647001:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966665792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647004:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 5/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 782 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.647005:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647011:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373888 00010000:00010000:1.0:1651529344.647014:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 4/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 783 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.647020:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11952 00000100:00100000:1.0:1651529344.647021:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41278:x1731746396373824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.647024:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.647026:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 5/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647027:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152993 00010000:00010000:1.0:1651529344.647029:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 4/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647029:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1282:39030:x1731745946492864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.647034:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177785 count 1 00010000:00010000:1.0:1651529344.647035:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647035:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647036:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647038:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647041:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 4/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647042:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 2/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647045:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647046:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.647046:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647047:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 4/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647053:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41278:x1731746396373824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.647053:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.647055:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11952 00010000:00010000:0.0:1651529344.647057:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.647060:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11953 00000100:00100000:1.0:1651529344.647061:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+782:41279:x1731746396373888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.647063:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647064:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.647065:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 4/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 782 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.647069:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 3/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 782 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647071:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.647073:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3cad986/0xa29a79078f3b786f lrc: 0/0,0 mode: --/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb730 expref: 782 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.647076:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647077:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647077:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647079:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e161130/0xa29a79078f3ba181 lrc: 0/0,0 mode: --/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03c0 expref: 781 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.647080:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 4/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647083:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966665728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647087:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647091:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.647097:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41279:x1731746396373888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.647097:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647100:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11953 00010000:00010000:0.0:1651529344.647100:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647103:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647106:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647175:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1283:39029:x1731745946492736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1013us (1049us total) trans 30064893853 rc 0/0 00000100:00100000:0.0:1651529344.647178:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152990 00000100:00100000:1.0:1651529344.647182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.647191:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647195:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d1f444b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.647196:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647199:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 3/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647204:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 1/0,0 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647207:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1f444b/0xa29a79078f3bf390 lrc: 0/0,0 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647213:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647216:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.647219:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647222:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647226:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493248 00000100:00100000:1.0:1651529344.647237:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493312 00000100:00100000:1.0:1651529344.647251:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152994 00000100:00100000:1.0:1651529344.647252:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1284:39029:x1731745946493248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.647258:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177786 count 1 00010000:00010000:1.0:1651529344.647262:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647267:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 2/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647270:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647270:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647271:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 4/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647277:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.647278:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1285:39030:x1731745946492672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1031us (1144us total) trans 30064893854 rc 0/0 00010000:00010000:1.0:1651529344.647281:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 4/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647282:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152991 00000100:00100000:0.0:1651529344.647287:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152995 00000100:00100000:0.0:1651529344.647288:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946493312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.647293:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177787 count 1 00000100:00100000:1.0:1651529344.647297:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647297:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647301:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 2/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.647307:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.647312:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647315:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b744bd8d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.647316:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647319:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 3/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647321:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647322:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647323:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 4/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647324:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 1/0,0 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647327:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b744bd8d/0xa29a79078f3bf397 lrc: 0/0,0 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647331:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 3/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647335:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647339:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647346:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.647429:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493504 00000100:00100000:0.0:1651529344.647437:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493568 00000100:00100000:1.0:1651529344.647441:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493696 00000100:00100000:0.0:1651529344.647445:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152996 00000100:00100000:0.0:1651529344.647447:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1286:39029:x1731745946493504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.647452:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177788 count 1 00010000:00010000:0.0:1651529344.647456:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647462:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152997 00000100:00100000:1.0:1651529344.647464:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1287:39030:x1731745946493568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.647467:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 2/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.647469:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177789 count 1 00010000:00010000:0.0:1651529344.647470:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647471:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647471:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 4/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647474:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647478:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 2/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647478:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647481:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.647482:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647482:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647483:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 4/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647490:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 3/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647493:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.647497:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966666176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647504:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966666112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.647518:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.647523:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647525:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152998 00000100:00100000:1.0:1651529344.647527:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1287:39030:x1731745946493696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.647531:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177790 count 1 00010000:00010000:1.0:1651529344.647535:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.647539:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 2/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647553:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647553:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647554:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 4/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647560:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.647566:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493760 00010000:00010000:1.0:1651529344.647572:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 4/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647575:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 152999 00000100:00100000:1.0:1651529344.647576:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966666240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647577:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1288:39030:x1731745946493760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.647582:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177791 count 1 00010000:00010000:0.0:1651529344.647586:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647590:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.647610:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 2/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647613:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647614:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647614:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 4/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647622:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 3/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 779 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647626:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.647630:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966666304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647644:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.647832:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966665856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647836:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647897:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966665920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647901:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647919:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966665984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647924:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647924:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647928:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647951:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966666176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647954:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648214:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966666112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.648222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648223:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.648236:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966666304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.648238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648238:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.648246:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374400 00000100:00100000:1.0:1651529344.648249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648251:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 4/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 780 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648254:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.648257:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374592 00000100:00100000:1.0:1651529344.648259:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648259:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 4/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 781 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648263:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374528 00010000:00010000:0.0:1651529344.648266:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 782 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648270:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374720 00010000:00010000:0.0:1651529344.648271:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.648278:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374656 00010000:00010000:0.0:1651529344.648280:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 784 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648284:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374848 00010000:00010000:0.0:1651529344.648286:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 5/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 785 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648290:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374784 00000100:00100000:1.0:1651529344.648291:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966666240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.648292:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648295:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648295:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374912 00010000:00010000:0.0:1651529344.648297:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648302:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11954 00000100:00100000:1.0:1651529344.648304:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11955 00000100:00100000:0.0:1651529344.648304:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41279:x1731746396374400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.648306:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41278:x1731746396374592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.648307:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648309:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 4/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648310:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.648311:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 4/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648312:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 3/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648315:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648318:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068cabf2c/0xa29a79078f3ba60b lrc: 0/0,0 mode: --/PR res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1762 expref: 787 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648321:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000892682f5/0xa29a79078f3b9b3e lrc: 0/0,0 mode: --/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb32 expref: 786 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648322:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648323:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648324:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648325:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648326:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648326:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 4/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648327:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648330:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 4/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648333:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.648339:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.648342:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+785:41279:x1731746396374400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.648345:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11954 00000100:00100000:1.0:1651529344.648346:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+785:41278:x1731746396374592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.648349:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11955 00000100:00100000:0.0:1651529344.648351:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11956 00000100:00100000:0.0:1651529344.648352:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41279:x1731746396374528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.648355:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648356:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648360:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11957 00010000:00010000:0.0:1651529344.648360:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648362:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41278:x1731746396374720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.648364:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648365:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a6488b/0xa29a79078f3b9bd8 lrc: 0/0,0 mode: --/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced54 expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648366:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 783 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648368:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648369:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 3/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 782 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648369:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648370:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648373:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 4/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648374:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b098a8cf/0xa29a79078f3b9a42 lrc: 0/0,0 mode: --/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6ee expref: 782 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648378:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648378:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648378:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.648379:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648382:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 4/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648383:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+781:41279:x1731746396374528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.648385:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11956 00010000:00010000:1.0:1651529344.648387:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.648389:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11958 00000100:00100000:0.0:1651529344.648391:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41279:x1731746396374656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.648392:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41278:x1731746396374720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.648393:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648394:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 780 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648395:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11957 00010000:00010000:0.0:1651529344.648398:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 3/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648400:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11959 00000100:00100000:1.0:1651529344.648401:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+779:41278:x1731746396374848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.648403:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648403:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f4e2bea/0xa29a79078f3bbd2d lrc: 0/0,0 mode: --/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71c8 expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648405:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 4/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 779 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648406:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648407:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648407:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648408:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 778 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648413:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601a8bae/0xa29a79078f3bbb5f lrc: 0/0,0 mode: --/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b1c expref: 778 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648413:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 4/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648416:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648417:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648417:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648418:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.648420:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 4/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648423:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+777:41279:x1731746396374656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.648425:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.648425:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11958 00000100:00100000:0.0:1651529344.648429:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11960 00000100:00100000:1.0:1651529344.648430:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+776:41278:x1731746396374848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.648431:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+776:41279:x1731746396374784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.648432:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11959 00010000:00010000:0.0:1651529344.648433:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648435:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 775 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.648436:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11961 00010000:00010000:0.0:1651529344.648438:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 775 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648443:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec016a57/0xa29a79078f3bbed8 lrc: 0/0,0 mode: --/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7882 expref: 775 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648446:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648446:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648447:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648448:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+774:41279:x1731746396374912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.648450:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648450:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 4/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648452:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.648456:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 3/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 774 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.648458:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.648461:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e970e5bc/0xa29a79078f3b9ba7 lrc: 0/0,0 mode: --/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec43 expref: 774 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.648463:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+774:41279:x1731746396374784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.648464:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648465:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648465:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648465:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11960 00010000:00010000:1.0:1651529344.648468:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 4/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648471:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648474:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648477:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.648483:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+772:41279:x1731746396374912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.648485:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648486:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11961 00010000:00010000:0.0:1651529344.648488:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648500:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648504:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648510:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648512:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648549:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1290:39030:x1731745946492800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1607us (1667us total) trans 30064893855 rc 0/0 00000100:00100000:0.0:1651529344.648552:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152992 00010000:00010000:0.0:1651529344.648560:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648563:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648566:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648569:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1289:39029:x1731745946493248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1316us (1387us total) trans 30064893856 rc 0/0 00010000:00010000:0.0:1651529344.648569:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648573:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152994 00010000:00010000:1.0:1651529344.648586:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648589:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648593:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648595:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648607:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1289:39030:x1731745946492864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1577us (1701us total) trans 30064893857 rc 0/0 00000100:00100000:0.0:1651529344.648610:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152993 00010000:00010000:0.0:1651529344.648617:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648620:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648623:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648626:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648639:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1289:39030:x1731745946493568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1238us total) trans 30064893858 rc 0/0 00000100:00100000:1.0:1651529344.648642:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152997 00010000:00010000:1.0:1651529344.648650:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648657:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1289:39030:x1731745946493312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1367us (1439us total) trans 30064893859 rc 0/0 00000100:00100000:0.0:1651529344.648660:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152995 00010000:00010000:1.0:1651529344.648663:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000426608f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.648664:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648667:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 3/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648667:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648670:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c53ee2cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.648671:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648672:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 1/0,0 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648674:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000426608f/0xa29a79078f3bf39e lrc: 0/0,0 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648674:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 3/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648679:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648679:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 1/0,0 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648682:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.648682:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf3ac lrc: 0/0,0 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648683:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648685:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 3/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648686:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648688:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 1/0,0 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648689:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8ccde44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.648690:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648693:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 3/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648694:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf3a5 lrc: 0/0,0 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648696:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 1/0,0 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648697:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648698:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf3c1 lrc: 0/0,0 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648700:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.648700:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648703:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 3/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648703:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648706:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 1/0,0 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648707:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648709:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf3b3 lrc: 0/0,0 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648709:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648712:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648715:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648718:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648721:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648724:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648757:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1290:39029:x1731745946493504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1309us (1396us total) trans 30064893860 rc 0/0 00000100:00100000:0.0:1651529344.648760:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152996 00010000:00010000:0.0:1651529344.648767:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648770:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.648771:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1289:39030:x1731745946493696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1354us total) trans 30064893861 rc 0/0 00010000:00010000:0.0:1651529344.648771:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648774:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152998 00010000:00010000:0.0:1651529344.648774:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 3/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648778:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 1/0,0 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648781:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648781:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf3ba lrc: 0/0,0 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648785:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c4ba74c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.648786:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648787:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648788:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 3/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648790:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648793:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 1/0,0 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648793:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648795:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 2/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648796:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf3c8 lrc: 0/0,0 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648800:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648828:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.648829:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 2/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648832:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 3/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648836:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 1/0,0 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648838:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf3cf lrc: 0/0,0 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648851:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1289:39030:x1731745946493760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1273us (1313us total) trans 30064893862 rc 0/0 00000100:00100000:0.0:1651529344.648854:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 152999 00000100:00100000:0.0:1651529344.649083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.649090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.649103:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494336 00000100:00100000:1.0:1651529344.649110:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494400 00000100:00100000:0.0:1651529344.649111:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153000 00000100:00100000:0.0:1651529344.649113:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1290:39030:x1731745946494336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.649123:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153001 00002000:00080000:0.0:1651529344.649123:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177792 count 1 00000100:00100000:1.0:1651529344.649124:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1290:39029:x1731745946494400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.649129:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.649130:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177793 count 1 00010000:00010000:0.0:1651529344.649134:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 2/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649135:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649139:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649140:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 2/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.649140:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649140:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 4/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649143:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649143:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649144:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 4/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649151:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 3/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649156:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.649160:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966666432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649183:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.649188:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 3/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.649193:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649198:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966666368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.649219:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649226:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494528 00000100:00100000:1.0:1651529344.649229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.649246:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494464 00000100:00100000:0.0:1651529344.649251:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153002 00000100:00100000:0.0:1651529344.649253:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1292:39029:x1731745946494528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.649258:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177795 count 1 00010000:00010000:0.0:1651529344.649262:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649266:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 2/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.649275:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.649276:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649276:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649277:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 4/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649289:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 3/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.649292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649292:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649297:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649298:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494656 00000100:00100000:1.0:1651529344.649303:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494592 00000100:00100000:1.0:1651529344.649305:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494784 00000100:00100000:1.0:1651529344.649307:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494720 00000100:00100000:0.0:1651529344.649310:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649317:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153003 00000100:00100000:0.0:1651529344.649319:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1296:39030:x1731745946494464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.649322:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153004 00000100:00100000:1.0:1651529344.649323:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1296:39029:x1731745946494656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.649323:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177794 count 1 00010000:00010000:0.0:1651529344.649327:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.649328:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177797 count 1 00010000:00010000:0.0:1651529344.649331:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 2/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649332:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649334:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649335:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649335:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 4/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649337:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 2/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649340:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649341:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649341:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 3/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649342:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 4/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649347:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.649349:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 3/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.649351:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966666560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.649353:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.649358:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966666624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.649358:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649363:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153005 00000100:00100000:0.0:1651529344.649365:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1296:39030:x1731745946494592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.649366:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.649369:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177796 count 1 00000100:00100000:1.0:1651529344.649373:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153006 00000100:00100000:1.0:1651529344.649374:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1296:39029:x1731745946494784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.649379:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177799 count 1 00010000:00010000:1.0:1651529344.649382:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649386:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 2/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649389:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649389:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649390:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 4/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649395:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649396:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 3/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.649401:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 2/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.649404:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649404:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649405:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 4/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649410:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649412:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 3/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.649415:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966666688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649416:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.649422:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649423:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966666752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649429:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153007 00000100:00100000:1.0:1651529344.649430:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1296:39030:x1731745946494720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.649430:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.649434:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177798 count 1 00010000:00010000:1.0:1651529344.649438:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649442:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 2/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 771 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649445:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649446:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649446:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 4/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649460:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 3/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 771 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.649464:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 771 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.649485:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966666816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649494:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.649502:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966666432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.649512:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649520:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375488 00010000:00010000:1.0:1651529344.649543:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 772 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.649563:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375552 00010000:00010000:1.0:1651529344.649567:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649568:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966666368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649572:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649577:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11962 00000100:00100000:1.0:1651529344.649579:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396375488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.649582:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649583:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649586:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11963 00010000:00010000:1.0:1651529344.649587:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 3/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649588:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396375552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.649591:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649593:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005afe88e7/0xa29a79078f3ba0e7 lrc: 0/0,0 mode: --/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0182 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649593:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649597:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 3/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649603:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035cd1480/0xa29a79078f3bb96e lrc: 0/0,0 mode: --/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63cf expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.649604:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649604:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649605:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649607:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649607:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649608:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 4/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649608:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649613:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 4/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649615:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.649619:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649627:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+771:41279:x1731746396375488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649630:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11962 00000100:00100000:0.0:1651529344.649632:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+770:41279:x1731746396375552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.649635:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11963 00010000:00010000:1.0:1651529344.649643:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649646:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649649:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649652:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649662:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649674:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649677:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649680:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649701:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1297:39029:x1731745946494400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 575us (610us total) trans 30064893863 rc 0/0 00000100:00100000:1.0:1651529344.649704:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153001 00010000:00010000:1.0:1651529344.649711:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649715:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051bb957c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.649716:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649719:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 3/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649723:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 1/0,0 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649726:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf3dd lrc: 0/0,0 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649741:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649744:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.649744:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1297:39030:x1731745946494336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 630us (661us total) trans 30064893864 rc 0/0 00010000:00010000:1.0:1651529344.649745:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649747:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153000 00010000:00010000:1.0:1651529344.649748:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 3/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649752:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 1/0,0 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649757:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf3d6 lrc: 0/0,0 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649783:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649788:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649793:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.649847:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375616 00010000:00010000:0.0:1651529344.649853:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.649864:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11964 00000100:00100000:0.0:1651529344.649866:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+770:41279:x1731746396375616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.649869:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.649870:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649874:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 3/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649880:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d16f65d0/0xa29a79078f3bb97c lrc: 0/0,0 mode: --/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63f9 expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.649883:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649884:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649885:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649888:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 4/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649894:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.649902:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+769:41279:x1731746396375616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.649905:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11964 00010000:00010000:0.0:1651529344.649911:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649914:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649918:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649920:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649939:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649943:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.649944:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649953:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 3/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649958:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 1/0,0 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649961:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf3e4 lrc: 0/0,0 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650025:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1297:39029:x1731745946494528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 771us (811us total) trans 30064893865 rc 0/0 00000100:00100000:0.0:1651529344.650028:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153002 00000100:00100000:0.0:1651529344.650039:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966666560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650043:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650087:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966666624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.650088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.650092:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.650102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.650108:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.650119:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966666688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.650119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.650123:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650126:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966666752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650130:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966666816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650130:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650133:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650137:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495104 00000100:00100000:1.0:1651529344.650140:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375680 00000100:00100000:0.0:1651529344.650146:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495040 00010000:00010000:1.0:1651529344.650150:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.650152:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153008 00000100:00100000:0.0:1651529344.650153:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1298:39030:x1731745946495104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.650156:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375744 00002000:00080000:0.0:1651529344.650158:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177801 count 1 00010000:00010000:1.0:1651529344.650159:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.650163:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375808 00010000:00010000:0.0:1651529344.650163:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650165:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650167:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 2/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 771 pid: 142993 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.650169:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375872 00010000:00010000:0.0:1651529344.650170:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650171:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 772 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650171:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650171:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 4/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650174:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375936 00010000:00010000:1.0:1651529344.650184:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 773 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.650189:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11965 00000100:00100000:1.0:1651529344.650191:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396375680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.650199:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.650199:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 3/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 773 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650201:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650203:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 4/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 773 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650205:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 3/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.650207:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.650210:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bac0f lrc: 0/0,0 mode: --/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ed1 expref: 773 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650214:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650215:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650216:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650219:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 4/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650219:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.650225:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.650225:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153009 00000100:00100000:0.0:1651529344.650227:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1298:39029:x1731745946495040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.650232:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177800 count 1 00000100:00100000:1.0:1651529344.650233:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+772:41279:x1731746396375680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650235:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11965 00010000:00010000:0.0:1651529344.650236:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650240:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11966 00010000:00010000:0.0:1651529344.650240:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 2/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.650242:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+771:41278:x1731746396375744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.650243:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650244:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.650244:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650245:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650245:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 4/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650249:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 3/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650251:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 3/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 771 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650253:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8b7501a/0xa29a79078f3ba16c lrc: 0/0,0 mode: --/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d036c expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650254:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 4/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650257:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650257:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650258:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650258:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966666944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.650261:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 4/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650265:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.650271:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650276:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+770:41278:x1731746396375744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.650278:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650279:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11966 00010000:00010000:0.0:1651529344.650282:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650283:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11967 00000100:00100000:1.0:1651529344.650284:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+769:41279:x1731746396375808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.650287:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.650288:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650288:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650290:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650299:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 3/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650304:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab4445f6/0xa29a79078f3bae0e lrc: 0/0,0 mode: --/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36d4 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650307:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650308:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650309:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650312:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 4/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650318:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650323:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+768:41279:x1731746396375808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650326:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11967 00000100:00100000:0.0:1651529344.650329:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1299:39030:x1731745946494464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1009us (1100us total) trans 30064893866 rc 0/0 00000100:00100000:1.0:1651529344.650330:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11968 00000100:00100000:1.0:1651529344.650332:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+767:41279:x1731746396375872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.650332:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153003 00010000:00010000:1.0:1651529344.650334:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.650335:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 767 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650339:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 3/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 767 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650339:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650342:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.650344:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1c45db5/0xa29a79078f3b9f90 lrc: 0/0,0 mode: --/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc49 expref: 767 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650344:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650347:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650347:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 3/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650348:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650348:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650351:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 4/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650351:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 1/0,0 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650355:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf3eb lrc: 0/0,0 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650359:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650364:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+766:41279:x1731746396375872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650367:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11968 00010000:00010000:0.0:1651529344.650368:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650371:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11969 00000100:00100000:1.0:1651529344.650372:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+765:41278:x1731746396375936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.650372:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650374:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.650375:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650376:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 765 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650377:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650379:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 3/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 765 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650390:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa78b311/0xa29a79078f3b8366 lrc: 0/0,0 mode: --/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe92 expref: 765 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.650397:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650397:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650398:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650401:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 4/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650406:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650411:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41278:x1731746396375936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650414:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11969 00000100:00100000:0.0:1651529344.650426:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1299:39030:x1731745946494592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1060us (1149us total) trans 30064893867 rc 0/0 00010000:00010000:1.0:1651529344.650427:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650429:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153005 00010000:00010000:1.0:1651529344.650430:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.650432:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650434:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 3/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650438:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 1/0,0 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650441:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf400 lrc: 0/0,0 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.650449:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650452:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650455:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650457:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650497:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495488 00000100:00100000:0.0:1651529344.650508:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153010 00000100:00100000:0.0:1651529344.650509:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1300:39029:x1731745946495488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.650515:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177802 count 1 00010000:00010000:0.0:1651529344.650519:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650524:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 2/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650527:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650527:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650528:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 4/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650535:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650539:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 4/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.650551:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1300:39030:x1731745946494720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1120us (1259us total) trans 30064893868 rc 0/0 00000100:00100000:1.0:1651529344.650554:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153007 00010000:00010000:1.0:1651529344.650562:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650565:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966667008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.650566:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050bec487 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.650567:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650570:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 3/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650574:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 1/0,0 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650575:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.650577:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf407 lrc: 0/0,0 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650584:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650587:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650590:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650592:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650649:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1300:39029:x1731745946494784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1274us (1364us total) trans 30064893869 rc 0/0 00000100:00100000:1.0:1651529344.650652:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153006 00000100:00100000:0.0:1651529344.650657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650669:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495616 00000100:00100000:1.0:1651529344.650675:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153011 00000100:00100000:1.0:1651529344.650676:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1300:39030:x1731745946495616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.650681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.650688:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177804 count 1 00010000:00010000:0.0:1651529344.650689:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650692:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650692:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be36d90 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.650694:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650697:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 2/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650697:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 3/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650700:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650701:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650701:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 4/0,1 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650702:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 1/0,0 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650705:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf3f9 lrc: 0/0,0 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650708:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 3/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650712:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 4/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.650716:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650725:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.650739:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495552 00010000:00010000:1.0:1651529344.650744:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650751:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153012 00000100:00100000:0.0:1651529344.650752:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1301:39029:x1731745946495552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.650753:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650756:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.650757:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177803 count 1 00010000:00010000:1.0:1651529344.650759:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650761:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650766:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 2/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650769:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650769:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650770:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 4/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650777:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650780:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 4/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.650784:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966667136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.650793:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.650797:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1302:39029:x1731745946494656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1472us (1530us total) trans 30064893870 rc 0/0 00000100:00100000:1.0:1651529344.650800:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153004 00010000:00010000:1.0:1651529344.650832:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650836:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9087fb6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.650837:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650840:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 3/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650848:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.650856:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 1/0,0 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650859:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf3f2 lrc: 0/0,0 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650873:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495680 00000100:00100000:1.0:1651529344.650884:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495744 00000100:00100000:1.0:1651529344.650897:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153013 00000100:00100000:1.0:1651529344.650898:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8b6fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1303:39030:x1731745946495680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.650908:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153014 00002000:00080000:1.0:1651529344.650909:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177805 count 1 00000100:00100000:0.0:1651529344.650911:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1303:39030:x1731745946495744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.650913:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.650916:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177806 count 1 00010000:00010000:1.0:1651529344.650917:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 2/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650920:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650923:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650923:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650924:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 4/0,1 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650925:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 2/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650928:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650929:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650930:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 4/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650931:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 3/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650934:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 4/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.650936:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 3/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.650939:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966667200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650940:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 4/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.650944:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966667264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650953:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.650960:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.651030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.651037:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496000 00000100:00100000:0.0:1651529344.651052:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153015 00000100:00100000:0.0:1651529344.651053:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1304:39030:x1731745946496000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.651059:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177807 count 1 00010000:00010000:0.0:1651529344.651063:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651068:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 2/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651071:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651071:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651072:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 4/0,1 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651078:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 3/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 763 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651082:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 4/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651086:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.651099:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.651454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.651460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.651478:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376192 00000100:00100000:0.0:1651529344.651478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.651494:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 5/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 764 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.651506:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376256 00000100:00100000:0.0:1651529344.651506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.651509:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 5/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 765 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.651513:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376448 00010000:00010000:1.0:1651529344.651515:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 5/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 766 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.651519:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376704 00000100:00100000:0.0:1651529344.651525:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.651530:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 5/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 767 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.651535:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376832 00010000:00010000:1.0:1651529344.651537:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 5/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 768 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.651541:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376768 00000100:00100000:0.0:1651529344.651543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.651551:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 5/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 769 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.651556:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376896 00010000:00010000:1.0:1651529344.651558:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 5/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 770 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.651562:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376960 00000100:00100000:0.0:1651529344.651563:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966666880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651564:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 5/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 771 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651567:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651568:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11970 00000100:00100000:1.0:1651529344.651570:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+771:41278:x1731746396376192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.651573:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651574:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 4/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 771 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651574:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966666944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.651577:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651578:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 3/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 771 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651584:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966667008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651586:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f98bfc5f/0xa29a79078f3bc411 lrc: 0/0,0 mode: --/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d3c expref: 771 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651586:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651590:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651591:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651592:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651592:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966667136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651595:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 4/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651595:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651601:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966667264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651605:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.651610:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651615:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651616:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+770:41278:x1731746396376192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651618:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11970 00010000:00010000:0.0:1651529344.651618:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651621:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651623:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11971 00000100:00100000:1.0:1651529344.651625:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+769:41279:x1731746396376256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.651626:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651627:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651629:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 4/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651633:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 3/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651645:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000364a8185/0xa29a79078f3bacb0 lrc: 0/0,0 mode: --/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3171 expref: 769 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651650:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651651:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651652:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651654:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 4/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651663:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651669:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+768:41279:x1731746396376256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651671:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11971 00000100:00100000:1.0:1651529344.651675:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11972 00000100:00100000:1.0:1651529344.651677:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+767:41279:x1731746396376448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.651680:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651681:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 4/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 767 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651684:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 767 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651687:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1305:39030:x1731745946495104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1532us (1632us total) trans 30064893871 rc 0/0 00010000:00010000:1.0:1651529344.651689:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bfb9224/0xa29a79078f3b9698 lrc: 0/0,0 mode: --/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd83f expref: 767 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651690:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153008 00010000:00010000:1.0:1651529344.651692:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651697:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651700:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651701:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651701:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651704:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 4/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651704:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651706:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651712:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651718:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+766:41279:x1731746396376448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651721:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11972 00000100:00100000:1.0:1651529344.651725:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11973 00000100:00100000:1.0:1651529344.651727:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+765:41279:x1731746396376704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.651729:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651740:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 5/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 765 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651744:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 4/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 765 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651749:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651750:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651753:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 4/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651757:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.651760:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1305:39029:x1731745946495040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1532us (1689us total) trans 30064893872 rc 0/0 00000100:00100000:1.0:1651529344.651762:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+765:41279:x1731746396376704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.651763:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153009 00000100:00100000:1.0:1651529344.651765:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11973 00000100:00100000:1.0:1651529344.651769:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11974 00000100:00100000:1.0:1651529344.651770:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41279:x1731746396376832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.651771:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651773:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651774:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 5/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 764 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651774:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.651775:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651777:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 4/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 764 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651778:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 3/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651781:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651782:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651783:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651783:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 1/0,0 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651785:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 4/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651786:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf40e lrc: 0/0,0 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651789:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.651790:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651793:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41279:x1731746396376832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 22us (282us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.651793:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ae8a38f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.651794:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651795:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11974 00010000:00010000:0.0:1651529344.651797:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 3/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651799:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11975 00000100:00100000:1.0:1651529344.651800:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+763:41279:x1731746396376768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.651800:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 1/0,0 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651820:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.651821:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf415 lrc: 0/0,0 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651822:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 4/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651826:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651827:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651831:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f56368/0xa29a79078f3b8a27 lrc: 0/0,0 mode: --/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1d3 expref: 763 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.651831:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651834:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651834:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651835:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651836:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651836:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651838:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 4/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651852:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651858:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+762:41279:x1731746396376768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651861:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11975 00000100:00100000:1.0:1651529344.651866:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11976 00000100:00100000:1.0:1651529344.651867:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+761:41278:x1731746396376896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.651870:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651871:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 4/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 761 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651875:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 3/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 761 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.651881:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1305:39029:x1731745946495488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1435us total) trans 30064893873 rc 0/0 00000100:00100000:0.0:1651529344.651884:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153010 00010000:00010000:1.0:1651529344.651887:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23270b8/0xa29a79078f3ba6a5 lrc: 0/0,0 mode: --/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19e6 expref: 761 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651890:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651891:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651891:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651892:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651895:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 4/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651895:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651897:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651900:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651903:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651909:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+760:41278:x1731746396376896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651912:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11976 00000100:00100000:1.0:1651529344.651919:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11977 00000100:00100000:1.0:1651529344.651921:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41278:x1731746396376960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.651923:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651925:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 5/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651928:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 4/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.651933:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651934:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651935:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651937:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 4/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651941:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.651942:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1305:39029:x1731745946495552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1189us (1260us total) trans 30064893874 rc 0/0 00000100:00100000:1.0:1651529344.651946:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41278:x1731746396376960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.651947:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153012 00000100:00100000:1.0:1651529344.651948:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11977 00010000:00010000:0.0:1651529344.651953:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651956:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651957:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651959:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f9ca756 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.651960:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651960:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651962:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651963:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 3/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651967:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 1/0,0 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651970:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf41c lrc: 0/0,0 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651974:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651986:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044bb7b14 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.651987:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651990:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 3/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651993:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1305:39030:x1731745946495744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1081us (1127us total) trans 30064893875 rc 0/0 00010000:00010000:1.0:1651529344.651994:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 1/0,0 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651995:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153014 00010000:00010000:1.0:1651529344.651996:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf42a lrc: 0/0,0 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652000:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652002:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b29cda82 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.652003:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652006:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 3/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652006:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3ba532 lrc: 0/0,0 mode: --/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13c6 expref: 758 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.652009:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 1/0,0 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652010:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652014:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652017:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652019:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf438 lrc: 0/0,0 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652022:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652025:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652028:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652030:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dad84b3/0xa29a79078f3bb1e9 lrc: 0/0,0 mode: --/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4647 expref: 757 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.652033:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966667200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652037:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652040:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652043:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652046:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652048:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652061:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1305:39030:x1731745946496000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1031us total) trans 30064893876 rc 0/0 00000100:00100000:0.0:1651529344.652064:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153015 00010000:00010000:0.0:1651529344.652071:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652074:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f8bd8f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.652075:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652078:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 3/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652082:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 1/0,0 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652085:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf43f lrc: 0/0,0 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652089:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8b6fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1305:39030:x1731745946495680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1190us (1242us total) trans 30064893877 rc 0/0 00010000:00010000:0.0:1651529344.652089:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652092:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153013 00010000:00010000:0.0:1651529344.652092:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4df3b46 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.652093:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652096:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 3/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652099:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 1/0,0 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652101:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf431 lrc: 0/0,0 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652104:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ac4c6c/0xa29a79078f3b984a lrc: 0/0,0 mode: --/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf69 expref: 756 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.652108:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652111:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652114:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652117:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652120:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652123:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652202:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1305:39030:x1731745946495616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1520us (1541us total) trans 30064893878 rc 0/0 00000100:00100000:1.0:1651529344.652205:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153011 00010000:00010000:1.0:1651529344.652226:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652230:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f198e1d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.652231:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652234:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 3/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652239:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 1/0,0 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652242:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf423 lrc: 0/0,0 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652432:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.652443:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496320 00000100:00100000:1.0:1651529344.652451:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153016 00000100:00100000:0.0:1651529344.652452:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.652460:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1305:39029:x1731745946496320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.652460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.652466:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177808 count 1 00010000:00010000:1.0:1651529344.652470:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.652475:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 2/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.652477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.652478:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652478:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652479:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 4/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.652486:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 3/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.652490:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496448 00010000:00010000:1.0:1651529344.652492:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.652496:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.652501:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496576 00000100:00100000:0.0:1651529344.652506:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496704 00000100:00100000:0.0:1651529344.652510:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496384 00000100:00100000:1.0:1651529344.652517:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.652523:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496512 00000100:00100000:1.0:1651529344.652528:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496640 00000100:00100000:1.0:1651529344.652531:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153017 00000100:00100000:1.0:1651529344.652533:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.652536:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153018 00002000:00080000:1.0:1651529344.652537:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177810 count 1 00000100:00100000:0.0:1651529344.652538:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.652541:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.652544:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177812 count 1 00010000:00010000:1.0:1651529344.652545:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 2/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652548:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652549:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652549:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 4/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652549:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652554:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 2/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652555:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 3/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652557:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652558:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652558:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 4/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652559:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.652566:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 3/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652569:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 4/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.652574:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652575:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966667456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.652584:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.652586:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.652591:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153019 00000100:00100000:1.0:1651529344.652593:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153020 00000100:00100000:0.0:1651529344.652593:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.652595:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.652597:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177814 count 1 00002000:00080000:1.0:1651529344.652599:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177811 count 1 00010000:00010000:0.0:1651529344.652601:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652603:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652607:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 2/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652610:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652611:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652611:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 4/0,1 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652617:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 3/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652617:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 2/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652620:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652621:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 4/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.652621:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652621:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 4/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652625:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966667584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652629:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 3/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.652631:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652632:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 4/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.652636:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966667648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652637:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153021 00000100:00100000:0.0:1651529344.652644:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.652646:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.652650:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177813 count 1 00000100:00100000:0.0:1651529344.652651:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153022 00000100:00100000:0.0:1651529344.652653:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946496384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.652654:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.652657:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177809 count 1 00010000:00010000:1.0:1651529344.652658:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 2/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652661:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652661:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652661:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652662:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 4/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652665:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 2/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 755 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652668:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652668:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652672:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 4/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.652676:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966667712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652676:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652676:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 4/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652683:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652683:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 3/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 755 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652687:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 4/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 755 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.652691:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966667776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652699:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.652705:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496960 00000100:00100000:0.0:1651529344.652711:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153023 00000100:00100000:0.0:1651529344.652712:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1312:39030:x1731745946496960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.652717:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177815 count 1 00010000:00010000:0.0:1651529344.652720:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652725:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 2/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652728:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652728:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652729:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 4/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652746:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 3/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 755 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652757:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.652761:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966667840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.652769:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.652931:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652936:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652969:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652984:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653003:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966667648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.653004:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966667456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.653006:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653008:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653015:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966667584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.653018:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653068:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966667712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.653070:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653076:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966667776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.653081:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653489:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966667840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.653490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.653499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.653499:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653506:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377472 00000100:00100000:1.0:1651529344.653511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.653512:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 756 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653518:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377600 00010000:00010000:0.0:1651529344.653520:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 757 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653524:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377664 00000100:00100000:1.0:1651529344.653526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.653527:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 4/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 758 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.653532:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377536 00000100:00100000:1.0:1651529344.653533:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377984 00010000:00010000:0.0:1651529344.653534:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 4/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.653538:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377728 00010000:00010000:1.0:1651529344.653539:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 4/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 760 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653540:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 4/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 761 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653545:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378048 00000100:00100000:0.0:1651529344.653545:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377792 00010000:00010000:0.0:1651529344.653547:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 4/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653548:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.653552:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11978 00000100:00100000:0.0:1651529344.653553:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+763:41279:x1731746396377472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.653556:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653558:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653564:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11979 00010000:00010000:0.0:1651529344.653564:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 3/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653565:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+763:41279:x1731746396377600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.653569:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653570:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005562d04c/0xa29a79078f3bbdea lrc: 0/0,0 mode: --/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7492 expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653571:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 763 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653574:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653574:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653575:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 3/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653575:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653578:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 4/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653580:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf9c056/0xa29a79078f3bb06f lrc: 0/0,0 mode: --/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d407b expref: 762 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653584:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653585:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653586:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653589:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.653596:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 4/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653599:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+761:41279:x1731746396377472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.653602:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653602:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11978 00000100:00100000:0.0:1651529344.653608:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11980 00000100:00100000:0.0:1651529344.653609:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+760:41279:x1731746396377664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.653610:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+760:41279:x1731746396377600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.653612:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.653613:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11979 00010000:00010000:0.0:1651529344.653614:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 4/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 760 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653617:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 3/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653618:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11981 00000100:00100000:1.0:1651529344.653620:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41278:x1731746396377536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.653622:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fffe47fb/0xa29a79078f3bb6b9 lrc: 0/0,0 mode: --/PR res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5917 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653623:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.653624:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 4/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 759 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653626:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653627:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653627:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653628:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 3/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 758 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653630:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 4/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653633:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f327ff6/0xa29a79078f3bbeb5 lrc: 0/0,0 mode: --/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77e1 expref: 758 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653639:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.653643:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653644:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.653644:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+757:41279:x1731746396377664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.653645:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653647:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11980 00010000:00010000:1.0:1651529344.653648:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 4/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653652:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11982 00000100:00100000:0.0:1651529344.653653:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+756:41279:x1731746396377984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.653656:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.653663:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+756:41278:x1731746396377536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.653663:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653664:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 4/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 756 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653666:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11981 00010000:00010000:0.0:1651529344.653668:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 3/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 755 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653670:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11983 00000100:00100000:1.0:1651529344.653672:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+755:41278:x1731746396377728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.653673:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db97b9e/0xa29a79078f3b94e6 lrc: 0/0,0 mode: --/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0e4 expref: 755 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653674:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.653676:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 4/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653679:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653680:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653681:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653683:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 4/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653687:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 3/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 754 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653689:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.653692:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df07a81/0xa29a79078f3bb109 lrc: 0/0,0 mode: --/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b9 expref: 754 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.653694:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+754:41279:x1731746396377984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.653695:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653696:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653697:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653697:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11982 00010000:00010000:1.0:1651529344.653700:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 4/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653702:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11984 00000100:00100000:0.0:1651529344.653703:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+752:41278:x1731746396377792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.653706:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.653708:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.653713:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 4/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 752 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653714:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+752:41278:x1731746396377728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653717:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11983 00010000:00010000:0.0:1651529344.653717:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 752 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653722:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add2dbd0/0xa29a79078f3bb2ec lrc: 0/0,0 mode: --/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4af4 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.653725:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11985 00010000:00010000:0.0:1651529344.653725:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653726:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.653727:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+750:41278:x1731746396378048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.653727:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653730:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653738:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 4/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653740:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653744:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 3/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.653747:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653753:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+750:41278:x1731746396377792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.653756:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11984 00010000:00010000:1.0:1651529344.653757:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030034d60/0xa29a79078f3b9a50 lrc: 0/0,0 mode: --/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce718 expref: 750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.653760:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653761:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653762:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653764:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653765:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 4/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653767:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653770:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653774:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.653779:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653780:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+748:41278:x1731746396378048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653783:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11985 00010000:00010000:1.0:1651529344.653790:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653793:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653796:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653799:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653843:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1377us total) trans 30064893879 rc 0/0 00000100:00100000:0.0:1651529344.653847:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153019 00010000:00010000:0.0:1651529344.653855:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653861:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000817e8576 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.653862:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653865:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 3/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653869:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 1/0,0 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653872:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf45b lrc: 0/0,0 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653873:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1339us (1420us total) trans 30064893880 rc 0/0 00000100:00100000:1.0:1651529344.653876:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153017 00010000:00010000:0.0:1651529344.653877:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653879:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000403b01ba already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.653880:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653883:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 3/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653884:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653886:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 1/0,0 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653888:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653891:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653891:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf44d lrc: 0/0,0 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653894:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653896:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653899:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653902:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653905:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653926:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1314:39029:x1731745946496512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1331us (1449us total) trans 30064893881 rc 0/0 00000100:00100000:1.0:1651529344.653929:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153020 00010000:00010000:1.0:1651529344.653936:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653939:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653942:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653945:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1291us (1474us total) trans 30064893882 rc 0/0 00010000:00010000:1.0:1651529344.653947:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653948:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153022 00010000:00010000:0.0:1651529344.653956:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653959:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653962:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653967:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653977:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1331us (1493us total) trans 30064893883 rc 0/0 00000100:00100000:1.0:1651529344.653980:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153021 00010000:00010000:1.0:1651529344.653987:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653990:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8ccde44 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.653991:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653994:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 3/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653998:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1313:39030:x1731745946496960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1301us total) trans 30064893884 rc 0/0 00010000:00010000:1.0:1651529344.653999:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 1/0,0 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654001:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153023 00010000:00010000:1.0:1651529344.654002:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf462 lrc: 0/0,0 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654006:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654008:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654009:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001acf1de1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.654010:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654011:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654013:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 3/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654014:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654016:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 1/0,0 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654017:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654019:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf470 lrc: 0/0,0 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654022:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654025:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c53ee2cd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.654026:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654028:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 3/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654031:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 1/0,0 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654034:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf469 lrc: 0/0,0 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654040:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654042:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.654043:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654044:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1505us (1584us total) trans 30064893885 rc 0/0 00010000:00010000:1.0:1651529344.654046:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 3/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654047:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153018 00010000:00010000:1.0:1651529344.654049:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 1/0,0 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654051:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf477 lrc: 0/0,0 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654053:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654056:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f57d720 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.654057:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654058:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654060:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 3/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654061:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654064:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654065:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 1/0,0 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654066:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654067:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf454 lrc: 0/0,0 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654120:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1313:39029:x1731745946496320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1659us (1697us total) trans 30064893886 rc 0/0 00000100:00100000:1.0:1651529344.654135:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153016 00010000:00010000:1.0:1651529344.654143:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654171:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c4ba74c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.654172:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654175:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 3/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654180:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 1/0,0 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654183:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf446 lrc: 0/0,0 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654490:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497664 00000100:00100000:0.0:1651529344.654497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654501:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497600 00000100:00100000:1.0:1651529344.654514:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497728 00000100:00100000:0.0:1651529344.654516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654525:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497984 00000100:00100000:0.0:1651529344.654527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654537:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498112 00000100:00100000:1.0:1651529344.654543:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153024 00000100:00100000:1.0:1651529344.654545:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1317:39030:x1731745946497664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.654546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.654552:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177817 count 1 00000100:00100000:0.0:1651529344.654553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.654556:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.654561:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 2/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654564:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654565:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654566:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 4/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654566:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497920 00000100:00100000:0.0:1651529344.654572:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498048 00010000:00010000:1.0:1651529344.654573:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 3/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.654574:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498176 00010000:00010000:1.0:1651529344.654576:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.654577:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153025 00000100:00100000:0.0:1651529344.654579:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946497600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.654581:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667904:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.654584:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177816 count 1 00010000:00010000:0.0:1651529344.654589:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654593:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.654594:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 2/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654597:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654598:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654598:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 4/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654599:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153026 00000100:00100000:1.0:1651529344.654601:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946497728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.654605:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177818 count 1 00010000:00010000:0.0:1651529344.654606:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 3/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654608:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654609:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.654613:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 2/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.654614:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.654623:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.654624:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654625:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654626:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 4/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654630:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153027 00000100:00100000:0.0:1651529344.654632:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946497984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.654633:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 3/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.654636:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177820 count 1 00010000:00010000:1.0:1651529344.654637:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.654639:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654641:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966668032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654643:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 2/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654647:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654647:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.654648:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.654648:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 4/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654655:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153028 00010000:00010000:0.0:1651529344.654656:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 3/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.654657:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946498112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.654660:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 4/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:1.0:1651529344.654661:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177822 count 1 00010000:00010000:1.0:1651529344.654664:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654664:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.654668:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 2/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 747 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654671:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.654671:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.654672:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654672:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 4/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654677:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153029 00000100:00100000:0.0:1651529344.654678:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946497920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.654682:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177819 count 1 00010000:00010000:0.0:1651529344.654685:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654689:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 3/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 747 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654689:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 2/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654692:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654692:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654693:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 747 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.654693:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 4/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654697:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966668160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654699:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 3/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654703:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 4/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.654704:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.654707:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966668224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.654710:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153030 00000100:00100000:1.0:1651529344.654712:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946498048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.654713:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.654716:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177821 count 1 00000100:00100000:0.0:1651529344.654718:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153031 00010000:00010000:1.0:1651529344.654719:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654720:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946498176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.654724:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 2/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 747 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.654724:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177823 count 1 00010000:00010000:1.0:1651529344.654727:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654727:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654727:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654728:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 4/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654742:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 2/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654744:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 3/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 747 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654746:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654746:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654747:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 747 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.654747:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 4/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654754:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 747 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654757:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.654758:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966668288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.654761:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966668352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.654766:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.654768:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.655029:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966667904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655034:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655109:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966667968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.655114:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655439:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966668032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655444:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655457:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966668160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655470:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655478:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966668288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.655485:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.655486:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.655501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655504:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378816 00000100:00100000:0.0:1651529344.655509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.655510:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 748 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.655514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655516:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378944 00010000:00010000:1.0:1651529344.655518:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 749 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.655518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655522:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379072 00010000:00010000:1.0:1651529344.655524:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 750 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.655524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655529:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379200 00010000:00010000:1.0:1651529344.655530:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 5/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.655532:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.655534:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379328 00010000:00010000:1.0:1651529344.655536:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 752 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655536:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655540:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379264 00010000:00010000:1.0:1651529344.655542:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 5/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 753 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.655544:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966668224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.655546:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379392 00010000:00010000:0.0:1651529344.655546:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655548:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 754 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.655552:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379456 00000100:00100000:0.0:1651529344.655552:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966668352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655554:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655555:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655558:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11986 00000100:00100000:1.0:1651529344.655559:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+755:41278:x1731746396378816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.655562:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11987 00000100:00100000:0.0:1651529344.655564:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+755:41278:x1731746396378944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.655568:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655570:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655571:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655572:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655573:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 3/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655576:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 3/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655579:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058046b5a/0xa29a79078f3bb133 lrc: 0/0,0 mode: --/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d434c expref: 755 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655582:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3ba2b5 lrc: 0/0,0 mode: --/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0915 expref: 754 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655583:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655584:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655585:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655586:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655587:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655588:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655588:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 4/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655591:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 4/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655594:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.655598:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655606:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+753:41278:x1731746396378944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655608:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11987 00000100:00100000:1.0:1651529344.655612:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+752:41278:x1731746396378816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655615:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11988 00000100:00100000:1.0:1651529344.655617:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11986 00000100:00100000:0.0:1651529344.655617:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+752:41278:x1731746396379072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.655620:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655621:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.655622:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11989 00000100:00100000:1.0:1651529344.655624:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+751:41278:x1731746396379200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.655627:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655628:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 4/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655628:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 3/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655633:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fec7100/0xa29a79078f3bb53f lrc: 0/0,0 mode: --/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5416 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655635:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 3/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 751 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655636:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655636:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655637:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655640:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c89fac4a/0xa29a79078f3bb0d1 lrc: 0/0,0 mode: --/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41d2 expref: 750 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655640:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 4/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655643:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655643:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655644:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655648:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.655653:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 4/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655654:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+749:41278:x1731746396379072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655656:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11988 00010000:00010000:1.0:1651529344.655663:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655667:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11990 00000100:00100000:1.0:1651529344.655669:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+748:41278:x1731746396379200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655669:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+748:41278:x1731746396379328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.655672:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11989 00010000:00010000:0.0:1651529344.655672:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655674:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 748 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.655677:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11991 00010000:00010000:0.0:1651529344.655677:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 3/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 747 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.655678:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+747:41279:x1731746396379264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.655681:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655682:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 4/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 747 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655683:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db7d8b9/0xa29a79078f3b96f3 lrc: 0/0,0 mode: --/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd965 expref: 747 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655686:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 3/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655686:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655687:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655688:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655690:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 4/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655691:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085471f7a/0xa29a79078f3bbbb3 lrc: 0/0,0 mode: --/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c96 expref: 746 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655695:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655695:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655696:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655699:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655704:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+745:41278:x1731746396379328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.655705:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 4/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655707:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11990 00010000:00010000:1.0:1651529344.655714:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.655720:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+744:41279:x1731746396379264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655722:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11992 00000100:00100000:1.0:1651529344.655723:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11991 00000100:00100000:0.0:1651529344.655723:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+744:41278:x1731746396379392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.655726:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.655728:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11993 00010000:00010000:0.0:1651529344.655728:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 743 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.655729:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+743:41279:x1731746396379456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.655740:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655741:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 3/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 743 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655742:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 743 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655746:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 743 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655747:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3b97da lrc: 0/0,0 mode: --/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd86 expref: 743 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.655751:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e930999/0xa29a79078f3bb0df lrc: 0/0,0 mode: --/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4211 expref: 743 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.655753:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655754:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655754:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655757:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655757:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655757:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 4/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655758:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655761:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 4/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655765:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655772:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+741:41278:x1731746396379392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.655776:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655781:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11992 00000100:00100000:1.0:1651529344.655782:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+741:41279:x1731746396379456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.655785:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11993 00010000:00010000:0.0:1651529344.655787:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655791:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655792:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655794:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655795:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655797:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655799:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655801:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655863:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946497600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1373us total) trans 30064893887 rc 0/0 00000100:00100000:1.0:1651529344.655866:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946498112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1339us total) trans 30064893888 rc 0/0 00000100:00100000:0.0:1651529344.655866:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153025 00000100:00100000:1.0:1651529344.655869:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153028 00010000:00010000:0.0:1651529344.655874:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655877:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.655878:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655881:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 3/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655886:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655886:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 1/0,0 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655888:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf485 lrc: 0/0,0 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655889:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1872a21 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.655890:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655893:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 3/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655894:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655897:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655898:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 1/0,0 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655901:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1872a21/0xa29a79078f3bf49a lrc: 0/0,0 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655901:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655903:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655907:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655910:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655919:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655922:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655952:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946498176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1231us (1391us total) trans 30064893889 rc 0/0 00000100:00100000:0.0:1651529344.655955:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153031 00010000:00010000:0.0:1651529344.655962:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655964:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946498048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1252us (1411us total) trans 30064893890 rc 0/0 00010000:00010000:0.0:1651529344.655965:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655968:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153030 00010000:00010000:0.0:1651529344.655968:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655971:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655984:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655988:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.655989:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655992:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 3/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655996:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 1/0,0 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655999:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf4af lrc: 0/0,0 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656003:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656006:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a59a7b3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.656007:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656009:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946497920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1330us (1468us total) trans 30064893891 rc 0/0 00010000:00010000:1.0:1651529344.656010:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 3/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656012:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153029 00010000:00010000:1.0:1651529344.656015:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 1/0,0 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656018:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a59a7b3/0xa29a79078f3bf4a8 lrc: 0/0,0 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656019:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656021:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656022:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656024:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.656025:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656026:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656027:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 3/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656028:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656030:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 1/0,0 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656033:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf4a1 lrc: 0/0,0 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656036:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656039:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.656047:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656050:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 3/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656054:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 1/0,0 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656056:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf493 lrc: 0/0,0 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656059:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946497984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1427us (1543us total) trans 30064893892 rc 0/0 00010000:00010000:1.0:1651529344.656062:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656062:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153027 00010000:00010000:1.0:1651529344.656065:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656068:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656071:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656114:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946497728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1512us (1616us total) trans 30064893893 rc 0/0 00000100:00100000:1.0:1651529344.656129:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153026 00010000:00010000:1.0:1651529344.656154:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656168:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051bb957c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.656169:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656172:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 3/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656177:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 1/0,0 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656180:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bb957c/0xa29a79078f3bf48c lrc: 0/0,0 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656188:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656191:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656194:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656197:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656216:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050bec487 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.656222:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656225:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 3/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656241:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 1/0,0 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656246:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1321:39030:x1731745946497664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1699us (1769us total) trans 30064893894 rc 0/0 00000100:00100000:1.0:1651529344.656249:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153024 00010000:00010000:0.0:1651529344.656250:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050bec487/0xa29a79078f3bf47e lrc: 0/0,0 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.656355:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498880 00000100:00100000:1.0:1651529344.656364:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153032 00000100:00100000:1.0:1651529344.656366:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946498880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.656370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.656378:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177824 count 1 00000100:00100000:0.0:1651529344.656378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.656383:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.656393:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 2/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 739 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.656393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.656396:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656397:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656398:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 4/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.656407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.656409:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 3/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 739 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656414:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 739 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.656414:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498944 00000100:00100000:1.0:1651529344.656418:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966668416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.656429:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.656435:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499008 00000100:00100000:0.0:1651529344.656435:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499072 00000100:00100000:0.0:1651529344.656440:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499136 00000100:00100000:1.0:1651529344.656447:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499200 00000100:00100000:1.0:1651529344.656450:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499264 00000100:00100000:0.0:1651529344.656452:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153033 00000100:00100000:0.0:1651529344.656454:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1327:39030:x1731745946498944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.656455:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153034 00000100:00100000:1.0:1651529344.656457:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1327:39030:x1731745946499072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.656460:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177825 count 1 00002000:00080000:1.0:1651529344.656461:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177827 count 1 00010000:00010000:0.0:1651529344.656464:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656465:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656470:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 2/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656470:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 2/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656473:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656473:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656473:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656474:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656474:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 4/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656474:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 4/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656480:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 3/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656481:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 3/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656484:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 4/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 739 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.656485:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 739 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.656488:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966668480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656489:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.656495:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656499:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.656502:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153035 00000100:00100000:1.0:1651529344.656503:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1327:39029:x1731745946499008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.656506:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153036 00002000:00080000:1.0:1651529344.656507:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177826 count 1 00000100:00100000:0.0:1651529344.656507:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1327:39029:x1731745946499136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.656511:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.656513:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177828 count 1 00010000:00010000:0.0:1651529344.656516:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656517:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 2/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656520:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656520:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 2/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 739 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656521:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656521:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 4/0,1 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656523:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656524:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656524:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 4/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656527:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 3/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656530:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 3/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 739 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656531:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 4/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 739 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.656534:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 739 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.656535:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966668608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656538:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966668672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.656540:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656544:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.656546:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153037 00000100:00100000:1.0:1651529344.656548:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1327:39030:x1731745946499200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.656550:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153038 00002000:00080000:1.0:1651529344.656552:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177829 count 1 00000100:00100000:0.0:1651529344.656552:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1327:39029:x1731745946499264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.656555:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.656556:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177830 count 1 00010000:00010000:1.0:1651529344.656559:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 2/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656559:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656562:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656563:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 2/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656566:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656567:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656567:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 4/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656570:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656571:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 4/0,1 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656573:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 3/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656576:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 4/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 739 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.656579:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 3/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 739 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.656580:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966668736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656583:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 4/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 739 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.656586:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966668800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656586:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.656594:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.656607:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499328 00000100:00100000:0.0:1651529344.656614:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153039 00000100:00100000:0.0:1651529344.656615:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1328:39030:x1731745946499328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.656620:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177831 count 1 00010000:00010000:0.0:1651529344.656623:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656628:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 2/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 739 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656631:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656631:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656632:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 4/0,1 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656639:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 3/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 739 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656642:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 4/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 739 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.656647:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966668864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656653:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.657185:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966668480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657190:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657221:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966668416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657225:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657228:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.657234:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380096 00010000:00010000:1.0:1651529344.657238:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 740 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.657262:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380032 00010000:00010000:1.0:1651529344.657265:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 4/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 741 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657288:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11994 00000100:00100000:1.0:1651529344.657289:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+741:41278:x1731746396380096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.657297:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657298:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 741 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.657302:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 3/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 741 pid: 127525 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657308:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a9a6cd/0xa29a79078f3b9086 lrc: 0/0,0 mode: --/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc522 expref: 741 pid: 127525 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.657312:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657313:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.657313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.657314:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657317:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 4/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.657322:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.657323:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.657327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.657332:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41278:x1731746396380096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.657334:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11994 00000100:00100000:1.0:1651529344.657339:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380224 00010000:00010000:1.0:1651529344.657342:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 5/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 740 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657347:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380160 00000100:00100000:0.0:1651529344.657354:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657358:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657359:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 741 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657364:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380288 00010000:00010000:1.0:1651529344.657366:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 742 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657366:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966668672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657368:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657370:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380352 00010000:00010000:1.0:1651529344.657372:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 5/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 743 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657376:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380416 00010000:00010000:1.0:1651529344.657378:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 5/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 744 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657378:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966668736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657380:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657382:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380480 00010000:00010000:1.0:1651529344.657384:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 5/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657387:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11995 00000100:00100000:0.0:1651529344.657389:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+745:41279:x1731746396380032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.657390:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11996 00000100:00100000:1.0:1651529344.657391:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+745:41278:x1731746396380224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.657392:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657394:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.657394:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 4/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657395:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 5/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657398:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 3/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657402:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 4/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657404:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9fa14cb/0xa29a79078f3bb833 lrc: 0/0,0 mode: --/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f1b expref: 745 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657407:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657407:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657408:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657408:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657408:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657409:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657411:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 4/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657412:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 4/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657415:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.657422:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.657433:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+744:41278:x1731746396380224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.657436:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11996 00000100:00100000:0.0:1651529344.657438:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+743:41279:x1731746396380032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.657440:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11997 00000100:00100000:1.0:1651529344.657442:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+743:41278:x1731746396380160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.657442:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11995 00010000:00010000:1.0:1651529344.657445:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657446:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 742 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657448:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11998 00010000:00010000:1.0:1651529344.657450:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 3/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 742 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657450:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+742:41278:x1731746396380288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.657453:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.657454:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 742 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657455:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6fd144c/0xa29a79078f3ba150 lrc: 0/0,0 mode: --/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0326 expref: 742 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657458:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 3/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 742 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657463:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f44dd75b/0xa29a79078f3b9628 lrc: 0/0,0 mode: --/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6e1 expref: 742 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657467:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657467:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657468:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657468:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657468:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657469:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657471:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 4/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657472:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 4/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657477:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.657480:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.657487:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41278:x1731746396380160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657489:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41278:x1731746396380288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.657490:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11997 00000100:00100000:0.0:1651529344.657492:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11998 00000100:00100000:1.0:1651529344.657498:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11999 00000100:00100000:1.0:1651529344.657500:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+738:41278:x1731746396380352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.657500:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12000 00000100:00100000:0.0:1651529344.657502:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+738:41279:x1731746396380416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.657503:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657504:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 4/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 738 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657504:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.657506:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 5/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 738 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657508:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 3/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 738 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657510:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 4/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 738 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657513:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb02ad1/0xa29a79078f3bab75 lrc: 0/0,0 mode: --/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ca1 expref: 738 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657515:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657515:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657516:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657516:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657517:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657518:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657519:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 4/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657521:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 4/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657523:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.657529:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.657534:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+737:41278:x1731746396380352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657534:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+737:41279:x1731746396380416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657537:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12000 00000100:00100000:1.0:1651529344.657538:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11999 00000100:00100000:0.0:1651529344.657541:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12001 00000100:00100000:0.0:1651529344.657543:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+735:41279:x1731746396380480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.657546:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.657547:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 5/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.657550:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029cc2a83/0xa29a79078f3ba857 lrc: 0/0,0 mode: --/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20a7 expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.657553:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 4/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657554:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966668608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657558:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657558:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657558:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657559:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657561:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657562:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 4/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657564:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657566:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.657567:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657569:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657572:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41279:x1731746396380480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657574:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12001 00010000:00010000:0.0:1651529344.657583:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083176a72/0xa29a79078f3b78a0 lrc: 0/0,0 mode: --/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb809 expref: 733 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.657587:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966668864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657590:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657593:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657596:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657600:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657602:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657609:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1329:39029:x1731745946499008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1104us (1230us total) trans 30064893895 rc 0/0 00000100:00100000:1.0:1651529344.657620:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153035 00010000:00010000:1.0:1651529344.657627:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657631:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c4df3b46 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657632:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657635:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 3/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657639:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 1/0,0 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657642:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4df3b46/0xa29a79078f3bf4cb lrc: 0/0,0 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657646:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657649:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657650:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657650:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946499328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1033us (1048us total) trans 30064893896 rc 0/0 00000100:00100000:0.0:1651529344.657653:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153039 00010000:00010000:1.0:1651529344.657655:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 3/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657658:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 1/0,0 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657660:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657661:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf4e7 lrc: 0/0,0 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657664:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657667:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657670:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657671:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fc2865/0xa29a79078f3bb975 lrc: 0/0,0 mode: --/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63eb expref: 732 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.657674:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966668800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657678:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657680:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657683:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657686:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657689:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657701:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1329:39029:x1731745946499264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1293us total) trans 30064893897 rc 0/0 00000100:00100000:0.0:1651529344.657704:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153038 00010000:00010000:0.0:1651529344.657710:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657716:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.657717:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657720:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 3/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657724:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 1/0,0 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657726:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946499200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1178us (1327us total) trans 30064893898 rc 0/0 00010000:00010000:0.0:1651529344.657727:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf4e0 lrc: 0/0,0 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657730:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153037 00010000:00010000:0.0:1651529344.657742:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657745:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be36d90 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.657746:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657748:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 3/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657750:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657752:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 1/0,0 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657754:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657757:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657757:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be36d90/0xa29a79078f3bf4d9 lrc: 0/0,0 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657760:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657763:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657765:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657769:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657771:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657819:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1330:39030:x1731745946499072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1345us (1419us total) trans 30064893899 rc 0/0 00000100:00100000:1.0:1651529344.657823:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153034 00000100:00100000:0.0:1651529344.657828:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1329:39029:x1731745946499136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1435us total) trans 30064893900 rc 0/0 00010000:00010000:1.0:1651529344.657830:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657832:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153036 00010000:00010000:1.0:1651529344.657833:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9087fb6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657834:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657837:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 3/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657839:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657842:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 1/0,0 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657842:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657845:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9087fb6/0xa29a79078f3bf4c4 lrc: 0/0,0 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657845:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657849:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657850:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657851:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657852:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657855:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 3/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657858:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 1/0,0 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657861:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf4d2 lrc: 0/0,0 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657864:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657867:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657868:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657871:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 3/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657874:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 1/0,0 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657877:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf4bd lrc: 0/0,0 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657882:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657884:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946498944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1429us (1514us total) trans 30064893901 rc 0/0 00010000:00010000:1.0:1651529344.657885:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657887:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153033 00010000:00010000:1.0:1651529344.657888:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657890:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657933:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1329:39029:x1731745946498880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1560us (1587us total) trans 30064893902 rc 0/0 00000100:00100000:1.0:1651529344.657936:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153032 00010000:00010000:1.0:1651529344.657957:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657961:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f198e1d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.657962:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657965:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 3/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657985:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 1/0,0 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657993:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f198e1d/0xa29a79078f3bf4b6 lrc: 0/0,0 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.658175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.658183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.658186:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500032 00000100:00100000:0.0:1651529344.658190:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.658200:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499968 00000100:00100000:1.0:1651529344.658202:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500096 00000100:00100000:1.0:1651529344.658209:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500160 00000100:00100000:1.0:1651529344.658214:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153040 00000100:00100000:1.0:1651529344.658216:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1332:39029:x1731745946500032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.658221:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177833 count 1 00010000:00010000:1.0:1651529344.658225:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658230:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 2/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.658240:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153041 00000100:00100000:0.0:1651529344.658242:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d97b23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1332:39030:x1731745946500096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.658247:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658248:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658248:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 4/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.658248:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177834 count 1 00010000:00010000:0.0:1651529344.658252:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658256:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 3/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658257:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 2/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.658260:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.658261:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658261:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658262:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 4/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658265:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966668928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658269:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658274:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658280:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.658285:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.658287:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153042 00000100:00100000:1.0:1651529344.658289:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1332:39030:x1731745946499968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.658293:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177832 count 1 00000100:00100000:0.0:1651529344.658295:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.658297:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658302:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 2/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.658302:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153043 00000100:00100000:0.0:1651529344.658303:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1332:39029:x1731745946500160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.658305:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658305:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658306:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 4/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.658308:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177835 count 1 00010000:00010000:0.0:1651529344.658311:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658312:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 3/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658316:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 2/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 731 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.658318:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.658319:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658319:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658320:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 4/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658322:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966669056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658326:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 3/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 731 pid: 142993 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.658329:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.658330:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 731 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.658337:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966669120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.658344:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.658345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.658349:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500224 00000100:00100000:0.0:1651529344.658361:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153044 00000100:00100000:0.0:1651529344.658363:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1333:39030:x1731745946500224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.658366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.658367:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177836 count 1 00010000:00010000:0.0:1651529344.658377:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658381:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.658382:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 2/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658390:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658390:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658391:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 4/0,1 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.658402:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 3/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658406:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 4/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.658410:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966669184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.658422:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.658428:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500352 00000100:00100000:1.0:1651529344.658431:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500288 00000100:00100000:0.0:1651529344.658433:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500416 00000100:00100000:0.0:1651529344.658436:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153045 00000100:00100000:0.0:1651529344.658438:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1336:39030:x1731745946500352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.658440:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153046 00000100:00100000:1.0:1651529344.658442:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1336:39029:x1731745946500416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.658442:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177838 count 1 00010000:00010000:0.0:1651529344.658446:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.658447:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177839 count 1 00010000:00010000:1.0:1651529344.658451:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658451:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 2/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658454:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658454:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658455:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 2/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658455:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 4/0,1 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658458:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658459:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658460:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 4/0,1 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658461:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 3/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.658464:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 4/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.658466:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 3/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.658473:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 4/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658477:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966669312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.658485:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.658485:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966669248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.658491:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153047 00000100:00100000:1.0:1651529344.658493:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1336:39029:x1731745946500288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.658494:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.658496:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177837 count 1 00010000:00010000:1.0:1651529344.658500:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658504:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 2/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.658507:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658507:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658508:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 4/0,1 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658513:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 3/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 731 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.658517:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 4/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658524:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966669376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.658545:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.658782:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966669056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.658786:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658794:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966668928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.658796:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658800:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966668992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658827:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658839:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966669120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658842:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.658885:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381120 00000100:00100000:0.0:1651529344.658892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.658900:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 732 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658911:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381248 00010000:00010000:1.0:1651529344.658914:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 733 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658918:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381184 00010000:00010000:1.0:1651529344.658920:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 734 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658924:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381312 00010000:00010000:1.0:1651529344.658926:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 735 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658933:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12002 00000100:00100000:0.0:1651529344.658945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.658946:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+735:41278:x1731746396381120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.658949:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.658950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.658951:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.658955:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 3/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.658955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.658960:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3dcbc2/0xa29a79078f3bb2a6 lrc: 0/0,0 mode: --/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48af expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.658962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.658964:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658965:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658966:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658968:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381376 00010000:00010000:1.0:1651529344.658969:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 4/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658973:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 5/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 735 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.658975:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.658979:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381440 00010000:00010000:0.0:1651529344.658981:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 5/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 736 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658984:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+736:41278:x1731746396381120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.658985:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381568 00000100:00100000:1.0:1651529344.658986:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12002 00010000:00010000:0.0:1651529344.658987:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 5/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 737 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.658991:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381504 00000100:00100000:0.0:1651529344.658992:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12003 00000100:00100000:0.0:1651529344.658994:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+736:41278:x1731746396381248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.658997:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.658998:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 736 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659002:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 3/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 737 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.659005:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 5/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 737 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659008:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f5e8f0/0xa29a79078f3baae2 lrc: 0/0,0 mode: --/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a94 expref: 737 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659011:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12004 00000100:00100000:1.0:1651529344.659012:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+736:41278:x1731746396381184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.659012:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659012:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659013:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659015:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.659016:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 736 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659016:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 4/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659020:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 736 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659026:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.659031:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a687bc/0xa29a79078f3bab2f lrc: 0/0,0 mode: --/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bb3 expref: 736 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.659034:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+736:41278:x1731746396381248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.659035:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659036:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659037:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12003 00010000:00010000:1.0:1651529344.659039:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 4/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659042:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12005 00000100:00100000:0.0:1651529344.659043:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41278:x1731746396381312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.659046:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.659048:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.659055:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41278:x1731746396381184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.659055:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 734 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659058:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12004 00010000:00010000:0.0:1651529344.659061:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 3/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 733 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659066:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae72cea/0xa29a79078f3b7e88 lrc: 0/0,0 mode: --/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc00 expref: 733 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659067:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12006 00000100:00100000:1.0:1651529344.659069:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+733:41278:x1731746396381376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.659070:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659070:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659071:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.659071:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659073:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 5/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 732 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659074:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 4/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659076:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 4/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 732 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659079:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.659081:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659082:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659083:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659085:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+732:41278:x1731746396381312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.659086:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 4/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659088:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12005 00010000:00010000:1.0:1651529344.659090:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.659092:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12007 00000100:00100000:1.0:1651529344.659094:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41278:x1731746396381376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.659094:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41279:x1731746396381440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.659096:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.659097:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12006 00010000:00010000:0.0:1651529344.659098:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 5/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 731 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659101:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12008 00010000:00010000:0.0:1651529344.659101:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 4/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 730 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659102:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+730:41279:x1731746396381568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.659105:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.659106:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 5/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 730 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659106:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659107:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659107:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659110:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 4/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 730 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659110:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 4/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659114:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.659115:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659115:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659116:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659119:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 4/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659119:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+730:41279:x1731746396381440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.659121:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12007 00010000:00010000:1.0:1651529344.659122:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.659125:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12009 00000100:00100000:0.0:1651529344.659126:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41278:x1731746396381504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.659127:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41279:x1731746396381568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.659129:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12008 00010000:00010000:0.0:1651529344.659129:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.659130:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 5/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659134:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 4/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 728 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.659136:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659138:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659138:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659139:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659140:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659143:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659144:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 4/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659145:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659148:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.659152:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+728:41278:x1731746396381504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.659155:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12009 00010000:00010000:0.0:1651529344.659164:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000311a154d/0xa29a79078f3bc0b4 lrc: 0/0,0 mode: --/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fc1 expref: 727 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.659168:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966669184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659171:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659175:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659177:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659180:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659183:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659190:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1337:39030:x1731745946499968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 900us (1014us total) trans 30064893903 rc 0/0 00000100:00100000:1.0:1651529344.659193:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153042 00010000:00010000:1.0:1651529344.659201:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659204:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c53ee2cd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.659206:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659208:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 3/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659213:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 1/0,0 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659216:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53ee2cd/0xa29a79078f3bf4fc lrc: 0/0,0 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659220:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659223:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.659223:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659226:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 3/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659229:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 1/0,0 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659234:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf50a lrc: 0/0,0 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659237:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1337:39030:x1731745946500224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 872us (891us total) trans 30064893904 rc 0/0 00000100:00100000:0.0:1651529344.659240:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153044 00010000:00010000:1.0:1651529344.659244:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f35a9a6/0xa29a79078f3b9f97 lrc: 0/0,0 mode: --/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc65 expref: 726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659247:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966669376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.659251:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659251:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3b99a1 lrc: 0/0,0 mode: --/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce471 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.659254:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659255:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966669248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.659257:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659259:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659260:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659262:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659262:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659265:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659268:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659270:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659307:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1338:39029:x1731745946500288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 813us (926us total) trans 30064893905 rc 0/0 00000100:00100000:1.0:1651529344.659310:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153047 00000100:00100000:0.0:1651529344.659312:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1338:39030:x1731745946500352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 873us (946us total) trans 30064893906 rc 0/0 00000100:00100000:0.0:1651529344.659315:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153045 00010000:00010000:1.0:1651529344.659317:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659321:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000403b01ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.659322:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659323:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659324:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 3/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659326:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659329:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 1/0,0 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659329:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659332:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403b01ba/0xa29a79078f3bf51f lrc: 0/0,0 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659332:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659336:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659338:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f57d720 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.659339:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659342:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 3/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659345:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 1/0,0 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659350:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3bf511 lrc: 0/0,0 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659354:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659356:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.659357:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659359:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 3/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659361:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1337:39029:x1731745946500160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1056us (1170us total) trans 30064893907 rc 0/0 00010000:00010000:1.0:1651529344.659362:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 1/0,0 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659363:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153043 00010000:00010000:1.0:1651529344.659365:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf503 lrc: 0/0,0 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659371:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659374:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659375:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e3869ba/0xa29a79078f3bc2a5 lrc: 0/0,0 mode: --/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87fc expref: 724 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659377:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659378:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966669312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659380:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659381:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659394:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659397:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659400:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659403:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659422:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d97b23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1337:39030:x1731745946500096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1180us (1238us total) trans 30064893908 rc 0/0 00000100:00100000:0.0:1651529344.659426:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153041 00010000:00010000:0.0:1651529344.659432:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659436:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.659437:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659440:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 3/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659442:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1337:39029:x1731745946500416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1048us total) trans 30064893909 rc 0/0 00010000:00010000:0.0:1651529344.659444:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 1/0,0 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659445:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153046 00010000:00010000:0.0:1651529344.659447:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf4f5 lrc: 0/0,0 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659451:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659454:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659454:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8ccde44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.659455:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659457:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 3/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659458:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659461:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659463:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 2/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659463:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 1/0,0 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659466:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ccde44/0xa29a79078f3bf518 lrc: 0/0,0 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659469:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659472:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c4ba74c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.659473:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 2/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659475:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 3/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659479:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 1/0,0 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659481:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c4ba74c/0xa29a79078f3bf4ee lrc: 0/0,0 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659498:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1337:39029:x1731745946500032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1281us (1334us total) trans 30064893910 rc 0/0 00000100:00100000:1.0:1651529344.659501:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153040 00000100:00100000:0.0:1651529344.659711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659743:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500992 00000100:00100000:0.0:1651529344.659743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659764:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501120 00000100:00100000:1.0:1651529344.659771:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153048 00000100:00100000:1.0:1651529344.659773:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1338:39030:x1731745946500992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.659773:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501056 00002000:00080000:1.0:1651529344.659778:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177840 count 1 00000100:00100000:0.0:1651529344.659784:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153049 00000100:00100000:0.0:1651529344.659786:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1339:39030:x1731745946501120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.659788:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.659792:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177842 count 1 00010000:00010000:1.0:1651529344.659793:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 2/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659796:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659797:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659797:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659798:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 4/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659802:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 2/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 723 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659820:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 3/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659824:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659828:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966669440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659848:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.659852:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659853:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659853:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 4/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659855:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153050 00000100:00100000:1.0:1651529344.659857:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1339:39030:x1731745946501056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.659862:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177841 count 1 00010000:00010000:0.0:1651529344.659863:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 3/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 723 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659866:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659866:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 723 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.659870:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 2/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.659870:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966669504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.659873:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659874:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659874:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 4/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659880:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.659881:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 3/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659884:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.659888:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966669568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659896:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659945:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501248 00000100:00100000:0.0:1651529344.659952:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501184 00000100:00100000:1.0:1651529344.659953:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501376 00000100:00100000:0.0:1651529344.659956:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501312 00000100:00100000:0.0:1651529344.659959:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501440 00000100:00100000:1.0:1651529344.659961:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153051 00000100:00100000:1.0:1651529344.659963:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1344:39030:x1731745946501248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.659964:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153052 00000100:00100000:0.0:1651529344.659965:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1344:39029:x1731745946501184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.659967:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177844 count 1 00002000:00080000:0.0:1651529344.659971:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177843 count 1 00010000:00010000:1.0:1651529344.659972:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659975:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659976:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 2/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659979:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659980:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659980:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 2/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659981:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 4/0,1 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659982:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659983:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659984:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 4/0,1 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659987:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 3/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659990:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 4/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.659990:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 3/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.659994:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966669632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659994:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 4/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.659998:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966669696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660005:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.660007:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.660011:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153053 00000100:00100000:1.0:1651529344.660013:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1344:39029:x1731745946501312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.660013:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153054 00000100:00100000:0.0:1651529344.660015:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1344:39030:x1731745946501376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.660017:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177845 count 1 00002000:00080000:0.0:1651529344.660019:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177846 count 1 00010000:00010000:1.0:1651529344.660020:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660022:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660024:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 2/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660027:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 2/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660029:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660030:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660030:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660030:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660030:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 4/0,1 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660031:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 4/0,1 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660036:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 3/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.660037:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 3/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660040:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 4/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660041:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 4/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660044:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966669760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660045:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966669824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.660049:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.660051:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.660055:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153055 00000100:00100000:0.0:1651529344.660069:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1344:39029:x1731745946501440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.660074:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177847 count 1 00010000:00010000:0.0:1651529344.660077:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660082:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 2/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660102:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660102:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660103:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 4/0,1 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660110:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 3/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 723 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660114:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 4/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660118:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966669888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660133:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966669440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.660136:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.660143:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660147:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966669504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660151:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660503:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966669568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.660507:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660522:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660539:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382144 00010000:00010000:1.0:1651529344.660545:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 724 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660555:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382272 00010000:00010000:1.0:1651529344.660558:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660563:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382208 00010000:00010000:1.0:1651529344.660566:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.660576:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12010 00000100:00100000:1.0:1651529344.660578:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+726:41278:x1731746396382144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.660581:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660582:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 726 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660586:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 3/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 726 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660591:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002076fdc8/0xa29a79078f3b9484 lrc: 0/0,0 mode: --/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf7f expref: 726 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660602:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660607:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660608:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660612:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 4/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.660618:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.660621:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.660630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660631:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41278:x1731746396382144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660634:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12010 00000100:00100000:1.0:1651529344.660638:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382336 00010000:00010000:1.0:1651529344.660642:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 5/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.660646:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382464 00000100:00100000:0.0:1651529344.660652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.660656:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 5/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 726 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660661:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382400 00010000:00010000:1.0:1651529344.660664:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 5/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 727 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.660668:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382592 00010000:00010000:1.0:1651529344.660670:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 5/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 728 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.660674:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382528 00010000:00010000:1.0:1651529344.660675:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 5/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660676:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12011 00000100:00100000:0.0:1651529344.660678:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41278:x1731746396382272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.660680:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12012 00000100:00100000:1.0:1651529344.660681:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41279:x1731746396382208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.660682:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.660684:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660685:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660687:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660688:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 3/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660691:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 3/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660694:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000698988e0/0xa29a79078f3ba0f5 lrc: 0/0,0 mode: --/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01b3 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660695:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc45250e/0xa29a79078f3ba86c lrc: 0/0,0 mode: --/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2148 expref: 729 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660699:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660699:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660699:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660700:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660700:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660703:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 4/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660703:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 4/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660710:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.660712:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.660721:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+727:41278:x1731746396382272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660722:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+727:41279:x1731746396382208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.660724:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12011 00000100:00100000:1.0:1651529344.660726:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12012 00000100:00100000:1.0:1651529344.660740:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12013 00000100:00100000:1.0:1651529344.660742:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396382336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.660744:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.660745:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12014 00010000:00010000:1.0:1651529344.660746:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 5/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660747:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396382464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.660750:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.660759:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 5/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660760:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 4/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660763:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 4/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 725 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660766:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660766:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660767:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660769:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660769:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660770:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 4/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660770:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660773:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 4/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660774:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.660777:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660781:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396382336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660783:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12013 00000100:00100000:0.0:1651529344.660784:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396382464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.660787:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12014 00000100:00100000:1.0:1651529344.660788:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12015 00000100:00100000:1.0:1651529344.660790:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+723:41278:x1731746396382400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.660792:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.660792:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12016 00000100:00100000:0.0:1651529344.660793:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+723:41279:x1731746396382592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.660794:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 5/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660796:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.660797:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 5/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660798:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 4/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660801:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 4/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 723 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660802:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660815:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660823:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660824:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660828:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 4/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660830:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660831:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660833:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.660834:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 4/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660839:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+723:41278:x1731746396382400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.660839:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660842:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12015 00000100:00100000:0.0:1651529344.660846:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+722:41279:x1731746396382592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660847:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12017 00000100:00100000:1.0:1651529344.660848:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+722:41278:x1731746396382528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.660849:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12016 00010000:00010000:1.0:1651529344.660851:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660852:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 5/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660856:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 4/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.660860:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035900975/0xa29a79078f3ba261 lrc: 0/0,0 mode: --/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07a9 expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.660861:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660861:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660862:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660864:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966669696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.660865:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 4/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660868:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660869:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.660871:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660873:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+720:41278:x1731746396382528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.660874:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660876:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12017 00010000:00010000:0.0:1651529344.660877:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660880:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660889:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e78d9a3/0xa29a79078f3bacbe lrc: 0/0,0 mode: --/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d318d expref: 719 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.660900:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966669824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.660904:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660908:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660910:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660913:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660916:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660939:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1346:39029:x1731745946501184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 973us (1022us total) trans 30064893911 rc 0/0 00000100:00100000:0.0:1651529344.660943:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153052 00010000:00010000:0.0:1651529344.660954:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955dcc63/0xa29a79078f3bc0c9 lrc: 0/0,0 mode: --/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8038 expref: 718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.660958:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966669760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660962:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660965:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946501312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 952us (1035us total) trans 30064893912 rc 0/0 00010000:00010000:0.0:1651529344.660965:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660967:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660969:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153053 00010000:00010000:0.0:1651529344.660971:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660973:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660977:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660990:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001acf1de1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.660991:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660994:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 3/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660999:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 1/0,0 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661002:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3bf542 lrc: 0/0,0 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661006:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661009:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.661010:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661013:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 3/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661014:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946501376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 998us (1089us total) trans 30064893913 rc 0/0 00010000:00010000:1.0:1651529344.661016:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 1/0,0 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661017:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153054 00010000:00010000:1.0:1651529344.661021:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf549 lrc: 0/0,0 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661024:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661027:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b29cda82 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.661028:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661030:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 3/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661033:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 1/0,0 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661036:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3bf550 lrc: 0/0,0 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661036:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6006789/0xa29a79078f3bc083 lrc: 0/0,0 mode: --/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f51 expref: 717 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.661040:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966669888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661042:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661043:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661045:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661047:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661048:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661049:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661051:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661052:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661055:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661093:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1346:39030:x1731745946501056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1234us (1338us total) trans 30064893914 rc 0/0 00000100:00100000:0.0:1651529344.661095:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1346:39029:x1731745946501440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1025us (1159us total) trans 30064893915 rc 0/0 00000100:00100000:1.0:1651529344.661096:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153050 00000100:00100000:0.0:1651529344.661098:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153055 00010000:00010000:1.0:1651529344.661102:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661106:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.661106:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661107:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661109:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661110:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 3/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661114:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 1/0,0 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661117:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf534 lrc: 0/0,0 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661121:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661121:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661124:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044bb7b14 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.661124:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661125:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661128:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 3/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661131:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 1/0,0 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661133:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3bf557 lrc: 0/0,0 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661137:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661139:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000817e8576 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.661140:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661143:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 3/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661146:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 1/0,0 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661148:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3bf52d lrc: 0/0,0 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661157:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946501120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1370us (1413us total) trans 30064893916 rc 0/0 00000100:00100000:0.0:1651529344.661160:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153049 00010000:00010000:1.0:1651529344.661161:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3ba7d9 lrc: 0/0,0 mode: --/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f26 expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.661164:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966669632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661168:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661171:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661173:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661176:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661179:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661239:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946501248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1332us total) trans 30064893917 rc 0/0 00000100:00100000:1.0:1651529344.661242:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153051 00010000:00010000:1.0:1651529344.661254:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661265:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.661266:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661269:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 3/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661274:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 1/0,0 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661277:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf53b lrc: 0/0,0 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661284:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661287:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661290:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661293:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661335:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946500992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1561us (1642us total) trans 30064893918 rc 0/0 00000100:00100000:1.0:1651529344.661339:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153048 00010000:00010000:1.0:1651529344.661346:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661349:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.661350:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661353:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 3/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661358:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 1/0,0 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661360:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf526 lrc: 0/0,0 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661428:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.661439:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502080 00000100:00100000:1.0:1651529344.661447:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153056 00000100:00100000:1.0:1651529344.661449:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946502080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.661454:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177848 count 1 00010000:00010000:1.0:1651529344.661458:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.661467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.661471:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 2/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 715 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661477:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661477:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661478:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 4/0,1 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661485:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 3/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 715 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.661486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.661489:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 4/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 715 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.661499:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966669952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.661499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.661510:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.661515:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.661516:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502144 00000100:00100000:1.0:1651529344.661531:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502208 00000100:00100000:1.0:1651529344.661537:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502272 00000100:00100000:1.0:1651529344.661549:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502400 00000100:00100000:1.0:1651529344.661556:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502336 00000100:00100000:1.0:1651529344.661559:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153057 00000100:00100000:0.0:1651529344.661564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.661566:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1350:39030:x1731745946502144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.661571:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177849 count 1 00000100:00100000:0.0:1651529344.661571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.661575:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661577:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502464 00010000:00010000:1.0:1651529344.661579:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 2/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.661582:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502528 00010000:00010000:1.0:1651529344.661585:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661585:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.661585:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153058 00010000:00010000:1.0:1651529344.661586:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 4/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661587:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1352:39029:x1731745946502208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.661592:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.661593:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177850 count 1 00010000:00010000:1.0:1651529344.661595:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 715 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.661597:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661600:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966670016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.661602:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 2/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.661613:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.661620:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.661621:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153059 00010000:00010000:0.0:1651529344.661621:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661622:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 4/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661623:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1352:39030:x1731745946502272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.661627:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177851 count 1 00010000:00010000:1.0:1651529344.661630:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661630:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 3/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661634:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 715 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.661635:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 2/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 715 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661638:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.661638:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966670080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661639:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661639:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 4/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661647:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.661648:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 715 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661652:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 715 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.661654:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153060 00000100:00100000:1.0:1651529344.661656:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966670144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.661656:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1352:39030:x1731745946502400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.661661:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177853 count 1 00000100:00100000:1.0:1651529344.661663:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.661664:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661668:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 2/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.661669:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153061 00000100:00100000:1.0:1651529344.661670:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1352:39030:x1731745946502336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.661671:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661672:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661673:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 4/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.661674:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177852 count 1 00010000:00010000:1.0:1651529344.661677:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661681:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 2/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661684:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661685:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661686:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 4/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661691:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 3/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661694:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 715 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.661698:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966670208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661704:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.661708:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 3/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661712:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 4/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 715 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.661716:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966670272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.661724:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.661741:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153062 00000100:00100000:0.0:1651529344.661743:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1352:39030:x1731745946502464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.661748:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177854 count 1 00000100:00100000:1.0:1651529344.661749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.661752:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661756:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 2/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661759:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661761:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 4/0,1 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661767:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 3/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 715 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661770:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 4/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 715 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.661782:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966670336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.661795:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.661819:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153063 00000100:00100000:0.0:1651529344.661821:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1352:39030:x1731745946502528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.661826:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177855 count 1 00000100:00100000:1.0:1651529344.661827:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383232 00010000:00010000:0.0:1651529344.661830:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661833:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 5/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 716 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.661834:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 2/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 716 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.661842:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12018 00000100:00100000:1.0:1651529344.661844:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+716:41279:x1731746396383232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.661847:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.661848:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 5/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 716 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.661852:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 4/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 716 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.661852:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661853:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661853:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 4/0,1 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661857:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661858:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661858:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661861:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 4/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661861:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 3/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 716 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661865:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 4/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.661866:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.661869:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966670400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661874:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+716:41279:x1731746396383232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.661876:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12018 00000100:00100000:0.0:1651529344.661877:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.661892:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e05869/0xa29a79078f3b953a lrc: 0/0,0 mode: --/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd27a expref: 715 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.661896:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966669952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661899:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661902:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661905:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661908:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661920:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661933:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661944:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.661945:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661949:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 3/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661954:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 1/0,0 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661956:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf55e lrc: 0/0,0 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661967:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1353:39029:x1731745946502080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 517us (551us total) trans 30064893919 rc 0/0 00000100:00100000:1.0:1651529344.661970:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153056 00000100:00100000:0.0:1651529344.662123:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966670080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662131:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966670144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662135:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662143:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966670208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662146:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662152:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966670016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662155:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662165:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.662185:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502592 00000100:00100000:0.0:1651529344.662194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.662209:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153064 00000100:00100000:0.0:1651529344.662209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.662211:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1353:39030:x1731745946502592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.662219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.662220:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177856 count 1 00000100:00100000:0.0:1651529344.662227:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.662229:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662234:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 2/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 714 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662237:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662237:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662238:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 4/0,1 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662245:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 3/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 714 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.662245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.662249:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 714 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662253:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966670464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.662259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.662264:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.662267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.662269:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383360 00010000:00010000:1.0:1651529344.662274:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 715 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662279:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383296 00010000:00010000:1.0:1651529344.662281:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662292:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966670272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662294:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383488 00010000:00010000:1.0:1651529344.662298:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 717 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662302:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383424 00010000:00010000:1.0:1651529344.662304:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 718 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662305:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662308:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383552 00010000:00010000:1.0:1651529344.662310:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 4/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 719 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662314:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383680 00000100:00100000:0.0:1651529344.662314:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383616 00010000:00010000:1.0:1651529344.662317:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 5/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662319:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 5/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662321:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12019 00000100:00100000:1.0:1651529344.662323:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+721:41279:x1731746396383360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.662326:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.662326:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12020 00010000:00010000:1.0:1651529344.662327:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 721 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662327:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+721:41278:x1731746396383296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.662330:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 721 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662330:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.662332:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662335:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 721 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662336:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0aa34ae/0xa29a79078f3b9269 lrc: 0/0,0 mode: --/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc77c expref: 721 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662339:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662340:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662341:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662341:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3b9fdd lrc: 0/0,0 mode: --/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd3e expref: 720 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662344:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 4/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662345:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662346:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662347:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662350:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.662350:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 4/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662363:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+719:41279:x1731746396383360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.662365:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12019 00000100:00100000:1.0:1651529344.662370:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12021 00000100:00100000:1.0:1651529344.662372:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+718:41279:x1731746396383488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.662375:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.662380:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.662382:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662383:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+718:41278:x1731746396383296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.662386:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 3/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 718 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662386:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12020 00010000:00010000:1.0:1651529344.662391:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f934e234/0xa29a79078f3bc1ef lrc: 0/0,0 mode: --/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84ec expref: 717 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662392:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12022 00010000:00010000:1.0:1651529344.662394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.662394:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+717:41278:x1731746396383424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.662395:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662396:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662397:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.662398:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662399:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 4/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662402:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 3/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662404:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.662407:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3ba7f5 lrc: 0/0,0 mode: --/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f88 expref: 716 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662410:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+716:41279:x1731746396383488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.662411:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662411:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.662412:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12021 00010000:00010000:0.0:1651529344.662412:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662415:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 4/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662417:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12023 00000100:00100000:1.0:1651529344.662419:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+714:41278:x1731746396383552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.662421:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.662421:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.662422:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 4/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 714 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662426:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 3/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 714 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662427:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+714:41278:x1731746396383424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.662430:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd62d8d6/0xa29a79078f3bc290 lrc: 0/0,0 mode: --/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87af expref: 714 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.662430:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12022 00010000:00010000:1.0:1651529344.662434:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662434:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662435:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662438:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 4/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662447:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.662453:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+712:41278:x1731746396383552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.662455:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12024 00000100:00100000:1.0:1651529344.662457:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12023 00000100:00100000:0.0:1651529344.662457:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+712:41279:x1731746396383680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.662460:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.662461:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12025 00000100:00100000:1.0:1651529344.662462:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+711:41278:x1731746396383616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.662462:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 5/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662465:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.662466:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 5/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662466:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 4/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662470:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 4/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.662471:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662472:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662473:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662476:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 4/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662480:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.662483:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662484:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662485:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662486:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+711:41279:x1731746396383680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.662488:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 4/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662489:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12024 00010000:00010000:1.0:1651529344.662492:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.662498:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+710:41278:x1731746396383616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (239us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.662500:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001782a6a5/0xa29a79078f3ba23e lrc: 0/0,0 mode: --/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06ad expref: 710 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662501:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12025 00000100:00100000:0.0:1651529344.662504:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966670336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.662507:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662511:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662511:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662513:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662514:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662516:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662517:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662519:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662520:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662574:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946502464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 830us (1010us total) trans 30064893920 rc 0/0 00000100:00100000:1.0:1651529344.662575:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946502272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1101us total) trans 30064893921 rc 0/0 00000100:00100000:0.0:1651529344.662577:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153062 00000100:00100000:1.0:1651529344.662579:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153059 00010000:00010000:1.0:1651529344.662587:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662588:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077bcc05d/0xa29a79078f3b9e86 lrc: 0/0,0 mode: --/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf867 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662590:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ae8a38f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.662591:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662592:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966670400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662594:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 3/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662595:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662599:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 1/0,0 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662599:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662602:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3bf588 lrc: 0/0,0 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662604:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662606:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662607:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662609:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.662609:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662610:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662612:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 3/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662615:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 1/0,0 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662620:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf573 lrc: 0/0,0 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662624:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662626:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.662627:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662630:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 3/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662633:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 1/0,0 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662635:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf58f lrc: 0/0,0 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662641:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662644:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662645:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1354:39030:x1731745946502528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 823us (1073us total) trans 30064893922 rc 0/0 00010000:00010000:1.0:1651529344.662646:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662648:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153063 00010000:00010000:1.0:1651529344.662650:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662655:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662659:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.662660:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662662:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 3/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662667:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 1/0,0 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662670:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf581 lrc: 0/0,0 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662676:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662679:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662682:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662684:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1354:39030:x1731745946502336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1013us (1168us total) trans 30064893923 rc 0/0 00010000:00010000:0.0:1651529344.662685:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662687:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153061 00010000:00010000:1.0:1651529344.662702:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662706:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f9ca756 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.662707:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662710:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 3/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662714:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 1/0,0 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662717:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3bf56c lrc: 0/0,0 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662724:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1354:39029:x1731745946502208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1257us total) trans 30064893924 rc 0/0 00010000:00010000:1.0:1651529344.662725:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662727:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153058 00010000:00010000:1.0:1651529344.662728:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662741:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662743:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662744:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662747:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662750:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662758:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662790:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946502144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1228us (1331us total) trans 30064893925 rc 0/0 00000100:00100000:1.0:1651529344.662793:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153057 00010000:00010000:1.0:1651529344.662800:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662801:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1354:39030:x1731745946502400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1144us (1302us total) trans 30064893926 rc 0/0 00010000:00010000:1.0:1651529344.662815:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.662820:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153060 00010000:00010000:1.0:1651529344.662821:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662824:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 3/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662828:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662829:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 1/0,0 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662831:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf565 lrc: 0/0,0 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662831:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f8bd8f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.662833:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662835:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 3/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662840:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 1/0,0 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662843:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3bf57a lrc: 0/0,0 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662870:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.662872:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966670464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662881:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662888:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383744 00010000:00010000:1.0:1651529344.662892:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.662906:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12026 00000100:00100000:1.0:1651529344.662908:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41279:x1731746396383744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.662935:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.662937:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662941:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 3/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662947:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb805ab/0xa29a79078f3b9ab2 lrc: 0/0,0 mode: --/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce902 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.662950:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662951:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662952:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662955:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 4/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662964:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.662971:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41279:x1731746396383744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.662974:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12026 00010000:00010000:1.0:1651529344.662981:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662984:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662987:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662990:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663033:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1354:39030:x1731745946502592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 822us (854us total) trans 30064893927 rc 0/0 00000100:00100000:1.0:1651529344.663036:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153064 00010000:00010000:1.0:1651529344.663043:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663047:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.663047:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663060:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 3/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663066:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 1/0,0 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663069:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf596 lrc: 0/0,0 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663160:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.663198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.663208:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503232 00000100:00100000:1.0:1651529344.663209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.663215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.663217:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503168 00000100:00100000:0.0:1651529344.663221:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503296 00000100:00100000:1.0:1651529344.663222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.663234:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503424 00000100:00100000:1.0:1651529344.663239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.663239:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503552 00000100:00100000:1.0:1651529344.663250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.663257:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503360 00000100:00100000:1.0:1651529344.663262:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503488 00000100:00100000:0.0:1651529344.663262:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153065 00000100:00100000:0.0:1651529344.663264:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1360:39029:x1731745946503232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.663265:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153066 00000100:00100000:1.0:1651529344.663267:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1360:39030:x1731745946503168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.663270:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177858 count 1 00002000:00080000:1.0:1651529344.663272:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177857 count 1 00010000:00010000:0.0:1651529344.663275:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663276:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663280:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 2/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 706 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.663281:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 2/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663283:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663284:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663284:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 4/0,1 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663291:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 3/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 706 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.663295:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663295:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 4/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 706 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.663296:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663296:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 4/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663299:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966670528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.663304:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 3/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.663308:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.663315:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.663319:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966670592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663322:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153067 00000100:00100000:0.0:1651529344.663324:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1360:39030:x1731745946503296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.663328:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.663329:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177859 count 1 00010000:00010000:0.0:1651529344.663333:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663335:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153068 00000100:00100000:1.0:1651529344.663336:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1360:39030:x1731745946503424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.663337:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 2/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663340:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.663341:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177861 count 1 00010000:00010000:0.0:1651529344.663341:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663342:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 4/0,1 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663345:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663348:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 3/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.663349:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 2/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663351:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 4/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.663352:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663352:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663353:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 4/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663355:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966670656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.663362:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 3/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.663363:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.663366:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.663369:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153069 00000100:00100000:1.0:1651529344.663370:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966670720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663370:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1360:39030:x1731745946503552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.663374:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177863 count 1 00000100:00100000:1.0:1651529344.663376:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.663377:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663381:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 2/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.663382:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153070 00000100:00100000:1.0:1651529344.663383:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1360:39029:x1731745946503360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.663384:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663385:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663385:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 4/0,1 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.663387:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177860 count 1 00010000:00010000:1.0:1651529344.663390:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663393:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 3/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.663394:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 2/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663397:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 4/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.663398:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663398:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663399:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 4/0,1 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663401:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966670784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.663405:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 3/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.663407:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.663408:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 4/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.663412:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966670848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663413:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153071 00000100:00100000:0.0:1651529344.663415:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028a0b830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1360:39029:x1731745946503488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.663418:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.663419:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177862 count 1 00010000:00010000:0.0:1651529344.663422:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663426:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 2/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663428:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663429:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663429:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 4/0,1 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663435:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 3/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663439:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 4/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.663442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.663443:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966670912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663449:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.663455:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503616 00000100:00100000:0.0:1651529344.663460:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153072 00000100:00100000:0.0:1651529344.663462:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1361:39030:x1731745946503616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.663466:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177864 count 1 00010000:00010000:0.0:1651529344.663469:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663473:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 2/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663476:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663477:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663477:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 4/0,1 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663483:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 3/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 706 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.663487:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 4/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 706 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.663490:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966670976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663497:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.664037:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966670592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664047:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.664055:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966670720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.664062:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.664063:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.664079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.664081:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384320 00000100:00100000:0.0:1651529344.664085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.664087:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 5/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 707 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.664098:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384448 00010000:00010000:1.0:1651529344.664101:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 5/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.664105:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384576 00010000:00010000:1.0:1651529344.664107:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 5/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 709 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.664112:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12027 00000100:00100000:1.0:1651529344.664113:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+709:41278:x1731746396384320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.664115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.664116:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.664118:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 5/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 709 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664121:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384384 00010000:00010000:1.0:1651529344.664122:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 4/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 709 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664127:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664127:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 710 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664128:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664129:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664131:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 4/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664133:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384512 00010000:00010000:0.0:1651529344.664135:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664136:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.664139:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384704 00010000:00010000:0.0:1651529344.664141:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 5/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 712 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664145:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384640 00000100:00100000:1.0:1651529344.664146:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+713:41278:x1731746396384320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (94us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.664147:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 5/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.664149:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12027 00000100:00100000:0.0:1651529344.664151:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384768 00010000:00010000:0.0:1651529344.664153:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 5/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.664154:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12028 00000100:00100000:1.0:1651529344.664155:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+713:41278:x1731746396384448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.664158:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.664158:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12029 00010000:00010000:1.0:1651529344.664159:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 5/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664159:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+713:41278:x1731746396384576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.664162:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.664163:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 4/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.664164:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 5/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.664168:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 4/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 713 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664170:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664170:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664171:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664174:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 4/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664174:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664174:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664175:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664178:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.664178:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 4/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664182:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+713:41278:x1731746396384448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.664183:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.664185:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12028 00000100:00100000:1.0:1651529344.664188:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12030 00000100:00100000:1.0:1651529344.664190:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+712:41279:x1731746396384384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.664190:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+712:41278:x1731746396384576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.664192:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.664193:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12029 00010000:00010000:1.0:1651529344.664194:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 712 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664197:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 3/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664198:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12031 00000100:00100000:0.0:1651529344.664200:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+711:41279:x1731746396384512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.664201:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2584cf1/0xa29a79078f3ba70e lrc: 0/0,0 mode: --/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bde expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.664202:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.664203:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 711 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664205:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664205:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664206:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664207:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 3/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 710 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664209:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 4/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664212:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753a2a23/0xa29a79078f3b9e8d lrc: 0/0,0 mode: --/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf875 expref: 710 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664215:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.664216:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664216:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664217:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664220:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+709:41279:x1731746396384384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.664220:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 4/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664222:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12030 00010000:00010000:0.0:1651529344.664229:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.664233:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12032 00000100:00100000:0.0:1651529344.664234:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41279:x1731746396384512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.664235:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41278:x1731746396384704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.664237:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12031 00010000:00010000:1.0:1651529344.664238:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.664239:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 5/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 708 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664242:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12033 00010000:00010000:1.0:1651529344.664243:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 4/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 707 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664244:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41278:x1731746396384640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.664246:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.664247:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 5/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664248:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664249:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664249:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664251:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 4/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 707 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664252:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 4/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664256:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.664256:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664256:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664257:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664260:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 4/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664262:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41278:x1731746396384704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.664264:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.664265:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12032 00000100:00100000:0.0:1651529344.664268:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+706:41278:x1731746396384640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.664271:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12033 00000100:00100000:1.0:1651529344.664273:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12034 00000100:00100000:1.0:1651529344.664275:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+705:41278:x1731746396384768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.664277:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.664279:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 5/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664282:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 4/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 705 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.664282:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f6b30a8/0xa29a79078f3bc0de lrc: 0/0,0 mode: --/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d808c expref: 705 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664286:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966670912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664287:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664287:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664288:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664290:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664291:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 4/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664293:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664295:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.664296:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664299:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664300:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+704:41278:x1731746396384768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.664301:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664302:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12034 00010000:00010000:1.0:1651529344.664309:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664319:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664323:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664326:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664359:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028a0b830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1363:39029:x1731745946503488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 943us (1108us total) trans 30064893928 rc 0/0 00000100:00100000:0.0:1651529344.664362:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153071 00010000:00010000:0.0:1651529344.664369:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664371:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1362:39030:x1731745946503424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1033us (1154us total) trans 30064893929 rc 0/0 00010000:00010000:0.0:1651529344.664373:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.664374:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153068 00010000:00010000:0.0:1651529344.664374:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664377:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 3/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664381:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664382:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 1/0,0 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664384:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf5c7 lrc: 0/0,0 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664385:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664386:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664389:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 3/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664393:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 1/0,0 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664394:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3ba516 lrc: 0/0,0 mode: --/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1348 expref: 703 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664396:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf5b2 lrc: 0/0,0 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664398:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966670784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.664401:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664402:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664406:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664407:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664409:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664409:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664411:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664412:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664415:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664444:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946503168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1177us (1251us total) trans 30064893930 rc 0/0 00000100:00100000:1.0:1651529344.664447:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153066 00000100:00100000:0.0:1651529344.664451:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1362:39030:x1731745946503552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1229us total) trans 30064893931 rc 0/0 00010000:00010000:1.0:1651529344.664454:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664454:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153069 00010000:00010000:1.0:1651529344.664457:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664458:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664461:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 3/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664461:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664465:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 1/0,0 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664465:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.664465:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664468:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf5a4 lrc: 0/0,0 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664468:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 3/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664473:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 1/0,0 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664476:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf5b9 lrc: 0/0,0 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664478:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000276d9c8e/0xa29a79078f3bbdf1 lrc: 0/0,0 mode: --/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74a0 expref: 702 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.664481:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966670848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664485:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664485:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eff0df3/0xa29a79078f3b9d6e lrc: 0/0,0 mode: --/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3c8 expref: 701 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664488:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664488:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966670656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664491:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664492:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664494:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664495:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664496:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664498:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664500:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664503:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664541:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1363:39029:x1731745946503360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1156us (1301us total) trans 30064893932 rc 0/0 00000100:00100000:1.0:1651529344.664544:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153070 00000100:00100000:0.0:1651529344.664545:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946503296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1220us (1336us total) trans 30064893933 rc 0/0 00000100:00100000:0.0:1651529344.664548:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153067 00010000:00010000:1.0:1651529344.664551:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664556:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664558:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664559:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d7cd4d1/0xa29a79078f3bb673 lrc: 0/0,0 mode: --/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d581b expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.664560:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 3/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664563:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966670976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664565:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 1/0,0 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664567:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf5c0 lrc: 0/0,0 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664567:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664570:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664571:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664573:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664574:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664575:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664575:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664578:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 3/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664578:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664581:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 1/0,0 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664595:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf5ab lrc: 0/0,0 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664600:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664602:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664603:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664606:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 3/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664609:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 1/0,0 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664610:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1362:39030:x1731745946503616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1169us total) trans 30064893934 rc 0/0 00010000:00010000:1.0:1651529344.664612:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf5ce lrc: 0/0,0 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664613:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153072 00010000:00010000:0.0:1651529344.664624:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be48da7a/0xa29a79078f3b9812 lrc: 0/0,0 mode: --/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde74 expref: 699 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664628:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966670528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.664631:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664634:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664637:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664639:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664642:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664680:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1362:39029:x1731745946503232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1415us (1520us total) trans 30064893935 rc 0/0 00000100:00100000:0.0:1651529344.664682:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153065 00010000:00010000:1.0:1651529344.664765:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664770:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.664770:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664783:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 3/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664788:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 1/0,0 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664791:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf59d lrc: 0/0,0 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.664851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.664857:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504192 00000100:00100000:0.0:1651529344.664863:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504256 00000100:00100000:0.0:1651529344.664875:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153073 00000100:00100000:0.0:1651529344.664876:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946504192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.664882:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177865 count 1 00000100:00100000:1.0:1651529344.664884:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153074 00000100:00100000:1.0:1651529344.664886:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946504256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.664886:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664891:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 2/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.664892:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177866 count 1 00010000:00010000:0.0:1651529344.664895:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664895:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664896:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664896:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 4/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664901:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 2/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 698 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664904:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664904:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664905:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 4/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664912:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 3/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 698 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664919:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 698 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.664919:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 3/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.664923:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966671040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.664923:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.664927:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966671104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.664935:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.664936:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.664968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.664997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.665016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.665023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665032:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504384 00000100:00100000:1.0:1651529344.665040:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504320 00000100:00100000:0.0:1651529344.665040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665045:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504512 00000100:00100000:0.0:1651529344.665049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665057:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504448 00000100:00100000:1.0:1651529344.665060:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504640 00000100:00100000:0.0:1651529344.665062:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504576 00000100:00100000:1.0:1651529344.665064:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153075 00000100:00100000:1.0:1651529344.665065:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1369:39029:x1731745946504384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.665069:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153076 00002000:00080000:1.0:1651529344.665070:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177868 count 1 00000100:00100000:0.0:1651529344.665071:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1369:39030:x1731745946504320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.665074:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.665076:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177867 count 1 00010000:00010000:1.0:1651529344.665079:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 2/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665081:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665082:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665083:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665083:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 4/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665088:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 2/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665090:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 3/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665091:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665091:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665092:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 4/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665096:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.665099:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 3/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.665100:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966671168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665102:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665106:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966671232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665111:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.665115:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665117:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153077 00000100:00100000:1.0:1651529344.665119:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1369:39029:x1731745946504512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.665122:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153078 00002000:00080000:1.0:1651529344.665123:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177870 count 1 00000100:00100000:0.0:1651529344.665123:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1369:39030:x1731745946504448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.665126:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.665128:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177869 count 1 00010000:00010000:1.0:1651529344.665130:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 2/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665133:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665133:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665134:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 4/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665140:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 3/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665144:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.665151:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966671296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665151:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665156:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 2/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.665157:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.665159:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665160:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665161:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 4/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665163:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153079 00000100:00100000:1.0:1651529344.665164:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1369:39029:x1731745946504640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.665168:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177872 count 1 00010000:00010000:0.0:1651529344.665168:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665171:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665171:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665175:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 2/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.665175:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966671360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665178:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665179:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665179:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 4/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665183:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.665186:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 3/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665189:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665189:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153080 00000100:00100000:0.0:1651529344.665191:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1369:39030:x1731745946504576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.665193:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966671424:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.665196:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177871 count 1 00010000:00010000:0.0:1651529344.665199:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665200:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.665204:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 2/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665206:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665207:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665207:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 4/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665213:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 3/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 698 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665240:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665244:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966671488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.665252:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.665263:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966671104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665267:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665294:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966671040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665299:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665313:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385344 00010000:00010000:1.0:1651529344.665318:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 699 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.665325:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385408 00010000:00010000:1.0:1651529344.665328:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.665339:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12035 00000100:00100000:1.0:1651529344.665341:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+700:41278:x1731746396385344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.665344:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665345:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 700 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665349:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 3/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 700 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665351:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12036 00000100:00100000:0.0:1651529344.665353:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+700:41278:x1731746396385408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.665355:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa836cd7/0xa29a79078f3b9388 lrc: 0/0,0 mode: --/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbf1 expref: 700 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.665357:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665358:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665359:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665359:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 699 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665360:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665363:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 4/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665363:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 3/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 699 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665370:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.665381:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+699:41278:x1731746396385344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665384:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12035 00010000:00010000:0.0:1651529344.665388:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f623829c/0xa29a79078f3b9d59 lrc: 0/0,0 mode: --/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf390 expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665392:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665392:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665393:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665394:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665395:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665398:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665401:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665406:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 4/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665414:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.665430:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+697:41278:x1731746396385408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.665433:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12036 00000100:00100000:1.0:1651529344.665441:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1370:39030:x1731745946504256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 554us (590us total) trans 30064893936 rc 0/0 00010000:00010000:0.0:1651529344.665441:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665444:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153074 00010000:00010000:0.0:1651529344.665445:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665448:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665451:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665451:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665457:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.665458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665461:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 3/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665465:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 1/0,0 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665468:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf5dc lrc: 0/0,0 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665472:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665475:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.665476:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665479:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 3/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665482:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 1/0,0 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665487:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf5d5 lrc: 0/0,0 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665492:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1370:39030:x1731745946504192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 614us (649us total) trans 30064893937 rc 0/0 00000100:00100000:0.0:1651529344.665495:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153073 00000100:00100000:0.0:1651529344.665543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665567:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966671168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665572:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665579:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385472 00010000:00010000:1.0:1651529344.665584:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.665595:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12037 00000100:00100000:1.0:1651529344.665597:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+697:41278:x1731746396385472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.665600:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665601:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665605:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 3/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665610:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d75dc4f/0xa29a79078f3b9dd0 lrc: 0/0,0 mode: --/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf57a expref: 697 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665614:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665615:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665615:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665618:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 4/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665625:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.665635:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+696:41278:x1731746396385472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665638:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12037 00010000:00010000:1.0:1651529344.665644:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665648:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665651:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665653:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665717:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946504384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 651us (749us total) trans 30064893938 rc 0/0 00000100:00100000:1.0:1651529344.665720:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153075 00010000:00010000:1.0:1651529344.665745:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665756:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.665757:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.665758:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665772:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 3/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665777:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 1/0,0 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665779:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf5e3 lrc: 0/0,0 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665789:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665795:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966671296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665799:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665833:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966671424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665837:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665843:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504704 00000100:00100000:0.0:1651529344.665854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665863:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504768 00000100:00100000:0.0:1651529344.665864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665872:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153081 00000100:00100000:1.0:1651529344.665874:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1371:39030:x1731745946504704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.665876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.665884:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177873 count 1 00000100:00100000:0.0:1651529344.665885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.665892:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.665897:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 2/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 695 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665900:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665901:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665902:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 4/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665903:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966671232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665907:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665908:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 3/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 695 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665912:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 695 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665915:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966671360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665916:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966671552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665930:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665937:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153082 00010000:00010000:0.0:1651529344.665937:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665939:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1371:39030:x1731745946504768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.665944:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177874 count 1 00000100:00100000:0.0:1651529344.665946:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966671488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665947:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665949:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665951:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 2/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 695 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665954:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665955:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665956:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 4/0,1 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665958:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385600 00010000:00010000:1.0:1651529344.665962:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 3/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 696 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665963:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665965:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 4/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665968:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385536 00000100:00100000:1.0:1651529344.665969:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966671616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665970:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 697 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665974:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385728 00000100:00100000:1.0:1651529344.665976:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.665976:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 698 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.665982:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385664 00000100:00100000:0.0:1651529344.665983:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385792 00010000:00010000:0.0:1651529344.665985:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665987:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.665989:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12038 00000100:00100000:0.0:1651529344.665991:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+700:41278:x1731746396385600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.665993:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12039 00010000:00010000:0.0:1651529344.665994:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.665995:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+700:41279:x1731746396385536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.665995:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.665997:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665999:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.665999:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 3/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.666003:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 3/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666005:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000896a36c8/0xa29a79078f3bb6ab lrc: 0/0,0 mode: --/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58df expref: 700 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666008:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666009:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666010:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666011:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c840001/0xa29a79078f3bbc62 lrc: 0/0,0 mode: --/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f6e expref: 699 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666013:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 4/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666014:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666015:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666016:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666019:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 4/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666024:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.666031:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+698:41278:x1731746396385600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.666036:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.666041:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12038 00000100:00100000:1.0:1651529344.666042:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+698:41279:x1731746396385536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.666045:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12039 00000100:00100000:0.0:1651529344.666047:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12040 00000100:00100000:0.0:1651529344.666049:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+696:41278:x1731746396385728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.666052:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.666053:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.666056:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12041 00010000:00010000:0.0:1651529344.666057:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 3/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.666058:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+696:41279:x1731746396385792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.666060:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.666061:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666062:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084251fe9/0xa29a79078f3bbf6b lrc: 0/0,0 mode: --/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a9d expref: 696 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.666065:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 3/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666065:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666066:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666067:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666069:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 4/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666070:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002038ca62/0xa29a79078f3baf50 lrc: 0/0,0 mode: --/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b8f expref: 695 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666079:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.666084:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666085:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.666085:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+694:41278:x1731746396385728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (209us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.666086:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666087:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12040 00010000:00010000:1.0:1651529344.666089:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 4/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666092:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12042 00000100:00100000:0.0:1651529344.666093:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41279:x1731746396385664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.666096:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.666098:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.666103:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.666104:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41279:x1731746396385792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.666107:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12041 00010000:00010000:0.0:1651529344.666107:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666112:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e22160/0xa29a79078f3bb7f4 lrc: 0/0,0 mode: --/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5de7 expref: 692 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.666114:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666115:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666116:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666117:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666118:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666120:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 4/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666121:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666124:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666125:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.666130:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+691:41279:x1731746396385664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.666133:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12042 00010000:00010000:0.0:1651529344.666139:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666143:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666149:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666151:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666162:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1372:39029:x1731745946504512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1042us (1145us total) trans 30064893939 rc 0/0 00000100:00100000:1.0:1651529344.666165:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153077 00010000:00010000:1.0:1651529344.666172:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666175:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.666176:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666179:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 3/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666184:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 1/0,0 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666187:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf5f1 lrc: 0/0,0 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666191:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666194:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.666195:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666197:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 3/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666201:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 1/0,0 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666206:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf606 lrc: 0/0,0 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666207:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1372:39030:x1731745946504576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1015us (1157us total) trans 30064893940 rc 0/0 00000100:00100000:0.0:1651529344.666210:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153080 00010000:00010000:1.0:1651529344.666212:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666215:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666218:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666218:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666220:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666222:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666225:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666228:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666263:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1373:39029:x1731745946504640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1097us (1222us total) trans 30064893941 rc 0/0 00000100:00100000:1.0:1651529344.666266:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153079 00000100:00100000:0.0:1651529344.666269:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1372:39030:x1731745946504448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1145us (1245us total) trans 30064893942 rc 0/0 00010000:00010000:1.0:1651529344.666272:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666272:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153078 00010000:00010000:1.0:1651529344.666276:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.666277:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666279:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 3/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666279:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666284:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 1/0,0 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666285:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666287:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf5ff lrc: 0/0,0 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666288:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666291:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666291:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666294:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.666295:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666298:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 3/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666301:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 1/0,0 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666303:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf5f8 lrc: 0/0,0 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666307:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666309:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.666310:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666313:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 3/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666316:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 1/0,0 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666319:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf5ea lrc: 0/0,0 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666321:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1372:39030:x1731745946504320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1324us total) trans 30064893943 rc 0/0 00000100:00100000:0.0:1651529344.666324:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153076 00000100:00100000:1.0:1651529344.666334:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666384:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505152 00000100:00100000:0.0:1651529344.666392:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153083 00000100:00100000:0.0:1651529344.666393:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1372:39029:x1731745946505152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.666399:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177875 count 1 00010000:00010000:0.0:1651529344.666403:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666408:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 2/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666411:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666411:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666412:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 4/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666421:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 3/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666425:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.666429:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966671680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666443:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.666588:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966671552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666593:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.666635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666635:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505472 00000100:00100000:1.0:1651529344.666643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666643:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505408 00000100:00100000:0.0:1651529344.666647:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505600 00000100:00100000:0.0:1651529344.666651:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153084 00000100:00100000:0.0:1651529344.666653:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1375:39030:x1731745946505472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.666656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.666658:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177877 count 1 00000100:00100000:1.0:1651529344.666666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.666668:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666675:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505536 00010000:00010000:0.0:1651529344.666678:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 2/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.666680:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505664 00010000:00010000:0.0:1651529344.666681:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666682:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666682:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 4/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666684:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153085 00000100:00100000:1.0:1651529344.666685:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1377:39029:x1731745946505408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.666690:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 3/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.666691:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177876 count 1 00010000:00010000:0.0:1651529344.666693:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.666695:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666697:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966671744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666700:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 2/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666703:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666704:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666704:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 4/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666708:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.666711:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 3/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.666714:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153086 00010000:00010000:1.0:1651529344.666715:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.666716:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1377:39030:x1731745946505600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.666719:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966671808:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.666721:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177879 count 1 00010000:00010000:0.0:1651529344.666724:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666728:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.666728:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 2/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666742:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666742:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666743:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 4/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666744:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153087 00000100:00100000:1.0:1651529344.666746:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1377:39029:x1731745946505536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.666750:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 3/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.666751:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177878 count 1 00010000:00010000:0.0:1651529344.666754:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.666755:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666759:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 2/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.666761:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966671872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666765:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666765:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666766:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 4/0,1 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666769:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.666772:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 3/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666775:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.666775:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153088 00000100:00100000:0.0:1651529344.666777:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1377:39029:x1731745946505664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.666780:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966671936:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.666781:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177880 count 1 00010000:00010000:0.0:1651529344.666785:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666787:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.666789:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 2/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666792:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666793:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666793:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 4/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666799:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 3/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 690 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666819:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.666824:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966672000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666831:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.666893:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966671616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666898:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666953:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.666955:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966671680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.666960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.666960:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.666976:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386304 00010000:00010000:1.0:1651529344.666981:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 691 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.666989:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386496 00000100:00100000:0.0:1651529344.666989:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386432 00010000:00010000:1.0:1651529344.666992:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.666995:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 4/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.666997:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12043 00000100:00100000:1.0:1651529344.666998:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41279:x1731746396386304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.667001:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.667002:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12044 00010000:00010000:1.0:1651529344.667003:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667004:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41278:x1731746396386496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.667006:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 3/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667007:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.667008:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667012:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004373d0b7/0xa29a79078f3bc0d0 lrc: 0/0,0 mode: --/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8046 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667012:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 3/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 693 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667015:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667016:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667017:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667017:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa7a7db/0xa29a79078f3ba95a lrc: 0/0,0 mode: --/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2474 expref: 692 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667020:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 4/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667021:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667022:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667023:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667026:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.667026:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 4/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667038:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+691:41279:x1731746396386304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667041:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12043 00010000:00010000:0.0:1651529344.667043:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.667046:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12045 00000100:00100000:1.0:1651529344.667048:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41279:x1731746396386432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.667050:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.667051:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396386496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (81us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.667052:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 4/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667054:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12044 00010000:00010000:1.0:1651529344.667056:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 3/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667061:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080f56f91/0xa29a79078f3b9f66 lrc: 0/0,0 mode: --/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfbbd expref: 689 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667061:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667064:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667064:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667065:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667065:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667068:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 4/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667068:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667070:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667074:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.667086:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+688:41279:x1731746396386432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667089:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12045 00010000:00010000:1.0:1651529344.667097:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667100:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667105:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667108:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667120:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1378:39029:x1731745946505152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 726us (786us total) trans 30064893944 rc 0/0 00000100:00100000:0.0:1651529344.667123:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153083 00000100:00100000:1.0:1651529344.667160:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1378:39030:x1731745946504704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1279us (1398us total) trans 30064893945 rc 0/0 00000100:00100000:1.0:1651529344.667163:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153081 00010000:00010000:1.0:1651529344.667179:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667183:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667186:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667188:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667201:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667205:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.667206:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667211:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 3/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667216:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 1/0,0 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667219:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf61b lrc: 0/0,0 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667229:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1378:39030:x1731745946504768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1289us (1440us total) trans 30064893946 rc 0/0 00000100:00100000:1.0:1651529344.667232:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153082 00010000:00010000:1.0:1651529344.667239:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667242:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667245:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.667245:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.667246:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667246:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667249:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 3/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667249:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 3/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667253:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 1/0,0 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667254:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 1/0,0 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667255:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf614 lrc: 0/0,0 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667256:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf60d lrc: 0/0,0 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667320:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966671744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667324:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.667356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.667362:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.667362:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966671872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667366:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667369:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.667375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.667395:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966671808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.667399:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667406:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386688 00010000:00010000:1.0:1651529344.667411:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 688 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667418:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966672000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667422:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667437:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386752 00010000:00010000:1.0:1651529344.667441:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 689 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667445:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386816 00010000:00010000:1.0:1651529344.667447:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667451:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12046 00000100:00100000:1.0:1651529344.667453:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396386688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.667456:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.667457:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.667467:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 3/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667473:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef12e8c/0xa29a79078f3bb6ce lrc: 0/0,0 mode: --/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d596b expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.667476:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667477:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667478:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.667481:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 4/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667484:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386880 00010000:00010000:0.0:1651529344.667490:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 5/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.667496:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386944 00010000:00010000:1.0:1651529344.667498:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.667505:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 691 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667509:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+691:41278:x1731746396386688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667512:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12046 00000100:00100000:0.0:1651529344.667516:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12047 00000100:00100000:0.0:1651529344.667517:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396386752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.667521:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.667522:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667523:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12048 00000100:00100000:1.0:1651529344.667524:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396386816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.667526:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 3/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667527:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.667529:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667532:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 3/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 690 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667532:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187a1d9a/0xa29a79078f3b9334 lrc: 0/0,0 mode: --/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca85 expref: 690 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667535:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667536:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667537:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000932c43e/0xa29a79078f3b9b22 lrc: 0/0,0 mode: --/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceac2 expref: 689 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667537:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667540:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 4/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667541:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667541:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667542:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667545:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 4/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667550:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.667557:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+688:41278:x1731746396386752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.667561:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.667566:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12047 00000100:00100000:1.0:1651529344.667567:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+688:41278:x1731746396386816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.667572:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12049 00000100:00100000:0.0:1651529344.667573:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+687:41278:x1731746396386880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.667576:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.667577:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12048 00010000:00010000:0.0:1651529344.667578:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 5/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 687 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667581:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 4/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 686 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667582:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12050 00000100:00100000:1.0:1651529344.667584:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+686:41278:x1731746396386944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.667586:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.667586:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667587:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667588:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 686 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667588:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667591:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 4/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667592:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 3/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 686 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667595:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.667597:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3cfb0e6/0xa29a79078f3bb49e lrc: 0/0,0 mode: --/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51a0 expref: 686 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667600:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.667600:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+685:41278:x1731746396386880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.667601:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667602:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667602:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12049 00010000:00010000:1.0:1651529344.667605:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 4/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667609:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667613:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.667618:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667620:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+684:41278:x1731746396386944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667622:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12050 00010000:00010000:0.0:1651529344.667622:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667624:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667634:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7080e87/0xa29a79078f3bb5f5 lrc: 0/0,0 mode: --/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d564d expref: 683 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.667645:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966671936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.667648:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667652:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667654:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667657:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667660:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667663:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1378:39030:x1731745946505600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 946us (1020us total) trans 30064893947 rc 0/0 00000100:00100000:0.0:1651529344.667666:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153086 00000100:00100000:0.0:1651529344.667672:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505984 00000100:00100000:0.0:1651529344.667678:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506048 00000100:00100000:0.0:1651529344.667681:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506112 00000100:00100000:0.0:1651529344.667685:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153089 00000100:00100000:0.0:1651529344.667687:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1381:39030:x1731745946505984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.667692:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177881 count 1 00010000:00010000:0.0:1651529344.667696:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667700:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 2/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.667701:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1381:39029:x1731745946505536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 953us (1044us total) trans 30064893948 rc 0/0 00010000:00010000:0.0:1651529344.667703:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.667704:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153087 00010000:00010000:0.0:1651529344.667704:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667705:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 4/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667709:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153090 00000100:00100000:1.0:1651529344.667711:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1380:39030:x1731745946506048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.667711:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.667715:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177882 count 1 00010000:00010000:0.0:1651529344.667715:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667719:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667719:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966672064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.667728:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.667741:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 2/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667744:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667745:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667746:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 4/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667746:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153091 00000100:00100000:0.0:1651529344.667748:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1380:39030:x1731745946506112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.667753:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 3/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.667755:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177883 count 1 00010000:00010000:1.0:1651529344.667756:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.667758:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667761:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966672128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667762:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 2/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.667765:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667766:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667767:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 4/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667769:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.667773:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 3/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667775:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667776:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.667778:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.667779:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667780:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966672192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.667782:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 3/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667788:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.667790:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 1/0,0 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667793:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf630 lrc: 0/0,0 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667794:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667797:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667797:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667799:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.667800:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667800:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667821:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 3/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667822:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667825:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 1/0,0 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667828:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf637 lrc: 0/0,0 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667842:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667845:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.667846:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667849:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 3/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667853:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 1/0,0 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667855:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf622 lrc: 0/0,0 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667861:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667862:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1381:39030:x1731745946505472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1237us total) trans 30064893949 rc 0/0 00010000:00010000:1.0:1651529344.667864:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667865:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153084 00010000:00010000:1.0:1651529344.667867:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667870:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667873:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667876:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667879:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667882:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667915:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1382:39029:x1731745946505408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1228us (1279us total) trans 30064893950 rc 0/0 00000100:00100000:1.0:1651529344.667918:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153085 00000100:00100000:0.0:1651529344.667921:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1381:39029:x1731745946505664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1143us (1254us total) trans 30064893951 rc 0/0 00000100:00100000:0.0:1651529344.667924:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153088 00010000:00010000:1.0:1651529344.667926:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667930:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.667931:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667932:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667934:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 3/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667935:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.667936:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667938:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 1/0,0 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667939:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 3/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667941:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf629 lrc: 0/0,0 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667944:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 1/0,0 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667947:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf63e lrc: 0/0,0 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.668187:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506432 00000100:00100000:1.0:1651529344.668188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.668206:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506560 00000100:00100000:1.0:1651529344.668209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.668212:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506688 00000100:00100000:0.0:1651529344.668216:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153092 00000100:00100000:1.0:1651529344.668217:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.668218:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1383:39030:x1731745946506432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.668228:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177884 count 1 00010000:00010000:0.0:1651529344.668233:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.668237:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 2/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668245:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668246:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668247:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 4/0,1 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668252:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506496 00010000:00010000:0.0:1651529344.668255:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 3/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.668258:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506624 00010000:00010000:0.0:1651529344.668259:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 4/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668262:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153093 00000100:00100000:1.0:1651529344.668263:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1385:39029:x1731745946506560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.668269:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177886 count 1 00010000:00010000:1.0:1651529344.668273:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668277:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966672256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668278:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 2/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668281:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668281:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668282:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 4/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668289:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 3/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668293:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668297:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966672320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668301:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.668308:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153094 00000100:00100000:0.0:1651529344.668310:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1385:39029:x1731745946506688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.668314:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.668315:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177888 count 1 00010000:00010000:0.0:1651529344.668319:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668320:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153095 00000100:00100000:1.0:1651529344.668322:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1385:39029:x1731745946506496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.668323:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 2/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668326:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.668327:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177885 count 1 00010000:00010000:0.0:1651529344.668327:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668327:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 4/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668330:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668333:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 3/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668334:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 2/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668337:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668337:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668338:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668339:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 4/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668344:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668347:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 3/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 682 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668351:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668351:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.668355:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966672448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668357:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153096 00000100:00100000:0.0:1651529344.668359:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1385:39029:x1731745946506624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.668361:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.668363:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177887 count 1 00010000:00010000:0.0:1651529344.668366:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668370:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 2/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 682 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668373:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668374:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668374:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 4/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668380:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 3/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 682 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668384:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 682 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668388:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966672512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668402:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.668416:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966672064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.668421:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668428:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966672192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.668430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.668431:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.668482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.668490:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966672128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668495:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668502:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387136 00010000:00010000:1.0:1651529344.668507:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 683 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668517:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387264 00010000:00010000:1.0:1651529344.668520:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 684 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668521:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387200 00000100:00100000:1.0:1651529344.668525:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12051 00000100:00100000:1.0:1651529344.668527:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+685:41278:x1731746396387136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.668527:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 685 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668530:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.668531:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 685 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668534:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12052 00010000:00010000:1.0:1651529344.668535:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 685 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668535:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+685:41278:x1731746396387264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.668538:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.668540:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 685 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668541:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59f9915/0xa29a79078f3bc01a lrc: 0/0,0 mode: --/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cf7 expref: 685 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668544:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668544:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 3/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 684 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668545:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668546:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668549:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 4/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668550:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ab665d/0xa29a79078f3bc204 lrc: 0/0,0 mode: --/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d854e expref: 684 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.668553:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668554:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668555:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668558:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.668565:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 4/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668567:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+683:41278:x1731746396387136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.668570:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12051 00000100:00100000:1.0:1651529344.668575:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12053 00000100:00100000:1.0:1651529344.668576:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41279:x1731746396387200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.668579:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.668581:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.668587:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.668590:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 3/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.668595:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41278:x1731746396387264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.668596:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9334548/0xa29a79078f3b7fdf lrc: 0/0,0 mode: --/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcc4 expref: 682 pid: 127526 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.668600:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668600:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668601:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668604:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 4/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668608:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12052 00010000:00010000:1.0:1651529344.668612:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.668619:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+680:41279:x1731746396387200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.668621:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12053 00010000:00010000:0.0:1651529344.668621:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668625:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668634:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668638:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668638:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668641:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668641:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668644:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668685:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1387:39030:x1731745946506112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 936us (1221us total) trans 30064893952 rc 0/0 00000100:00100000:0.0:1651529344.668688:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153091 00000100:00100000:1.0:1651529344.668692:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946506048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1317us total) trans 30064893953 rc 0/0 00010000:00010000:0.0:1651529344.668695:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668696:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153090 00010000:00010000:0.0:1651529344.668701:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668703:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668704:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668706:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.668707:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668707:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668710:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 3/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668715:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 1/0,0 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668718:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf653 lrc: 0/0,0 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668722:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668725:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.668726:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668742:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 3/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668746:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 1/0,0 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668749:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf64c lrc: 0/0,0 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668750:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946505984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1062us (1387us total) trans 30064893954 rc 0/0 00010000:00010000:1.0:1651529344.668753:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668753:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153089 00010000:00010000:1.0:1651529344.668755:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.668756:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668759:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 3/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668762:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 1/0,0 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668765:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf645 lrc: 0/0,0 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668826:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966672256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.668830:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668845:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966672320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668847:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668850:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668850:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.668957:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387648 00000100:00100000:0.0:1651529344.668957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.668966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.668967:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 4/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 680 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668982:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387776 00010000:00010000:1.0:1651529344.668985:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 681 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668989:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387840 00010000:00010000:1.0:1651529344.668991:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.668996:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12054 00000100:00100000:1.0:1651529344.668997:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41278:x1731746396387648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.669000:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669001:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 4/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669014:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12055 00000100:00100000:0.0:1651529344.669017:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41278:x1731746396387776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.669020:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 3/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669021:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.669022:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669025:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335651c7/0xa29a79078f3bbef4 lrc: 0/0,0 mode: --/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78c8 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669027:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 3/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 682 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669032:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669032:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669033:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669033:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c8ff33/0xa29a79078f3bba94 lrc: 0/0,0 mode: --/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67e2 expref: 681 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669036:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669037:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 4/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669037:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669038:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669041:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 4/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669046:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669053:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+680:41278:x1731746396387648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.669057:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669062:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12054 00000100:00100000:0.0:1651529344.669065:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+679:41278:x1731746396387776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669067:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12056 00000100:00100000:1.0:1651529344.669069:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+679:41279:x1731746396387840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.669069:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12055 00010000:00010000:1.0:1651529344.669072:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669073:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 678 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669077:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 3/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 678 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669077:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669080:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669082:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38bdd61/0xa29a79078f3b9eb0 lrc: 0/0,0 mode: --/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8c9 expref: 678 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669085:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669086:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669086:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669087:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669089:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 4/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669089:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669098:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669104:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41279:x1731746396387840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669107:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12056 00010000:00010000:1.0:1651529344.669114:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669118:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669121:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669123:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669133:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946506432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 914us (957us total) trans 30064893955 rc 0/0 00000100:00100000:0.0:1651529344.669136:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153092 00010000:00010000:0.0:1651529344.669143:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669146:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.669147:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669150:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 3/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669155:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 1/0,0 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669157:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf65a lrc: 0/0,0 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669162:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1386:39029:x1731745946506560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 898us (974us total) trans 30064893956 rc 0/0 00010000:00010000:0.0:1651529344.669162:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669165:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153093 00010000:00010000:0.0:1651529344.669165:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.669166:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669168:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 3/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669171:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 1/0,0 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669174:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf661 lrc: 0/0,0 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669179:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669182:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669185:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669187:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.669227:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1386:39029:x1731745946506688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (1018us total) trans 30064893957 rc 0/0 00000100:00100000:0.0:1651529344.669238:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153094 00000100:00100000:1.0:1651529344.669240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.669248:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507008 00000100:00100000:1.0:1651529344.669252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.669254:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507072 00000100:00100000:0.0:1651529344.669262:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153097 00000100:00100000:0.0:1651529344.669264:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1387:39030:x1731745946507008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.669268:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177889 count 1 00010000:00010000:0.0:1651529344.669272:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669277:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 2/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 676 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669280:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669281:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669281:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 4/0,1 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.669296:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 3/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 676 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669300:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 4/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 676 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669304:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.669313:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.669314:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.669321:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966672512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669326:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669332:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507136 00000100:00100000:0.0:1651529344.669339:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153098 00000100:00100000:0.0:1651529344.669341:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1388:39029:x1731745946507072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.669348:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966672448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669353:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669359:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669362:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.669363:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669366:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 3/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669371:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 1/0,0 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.669371:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177890 count 1 00010000:00010000:1.0:1651529344.669373:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf668 lrc: 0/0,0 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669375:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669380:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 2/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 676 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.669381:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153099 00000100:00100000:1.0:1651529344.669383:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1388:39030:x1731745946507136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.669383:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669384:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669384:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 4/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.669389:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177891 count 1 00010000:00010000:0.0:1651529344.669391:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 3/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 676 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669392:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669394:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669399:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 2/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 676 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.669399:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966672640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669402:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669402:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669403:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 4/0,1 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669410:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 3/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 676 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.669413:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.669421:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 4/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669426:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966672704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.669435:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.669441:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387968 00010000:00010000:1.0:1651529344.669471:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 677 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669480:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387904 00010000:00010000:1.0:1651529344.669483:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 678 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669492:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12057 00000100:00100000:1.0:1651529344.669494:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+678:41279:x1731746396387968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.669497:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669499:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 678 pid: 142995 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.669502:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 3/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 678 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669508:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfd4a0d0/0xa29a79078f3b9182 lrc: 0/0,0 mode: --/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5a0 expref: 678 pid: 142995 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669511:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669512:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669513:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.669516:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 4/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669524:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669534:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41279:x1731746396387968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669537:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12057 00000100:00100000:1.0:1651529344.669541:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12058 00000100:00100000:1.0:1651529344.669543:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+676:41278:x1731746396387904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.669545:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669546:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669554:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507328 00010000:00010000:1.0:1651529344.669560:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 3/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669562:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507392 00010000:00010000:1.0:1651529344.669565:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d685da/0xa29a79078f3bac71 lrc: 0/0,0 mode: --/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d302f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669566:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153100 00000100:00100000:0.0:1651529344.669568:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ad16ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1390:39029:x1731745946507328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.669569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669569:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669570:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669573:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 4/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.669573:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177892 count 1 00010000:00010000:0.0:1651529344.669577:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669579:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.669582:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 2/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 675 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.669585:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+675:41278:x1731746396387904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (271us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.669585:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669585:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669586:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 4/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669588:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12058 00010000:00010000:1.0:1651529344.669593:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669593:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 3/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 674 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669596:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669597:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669600:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669600:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966672768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669605:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669609:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.669614:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669620:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669623:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669625:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669643:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1391:39029:x1731745946506496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1425us total) trans 30064893958 rc 0/0 00000100:00100000:1.0:1651529344.669646:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153095 00000100:00100000:1.0:1651529344.669650:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153101 00000100:00100000:1.0:1651529344.669652:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1391:39030:x1731745946507392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.669657:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177893 count 1 00010000:00010000:1.0:1651529344.669661:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669665:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 2/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 674 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669669:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669669:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669670:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 4/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669676:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 674 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669680:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669680:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1391:39029:x1731745946506624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1442us total) trans 30064893959 rc 0/0 00000100:00100000:0.0:1651529344.669683:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153096 00000100:00100000:1.0:1651529344.669687:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966672832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669692:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669695:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.669696:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.669697:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669700:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669700:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 3/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669703:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.669704:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669704:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 1/0,0 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669707:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 3/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669707:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf66f lrc: 0/0,0 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669712:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 1/0,0 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669714:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf676 lrc: 0/0,0 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669719:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669723:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.669751:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507456 00000100:00100000:0.0:1651529344.669763:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.669779:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153102 00000100:00100000:1.0:1651529344.669780:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1391:39029:x1731745946507456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.669785:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177894 count 1 00010000:00010000:1.0:1651529344.669789:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669819:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 2/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 674 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669827:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669828:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669828:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 4/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669828:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.669838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.669840:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 3/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 674 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669844:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669848:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966672896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.669848:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966672640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669852:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669856:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.669859:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388160 00000100:00100000:1.0:1651529344.669863:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388288 00010000:00010000:0.0:1651529344.669864:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 4/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 675 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669868:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.669874:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388352 00010000:00010000:0.0:1651529344.669877:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 5/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 677 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669881:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12059 00000100:00100000:1.0:1651529344.669883:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41278:x1731746396388160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.669884:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12060 00010000:00010000:1.0:1651529344.669886:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.669886:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41279:x1731746396388288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.669887:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 4/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 677 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669889:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.669890:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669894:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 3/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 677 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669897:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 3/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 677 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669899:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f940a7ce/0xa29a79078f3b9318 lrc: 0/0,0 mode: --/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca15 expref: 677 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.669902:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af8cef60/0xa29a79078f3b9ec5 lrc: 0/0,0 mode: --/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf90f expref: 676 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669903:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669903:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669904:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669906:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669906:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669907:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 4/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669907:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669910:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 4/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669917:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669924:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+675:41278:x1731746396388160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.669924:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669926:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12059 00000100:00100000:1.0:1651529344.669931:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12061 00000100:00100000:0.0:1651529344.669932:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+674:41279:x1731746396388288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669933:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+674:41279:x1731746396388352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.669935:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.669935:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12060 00010000:00010000:1.0:1651529344.669937:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 5/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669941:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 4/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 673 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.669946:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669946:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669946:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669947:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669949:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669950:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 4/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669952:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669954:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.669957:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669958:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+673:41279:x1731746396388352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669961:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12061 00010000:00010000:1.0:1651529344.669978:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006df8a047/0xa29a79078f3bb60a lrc: 0/0,0 mode: --/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5677 expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.669983:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966672704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669986:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669989:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669992:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669995:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669998:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 2/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670026:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1393:39029:x1731745946507072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 684us (785us total) trans 30064893960 rc 0/0 00000100:00100000:0.0:1651529344.670029:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153098 00010000:00010000:0.0:1651529344.670037:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670040:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.670041:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670043:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1392:39030:x1731745946507136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 659us (758us total) trans 30064893961 rc 0/0 00010000:00010000:0.0:1651529344.670044:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 3/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670046:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153099 00010000:00010000:0.0:1651529344.670049:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 1/0,0 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670052:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf684 lrc: 0/0,0 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670055:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 2/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670058:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.670058:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670059:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 2/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670061:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670062:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 3/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670064:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670067:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 1/0,0 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670067:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670069:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf68b lrc: 0/0,0 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670080:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670084:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.670085:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670088:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 3/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670091:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 1/0,0 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670094:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf67d lrc: 0/0,0 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670111:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1392:39030:x1731745946507008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 846us (897us total) trans 30064893962 rc 0/0 00000100:00100000:0.0:1651529344.670114:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153097 00000100:00100000:1.0:1651529344.670117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.670149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.670150:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507840 00000100:00100000:0.0:1651529344.670157:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507776 00000100:00100000:0.0:1651529344.670161:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153103 00000100:00100000:0.0:1651529344.670163:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1393:39029:x1731745946507840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.670169:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177896 count 1 00010000:00010000:0.0:1651529344.670172:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670177:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 2/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670180:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670181:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670181:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 4/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670188:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 3/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670192:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670196:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.670204:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670211:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153104 00000100:00100000:0.0:1651529344.670212:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1393:39030:x1731745946507776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.670216:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177895 count 1 00010000:00010000:0.0:1651529344.670220:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670224:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 2/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670227:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670227:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670228:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 4/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670233:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 3/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670237:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670272:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966673024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.670286:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670421:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966672768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.670426:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.670494:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.670502:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966672832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.670504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.670507:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670510:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508096 00000100:00100000:1.0:1651529344.670514:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966672896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.670516:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670517:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508224 00000100:00100000:0.0:1651529344.670520:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508160 00000100:00100000:1.0:1651529344.670523:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153105 00000100:00100000:1.0:1651529344.670531:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1396:39029:x1731745946508096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.670531:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153106 00000100:00100000:0.0:1651529344.670533:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1396:39029:x1731745946508224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.670536:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177897 count 1 00002000:00080000:0.0:1651529344.670538:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177899 count 1 00010000:00010000:1.0:1651529344.670540:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670542:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670545:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 2/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670547:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 2/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670548:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670548:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670549:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 4/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670550:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670551:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670551:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 4/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670556:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 3/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670559:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.670561:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 3/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.670563:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.670565:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670569:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670575:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670577:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.670580:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153107 00000100:00100000:1.0:1651529344.670582:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1396:39029:x1731745946508160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.670587:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177898 count 1 00010000:00010000:1.0:1651529344.670590:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670594:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 2/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670597:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670598:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670599:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 4/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670605:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 3/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 671 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670609:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.670613:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670619:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670777:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388864 00000100:00100000:0.0:1651529344.670782:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966673024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.670784:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.670787:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670792:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12062 00000100:00100000:1.0:1651529344.670794:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+672:41279:x1731746396388864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.670794:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966672960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.670797:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.670797:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670798:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670813:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 3/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670819:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632ee453/0xa29a79078f3bb921 lrc: 0/0,0 mode: --/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62da expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670831:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670831:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670832:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670835:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 4/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670846:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.670858:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+671:41279:x1731746396388864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.670861:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12062 00010000:00010000:1.0:1651529344.670870:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670873:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.670893:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670896:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.670913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.670924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.670937:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388672 00010000:00010000:0.0:1651529344.670943:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 671 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670952:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388992 00010000:00010000:0.0:1651529344.670954:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 672 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670958:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388800 00010000:00010000:0.0:1651529344.670960:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 673 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.670967:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946507456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1185us (1224us total) trans 30064893963 rc 0/0 00000100:00100000:0.0:1651529344.670969:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388928 00000100:00100000:1.0:1651529344.670970:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153102 00010000:00010000:0.0:1651529344.670973:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.670978:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12063 00000100:00100000:0.0:1651529344.670979:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+674:41278:x1731746396388672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.670980:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12064 00000100:00100000:1.0:1651529344.670982:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+674:41279:x1731746396388992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.670982:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.670984:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670985:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670987:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.670987:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 3/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670991:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 3/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.670993:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e10d99d2/0xa29a79078f3bb4dd lrc: 0/0,0 mode: --/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d524f expref: 674 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.670997:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3713a29/0xa29a79078f3bace8 lrc: 0/0,0 mode: --/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32a5 expref: 673 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.670997:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670997:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670998:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671000:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671001:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671002:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671002:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 4/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671005:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 4/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671008:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.671014:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671045:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+672:41279:x1731746396388992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.671045:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+672:41278:x1731746396388672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671048:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12064 00000100:00100000:0.0:1651529344.671049:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12063 00000100:00100000:1.0:1651529344.671052:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12065 00000100:00100000:1.0:1651529344.671054:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+670:41278:x1731746396388800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.671055:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12066 00010000:00010000:1.0:1651529344.671057:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.671057:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+670:41278:x1731746396388928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.671058:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671060:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.671061:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671062:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671065:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 3/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671067:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b5d362/0xa29a79078f3bb3a9 lrc: 0/0,0 mode: --/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d5c expref: 670 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671070:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671070:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e21b81e/0xa29a79078f3ba953 lrc: 0/0,0 mode: --/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2466 expref: 669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671071:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671072:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671074:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 4/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671074:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671075:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671075:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671080:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.671081:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 4/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671085:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41278:x1731746396388800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671087:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12065 00010000:00010000:0.0:1651529344.671087:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.671093:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671093:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+667:41278:x1731746396388928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.671096:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671096:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12066 00010000:00010000:1.0:1651529344.671099:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671103:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671106:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.671107:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671110:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671110:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 3/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671114:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 1/0,0 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671117:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf6a0 lrc: 0/0,0 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671121:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671126:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.671127:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671130:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 3/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671133:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 1/0,0 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671135:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf699 lrc: 0/0,0 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671141:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671144:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671147:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671148:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1397:39030:x1731745946507392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1495us (1633us total) trans 30064893964 rc 0/0 00010000:00010000:0.0:1651529344.671150:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671151:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153101 00010000:00010000:1.0:1651529344.671166:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671170:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.671171:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671174:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 3/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671179:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 1/0,0 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671182:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf692 lrc: 0/0,0 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671193:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671195:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ad16ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946507328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1626us (1694us total) trans 30064893965 rc 0/0 00010000:00010000:1.0:1651529344.671197:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671199:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153100 00010000:00010000:0.0:1651529344.671219:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671223:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671226:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671229:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.671271:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1397:39030:x1731745946507776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1057us (1121us total) trans 30064893966 rc 0/0 00000100:00100000:0.0:1651529344.671274:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153104 00010000:00010000:0.0:1651529344.671281:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671284:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.671287:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671295:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.671339:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946507840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1175us (1222us total) trans 30064893967 rc 0/0 00000100:00100000:0.0:1651529344.671342:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153103 00000100:00100000:0.0:1651529344.671352:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.671357:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671364:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389184 00010000:00010000:0.0:1651529344.671368:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.671378:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389312 00010000:00010000:0.0:1651529344.671381:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 668 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.671387:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671392:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671398:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671401:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.671401:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389248 00010000:00010000:1.0:1651529344.671402:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671404:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671405:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 3/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671409:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 1/0,0 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671409:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12067 00000100:00100000:0.0:1651529344.671411:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+669:41278:x1731746396389184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.671412:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf6ae lrc: 0/0,0 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671414:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.671415:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671416:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671422:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 3/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671427:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000589da9ff/0xa29a79078f3b9f12 lrc: 0/0,0 mode: --/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa6d expref: 669 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671429:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.671430:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671432:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671433:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 3/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671435:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 4/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671437:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 1/0,0 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671439:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf6a7 lrc: 0/0,0 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671446:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671453:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12068 00000100:00100000:0.0:1651529344.671456:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41278:x1731746396389184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671459:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41278:x1731746396389312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.671459:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12067 00010000:00010000:1.0:1651529344.671463:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671465:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671469:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 3/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.671469:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12069 00000100:00100000:0.0:1651529344.671471:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+667:41278:x1731746396389248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.671473:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000013f7379/0xa29a79078f3bb1bf lrc: 0/0,0 mode: --/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45ad expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671473:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.671475:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671478:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 3/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.671484:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ba25c3/0xa29a79078f3b9d9f lrc: 0/0,0 mode: --/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4a8 expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671485:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671486:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671487:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671487:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671488:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671489:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671490:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 4/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671491:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 4/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671504:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.671504:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671513:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+665:41278:x1731746396389312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671515:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12068 00010000:00010000:1.0:1651529344.671523:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671526:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671529:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671532:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671533:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41278:x1731746396389248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.671536:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12069 00010000:00010000:0.0:1651529344.671544:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671547:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671550:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671553:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671577:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946508096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1046us (1123us total) trans 30064893968 rc 0/0 00000100:00100000:1.0:1651529344.671580:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153105 00010000:00010000:1.0:1651529344.671588:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671591:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.671592:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671595:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 3/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671599:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 1/0,0 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671599:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946508224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1065us (1105us total) trans 30064893969 rc 0/0 00010000:00010000:1.0:1651529344.671602:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf6b5 lrc: 0/0,0 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671602:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153106 00010000:00010000:1.0:1651529344.671607:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671609:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.671610:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671613:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 3/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671616:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 1/0,0 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671621:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf6bc lrc: 0/0,0 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671626:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671632:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.671638:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671641:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671644:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671646:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.671686:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946508160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1103us (1182us total) trans 30064893970 rc 0/0 00000100:00100000:1.0:1651529344.671689:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153107 00000100:00100000:1.0:1651529344.671695:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508608 00000100:00100000:0.0:1651529344.671699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.671711:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508672 00000100:00100000:1.0:1651529344.671715:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508736 00000100:00100000:1.0:1651529344.671727:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508800 00010000:00010000:0.0:1651529344.671739:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671743:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.671744:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671748:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508864 00000100:00100000:1.0:1651529344.671754:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153108 00000100:00100000:1.0:1651529344.671756:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1401:39029:x1731745946508608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.671756:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 3/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.671761:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177900 count 1 00010000:00010000:0.0:1651529344.671761:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 1/0,0 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671766:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671771:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 2/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671774:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671774:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671775:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 4/0,1 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671779:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf6c3 lrc: 0/0,0 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671782:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 3/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671786:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 4/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.671789:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153109 00000100:00100000:1.0:1651529344.671790:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671791:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1401:39030:x1731745946508672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.671797:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177901 count 1 00010000:00010000:0.0:1651529344.671800:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671825:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.671829:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 2/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 663 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671832:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.671833:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153110 00010000:00010000:0.0:1651529344.671833:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.671834:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1401:39029:x1731745946508736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.671834:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 4/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.671839:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177902 count 1 00010000:00010000:0.0:1651529344.671841:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 3/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 663 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671843:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671844:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 663 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671847:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 2/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.671849:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966673344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671853:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671854:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671854:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 4/0,1 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671861:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 3/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671864:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 4/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.671868:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966673408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671871:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.671876:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.671878:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153111 00000100:00100000:0.0:1651529344.671880:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1401:39030:x1731745946508800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.671884:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153112 00000100:00100000:1.0:1651529344.671885:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1401:39029:x1731745946508864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.671885:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177903 count 1 00010000:00010000:0.0:1651529344.671888:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.671889:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177904 count 1 00010000:00010000:1.0:1651529344.671893:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671893:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 2/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671896:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671897:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 2/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671897:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671897:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 4/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671900:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671901:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671901:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 4/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671904:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 3/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671907:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.671910:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 3/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.671911:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966673472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671914:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.671917:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966673536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671919:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.671924:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.671948:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671972:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509056 00000100:00100000:0.0:1651529344.671979:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509120 00000100:00100000:0.0:1651529344.671982:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509184 00000100:00100000:0.0:1651529344.671986:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153113 00000100:00100000:0.0:1651529344.671987:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1404:39030:x1731745946509056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.671992:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177905 count 1 00000100:00100000:1.0:1651529344.671996:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153114 00000100:00100000:1.0:1651529344.671997:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1404:39029:x1731745946509120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.671997:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672001:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 2/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 663 pid: 142994 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.672003:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177906 count 1 00010000:00010000:0.0:1651529344.672004:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672005:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672006:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 4/0,1 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672007:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672012:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 2/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672012:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 3/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 663 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672015:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672015:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672016:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 4/0,1 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672016:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 4/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 663 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672022:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 3/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672026:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 4/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672030:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.672036:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672044:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.672052:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.672058:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153115 00000100:00100000:0.0:1651529344.672060:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1404:39030:x1731745946509184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.672065:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177907 count 1 00010000:00010000:0.0:1651529344.672069:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672073:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 2/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672076:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672077:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672077:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 4/0,1 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672086:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 3/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 663 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672090:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 4/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672094:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966673728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.672100:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.672399:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966673344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672405:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672405:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672412:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966673472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672420:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672433:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389824 00000100:00100000:1.0:1651529344.672436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672438:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 664 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672443:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389952 00010000:00010000:0.0:1651529344.672446:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 5/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 665 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672448:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966673408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.672450:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389760 00010000:00010000:1.0:1651529344.672452:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672452:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 5/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 666 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672456:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389888 00010000:00010000:0.0:1651529344.672458:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672459:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966673536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.672462:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672462:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390016 00010000:00010000:0.0:1651529344.672464:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 668 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672468:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12070 00000100:00100000:0.0:1651529344.672469:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41278:x1731746396389824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.672470:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12071 00000100:00100000:1.0:1651529344.672472:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41278:x1731746396389952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.672472:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.672474:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 668 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672475:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672477:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 4/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 668 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672477:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 3/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 668 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672481:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 3/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 668 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672482:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fec3ea5/0xa29a79078f3b9502 lrc: 0/0,0 mode: --/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd18c expref: 668 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672486:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672487:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672488:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672489:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbbf5f3/0xa29a79078f3b9d91 lrc: 0/0,0 mode: --/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf438 expref: 667 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672493:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672493:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 4/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672494:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672494:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672497:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 4/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672500:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.672504:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.672508:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+666:41278:x1731746396389824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672511:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+666:41278:x1731746396389952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.672511:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12070 00000100:00100000:1.0:1651529344.672514:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12071 00000100:00100000:0.0:1651529344.672516:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12072 00000100:00100000:0.0:1651529344.672517:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41279:x1731746396389760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.672520:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12073 00010000:00010000:0.0:1651529344.672520:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.672521:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41279:x1731746396389888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.672521:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 5/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 664 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672524:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672525:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 664 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672525:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 4/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 664 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672529:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 3/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 664 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672530:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672530:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672531:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672534:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884458b2/0xa29a79078f3bb856 lrc: 0/0,0 mode: --/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f7d expref: 664 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672540:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672540:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672541:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672544:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 4/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672552:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.672557:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+663:41279:x1731746396389888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.672564:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 4/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672570:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.672574:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12073 00000100:00100000:0.0:1651529344.672577:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41279:x1731746396389760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672578:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12074 00000100:00100000:1.0:1651529344.672580:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41279:x1731746396390016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.672581:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12072 00010000:00010000:1.0:1651529344.672583:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672584:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672588:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 3/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672589:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672592:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672593:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d7643ab/0xa29a79078f3bbefb lrc: 0/0,0 mode: --/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78d6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672596:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672597:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672598:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672601:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 4/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672606:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.672608:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672611:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672612:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+660:41279:x1731746396390016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672615:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12074 00010000:00010000:1.0:1651529344.672632:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672636:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.672637:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672640:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 3/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672644:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 1/0,0 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672647:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf6df lrc: 0/0,0 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672653:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672655:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1405:39030:x1731745946508800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 774us (977us total) trans 30064893971 rc 0/0 00010000:00010000:1.0:1651529344.672658:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672658:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153111 00010000:00010000:1.0:1651529344.672661:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672664:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672665:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672669:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672679:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672682:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672715:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946508864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 828us (1015us total) trans 30064893972 rc 0/0 00000100:00100000:1.0:1651529344.672718:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153112 00000100:00100000:0.0:1651529344.672724:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1405:39030:x1731745946508672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 932us (1077us total) trans 30064893973 rc 0/0 00010000:00010000:1.0:1651529344.672725:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672727:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153109 00010000:00010000:1.0:1651529344.672728:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.672729:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672743:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 3/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672743:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672747:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.672748:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 1/0,0 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672748:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672751:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf6e6 lrc: 0/0,0 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672751:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 3/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672756:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 1/0,0 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672757:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672759:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf6d1 lrc: 0/0,0 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672760:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672763:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672766:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672801:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.672828:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1405:39029:x1731745946508736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1159us total) trans 30064893974 rc 0/0 00000100:00100000:1.0:1651529344.672831:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153110 00000100:00100000:1.0:1651529344.672842:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390144 00010000:00010000:1.0:1651529344.672847:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 5/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 660 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672864:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390080 00010000:00010000:1.0:1651529344.672867:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 5/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672880:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12075 00000100:00100000:1.0:1651529344.672882:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41279:x1731746396390144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.672886:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672893:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 5/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 661 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672897:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 4/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 661 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672904:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672904:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.672904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.672905:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672908:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 4/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672911:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390336 00010000:00010000:1.0:1651529344.672913:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.672925:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41279:x1731746396390144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672927:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12075 00000100:00100000:1.0:1651529344.672932:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12076 00000100:00100000:1.0:1651529344.672933:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41278:x1731746396390080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.672936:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.672937:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 5/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672938:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 5/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672941:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 4/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672947:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12077 00010000:00010000:1.0:1651529344.672948:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672948:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672949:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672949:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41279:x1731746396390336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.672952:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 4/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672953:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.672954:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 5/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.672956:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.672958:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 4/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 661 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.672961:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41278:x1731746396390080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672963:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12076 00010000:00010000:0.0:1651529344.672964:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672964:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672965:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672968:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 4/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672973:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c30f3fb/0xa29a79078f3bb905 lrc: 0/0,0 mode: --/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6240 expref: 660 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.672973:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.672977:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.672980:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+659:41279:x1731746396390336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (77us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.672981:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672983:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12077 00010000:00010000:1.0:1651529344.672984:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672986:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672989:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672992:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672994:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0226757/0xa29a79078f3baa64 lrc: 0/0,0 mode: --/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27e6 expref: 658 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.672997:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966673728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673001:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673004:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673007:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673010:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673013:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673029:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1405:39029:x1731745946508608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1272us (1397us total) trans 30064893975 rc 0/0 00000100:00100000:1.0:1651529344.673032:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153108 00010000:00010000:1.0:1651529344.673039:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673043:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.673044:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673046:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 3/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673051:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 1/0,0 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673053:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3bf6d8 lrc: 0/0,0 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673054:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1405:39030:x1731745946509184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1087us total) trans 30064893976 rc 0/0 00000100:00100000:0.0:1651529344.673057:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153115 00010000:00010000:1.0:1651529344.673058:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673060:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.673061:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673064:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 3/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673067:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 1/0,0 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673070:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3bf6ca lrc: 0/0,0 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673073:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673076:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.673076:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673079:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 3/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673082:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 1/0,0 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673084:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf6fb lrc: 0/0,0 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673094:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7772af/0xa29a79078f3b783e lrc: 0/0,0 mode: --/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb688 expref: 657 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.673095:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001164ec6c/0xa29a79078f3bacda lrc: 0/0,0 mode: --/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d325f expref: 657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.673099:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673099:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673102:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673103:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673105:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673106:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673109:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673111:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673111:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673114:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673114:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673116:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673160:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946509120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1201us total) trans 30064893977 rc 0/0 00000100:00100000:1.0:1651529344.673163:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153114 00000100:00100000:0.0:1651529344.673165:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1406:39030:x1731745946509056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1176us (1216us total) trans 30064893978 rc 0/0 00000100:00100000:0.0:1651529344.673168:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153113 00010000:00010000:1.0:1651529344.673170:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673176:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.673176:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673177:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673179:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.673180:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 3/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673180:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673183:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 3/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673184:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 1/0,0 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673187:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bf6f4 lrc: 0/0,0 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673187:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 1/0,0 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673190:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf6ed lrc: 0/0,0 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.673270:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509632 00000100:00100000:0.0:1651529344.673281:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153116 00000100:00100000:0.0:1651529344.673283:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1405:39029:x1731745946509632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.673288:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177908 count 1 00010000:00010000:0.0:1651529344.673292:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673297:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 2/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673300:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673301:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673301:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 4/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673308:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 3/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.673309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.673312:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.673316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.673316:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.673349:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509760 00000100:00100000:0.0:1651529344.673349:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.673355:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509696 00000100:00100000:1.0:1651529344.673356:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509824 00000100:00100000:1.0:1651529344.673363:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153117 00000100:00100000:1.0:1651529344.673365:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1408:39029:x1731745946509760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.673374:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153118 00002000:00080000:1.0:1651529344.673375:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177910 count 1 00000100:00100000:0.0:1651529344.673376:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1408:39029:x1731745946509824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.673380:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.673381:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177911 count 1 00010000:00010000:1.0:1651529344.673385:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 2/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673385:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673388:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673389:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673390:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 4/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673390:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 2/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673393:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673393:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673394:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 4/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673396:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 3/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673400:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.673401:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 3/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.673404:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673404:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.673408:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966673920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673414:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.673420:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153119 00000100:00100000:1.0:1651529344.673422:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1408:39029:x1731745946509696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.673427:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177909 count 1 00000100:00100000:0.0:1651529344.673436:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.673437:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673442:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 2/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673445:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673445:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673446:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 4/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.673455:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 3/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673458:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.673462:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.673469:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.673475:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510080 00000100:00100000:1.0:1651529344.673486:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510016 00000100:00100000:1.0:1651529344.673493:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153120 00000100:00100000:1.0:1651529344.673494:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1410:39030:x1731745946510080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.673498:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177913 count 1 00010000:00010000:1.0:1651529344.673502:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.673515:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 2/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673518:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673518:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673519:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 4/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673526:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 3/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.673536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.673537:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.673542:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966674048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673542:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510144 00000100:00100000:0.0:1651529344.673547:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510208 00000100:00100000:0.0:1651529344.673550:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153121 00000100:00100000:0.0:1651529344.673552:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1412:39029:x1731745946510016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.673555:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.673562:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153122 00000100:00100000:1.0:1651529344.673564:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1412:39029:x1731745946510144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.673564:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177912 count 1 00010000:00010000:0.0:1651529344.673568:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.673569:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177914 count 1 00010000:00010000:1.0:1651529344.673572:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673577:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 2/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673580:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673580:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673581:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 4/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673586:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 2/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673587:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 3/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673589:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673590:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.673590:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673591:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 4/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673597:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966674112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673598:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 3/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673601:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.673604:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.673605:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966674176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673614:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.673621:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153123 00000100:00100000:0.0:1651529344.673623:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1412:39030:x1731745946510208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.673627:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177915 count 1 00010000:00010000:0.0:1651529344.673631:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673655:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 2/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673659:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673660:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673660:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 4/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673700:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 3/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 655 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673704:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 655 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.673708:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673716:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.673751:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966673920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673755:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673762:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966673792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673765:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673771:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966673856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673776:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673784:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966673984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673786:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673891:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966674048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673895:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673902:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966674176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673903:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966674112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673905:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673906:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673941:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673945:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.674289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674290:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390848 00000100:00100000:1.0:1651529344.674296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.674296:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 656 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674310:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390784 00000100:00100000:1.0:1651529344.674311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.674313:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 657 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674317:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390976 00010000:00010000:0.0:1651529344.674319:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 658 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674323:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390912 00010000:00010000:0.0:1651529344.674325:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674329:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391104 00010000:00010000:0.0:1651529344.674331:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 660 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674333:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391232 00000100:00100000:0.0:1651529344.674335:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391360 00010000:00010000:0.0:1651529344.674337:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 662 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674338:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 662 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674341:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391296 00010000:00010000:0.0:1651529344.674343:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.674345:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12078 00000100:00100000:1.0:1651529344.674347:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+663:41278:x1731746396390848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.674348:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12079 00000100:00100000:0.0:1651529344.674349:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+663:41279:x1731746396390784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.674350:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674351:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674352:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674354:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674355:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 3/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674358:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 3/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674361:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072589653/0xa29a79078f3ba66d lrc: 0/0,0 mode: --/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18ea expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674364:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf6ccad/0xa29a79078f3b9e4e lrc: 0/0,0 mode: --/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf79c expref: 663 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674365:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674366:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674367:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674368:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674368:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674369:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674370:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 4/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674372:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 4/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674376:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674379:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.674388:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41278:x1731746396390848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674391:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12078 00000100:00100000:0.0:1651529344.674393:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41279:x1731746396390784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674397:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12080 00000100:00100000:1.0:1651529344.674399:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+660:41278:x1731746396390976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.674399:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12079 00010000:00010000:1.0:1651529344.674401:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674403:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674404:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12081 00000100:00100000:0.0:1651529344.674406:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+659:41279:x1731746396390912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.674407:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 3/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674408:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674410:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674412:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eac9869/0xa29a79078f3bae23 lrc: 0/0,0 mode: --/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3736 expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674414:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 3/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 659 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674416:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674416:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674417:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674419:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d68678/0xa29a79078f3bb19c lrc: 0/0,0 mode: --/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44cd expref: 658 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674420:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 4/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674423:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674423:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674424:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674425:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674427:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 4/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674431:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+657:41278:x1731746396390976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.674432:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.674433:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12080 00000100:00100000:1.0:1651529344.674438:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12082 00000100:00100000:0.0:1651529344.674438:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+656:41279:x1731746396390912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674439:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+656:41278:x1731746396391104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.674441:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12081 00010000:00010000:1.0:1651529344.674442:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674443:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674447:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 3/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674449:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12083 00010000:00010000:1.0:1651529344.674451:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097bee320/0xa29a79078f3b9492 lrc: 0/0,0 mode: --/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfbe expref: 655 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674451:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+655:41278:x1731746396391360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.674453:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674454:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 654 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674455:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674455:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674456:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674458:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 3/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 654 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674459:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 4/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674462:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007aeb917/0xa29a79078f3bb722 lrc: 0/0,0 mode: --/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5af3 expref: 654 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674464:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674465:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674466:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674467:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674469:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+653:41278:x1731746396391104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.674470:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 4/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674471:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12082 00000100:00100000:1.0:1651529344.674475:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12084 00010000:00010000:0.0:1651529344.674476:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.674477:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+652:41278:x1731746396391232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.674479:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674480:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 652 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674481:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+652:41278:x1731746396391360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.674483:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12083 00010000:00010000:1.0:1651529344.674484:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 3/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 652 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674487:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12085 00010000:00010000:1.0:1651529344.674488:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ebeb2a0/0xa29a79078f3ba81f lrc: 0/0,0 mode: --/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d201b expref: 651 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.674489:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+651:41279:x1731746396391296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.674491:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674491:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674491:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674492:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674492:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 650 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674495:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 4/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674496:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 3/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 650 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.674500:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674501:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000356e35f/0xa29a79078f3b9d52 lrc: 0/0,0 mode: --/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf382 expref: 650 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.674504:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674504:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.674505:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41278:x1731746396391232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.674505:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674507:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12084 00010000:00010000:0.0:1651529344.674508:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 4/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674513:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.674514:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674517:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674518:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+648:41279:x1731746396391296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.674520:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674521:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12085 00010000:00010000:1.0:1651529344.674523:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674527:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674531:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674534:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674539:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674574:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1414:39029:x1731745946509760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1207us (1265us total) trans 30064893979 rc 0/0 00000100:00100000:1.0:1651529344.674577:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153117 00010000:00010000:1.0:1651529344.674583:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674585:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1413:39029:x1731745946509632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1302us (1345us total) trans 30064893980 rc 0/0 00010000:00010000:1.0:1651529344.674587:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674588:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153116 00010000:00010000:1.0:1651529344.674590:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674593:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674596:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674599:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674610:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674613:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674632:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1414:39029:x1731745946509696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1208us (1315us total) trans 30064893981 rc 0/0 00000100:00100000:1.0:1651529344.674635:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153119 00010000:00010000:1.0:1651529344.674642:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674645:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674646:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1413:39029:x1731745946509824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1269us (1319us total) trans 30064893982 rc 0/0 00000100:00100000:0.0:1651529344.674649:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153118 00010000:00010000:1.0:1651529344.674650:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674653:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674656:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674659:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674665:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674667:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674683:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1414:39030:x1731745946510080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1188us (1233us total) trans 30064893983 rc 0/0 00000100:00100000:1.0:1651529344.674686:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153120 00010000:00010000:1.0:1651529344.674693:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674696:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674698:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1413:39029:x1731745946510016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1145us (1234us total) trans 30064893984 rc 0/0 00010000:00010000:1.0:1651529344.674699:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674701:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153121 00010000:00010000:1.0:1651529344.674702:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674708:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674711:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.674712:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674715:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 3/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674720:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 1/0,0 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674723:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bf709 lrc: 0/0,0 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674727:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674741:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1413:39029:x1731745946510144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1177us (1228us total) trans 30064893985 rc 0/0 00010000:00010000:0.0:1651529344.674741:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.674743:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674744:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153122 00010000:00010000:0.0:1651529344.674746:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 3/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674749:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 1/0,0 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674752:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674752:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf702 lrc: 0/0,0 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674756:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674757:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.674758:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674758:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.674759:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674761:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 3/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674762:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 3/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674765:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 1/0,0 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674766:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 1/0,0 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674769:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bf717 lrc: 0/0,0 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674770:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf710 lrc: 0/0,0 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674773:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674774:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674776:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.674776:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.674777:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674777:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674780:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 3/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674780:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 3/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674783:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 1/0,0 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674783:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 1/0,0 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674785:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf725 lrc: 0/0,0 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674788:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674791:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.674792:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674796:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bf71e lrc: 0/0,0 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674797:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 3/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674800:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 1/0,0 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674817:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bf72c lrc: 0/0,0 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674824:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674827:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674830:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674833:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674872:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1413:39030:x1731745946510208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1248us (1336us total) trans 30064893986 rc 0/0 00000100:00100000:0.0:1651529344.674875:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153123 00010000:00010000:1.0:1651529344.674940:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674944:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.674945:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674948:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 3/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674953:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 1/0,0 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674956:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf733 lrc: 0/0,0 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675101:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510976 00000100:00100000:1.0:1651529344.675107:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510912 00000100:00100000:0.0:1651529344.675109:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153124 00000100:00100000:0.0:1651529344.675110:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1414:39030:x1731745946510976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.675115:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153125 00002000:00080000:0.0:1651529344.675116:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177917 count 1 00000100:00100000:1.0:1651529344.675117:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1414:39029:x1731745946510912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.675121:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.675123:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177916 count 1 00010000:00010000:0.0:1651529344.675126:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 2/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675127:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675129:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675129:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675130:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 4/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675137:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 3/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675141:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675143:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 2/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.675145:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675146:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675147:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675148:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 4/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675155:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675159:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 647 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.675169:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966674368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675185:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.675200:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675248:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511104 00000100:00100000:1.0:1651529344.675249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675256:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511232 00000100:00100000:0.0:1651529344.675260:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511360 00000100:00100000:1.0:1651529344.675263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675289:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511040 00000100:00100000:1.0:1651529344.675290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675300:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511168 00000100:00100000:0.0:1651529344.675300:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511296 00000100:00100000:0.0:1651529344.675305:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153126 00000100:00100000:0.0:1651529344.675315:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.675317:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153127 00000100:00100000:1.0:1651529344.675318:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.675320:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177919 count 1 00002000:00080000:1.0:1651529344.675324:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177921 count 1 00010000:00010000:0.0:1651529344.675325:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675329:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 2/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675332:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675333:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675334:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 4/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675335:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675340:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 2/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675340:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 3/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675343:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675344:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675344:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 4/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675344:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675348:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966674432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675352:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675355:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.675360:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966674496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.675360:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.675366:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153128 00000100:00100000:0.0:1651529344.675368:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.675369:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.675372:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177923 count 1 00010000:00010000:0.0:1651529344.675375:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675376:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153129 00000100:00100000:1.0:1651529344.675378:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f15d981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.675382:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177918 count 1 00010000:00010000:1.0:1651529344.675385:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675390:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 2/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675390:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 2/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675393:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675393:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675394:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 4/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675401:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 3/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675403:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675403:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675404:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 4/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675404:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 647 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675408:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966674560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675411:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 3/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 647 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675415:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 647 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675415:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675419:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966674624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675426:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675433:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153130 00000100:00100000:1.0:1651529344.675434:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.675442:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153131 00000100:00100000:0.0:1651529344.675444:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946511168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.675445:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177922 count 1 00010000:00010000:1.0:1651529344.675449:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.675449:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177920 count 1 00010000:00010000:1.0:1651529344.675453:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 2/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675453:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675456:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675457:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675457:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 4/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675457:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 2/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675460:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675466:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 3/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675467:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675468:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 4/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675469:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.675473:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966674688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.675476:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 3/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 647 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.675480:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.675480:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675484:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966674752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.675492:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675528:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966674368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675533:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.675581:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.675590:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675603:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391808 00010000:00010000:0.0:1651529344.675608:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 648 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675620:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391872 00000100:00100000:1.0:1651529344.675630:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12086 00000100:00100000:1.0:1651529344.675633:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41279:x1731746396391808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.675636:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.675636:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 649 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675638:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675642:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 3/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.675647:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12087 00000100:00100000:0.0:1651529344.675649:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41278:x1731746396391872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.675652:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.675654:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000593fcd1e/0xa29a79078f3bad89 lrc: 0/0,0 mode: --/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d354c expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675659:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675659:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675660:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675661:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 648 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675663:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 4/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675665:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 648 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.675672:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.675677:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3b97f6 lrc: 0/0,0 mode: --/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde2e expref: 648 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.675683:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+647:41279:x1731746396391808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.675685:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12086 00010000:00010000:0.0:1651529344.675687:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675687:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675688:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675692:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 4/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675700:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.675704:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675708:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675708:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41278:x1731746396391872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.675711:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675711:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12087 00010000:00010000:1.0:1651529344.675713:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675719:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675722:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675725:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675728:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675767:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1422:39029:x1731745946510912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 648us (679us total) trans 30064893987 rc 0/0 00000100:00100000:1.0:1651529344.675770:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153125 00010000:00010000:1.0:1651529344.675777:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675780:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1421:39030:x1731745946510976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 668us (700us total) trans 30064893988 rc 0/0 00010000:00010000:1.0:1651529344.675781:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.675782:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675783:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153124 00010000:00010000:1.0:1651529344.675785:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 3/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675789:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 1/0,0 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675792:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bf741 lrc: 0/0,0 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675797:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675799:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.675800:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675829:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 3/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675833:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 1/0,0 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675846:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf73a lrc: 0/0,0 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675900:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966674432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675910:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966674496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675914:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675919:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675939:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966674560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.675942:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676126:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511744 00000100:00100000:1.0:1651529344.676130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.676138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.676148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.676150:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511680 00000100:00100000:1.0:1651529344.676157:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.676160:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153132 00000100:00100000:0.0:1651529344.676161:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1422:39030:x1731745946511744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.676163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.676166:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177925 count 1 00010000:00010000:0.0:1651529344.676171:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676176:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 2/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 645 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676181:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676182:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676183:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 4/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676190:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 3/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 645 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676193:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 645 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.676194:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966674624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.676197:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.676198:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676206:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392256 00000100:00100000:0.0:1651529344.676213:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.676217:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 646 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.676220:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153133 00000100:00100000:0.0:1651529344.676222:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1422:39029:x1731745946511680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.676223:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392384 00010000:00010000:1.0:1651529344.676226:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.676226:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177924 count 1 00000100:00100000:1.0:1651529344.676230:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392512 00010000:00010000:0.0:1651529344.676230:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676233:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 648 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676234:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 2/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 648 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.676237:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392640 00010000:00010000:0.0:1651529344.676237:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676238:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 649 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676238:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676239:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 4/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676243:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12088 00000100:00100000:1.0:1651529344.676244:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41278:x1731746396392256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.676247:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.676247:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 3/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 649 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676249:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676252:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 3/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676258:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005356bba8/0xa29a79078f3bc2c1 lrc: 0/0,0 mode: --/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8842 expref: 649 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676261:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676262:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676263:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676264:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 648 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676266:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 4/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676269:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966674880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.676276:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.676283:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.676286:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+648:41278:x1731746396392256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.676288:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12088 00010000:00010000:0.0:1651529344.676289:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676292:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676295:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676298:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12089 00010000:00010000:0.0:1651529344.676298:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676299:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+647:41278:x1731746396392384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.676302:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676303:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676315:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676320:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5277080/0xa29a79078f3ba612 lrc: 0/0,0 mode: --/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1770 expref: 647 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676323:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676324:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676325:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676328:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 4/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676333:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.676339:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41278:x1731746396392384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.676342:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12089 00000100:00100000:0.0:1651529344.676342:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1423:39030:x1731745946511104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1026us (1110us total) trans 30064893989 rc 0/0 00000100:00100000:0.0:1651529344.676345:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153126 00000100:00100000:1.0:1651529344.676346:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12090 00000100:00100000:1.0:1651529344.676348:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+645:41278:x1731746396392512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.676350:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676352:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 645 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.676353:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12091 00010000:00010000:1.0:1651529344.676355:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 3/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 645 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.676355:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+645:41278:x1731746396392640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.676359:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008795531b/0xa29a79078f3b95f7 lrc: 0/0,0 mode: --/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd62b expref: 645 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676359:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.676360:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 645 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676363:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676363:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676364:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676364:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 3/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 644 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676367:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 4/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676370:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000827b91a3/0xa29a79078f3b9572 lrc: 0/0,0 mode: --/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd399 expref: 644 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676376:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.676381:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676381:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.676382:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41278:x1731746396392512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.676382:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676384:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12090 00010000:00010000:0.0:1651529344.676386:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 4/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676395:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.676400:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966674688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.676402:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+642:41278:x1731746396392640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.676404:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676404:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12091 00010000:00010000:1.0:1651529344.676412:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676412:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676415:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.676415:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676416:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676419:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 3/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676423:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 1/0,0 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676426:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3bf748 lrc: 0/0,0 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676429:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676432:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676432:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676434:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676438:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676440:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676471:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1424:39030:x1731745946511360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1103us (1215us total) trans 30064893990 rc 0/0 00000100:00100000:0.0:1651529344.676474:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153128 00000100:00100000:1.0:1651529344.676481:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1423:39030:x1731745946511232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1161us (1231us total) trans 30064893991 rc 0/0 00010000:00010000:0.0:1651529344.676481:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676484:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153127 00010000:00010000:0.0:1651529344.676485:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.676486:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676489:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 3/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676492:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676493:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 1/0,0 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676496:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.676496:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3bf756 lrc: 0/0,0 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676497:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676499:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 3/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676504:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 1/0,0 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676507:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bf74f lrc: 0/0,0 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676513:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676516:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676520:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676522:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.676545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.676555:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f15d981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1423:39030:x1731745946511040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1177us (1292us total) trans 30064893992 rc 0/0 00000100:00100000:1.0:1651529344.676558:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153129 00010000:00010000:1.0:1651529344.676591:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676599:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.676600:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676603:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 3/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676608:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966674752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.676613:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 1/0,0 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676613:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676616:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bf75d lrc: 0/0,0 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676620:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392704 00010000:00010000:0.0:1651529344.676624:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 642 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.676653:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392768 00010000:00010000:1.0:1651529344.676658:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.676658:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12092 00000100:00100000:0.0:1651529344.676660:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41279:x1731746396392704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.676664:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.676666:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.676668:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12093 00000100:00100000:1.0:1651529344.676670:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41279:x1731746396392768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.676670:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 3/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676672:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676674:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676676:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bad43 lrc: 0/0,0 mode: --/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3434 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.676677:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 3/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 643 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676680:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676680:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676681:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676682:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa778d0/0xa29a79078f3bba63 lrc: 0/0,0 mode: --/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6764 expref: 642 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676684:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 4/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676686:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676686:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676687:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676690:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 4/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676700:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.676708:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.676716:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41279:x1731746396392768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.676719:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12093 00000100:00100000:0.0:1651529344.676721:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+640:41279:x1731746396392704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.676725:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676725:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12092 00010000:00010000:1.0:1651529344.676729:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676742:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676742:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676745:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676746:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676749:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676757:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676798:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1424:39030:x1731745946511296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1363us (1507us total) trans 30064893993 rc 0/0 00000100:00100000:1.0:1651529344.676801:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153130 00010000:00010000:1.0:1651529344.676822:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676826:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.676827:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676830:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 3/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676835:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 1/0,0 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676838:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bf764 lrc: 0/0,0 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676842:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676843:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1423:39030:x1731745946511168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1397us (1563us total) trans 30064893994 rc 0/0 00010000:00010000:1.0:1651529344.676845:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.676846:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676846:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153131 00010000:00010000:1.0:1651529344.676848:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 3/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676852:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 1/0,0 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676854:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3bf76b lrc: 0/0,0 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.676890:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.676909:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512320 00000100:00100000:0.0:1651529344.676911:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512448 00000100:00100000:0.0:1651529344.676937:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153134 00000100:00100000:0.0:1651529344.676939:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1424:39029:x1731745946512448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.676942:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153135 00000100:00100000:1.0:1651529344.676944:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1424:39029:x1731745946512320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.676944:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177928 count 1 00002000:00080000:1.0:1651529344.676949:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177926 count 1 00010000:00010000:0.0:1651529344.676949:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676953:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676958:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 2/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676963:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676963:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 2/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676964:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676964:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 4/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676966:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676966:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676967:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 4/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676971:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 3/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676975:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.676975:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 3/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.676979:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966674944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676979:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.676983:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966675008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.676989:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.676992:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.677002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.677008:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512384 00000100:00100000:0.0:1651529344.677027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.677035:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512512 00000100:00100000:1.0:1651529344.677044:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153136 00000100:00100000:1.0:1651529344.677046:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1426:39030:x1731745946512384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.677051:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177927 count 1 00010000:00010000:1.0:1651529344.677055:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677059:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 2/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.677061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.677062:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677063:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677064:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 4/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.677077:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 3/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677081:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.677085:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966675072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.677090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.677094:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.677100:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512640 00000100:00100000:0.0:1651529344.677100:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966674816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677105:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677110:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512576 00000100:00100000:1.0:1651529344.677114:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153137 00000100:00100000:1.0:1651529344.677115:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946512512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.677119:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966674880:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.677120:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177929 count 1 00010000:00010000:0.0:1651529344.677122:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677123:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677128:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 2/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.677129:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153138 00010000:00010000:1.0:1651529344.677131:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.677131:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946512640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.677132:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677132:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 4/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.677136:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177931 count 1 00010000:00010000:1.0:1651529344.677138:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 3/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677140:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677142:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677144:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 2/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.677146:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966675136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677147:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677148:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677149:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 4/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677153:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.677155:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 3/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677159:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 4/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.677160:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153139 00000100:00100000:1.0:1651529344.677161:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1428:39029:x1731745946512576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.677163:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966675200:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.677165:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177930 count 1 00010000:00010000:1.0:1651529344.677168:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677171:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.677172:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 2/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677175:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677176:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677176:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 4/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677178:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392896 00010000:00010000:1.0:1651529344.677182:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 640 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677183:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677185:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677190:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392832 00010000:00010000:0.0:1651529344.677192:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 641 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.677193:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677199:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.677204:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12094 00000100:00100000:0.0:1651529344.677205:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41279:x1731746396392896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.677208:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.677210:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 641 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.677212:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12095 00000100:00100000:1.0:1651529344.677213:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41279:x1731746396392832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.677213:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 3/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 641 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677217:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677218:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 641 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677219:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba67d984/0xa29a79078f3bc212 lrc: 0/0,0 mode: --/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8578 expref: 641 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677222:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677223:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 3/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 640 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677223:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677224:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677227:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 4/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677228:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023bc1047/0xa29a79078f3b946f lrc: 0/0,0 mode: --/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf40 expref: 640 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677232:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677232:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677233:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677233:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.677236:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 4/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677240:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41279:x1731746396392896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.677243:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12094 00010000:00010000:1.0:1651529344.677246:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.677253:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+638:41279:x1731746396392832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677257:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12095 00010000:00010000:0.0:1651529344.677257:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677261:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677264:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677267:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677311:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1429:39029:x1731745946511680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1088us (1180us total) trans 30064893995 rc 0/0 00000100:00100000:0.0:1651529344.677314:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153133 00010000:00010000:0.0:1651529344.677321:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677324:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677327:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677330:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677371:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677375:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.677376:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677379:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 3/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677386:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1429:39030:x1731745946511744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1224us (1296us total) trans 30064893996 rc 0/0 00010000:00010000:1.0:1651529344.677389:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 1/0,0 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677389:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153132 00010000:00010000:1.0:1651529344.677392:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3bf779 lrc: 0/0,0 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677396:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677399:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.677400:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677403:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 3/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677408:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 1/0,0 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677411:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3bf772 lrc: 0/0,0 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677504:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966675008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677506:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966674944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677509:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677511:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.677554:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512768 00000100:00100000:0.0:1651529344.677561:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153140 00000100:00100000:0.0:1651529344.677563:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1429:39030:x1731745946512768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.677568:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177932 count 1 00010000:00010000:0.0:1651529344.677572:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677577:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 2/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 637 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677580:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677580:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677581:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 4/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677587:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 637 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677591:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 637 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677595:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966675328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.677630:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.677661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.677663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.677677:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393408 00000100:00100000:0.0:1651529344.677678:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512896 00010000:00010000:1.0:1651529344.677682:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 638 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677686:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153141 00000100:00100000:0.0:1651529344.677687:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1430:39030:x1731745946512896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.677693:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393472 00010000:00010000:1.0:1651529344.677696:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00002000:00080000:0.0:1651529344.677697:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177933 count 1 00000100:00100000:1.0:1651529344.677704:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12096 00000100:00100000:1.0:1651529344.677706:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41278:x1731746396393408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.677706:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677709:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677711:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677711:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 2/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 639 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677714:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677715:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 3/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.677715:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677716:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 4/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677720:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034b22c8b/0xa29a79078f3bb89c lrc: 0/0,0 mode: --/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6079 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677724:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677724:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677725:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677728:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 4/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677748:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.677749:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 3/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 638 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.677753:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 638 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677757:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966675392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677761:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+638:41278:x1731746396393408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677764:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12096 00000100:00100000:1.0:1651529344.677769:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12097 00000100:00100000:1.0:1651529344.677770:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41278:x1731746396393472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.677773:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677774:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677778:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 3/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.677783:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000422ff06c/0xa29a79078f3bbf48 lrc: 0/0,0 mode: --/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a03 expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.677784:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.677787:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677788:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677788:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677791:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 4/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677799:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.677830:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+636:41278:x1731746396393472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677833:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12097 00000100:00100000:1.0:1651529344.677845:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966675072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677849:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677854:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677857:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677860:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677877:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677900:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677904:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677908:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677910:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677937:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1431:39029:x1731745946512320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1060us total) trans 30064893997 rc 0/0 00000100:00100000:1.0:1651529344.677940:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153135 00000100:00100000:1.0:1651529344.677951:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966675136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677955:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677961:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677964:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.677965:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677965:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1431:39029:x1731745946512448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1026us (1075us total) trans 30064893998 rc 0/0 00010000:00010000:1.0:1651529344.677968:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 3/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677969:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153134 00010000:00010000:1.0:1651529344.677972:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 1/0,0 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677975:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bf787 lrc: 0/0,0 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677980:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966675200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677982:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677984:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.677984:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677985:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677988:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 3/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677991:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 1/0,0 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677994:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3bf780 lrc: 0/0,0 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678001:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.678003:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.678108:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966675328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678109:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.678112:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.678126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.678126:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393600 00000100:00100000:1.0:1651529344.678135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.678136:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 636 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678141:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393664 00010000:00010000:1.0:1651529344.678146:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678152:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393792 00010000:00010000:1.0:1651529344.678154:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 4/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 638 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.678157:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393920 00000100:00100000:1.0:1651529344.678158:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393856 00010000:00010000:1.0:1651529344.678161:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678161:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 640 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678166:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12098 00000100:00100000:1.0:1651529344.678167:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+640:41278:x1731746396393664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.678168:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12099 00000100:00100000:0.0:1651529344.678169:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+640:41279:x1731746396393600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.678170:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678171:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678172:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678175:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 3/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678180:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dee24c7/0xa29a79078f3bb8b8 lrc: 0/0,0 mode: --/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6121 expref: 640 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678183:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678184:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678184:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678185:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678189:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 3/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678191:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 4/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678195:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000516c4a8d/0xa29a79078f3baf49 lrc: 0/0,0 mode: --/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b81 expref: 639 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678197:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.678198:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678199:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678200:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678203:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 4/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678205:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+638:41278:x1731746396393664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.678208:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12098 00010000:00010000:0.0:1651529344.678213:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.678219:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12100 00000100:00100000:1.0:1651529344.678221:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41278:x1731746396393792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.678224:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678225:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 4/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678229:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 3/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.678229:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41279:x1731746396393600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.678234:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4e0a2c/0xa29a79078f3bacb7 lrc: 0/0,0 mode: --/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d317f expref: 637 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678237:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678238:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678239:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678241:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 4/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678242:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12099 00000100:00100000:0.0:1651529344.678248:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12101 00000100:00100000:0.0:1651529344.678249:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+635:41279:x1731746396393856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.678253:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.678258:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.678259:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+635:41278:x1731746396393792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (143us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.678260:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 635 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678262:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12100 00010000:00010000:0.0:1651529344.678264:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 635 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678266:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12102 00000100:00100000:1.0:1651529344.678268:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+634:41278:x1731746396393920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.678269:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f58110b9/0xa29a79078f3bc289 lrc: 0/0,0 mode: --/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d878c expref: 634 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678270:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678272:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 634 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678273:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678273:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678274:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678276:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 633 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678277:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 4/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678280:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f47f8b9/0xa29a79078f3b7814 lrc: 0/0,0 mode: --/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb60a expref: 633 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678286:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.678290:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678291:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678292:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678293:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+632:41279:x1731746396393856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.678295:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 4/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678296:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12101 00010000:00010000:1.0:1651529344.678303:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.678309:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41278:x1731746396393920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.678311:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678312:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12102 00010000:00010000:0.0:1651529344.678315:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678318:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678321:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678323:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678332:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678336:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678338:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678369:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1432:39030:x1731745946512640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1237us (1295us total) trans 30064893999 rc 0/0 00000100:00100000:0.0:1651529344.678372:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153138 00010000:00010000:0.0:1651529344.678379:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678381:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1431:39030:x1731745946512512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1265us (1354us total) trans 30064894000 rc 0/0 00010000:00010000:0.0:1651529344.678382:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.678383:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678385:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153137 00010000:00010000:0.0:1651529344.678386:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 3/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678391:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 1/0,0 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678392:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678394:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3bf79c lrc: 0/0,0 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678395:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678398:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678398:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678401:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678401:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.678402:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678405:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 3/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678408:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 1/0,0 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678410:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf795 lrc: 0/0,0 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678414:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678416:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.678417:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678420:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 3/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678425:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 1/0,0 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678428:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bf78e lrc: 0/0,0 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678433:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678436:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678438:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1431:39030:x1731745946512384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1391us (1436us total) trans 30064894001 rc 0/0 00010000:00010000:0.0:1651529344.678439:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678441:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153136 00010000:00010000:0.0:1651529344.678441:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678448:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678451:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678454:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678457:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678475:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1432:39030:x1731745946512768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 911us (938us total) trans 30064894002 rc 0/0 00000100:00100000:0.0:1651529344.678478:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153140 00010000:00010000:0.0:1651529344.678485:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678488:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1431:39029:x1731745946512576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1326us (1398us total) trans 30064894003 rc 0/0 00010000:00010000:0.0:1651529344.678488:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.678489:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678491:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153139 00010000:00010000:0.0:1651529344.678492:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 3/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678496:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 1/0,0 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678497:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678499:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf7aa lrc: 0/0,0 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678500:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.678501:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678504:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 3/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678509:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 1/0,0 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678512:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf7a3 lrc: 0/0,0 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.678559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.678569:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966675392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.678579:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678586:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513024 00000100:00100000:0.0:1651529344.678596:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513088 00000100:00100000:0.0:1651529344.678603:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153142 00000100:00100000:0.0:1651529344.678604:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1432:39030:x1731745946513024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.678610:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177934 count 1 00010000:00010000:0.0:1651529344.678614:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678618:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 2/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678624:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678625:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678625:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 4/0,1 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678632:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 3/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678635:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 4/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678637:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153143 00000100:00100000:1.0:1651529344.678639:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1432:39029:x1731745946513088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.678639:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966675456:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.678645:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177935 count 1 00000100:00100000:0.0:1651529344.678648:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.678649:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678654:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 2/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678657:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678657:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678658:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 4/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678665:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 3/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 630 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678669:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678676:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678685:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.678693:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393984 00010000:00010000:1.0:1651529344.678718:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678740:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12103 00000100:00100000:1.0:1651529344.678742:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41278:x1731746396393984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.678745:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678747:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678750:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 3/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678756:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097245c18/0xa29a79078f3bb8c6 lrc: 0/0,0 mode: --/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d613d expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.678760:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678761:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678761:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678765:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 4/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678775:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.678785:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+630:41278:x1731746396393984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.678788:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12103 00010000:00010000:0.0:1651529344.678798:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678812:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678815:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.678816:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678819:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678859:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513600 00000100:00100000:0.0:1651529344.678864:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1434:39030:x1731745946512896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1175us (1201us total) trans 30064894004 rc 0/0 00000100:00100000:0.0:1651529344.678867:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153141 00000100:00100000:1.0:1651529344.678874:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513536 00000100:00100000:1.0:1651529344.678881:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153144 00000100:00100000:1.0:1651529344.678883:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946513600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.678886:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153145 00002000:00080000:1.0:1651529344.678888:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177937 count 1 00000100:00100000:0.0:1651529344.678888:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1434:39030:x1731745946513536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.678892:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.678893:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177936 count 1 00010000:00010000:1.0:1651529344.678897:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 2/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678898:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678900:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678901:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678901:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 4/0,1 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678902:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 2/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678905:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678906:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678906:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 4/0,1 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678908:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 3/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678912:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 4/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.678913:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 3/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678917:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 4/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.678918:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966675584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.678921:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966675648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678927:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.678930:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.678956:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678962:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.678964:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678966:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 3/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678971:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 1/0,0 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678974:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf7b1 lrc: 0/0,0 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.679004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.679013:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513728 00000100:00100000:0.0:1651529344.679019:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513664 00000100:00100000:0.0:1651529344.679029:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513792 00000100:00100000:1.0:1651529344.679039:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153146 00000100:00100000:1.0:1651529344.679041:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1437:39030:x1731745946513664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.679041:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153147 00000100:00100000:0.0:1651529344.679043:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1437:39029:x1731745946513728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.679046:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177938 count 1 00002000:00080000:0.0:1651529344.679048:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177939 count 1 00010000:00010000:1.0:1651529344.679050:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679052:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679054:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 2/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679057:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679057:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 2/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679058:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679059:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 4/0,1 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679060:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679061:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679062:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 4/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679065:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 3/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679069:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 4/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.679069:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 3/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.679073:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679076:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966675712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.679077:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966675776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.679087:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.679087:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.679093:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153148 00000100:00100000:1.0:1651529344.679094:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1437:39030:x1731745946513792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.679099:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177940 count 1 00010000:00010000:1.0:1651529344.679102:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679106:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 2/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679109:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679109:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679110:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 4/0,1 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679116:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 3/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679120:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 4/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679123:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966675840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.679128:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.679130:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.679180:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513856 00000100:00100000:0.0:1651529344.679188:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153149 00000100:00100000:0.0:1651529344.679189:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1438:39029:x1731745946513856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.679195:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177941 count 1 00010000:00010000:0.0:1651529344.679199:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679203:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 2/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.679207:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679207:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679208:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 4/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679214:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 3/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 629 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.679219:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.679223:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966675904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.679236:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.679484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679496:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.679501:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679509:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394432 00010000:00010000:1.0:1651529344.679513:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 5/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.679521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679539:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394560 00010000:00010000:1.0:1651529344.679542:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679551:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12104 00000100:00100000:1.0:1651529344.679553:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41278:x1731746396394432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.679553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.679556:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679557:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 5/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.679559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.679561:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 4/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.679571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.679572:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679573:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679574:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679577:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 4/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679580:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe8f4fe/0xa29a79078f3ba59b lrc: 0/0,0 mode: --/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1586 expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679584:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.679585:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966675456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.679589:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679592:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679593:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+630:41278:x1731746396394432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.679595:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679596:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12104 00010000:00010000:0.0:1651529344.679598:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679601:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394624 00010000:00010000:0.0:1651529344.679603:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679604:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 5/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679608:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394752 00010000:00010000:1.0:1651529344.679617:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 5/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 631 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679622:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394816 00010000:00010000:1.0:1651529344.679625:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 5/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 632 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679629:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12105 00000100:00100000:1.0:1651529344.679631:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+632:41279:x1731746396394560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.679633:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679634:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679638:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 3/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679643:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79fcca6/0xa29a79078f3bb16b lrc: 0/0,0 mode: --/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4433 expref: 632 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679646:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679647:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679648:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679648:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1439:39030:x1731745946513024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1043us (1112us total) trans 30064894005 rc 0/0 00010000:00010000:1.0:1651529344.679650:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 4/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679652:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153142 00010000:00010000:1.0:1651529344.679657:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.679660:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12106 00000100:00100000:0.0:1651529344.679662:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41279:x1731746396394624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.679663:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41279:x1731746396394560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679665:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12105 00000100:00100000:1.0:1651529344.679670:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12107 00000100:00100000:1.0:1651529344.679671:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+630:41278:x1731746396394752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.679673:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679675:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 5/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679678:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 4/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679682:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679683:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679683:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679693:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679695:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 4/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679695:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 5/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.679699:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 4/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 630 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679700:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.679705:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+630:41278:x1731746396394752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (146us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.679706:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679706:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679707:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679708:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12107 00010000:00010000:0.0:1651529344.679710:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 4/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679712:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12108 00000100:00100000:1.0:1651529344.679713:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396394816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.679715:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.679716:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679717:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 5/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.679721:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 4/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 629 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.679722:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396394624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.679725:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679725:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679726:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679726:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12106 00010000:00010000:1.0:1651529344.679729:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 4/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679744:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.679750:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+628:41279:x1731746396394816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.679750:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001496a886/0xa29a79078f3bae38 lrc: 0/0,0 mode: --/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3759 expref: 628 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679753:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12108 00000100:00100000:0.0:1651529344.679755:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966675648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.679758:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679762:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679764:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ca7625/0xa29a79078f3ba299 lrc: 0/0,0 mode: --/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08a5 expref: 626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.679764:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679767:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679769:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966675584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.679770:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679772:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679775:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679785:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679789:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679791:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679834:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1440:39030:x1731745946513536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (986us total) trans 30064894006 rc 0/0 00000100:00100000:0.0:1651529344.679837:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153145 00010000:00010000:0.0:1651529344.679844:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679850:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.679851:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679853:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1439:39029:x1731745946513600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 969us (1050us total) trans 30064894007 rc 0/0 00010000:00010000:0.0:1651529344.679854:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 3/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679857:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153144 00010000:00010000:0.0:1651529344.679859:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 1/0,0 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679862:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf7b8 lrc: 0/0,0 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679864:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679866:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679868:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.679869:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679870:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.679872:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679872:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 3/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679875:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 3/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679875:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 1/0,0 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679879:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 1/0,0 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679880:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf7c6 lrc: 0/0,0 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679882:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf7cd lrc: 0/0,0 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679893:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000652749a8/0xa29a79078f3bb99f lrc: 0/0,0 mode: --/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d644d expref: 625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.679896:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966675712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.679900:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679903:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679906:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679911:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679914:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.679943:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.679957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679971:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1439:39030:x1731745946513664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 929us (976us total) trans 30064894008 rc 0/0 00000100:00100000:1.0:1651529344.679974:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153146 00000100:00100000:0.0:1651529344.680000:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966675776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680002:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966675840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.680005:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680006:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680012:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966675904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680014:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395008 00010000:00010000:0.0:1651529344.680015:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680019:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 625 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680020:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680023:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.680024:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680029:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395072 00010000:00010000:1.0:1651529344.680032:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 4/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 626 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.680036:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395136 00010000:00010000:1.0:1651529344.680038:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 627 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.680043:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12109 00000100:00100000:1.0:1651529344.680045:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396395008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.680047:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.680048:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 627 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680048:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 3/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680052:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 3/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 627 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680054:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 1/0,0 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680057:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf7d4 lrc: 0/0,0 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680058:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df28c446/0xa29a79078f3ba930 lrc: 0/0,0 mode: --/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23e8 expref: 627 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.680061:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680061:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680062:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680065:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 4/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680066:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12110 00000100:00100000:0.0:1651529344.680068:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+626:41278:x1731746396395072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.680071:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.680074:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.680079:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 4/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 626 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.680084:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+626:41279:x1731746396395008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.680086:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12109 00010000:00010000:0.0:1651529344.680087:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 3/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 626 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680092:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051acad28/0xa29a79078f3baf57 lrc: 0/0,0 mode: --/PR res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b9d expref: 625 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.680096:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12111 00010000:00010000:0.0:1651529344.680096:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.680097:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+624:41279:x1731746396395136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.680097:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680097:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680100:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.680100:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 4/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680101:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 624 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.680105:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 3/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 624 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680110:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.680117:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5086369/0xa29a79078f3bbf79 lrc: 0/0,0 mode: --/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ace expref: 624 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.680118:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+624:41278:x1731746396395072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.680121:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680121:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680122:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680122:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12110 00010000:00010000:1.0:1651529344.680125:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 4/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680131:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680134:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.680139:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680140:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+622:41279:x1731746396395136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.680143:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12111 00010000:00010000:0.0:1651529344.680143:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680146:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680149:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680158:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680161:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680167:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680222:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1440:39029:x1731745946513728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1178us (1245us total) trans 30064894009 rc 0/0 00000100:00100000:1.0:1651529344.680223:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1440:39030:x1731745946513792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1128us (1219us total) trans 30064894010 rc 0/0 00000100:00100000:0.0:1651529344.680226:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153147 00000100:00100000:1.0:1651529344.680227:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153148 00010000:00010000:0.0:1651529344.680234:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680235:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680237:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.680240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680240:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 3/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680243:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680247:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 1/0,0 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680250:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf7db lrc: 0/0,0 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680254:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680257:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.680258:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680261:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 3/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680264:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 1/0,0 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680267:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf7e2 lrc: 0/0,0 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680270:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680273:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.680274:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680276:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 3/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680279:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 1/0,0 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680280:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1439:39029:x1731745946513856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1090us (1152us total) trans 30064894011 rc 0/0 00010000:00010000:1.0:1651529344.680282:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf7e9 lrc: 0/0,0 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680283:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153149 00010000:00010000:1.0:1651529344.680289:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680292:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680295:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680298:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680326:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680351:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1439:39029:x1731745946513088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1711us (1791us total) trans 30064894012 rc 0/0 00000100:00100000:0.0:1651529344.680353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680354:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153143 00000100:00100000:1.0:1651529344.680366:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514496 00000100:00100000:1.0:1651529344.680371:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514624 00000100:00100000:1.0:1651529344.680382:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514560 00000100:00100000:1.0:1651529344.680389:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514688 00000100:00100000:1.0:1651529344.680401:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153150 00000100:00100000:1.0:1651529344.680402:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1442:39029:x1731745946514496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.680407:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177942 count 1 00000100:00100000:0.0:1651529344.680413:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153151 00000100:00100000:0.0:1651529344.680415:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1442:39029:x1731745946514624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.680418:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.680421:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177944 count 1 00010000:00010000:1.0:1651529344.680424:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 2/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 621 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680425:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680427:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680427:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680428:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 4/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680430:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 2/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 621 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680434:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680434:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680435:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 621 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680435:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 4/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680439:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 621 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680442:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 3/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 621 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.680443:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680458:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.680464:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680467:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.680467:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 4/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 621 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.680468:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680471:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 3/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680475:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966676032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680476:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 1/0,0 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680481:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf7bf lrc: 0/0,0 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680484:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680489:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153152 00000100:00100000:1.0:1651529344.680491:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1442:39030:x1731745946514560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.680491:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153153 00000100:00100000:0.0:1651529344.680493:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1442:39030:x1731745946514688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.680496:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177943 count 1 00002000:00080000:0.0:1651529344.680498:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177945 count 1 00010000:00010000:1.0:1651529344.680499:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680502:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680503:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 2/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 621 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680506:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680506:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680506:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 2/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 621 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680507:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 4/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680509:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680510:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680511:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 4/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680513:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 3/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 621 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680517:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 621 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680517:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 3/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 621 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.680521:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966676096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.680521:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 4/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 621 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.680525:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966676160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680529:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.680531:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.680626:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680657:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514752 00000100:00100000:1.0:1651529344.680662:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514816 00000100:00100000:0.0:1651529344.680666:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514880 00000100:00100000:0.0:1651529344.680670:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515008 00000100:00100000:1.0:1651529344.680679:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153154 00000100:00100000:1.0:1651529344.680681:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1446:39029:x1731745946514752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.680682:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153155 00000100:00100000:0.0:1651529344.680684:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1446:39029:x1731745946514880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.680686:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177946 count 1 00002000:00080000:0.0:1651529344.680689:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177948 count 1 00010000:00010000:1.0:1651529344.680690:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680694:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680695:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 2/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 621 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680698:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680699:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680699:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 2/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 621 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680700:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 4/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680702:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680702:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680703:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 4/0,1 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680706:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 3/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 621 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680710:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 621 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.680710:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 3/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 621 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.680714:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966676224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.680714:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 4/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 621 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.680718:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966676288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680725:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.680727:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680740:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153156 00000100:00100000:1.0:1651529344.680742:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1446:39030:x1731745946514816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.680743:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153157 00000100:00100000:0.0:1651529344.680745:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1446:39029:x1731745946515008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.680747:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177947 count 1 00010000:00010000:1.0:1651529344.680750:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.680750:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177949 count 1 00010000:00010000:0.0:1651529344.680753:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680758:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 2/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 621 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680761:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680762:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680762:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 4/0,1 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680765:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 2/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 621 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680768:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680768:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680768:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 3/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 621 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680769:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 4/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680772:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 4/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 621 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.680776:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 3/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 621 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.680776:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966676352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680779:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 621 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.680783:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.680783:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680791:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680961:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966675968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680966:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680998:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966676096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681002:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.681016:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395456 00000100:00100000:0.0:1651529344.681016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.681030:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 622 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.681041:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395520 00000100:00100000:0.0:1651529344.681044:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.681050:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 5/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 623 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681053:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966676032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681056:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395648 00010000:00010000:1.0:1651529344.681059:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 5/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 624 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681059:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681063:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395584 00010000:00010000:1.0:1651529344.681065:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 625 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681067:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966676160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681069:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12112 00010000:00010000:0.0:1651529344.681069:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681071:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+625:41279:x1731746396395456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.681073:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681075:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 625 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681076:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12113 00010000:00010000:1.0:1651529344.681078:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 625 pid: 144528 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681078:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+625:41278:x1731746396395520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.681081:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681083:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 4/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 625 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681084:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b008358/0xa29a79078f3b77ea lrc: 0/0,0 mode: --/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb554 expref: 625 pid: 144528 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681087:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681087:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 3/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 625 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681092:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081d81f4b/0xa29a79078f3b7cf9 lrc: 0/0,0 mode: --/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb20 expref: 624 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681095:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681096:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681096:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681097:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681098:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681099:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 4/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681101:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 4/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681106:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681115:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+623:41279:x1731746396395456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681118:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12112 00010000:00010000:0.0:1651529344.681120:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681124:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12114 00000100:00100000:1.0:1651529344.681125:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+622:41279:x1731746396395648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.681128:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.681128:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+622:41278:x1731746396395520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (111us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.681129:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 4/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 622 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681131:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12113 00010000:00010000:1.0:1651529344.681133:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 3/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 622 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681137:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12115 00010000:00010000:1.0:1651529344.681138:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c2bea98/0xa29a79078f3bb14f lrc: 0/0,0 mode: --/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43bc expref: 621 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681139:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+621:41278:x1731746396395584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.681141:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681142:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681143:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681143:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 620 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681147:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 3/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 620 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681152:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e86980/0xa29a79078f3b9556 lrc: 0/0,0 mode: --/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2f8 expref: 620 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681155:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 4/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681156:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681156:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681157:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681160:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 4/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681163:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681170:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+619:41279:x1731746396395648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681173:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12114 00010000:00010000:0.0:1651529344.681176:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.681183:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+618:41278:x1731746396395584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (138us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.681186:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681190:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681192:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12115 00010000:00010000:1.0:1651529344.681193:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681196:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681201:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681222:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681226:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681228:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681254:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1448:39030:x1731745946514560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 762us (913us total) trans 30064894013 rc 0/0 00000100:00100000:1.0:1651529344.681257:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153152 00010000:00010000:1.0:1651529344.681265:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681268:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.681269:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681272:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 3/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681277:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 1/0,0 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681280:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf7fe lrc: 0/0,0 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681284:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681287:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.681287:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1447:39030:x1731745946514688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 793us (934us total) trans 30064894014 rc 0/0 00010000:00010000:1.0:1651529344.681288:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681290:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 3/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681290:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153153 00010000:00010000:1.0:1651529344.681293:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 1/0,0 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681296:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf805 lrc: 0/0,0 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681299:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681303:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681303:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681306:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681306:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681309:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681312:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681322:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681347:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1447:39029:x1731745946514496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 944us (1035us total) trans 30064894015 rc 0/0 00000100:00100000:1.0:1651529344.681350:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153150 00010000:00010000:1.0:1651529344.681357:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681360:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.681361:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681363:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 3/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681367:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 1/0,0 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681370:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf7f0 lrc: 0/0,0 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681371:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1447:39029:x1731745946514624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 956us (1044us total) trans 30064894016 rc 0/0 00010000:00010000:1.0:1651529344.681374:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681375:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153151 00010000:00010000:1.0:1651529344.681377:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.681378:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681381:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 3/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681384:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 1/0,0 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681386:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf7f7 lrc: 0/0,0 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681424:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966676224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681428:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.681467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681497:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395776 00000100:00100000:1.0:1651529344.681510:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681515:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681516:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 618 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681527:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396032 00000100:00100000:1.0:1651529344.681530:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12116 00010000:00010000:0.0:1651529344.681531:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 5/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 619 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.681532:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+619:41279:x1731746396395776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.681535:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681537:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 619 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681541:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 3/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 619 pid: 142994 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681546:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae493535/0xa29a79078f3b7892 lrc: 0/0,0 mode: --/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ca expref: 619 pid: 142994 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681552:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12117 00000100:00100000:0.0:1651529344.681554:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+619:41278:x1731746396396032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.681556:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681557:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681557:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681557:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681559:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 5/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 618 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681561:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 4/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681563:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 4/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 618 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.681566:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.681569:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681570:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681571:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681574:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+618:41279:x1731746396395776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681577:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12116 00010000:00010000:0.0:1651529344.681584:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 4/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681589:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681589:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.681592:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681595:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681597:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+617:41278:x1731746396396032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.681598:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681600:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12117 00010000:00010000:0.0:1651529344.681611:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaaeba5f/0xa29a79078f3b9231 lrc: 0/0,0 mode: --/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc68e expref: 616 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681615:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966676288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.681619:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681622:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681635:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1447:39029:x1731745946514752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 954us (1010us total) trans 30064894017 rc 0/0 00000100:00100000:1.0:1651529344.681638:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153154 00010000:00010000:0.0:1651529344.681640:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681645:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681648:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.681649:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681651:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681652:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 3/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681654:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681656:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 1/0,0 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681662:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf80c lrc: 0/0,0 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681666:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681668:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.681669:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681672:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 3/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681676:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 1/0,0 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681678:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf813 lrc: 0/0,0 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681699:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1447:39029:x1731745946514880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1014us (1059us total) trans 30064894018 rc 0/0 00000100:00100000:0.0:1651529344.681702:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153155 00000100:00100000:0.0:1651529344.681712:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966676352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.681716:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681724:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396096 00010000:00010000:0.0:1651529344.681728:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 4/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.681739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.681753:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12118 00000100:00100000:0.0:1651529344.681755:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+616:41278:x1731746396396096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.681756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.681758:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681760:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 4/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681763:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 3/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681769:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdaf725/0xa29a79078f3bac32 lrc: 0/0,0 mode: --/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f87 expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681773:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681774:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681775:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681778:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 4/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681783:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.681790:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396396096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.681793:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12118 00000100:00100000:0.0:1651529344.681797:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396160 00010000:00010000:0.0:1651529344.681800:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 615 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.681836:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12119 00000100:00100000:0.0:1651529344.681838:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396396160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.681841:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681842:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 615 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681846:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 3/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 615 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681851:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000246eb3ad/0xa29a79078f3b96ad lrc: 0/0,0 mode: --/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd893 expref: 615 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.681855:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681856:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681856:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681859:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 4/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681870:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.681877:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+614:41278:x1731746396396160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.681879:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12119 00000100:00100000:0.0:1651529344.681892:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515328 00000100:00100000:0.0:1651529344.681901:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515392 00000100:00100000:0.0:1651529344.681905:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515456 00000100:00100000:1.0:1651529344.681918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.681928:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681929:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515520 00010000:00010000:1.0:1651529344.681932:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681934:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153158 00010000:00010000:1.0:1651529344.681936:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681936:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b3db7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1450:39030:x1731745946515328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.681938:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.681941:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177950 count 1 00010000:00010000:0.0:1651529344.681945:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681950:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 2/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.681971:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681972:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681972:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 4/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681981:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 3/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.681985:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1451:39030:x1731745946514816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1242us (1350us total) trans 30064894019 rc 0/0 00010000:00010000:0.0:1651529344.681985:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.681988:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153156 00000100:00100000:0.0:1651529344.681989:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966676480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681993:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153159 00000100:00100000:1.0:1651529344.681994:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1450:39029:x1731745946515392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.681998:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.681999:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177951 count 1 00010000:00010000:1.0:1651529344.682003:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682005:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153160 00000100:00100000:0.0:1651529344.682007:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1450:39030:x1731745946515456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.682008:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 2/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682011:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.682011:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177952 count 1 00010000:00010000:1.0:1651529344.682012:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682013:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 4/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682015:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682019:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 2/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682022:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 3/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682022:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682023:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682024:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 4/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682026:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682029:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 3/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.682030:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682033:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.682038:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.682040:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966676608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.682044:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682046:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.682047:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.682048:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682051:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 3/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682052:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153161 00000100:00100000:0.0:1651529344.682053:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1450:39029:x1731745946515520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.682055:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 1/0,0 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.682057:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177953 count 1 00010000:00010000:1.0:1651529344.682058:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf81a lrc: 0/0,0 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682061:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682065:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 2/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 613 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682068:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682069:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682069:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 4/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682075:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 3/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 613 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.682076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.682078:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 613 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.682082:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966676672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682088:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.682094:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515648 00000100:00100000:0.0:1651529344.682104:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153162 00000100:00100000:0.0:1651529344.682106:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1451:39029:x1731745946515648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.682110:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177955 count 1 00010000:00010000:0.0:1651529344.682114:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.682118:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 2/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682121:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682122:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682122:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 4/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682128:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 3/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682131:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.682135:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966676736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682143:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.682147:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682150:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682156:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682159:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682177:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515584 00000100:00100000:1.0:1651529344.682188:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153163 00000100:00100000:1.0:1651529344.682190:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1453:39029:x1731745946515584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.682196:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177954 count 1 00010000:00010000:1.0:1651529344.682199:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682204:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 2/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682207:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682208:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682208:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 4/0,1 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682215:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 3/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682219:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 4/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.682223:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966676800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682237:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1453:39029:x1731745946515008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1491us (1591us total) trans 30064894020 rc 0/0 00000100:00100000:0.0:1651529344.682240:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153157 00000100:00100000:1.0:1651529344.682242:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.682248:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682252:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.682253:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682256:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 3/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682261:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 1/0,0 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682263:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf821 lrc: 0/0,0 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682271:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682325:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682326:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966676480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.682330:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682331:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682338:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515968 00000100:00100000:0.0:1651529344.682347:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153164 00000100:00100000:0.0:1651529344.682349:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1453:39030:x1731745946515968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.682354:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177956 count 1 00010000:00010000:0.0:1651529344.682358:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682362:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 2/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682365:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682366:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682367:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 4/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682373:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 3/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682377:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 4/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.682381:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966676864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682394:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.682490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682497:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516224 00000100:00100000:1.0:1651529344.682508:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153165 00000100:00100000:1.0:1651529344.682510:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1454:39030:x1731745946516224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.682510:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966676608:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.682515:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177957 count 1 00010000:00010000:0.0:1651529344.682515:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682519:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682523:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966676672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.682524:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 2/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682525:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682527:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682528:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682528:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 4/0,1 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682531:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966676736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682534:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682535:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 3/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 613 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682539:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 4/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.682543:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966676928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.682554:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.682630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.682637:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.682656:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396544 00000100:00100000:0.0:1651529344.682657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.682666:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 614 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.682668:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396672 00000100:00100000:1.0:1651529344.682677:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396480 00010000:00010000:0.0:1651529344.682679:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 615 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.682681:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.682686:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12120 00000100:00100000:1.0:1651529344.682688:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+616:41279:x1731746396396544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.682688:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12121 00010000:00010000:1.0:1651529344.682690:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.682690:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+616:41279:x1731746396396672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.682692:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682693:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.682694:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 616 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.682695:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 3/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682698:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 3/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 616 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.682701:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a794e3/0xa29a79078f3bb301 lrc: 0/0,0 mode: --/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b2c expref: 616 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682704:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008161a844/0xa29a79078f3b978d lrc: 0/0,0 mode: --/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc36 expref: 616 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.682705:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682706:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682706:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682707:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682708:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682709:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682710:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 4/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682712:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 4/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682716:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.682718:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.682724:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+614:41279:x1731746396396544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.682726:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+614:41279:x1731746396396672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.682727:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12120 00000100:00100000:1.0:1651529344.682741:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12122 00000100:00100000:1.0:1651529344.682743:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+613:41278:x1731746396396480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.682744:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12121 00010000:00010000:1.0:1651529344.682745:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.682747:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.682751:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 3/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 612 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682752:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682755:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682756:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005521bd5e/0xa29a79078f3badc1 lrc: 0/0,0 mode: --/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35f4 expref: 612 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.682759:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682761:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682762:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682762:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682763:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682766:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 4/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682775:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.682781:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+611:41278:x1731746396396480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.682784:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12122 00010000:00010000:1.0:1651529344.682791:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682794:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682798:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682800:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682836:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1455:39029:x1731745946515520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 781us (918us total) trans 30064894021 rc 0/0 00000100:00100000:0.0:1651529344.682840:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153161 00010000:00010000:0.0:1651529344.682847:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682850:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.682852:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682855:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 3/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682858:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1455:39029:x1731745946515392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 862us (1072us total) trans 30064894022 rc 0/0 00010000:00010000:0.0:1651529344.682860:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 1/0,0 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682861:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153159 00010000:00010000:1.0:1651529344.682869:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682870:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf83d lrc: 0/0,0 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682872:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.682874:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682876:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682877:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 3/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682879:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682881:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 1/0,0 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682882:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682884:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf82f lrc: 0/0,0 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682885:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682899:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682902:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.682903:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682906:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 3/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682910:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 1/0,0 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682915:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf828 lrc: 0/0,0 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682924:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b3db7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1455:39030:x1731745946515328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 987us (1194us total) trans 30064894023 rc 0/0 00000100:00100000:0.0:1651529344.682927:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153158 00000100:00100000:0.0:1651529344.683172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.683176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.683188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683189:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.683204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.683214:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516416 00000100:00100000:0.0:1651529344.683216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.683229:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516352 00000100:00100000:0.0:1651529344.683230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.683233:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516480 00000100:00100000:1.0:1651529344.683244:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153166 00000100:00100000:1.0:1651529344.683245:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1457:39029:x1731745946516416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.683251:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177959 count 1 00000100:00100000:0.0:1651529344.683254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.683255:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683259:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 2/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 610 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.683261:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396608 00010000:00010000:1.0:1651529344.683263:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683263:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683264:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 4/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683266:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683271:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 3/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 611 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683275:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.683279:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.683284:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396736 00010000:00010000:0.0:1651529344.683287:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 612 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.683291:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.683291:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396800 00010000:00010000:0.0:1651529344.683293:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 5/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 613 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.683296:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396864 00000100:00100000:0.0:1651529344.683297:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396992 00010000:00010000:0.0:1651529344.683298:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 5/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683301:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 5/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.683303:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12123 00000100:00100000:0.0:1651529344.683304:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396396608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.683307:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.683308:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12124 00000100:00100000:1.0:1651529344.683309:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396396736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.683309:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683312:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683313:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683313:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 3/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683317:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 3/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683318:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d31b7f5/0xa29a79078f3ba04d lrc: 0/0,0 mode: --/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff13 expref: 615 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683322:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683323:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000860f63e5/0xa29a79078f3ba36b lrc: 0/0,0 mode: --/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bc3 expref: 614 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683323:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683324:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683326:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683327:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683327:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 4/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683328:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683331:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 4/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683334:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.683344:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.683347:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+613:41278:x1731746396396608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683351:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+613:41278:x1731746396396736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.683351:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12123 00000100:00100000:1.0:1651529344.683354:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12124 00000100:00100000:1.0:1651529344.683359:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12125 00000100:00100000:1.0:1651529344.683361:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+611:41278:x1731746396396800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.683361:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12126 00000100:00100000:0.0:1651529344.683363:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+611:41278:x1731746396396992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.683364:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683365:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 5/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683366:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.683367:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 5/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683369:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 4/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683371:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 4/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 611 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683373:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683374:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683375:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683376:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683377:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683377:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683378:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 4/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683381:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 4/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683382:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.683385:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683386:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+611:41278:x1731746396396800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683388:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12125 00000100:00100000:0.0:1651529344.683390:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+610:41278:x1731746396396992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683392:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12127 00000100:00100000:0.0:1651529344.683393:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12126 00000100:00100000:1.0:1651529344.683394:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+610:41278:x1731746396396864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.683396:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683397:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 5/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 609 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683401:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 4/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 609 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.683404:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966676864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683405:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0e9bb2d/0xa29a79078f3bb236 lrc: 0/0,0 mode: --/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4735 expref: 609 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683407:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683408:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683409:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683410:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683413:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 4/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683420:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153167 00010000:00010000:1.0:1651529344.683422:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683428:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+608:41278:x1731746396396864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.683428:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1457:39030:x1731745946516352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.683430:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12127 00002000:00080000:0.0:1651529344.683434:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177958 count 1 00010000:00010000:0.0:1651529344.683438:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683440:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c270588c/0xa29a79078f3bbdce lrc: 0/0,0 mode: --/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7414 expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.683442:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 2/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 607 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.683444:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966676800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.683445:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683446:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683446:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 4/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683448:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683451:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683453:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 3/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 606 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683454:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683456:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 606 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.683457:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683459:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683463:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.683478:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.683484:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153168 00000100:00100000:0.0:1651529344.683486:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1458:39030:x1731745946516480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.683490:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177960 count 1 00010000:00010000:0.0:1651529344.683494:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683498:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 2/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 606 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.683501:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683502:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683502:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 4/0,1 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683508:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 3/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 606 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.683512:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 4/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.683516:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1458:39029:x1731745946515584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1324us (1398us total) trans 30064894024 rc 0/0 00000100:00100000:1.0:1651529344.683519:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153163 00000100:00100000:0.0:1651529344.683523:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683530:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036545fc6/0xa29a79078f3badac lrc: 0/0,0 mode: --/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ca expref: 606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.683531:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.683534:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966676928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.683535:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683538:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683539:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683541:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683542:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683544:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683546:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683549:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683559:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683587:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1458:39030:x1731745946515456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1579us (1710us total) trans 30064894025 rc 0/0 00000100:00100000:0.0:1651529344.683590:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153160 00010000:00010000:0.0:1651529344.683597:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683601:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683604:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683606:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683611:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1458:39030:x1731745946516224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1099us (1121us total) trans 30064894026 rc 0/0 00000100:00100000:1.0:1651529344.683614:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153165 00010000:00010000:1.0:1651529344.683621:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683625:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.683626:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683629:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 3/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683633:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 1/0,0 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683636:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bf84b lrc: 0/0,0 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683638:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1458:39029:x1731745946515648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1531us (1562us total) trans 30064894027 rc 0/0 00010000:00010000:1.0:1651529344.683640:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683642:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153162 00010000:00010000:1.0:1651529344.683643:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.683644:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683647:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 3/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683649:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683650:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 1/0,0 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683652:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf836 lrc: 0/0,0 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683653:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.683654:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683656:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683657:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 3/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683658:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.683659:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683661:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 1/0,0 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683662:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 3/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683664:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bf859 lrc: 0/0,0 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683668:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 1/0,0 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683670:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf844 lrc: 0/0,0 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683670:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683674:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683676:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683679:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683712:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1458:39030:x1731745946515968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1362us (1441us total) trans 30064894028 rc 0/0 00000100:00100000:0.0:1651529344.683715:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153164 00010000:00010000:0.0:1651529344.683721:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683724:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.683725:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683728:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 3/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683742:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 1/0,0 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683745:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf852 lrc: 0/0,0 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683950:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517056 00000100:00100000:1.0:1651529344.683955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683964:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517184 00000100:00100000:1.0:1651529344.683966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683978:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516992 00000100:00100000:1.0:1651529344.683979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.683994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.684001:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517120 00000100:00100000:0.0:1651529344.684003:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517248 00000100:00100000:1.0:1651529344.684007:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153169 00000100:00100000:1.0:1651529344.684008:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1462:39029:x1731745946517056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.684009:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153170 00000100:00100000:0.0:1651529344.684011:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1462:39029:x1731745946517184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.684014:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177962 count 1 00002000:00080000:0.0:1651529344.684016:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177964 count 1 00010000:00010000:1.0:1651529344.684018:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684020:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684023:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 2/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 605 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684025:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 2/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 605 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684026:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684026:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684027:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 4/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684029:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684029:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684030:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 4/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684034:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 3/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 605 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684037:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 3/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 605 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684038:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 605 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.684041:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 605 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.684042:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966677184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.684045:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966677248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684053:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.684059:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153171 00000100:00100000:1.0:1651529344.684060:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1462:39030:x1731745946516992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.684065:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177961 count 1 00000100:00100000:0.0:1651529344.684067:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.684068:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684072:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 2/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684075:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.684075:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153172 00010000:00010000:1.0:1651529344.684076:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684077:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 4/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684077:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1462:39030:x1731745946517120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.684081:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177963 count 1 00010000:00010000:1.0:1651529344.684083:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 3/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684085:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684086:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 4/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 605 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.684090:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 2/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684093:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966677312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684095:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684096:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684096:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 4/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684100:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.684103:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684106:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153173 00010000:00010000:0.0:1651529344.684106:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.684107:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1462:39030:x1731745946517248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.684110:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966677376:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.684111:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177965 count 1 00010000:00010000:1.0:1651529344.684114:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684117:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.684119:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 2/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684122:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684122:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684123:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 4/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684129:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 3/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 605 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684132:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 605 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.684136:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966677440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684142:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.684172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.684175:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966676992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.684178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.684179:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684192:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397504 00000100:00100000:0.0:1651529344.684193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.684202:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.684204:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684208:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684213:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397568 00010000:00010000:1.0:1651529344.684216:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.684220:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397632 00000100:00100000:0.0:1651529344.684222:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12128 00010000:00010000:1.0:1651529344.684223:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 5/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.684224:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+608:41278:x1731746396397504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.684227:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12129 00010000:00010000:0.0:1651529344.684228:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.684229:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+608:41279:x1731746396397568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.684229:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684231:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.684233:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.684233:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 3/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684236:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 3/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.684239:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864c4b9b/0xa29a79078f3b8f28 lrc: 0/0,0 mode: --/PR res: [0x2b727:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc481 expref: 608 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684242:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a1dfaed/0xa29a79078f3bbebc lrc: 0/0,0 mode: --/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77ef expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.684243:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684243:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684244:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684247:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 4/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684250:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684253:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 4/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684257:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.684264:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+606:41278:x1731746396397504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (92us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.684268:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.684273:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12128 00000100:00100000:1.0:1651529344.684276:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+605:41279:x1731746396397568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.684279:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12129 00000100:00100000:0.0:1651529344.684280:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12130 00000100:00100000:0.0:1651529344.684282:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41278:x1731746396397632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.684285:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.684286:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684287:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 5/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 604 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684290:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684291:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 4/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 604 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684293:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684295:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684296:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684296:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684297:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684300:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 4/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684304:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.684309:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41278:x1731746396397632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.684312:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12130 00010000:00010000:0.0:1651529344.684324:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005331cc4/0xa29a79078f3bbc2a lrc: 0/0,0 mode: --/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e10 expref: 603 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.684328:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684332:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684335:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684339:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1463:39029:x1731745946516416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1092us (1172us total) trans 30064894029 rc 0/0 00000100:00100000:1.0:1651529344.684342:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153166 00010000:00010000:0.0:1651529344.684345:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684348:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684349:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684352:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684353:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.684354:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684357:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 3/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684367:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 1/0,0 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684370:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bf860 lrc: 0/0,0 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684375:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684377:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.684378:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684381:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 3/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684384:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 1/0,0 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684390:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf86e lrc: 0/0,0 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684402:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1463:39030:x1731745946516480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 915us (1201us total) trans 30064894030 rc 0/0 00000100:00100000:0.0:1651529344.684405:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153168 00010000:00010000:0.0:1651529344.684413:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684417:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684420:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684422:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684455:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1463:39030:x1731745946516352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1026us (1267us total) trans 30064894031 rc 0/0 00000100:00100000:0.0:1651529344.684458:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153167 00010000:00010000:0.0:1651529344.684465:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684468:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.684469:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684472:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 3/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684477:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 1/0,0 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684480:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf867 lrc: 0/0,0 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684581:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.684606:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517376 00000100:00100000:0.0:1651529344.684614:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153174 00000100:00100000:0.0:1651529344.684616:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1463:39030:x1731745946517376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.684621:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177966 count 1 00010000:00010000:0.0:1651529344.684641:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.684646:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 2/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684649:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684650:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684651:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 4/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684658:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517440 00000100:00100000:1.0:1651529344.684675:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153175 00010000:00010000:0.0:1651529344.684676:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684677:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1464:39030:x1731745946517440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.684682:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177967 count 1 00010000:00010000:0.0:1651529344.684683:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 4/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 602 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.684686:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684687:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.684691:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 2/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684694:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684695:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684695:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 4/0,1 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684696:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.684702:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 3/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684706:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 4/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 602 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.684711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.684713:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966677568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684722:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.684730:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966677184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.684750:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684773:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966677248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684777:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684784:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517504 00000100:00100000:0.0:1651529344.684792:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153176 00000100:00100000:0.0:1651529344.684794:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1465:39030:x1731745946517504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529344.684799:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177968 count 1 00010000:00010000:0.0:1651529344.684819:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684824:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 2/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684827:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684828:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684828:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 4/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684838:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 3/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 602 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684842:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 4/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 602 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.684846:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.684857:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.684967:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966677376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.684971:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.684986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.684989:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398144 00000100:00100000:1.0:1651529344.684992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.684994:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 603 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685000:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398208 00010000:00010000:0.0:1651529344.685002:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 5/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 604 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.685007:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398080 00000100:00100000:1.0:1651529344.685008:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966677312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.685009:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 605 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685012:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685013:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398272 00010000:00010000:0.0:1651529344.685015:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 606 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685019:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966677440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685021:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685028:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398336 00010000:00010000:1.0:1651529344.685032:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685038:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12131 00000100:00100000:0.0:1651529344.685045:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12132 00000100:00100000:0.0:1651529344.685047:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+607:41278:x1731746396398208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.685049:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+607:41278:x1731746396398144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.685050:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.685052:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.685052:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 4/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685054:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 607 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685056:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 3/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685058:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 3/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 607 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685062:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a489938d/0xa29a79078f3bb8bf lrc: 0/0,0 mode: --/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d612f expref: 607 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685063:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000852670c6/0xa29a79078f3b9499 lrc: 0/0,0 mode: --/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfe8 expref: 607 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685066:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685066:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685067:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685067:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685068:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685069:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685070:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 4/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685072:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 4/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685086:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685094:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+605:41278:x1731746396398144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.685095:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685097:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12131 00000100:00100000:1.0:1651529344.685102:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12133 00000100:00100000:0.0:1651529344.685103:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41278:x1731746396398208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685104:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41279:x1731746396398080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.685106:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.685106:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12132 00010000:00010000:1.0:1651529344.685108:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 604 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685112:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 3/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 603 pid: 128009 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.685112:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12134 00000100:00100000:0.0:1651529344.685114:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+603:41279:x1731746396398336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.685117:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9c1d756/0xa29a79078f3b922a lrc: 0/0,0 mode: --/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc680 expref: 603 pid: 128009 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685117:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.685118:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 603 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685120:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685121:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685121:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685124:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 4/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685130:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.685133:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 3/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 602 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685135:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+602:41279:x1731746396398080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685137:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12133 00010000:00010000:0.0:1651529344.685139:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3b9985 lrc: 0/0,0 mode: --/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce401 expref: 602 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685142:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12135 00000100:00100000:1.0:1651529344.685143:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+600:41279:x1731746396398272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.685143:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685144:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685145:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685146:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.685147:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685147:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 4/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685151:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685157:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.685163:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9eb76c6/0xa29a79078f3bb324 lrc: 0/0,0 mode: --/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bb8 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.685164:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+600:41279:x1731746396398336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.685167:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685167:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.685167:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12134 00010000:00010000:1.0:1651529344.685168:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685171:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 4/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685175:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685179:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.685184:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685185:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+598:41279:x1731746396398272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685188:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12135 00010000:00010000:0.0:1651529344.685190:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685193:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685195:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685204:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685207:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685210:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685237:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1467:39029:x1731745946517184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1225us (1282us total) trans 30064894032 rc 0/0 00000100:00100000:0.0:1651529344.685240:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153170 00010000:00010000:0.0:1651529344.685247:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685250:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685253:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1466:39029:x1731745946517056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1243us (1317us total) trans 30064894033 rc 0/0 00010000:00010000:0.0:1651529344.685253:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685256:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153169 00010000:00010000:0.0:1651529344.685256:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685264:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685267:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685268:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685271:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 3/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685276:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 1/0,0 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685278:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf87c lrc: 0/0,0 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685282:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685285:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685286:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685291:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 3/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685295:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 1/0,0 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685297:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bf875 lrc: 0/0,0 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685300:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685303:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685304:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685306:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 3/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685306:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946517120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1229us (1332us total) trans 30064894034 rc 0/0 00010000:00010000:1.0:1651529344.685309:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 1/0,0 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685309:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153172 00010000:00010000:1.0:1651529344.685312:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf88a lrc: 0/0,0 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685318:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685321:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685324:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685326:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685382:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.685398:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946517248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1290us (1404us total) trans 30064894035 rc 0/0 00000100:00100000:1.0:1651529344.685401:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153173 00000100:00100000:1.0:1651529344.685410:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398400 00010000:00010000:1.0:1651529344.685421:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 5/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685436:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398528 00010000:00010000:1.0:1651529344.685440:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 5/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 599 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.685441:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685444:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398656 00010000:00010000:0.0:1651529344.685445:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685446:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 5/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685450:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12136 00000100:00100000:1.0:1651529344.685452:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+600:41278:x1731746396398400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.685453:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685455:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.685455:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685456:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 4/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685460:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685465:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081d00cd9/0xa29a79078f3ba341 lrc: 0/0,0 mode: --/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b45 expref: 600 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685470:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685473:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 4/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685483:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685493:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+599:41278:x1731746396398400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685496:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12136 00000100:00100000:0.0:1651529344.685498:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12137 00000100:00100000:1.0:1651529344.685500:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12138 00000100:00100000:0.0:1651529344.685500:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+598:41278:x1731746396398528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.685502:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+598:41278:x1731746396398656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.685504:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.685504:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.685505:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 5/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685506:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 4/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685509:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 4/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.685512:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 3/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685515:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685516:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685517:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a445ef/0xa29a79078f3ba48a lrc: 0/0,0 mode: --/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1070 expref: 598 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.685517:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685520:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685520:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 4/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685521:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685522:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685524:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.685525:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 4/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685532:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685538:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+597:41278:x1731746396398656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.685538:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+597:41278:x1731746396398528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685541:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12138 00000100:00100000:0.0:1651529344.685542:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12137 00010000:00010000:1.0:1651529344.685547:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685550:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685554:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685555:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685558:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685559:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685561:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685564:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685604:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946516992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1543us (1638us total) trans 30064894036 rc 0/0 00000100:00100000:1.0:1651529344.685607:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153171 00010000:00010000:1.0:1651529344.685614:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685617:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685618:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685621:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 3/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685626:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 1/0,0 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685629:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bf891 lrc: 0/0,0 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685633:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685636:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685637:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685640:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 3/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685643:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 1/0,0 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685645:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bf883 lrc: 0/0,0 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685647:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946517504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 852us (935us total) trans 30064894037 rc 0/0 00010000:00010000:1.0:1651529344.685648:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685651:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529344.685651:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153176 00010000:00010000:1.0:1651529344.685652:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685654:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 3/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685657:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 1/0,0 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685659:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685660:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bf8a6 lrc: 0/0,0 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685663:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685666:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685669:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685675:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685678:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685679:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685682:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 3/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685685:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 1/0,0 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685688:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bf898 lrc: 0/0,0 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685698:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae81ddd/0xa29a79078f3b8e48 lrc: 0/0,0 mode: --/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3fc expref: 595 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685701:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966677568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.685701:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946517376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1085us (1120us total) trans 30064894038 rc 0/0 00000100:00100000:0.0:1651529344.685704:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153174 00010000:00010000:1.0:1651529344.685705:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685708:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685718:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685721:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685724:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685741:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.685756:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.685766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.685781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.685783:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946517440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1105us (1136us total) trans 30064894039 rc 0/0 00000100:00100000:1.0:1651529344.685791:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153175 00000100:00100000:1.0:1651529344.685796:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518016 00000100:00100000:1.0:1651529344.685829:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517952 00000100:00100000:1.0:1651529344.685834:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518080 00000100:00100000:0.0:1651529344.685848:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518144 00000100:00100000:0.0:1651529344.685857:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153177 00000100:00100000:0.0:1651529344.685859:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1469:39030:x1731745946518016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.685864:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153178 00002000:00080000:0.0:1651529344.685864:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177970 count 1 00000100:00100000:1.0:1651529344.685866:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1469:39029:x1731745946517952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529344.685868:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.685872:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177969 count 1 00010000:00010000:0.0:1651529344.685873:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 2/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 594 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685876:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685876:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685877:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685878:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 4/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685881:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 2/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685884:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685884:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 594 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685885:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685888:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 594 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.685892:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685893:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 4/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685901:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 3/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685905:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 4/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685910:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966677760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685920:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.685920:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.685926:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685927:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153179 00000100:00100000:0.0:1651529344.685928:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1469:39029:x1731745946518080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.685929:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.685930:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685933:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 3/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.685933:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177971 count 1 00010000:00010000:0.0:1651529344.685937:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685938:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 1/0,0 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685940:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bf89f lrc: 0/0,0 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685942:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 2/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685945:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685945:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685946:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 4/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685948:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153180 00010000:00010000:0.0:1651529344.685952:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 3/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685956:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 4/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685957:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1469:39030:x1731745946518144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.685960:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677824:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.685962:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177972 count 1 00010000:00010000:1.0:1651529344.685966:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685967:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.685970:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 2/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685973:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685974:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685974:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 4/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685981:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 3/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685984:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 4/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.685989:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966677888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.686004:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.686026:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.686049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.686060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.686066:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518400 00000100:00100000:0.0:1651529344.686068:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.686077:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518336 00000100:00100000:1.0:1651529344.686083:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518528 00000100:00100000:1.0:1651529344.686087:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518464 00000100:00100000:0.0:1651529344.686089:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153181 00000100:00100000:0.0:1651529344.686091:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1473:39030:x1731745946518400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.686095:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153182 00000100:00100000:1.0:1651529344.686097:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1473:39029:x1731745946518336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.686101:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177973 count 1 00002000:00080000:0.0:1651529344.686101:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177974 count 1 00010000:00010000:0.0:1651529344.686105:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686106:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686110:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 2/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.686110:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 2/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686113:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686113:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686114:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686114:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686115:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 4/0,1 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686115:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 4/0,1 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686121:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 3/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.686121:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 3/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686125:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 4/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686129:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966677952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.686151:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.686157:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153183 00010000:00010000:0.0:1651529344.686158:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 4/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686159:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1473:39030:x1731745946518528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.686163:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678016:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.686164:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177976 count 1 00010000:00010000:1.0:1651529344.686167:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686172:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 2/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.686172:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.686177:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686178:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686178:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 4/0,1 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686178:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153184 00000100:00100000:0.0:1651529344.686180:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1473:39029:x1731745946518464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.686184:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 3/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.686186:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177975 count 1 00010000:00010000:1.0:1651529344.686188:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 4/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.686189:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686192:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686194:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 2/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.686197:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686197:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686198:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 4/0,1 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686200:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.686205:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 3/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 594 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.686208:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 4/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686212:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966678144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.686227:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.686237:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966677696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686241:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686279:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966677760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.686284:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.686375:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966677888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.686383:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686387:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966677824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.686390:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399168 00010000:00010000:0.0:1651529344.686391:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686395:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 595 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686408:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12139 00000100:00100000:1.0:1651529344.686410:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+595:41279:x1731746396399168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.686413:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686415:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 595 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686418:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 595 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686424:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d32efe/0xa29a79078f3b92c4 lrc: 0/0,0 mode: --/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8be expref: 595 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686427:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686428:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686429:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686432:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 4/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686440:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.686442:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686445:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686448:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686449:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41279:x1731746396399168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (76us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.686451:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686452:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12139 00000100:00100000:0.0:1651529344.686498:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1474:39030:x1731745946518016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 638us (757us total) trans 30064894040 rc 0/0 00000100:00100000:0.0:1651529344.686501:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153177 00010000:00010000:0.0:1651529344.686530:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686534:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.686535:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.686538:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 3/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686543:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 1/0,0 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686546:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bf8ad lrc: 0/0,0 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686566:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399232 00010000:00010000:1.0:1651529344.686571:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 4/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686581:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12140 00000100:00100000:1.0:1651529344.686583:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41279:x1731746396399232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.686586:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686587:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 4/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686591:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 3/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686596:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c4e7b2/0xa29a79078f3bc369 lrc: 0/0,0 mode: --/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ac6 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686599:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686600:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686601:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686604:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 4/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686617:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.686625:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+593:41279:x1731746396399232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.686625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.686628:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12140 00000100:00100000:1.0:1651529344.686643:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399360 00010000:00010000:1.0:1651529344.686646:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 4/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 593 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686655:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12141 00000100:00100000:1.0:1651529344.686656:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+593:41279:x1731746396399360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.686666:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686667:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 4/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 593 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686671:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 3/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 593 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686676:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06ddbf2/0xa29a79078f3baa95 lrc: 0/0,0 mode: --/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d291a expref: 593 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686679:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686680:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.686680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.686681:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686684:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 4/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686693:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.686698:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.686705:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396399360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686713:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12141 00000100:00100000:1.0:1651529344.686718:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399296 00010000:00010000:1.0:1651529344.686721:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 4/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.686741:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12142 00000100:00100000:1.0:1651529344.686743:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41278:x1731746396399296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.686751:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686752:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 4/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.686756:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 3/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686761:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c257a6/0xa29a79078f3bb2bb lrc: 0/0,0 mode: --/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4965 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.686765:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686765:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686766:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.686769:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 4/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.686775:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.686778:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399488 00000100:00100000:1.0:1651529344.686786:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41278:x1731746396399296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686789:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12142 00000100:00100000:1.0:1651529344.686813:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399424 00010000:00010000:0.0:1651529344.686817:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 5/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686821:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 5/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686825:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399616 00000100:00100000:1.0:1651529344.686827:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399552 00010000:00010000:0.0:1651529344.686828:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 5/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686831:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 5/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686834:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12143 00000100:00100000:0.0:1651529344.686835:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41279:x1731746396399488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.686836:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12144 00000100:00100000:1.0:1651529344.686838:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41278:x1731746396399424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.686839:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686840:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.686840:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 5/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686842:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 5/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.686844:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 4/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686845:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 4/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 594 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686850:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686851:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686851:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686853:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686853:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686854:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 4/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686854:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686857:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 4/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686859:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.686862:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.686864:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41278:x1731746396399424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686868:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12144 00000100:00100000:0.0:1651529344.686869:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41279:x1731746396399488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.686872:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12143 00000100:00100000:1.0:1651529344.686874:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12145 00000100:00100000:1.0:1651529344.686875:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396399616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.686877:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686879:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 5/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686882:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 4/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686882:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12146 00000100:00100000:0.0:1651529344.686884:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41278:x1731746396399552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.686886:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686887:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686887:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686888:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686888:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 5/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686891:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 4/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686891:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 4/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.686895:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.686896:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686897:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686897:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686899:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396399616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686902:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12145 00010000:00010000:0.0:1651529344.686903:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 4/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686906:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.686911:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+591:41278:x1731746396399552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.686913:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd16b3c3/0xa29a79078f3ba4d7 lrc: 0/0,0 mode: --/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1222 expref: 591 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.686914:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12146 00000100:00100000:1.0:1651529344.686917:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686921:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686924:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686928:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686930:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686930:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686934:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686936:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686945:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686948:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686974:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1475:39029:x1731745946518080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1045us (1207us total) trans 30064894041 rc 0/0 00000100:00100000:0.0:1651529344.686977:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153179 00000100:00100000:0.0:1651529344.686982:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518656 00000100:00100000:0.0:1651529344.686989:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153185 00000100:00100000:0.0:1651529344.686991:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1475:39029:x1731745946518656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529344.686995:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1475:39030:x1731745946518528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 835us (934us total) trans 30064894042 rc 0/0 00002000:00080000:0.0:1651529344.686995:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177977 count 1 00000100:00100000:1.0:1651529344.686999:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153183 00010000:00010000:0.0:1651529344.687000:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687004:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 2/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 589 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687006:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687007:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687008:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687009:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 4/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687010:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687013:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687015:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687015:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 589 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687019:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 4/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 589 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.687023:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966678208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.687039:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.687047:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002b5c71/0xa29a79078f3bad97 lrc: 0/0,0 mode: --/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3568 expref: 589 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.687051:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966678144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687055:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687058:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687061:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1475:39030:x1731745946518144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1104us (1280us total) trans 30064894043 rc 0/0 00010000:00010000:0.0:1651529344.687063:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687065:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153180 00010000:00010000:0.0:1651529344.687066:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687069:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687074:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687077:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.687078:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687081:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 3/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687086:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 1/0,0 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687089:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bf8bb lrc: 0/0,0 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687093:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687096:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.687097:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687105:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1475:39029:x1731745946518464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 923us (1036us total) trans 30064894044 rc 0/0 00000100:00100000:0.0:1651529344.687107:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153184 00010000:00010000:1.0:1651529344.687110:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 3/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687113:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 1/0,0 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687116:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bf8d7 lrc: 0/0,0 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687116:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687119:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.687120:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687120:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687123:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.687123:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 3/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687124:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687127:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 3/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687128:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 1/0,0 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687130:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 1/0,0 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687131:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bf8c2 lrc: 0/0,0 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687132:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bf8de lrc: 0/0,0 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687140:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed10dcde/0xa29a79078f3bbb20 lrc: 0/0,0 mode: --/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69e8 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.687143:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ea84c0/0xa29a79078f3bb51c lrc: 0/0,0 mode: --/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d533d expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.687144:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687147:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687150:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687153:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966677952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687153:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687156:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687157:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687159:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687160:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687162:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687165:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687168:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687193:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1476:39030:x1731745946518400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1101us (1166us total) trans 30064894045 rc 0/0 00000100:00100000:0.0:1651529344.687195:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153181 00010000:00010000:0.0:1651529344.687202:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687206:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1475:39029:x1731745946518336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1108us (1156us total) trans 30064894046 rc 0/0 00010000:00010000:0.0:1651529344.687208:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529344.687209:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153182 00010000:00010000:0.0:1651529344.687209:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687211:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 3/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687216:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687216:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 1/0,0 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687218:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf8c9 lrc: 0/0,0 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687219:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687222:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687225:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687225:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.687226:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687227:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687229:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 3/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687232:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 1/0,0 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687237:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bf8d0 lrc: 0/0,0 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687241:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687243:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.687244:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687246:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 3/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687249:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 1/0,0 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687252:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bf8b4 lrc: 0/0,0 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687259:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1475:39029:x1731745946517952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1392us (1503us total) trans 30064894047 rc 0/0 00000100:00100000:1.0:1651529344.687262:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153178 00000100:00100000:1.0:1651529344.687489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.687515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.687525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687526:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519104 00000100:00100000:1.0:1651529344.687532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687533:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519232 00000100:00100000:1.0:1651529344.687541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687544:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519360 00000100:00100000:1.0:1651529344.687547:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687558:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519488 00000100:00100000:0.0:1651529344.687562:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519168 00000100:00100000:1.0:1651529344.687563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687565:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519296 00000100:00100000:0.0:1651529344.687567:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519424 00000100:00100000:1.0:1651529344.687570:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153186 00000100:00100000:1.0:1651529344.687572:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.687572:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153187 00000100:00100000:0.0:1651529344.687574:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000353c57a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529344.687578:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177978 count 1 00002000:00080000:0.0:1651529344.687579:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177980 count 1 00010000:00010000:1.0:1651529344.687582:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687584:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687588:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 2/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687589:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 2/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 586 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687591:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687591:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687592:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 4/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687592:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687593:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687593:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 4/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687599:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 3/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687600:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 3/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 586 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687603:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 586 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.687604:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 586 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.687608:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966678272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.687608:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966678336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687624:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.687629:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.687631:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153188 00000100:00100000:1.0:1651529344.687632:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.687636:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153189 00002000:00080000:1.0:1651529344.687637:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177982 count 1 00000100:00100000:0.0:1651529344.687637:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.687640:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.687642:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177984 count 1 00010000:00010000:1.0:1651529344.687645:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 2/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687646:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687648:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687649:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687649:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 4/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687650:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 2/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687653:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687654:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687655:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 3/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687655:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 4/0,1 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687661:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 3/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687662:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 4/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 586 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.687665:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966678400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687673:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.687684:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 4/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 586 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.687685:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153190 00000100:00100000:1.0:1651529344.687687:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.687689:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678464:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.687691:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177979 count 1 00010000:00010000:1.0:1651529344.687695:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687697:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.687699:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 2/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687702:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687703:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687703:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 4/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687704:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153191 00000100:00100000:0.0:1651529344.687706:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529344.687709:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.687710:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177981 count 1 00010000:00010000:1.0:1651529344.687713:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 4/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 586 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.687714:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687718:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 2/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.687720:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687721:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687722:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687722:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 4/0,1 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687727:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.687739:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 3/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 586 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.687742:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153192 00010000:00010000:0.0:1651529344.687743:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 4/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 586 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.687744:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946519424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529344.687747:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966678592:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.687749:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177983 count 1 00010000:00010000:1.0:1651529344.687752:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687754:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.687756:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 2/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 586 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687759:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687760:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687760:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 4/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687767:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 3/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 586 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687770:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 586 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.687774:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966678656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687782:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.687785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.687800:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966678208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687821:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687829:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400128 00010000:00010000:0.0:1651529344.687834:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 4/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 587 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.687842:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12147 00000100:00100000:0.0:1651529344.687844:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+587:41279:x1731746396400128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.687846:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.687848:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 4/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 587 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.687851:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 587 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.687857:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de4812da/0xa29a79078f3b8653 lrc: 0/0,0 mode: --/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff0 expref: 587 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.687861:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687862:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687863:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687866:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 4/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687872:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.687879:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41279:x1731746396400128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.687882:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12147 00010000:00010000:0.0:1651529344.687902:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687906:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687909:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687911:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687975:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1482:39029:x1731745946518656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 983us (1282us total) trans 30064894048 rc 0/0 00000100:00100000:0.0:1651529344.687979:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153185 00010000:00010000:0.0:1651529344.687986:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687989:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.687991:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688004:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 3/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688009:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 1/0,0 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688020:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf8e5 lrc: 0/0,0 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688062:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966678272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688067:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688115:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966678400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688119:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688132:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688139:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688141:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.688146:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000361a0f6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966678656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688146:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688149:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688153:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966678592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688156:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688162:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966678336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688165:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.688339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.688339:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400384 00000100:00100000:1.0:1651529344.688347:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.688350:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 586 pid: 161133 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.688355:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.688364:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400512 00010000:00010000:0.0:1651529344.688367:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 4/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 587 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.688369:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.688371:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400640 00010000:00010000:0.0:1651529344.688373:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 4/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.688374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.688377:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400320 00000100:00100000:1.0:1651529344.688379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.688379:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 589 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.688383:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400448 00000100:00100000:1.0:1651529344.688385:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400576 00010000:00010000:0.0:1651529344.688385:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 4/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 590 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.688389:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400704 00010000:00010000:1.0:1651529344.688391:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 4/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688392:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 592 pid: 142993 timeout: 13094 lvb_type: 1 00000100:00100000:0.0:1651529344.688396:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12148 00000100:00100000:0.0:1651529344.688398:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396400384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.688399:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12149 00000100:00100000:1.0:1651529344.688401:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396400512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.688401:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.688402:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 592 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688404:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688406:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 4/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688406:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 3/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 592 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688409:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 3/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 592 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688411:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007526e54d/0xa29a79078f3b95f0 lrc: 0/0,0 mode: --/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd61d expref: 592 pid: 161133 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688415:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b72bfd8/0xa29a79078f3b9cdb lrc: 0/0,0 mode: --/PR res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1de expref: 591 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688415:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688416:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688416:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688419:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688419:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688420:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688420:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 4/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688424:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 4/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688426:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.688434:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688441:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+590:41279:x1731746396400384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.688442:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+590:41279:x1731746396400512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.688444:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12148 00000100:00100000:1.0:1651529344.688446:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12149 00000100:00100000:0.0:1651529344.688449:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12150 00000100:00100000:1.0:1651529344.688451:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12151 00000100:00100000:0.0:1651529344.688451:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+588:41279:x1731746396400640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.688453:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+588:41279:x1731746396400320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.688454:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688456:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.688456:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 4/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688457:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688459:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 3/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688461:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 3/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688464:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccab5965/0xa29a79078f3bc194 lrc: 0/0,0 mode: --/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8348 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688466:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039da59a8/0xa29a79078f3bbf87 lrc: 0/0,0 mode: --/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b22 expref: 588 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688468:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688468:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688469:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688470:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688470:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688471:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688472:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 4/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688474:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 4/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688477:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.688480:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688483:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41279:x1731746396400640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.688485:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12150 00000100:00100000:1.0:1651529344.688486:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41279:x1731746396400320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.688489:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12151 00000100:00100000:0.0:1651529344.688490:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12152 00000100:00100000:0.0:1651529344.688492:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+584:41279:x1731746396400448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.688494:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.688496:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 4/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 584 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.688497:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12153 00000100:00100000:1.0:1651529344.688499:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+584:41279:x1731746396400704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.688500:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 3/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 584 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688501:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688503:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 584 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688504:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000697989a0/0xa29a79078f3b9ad5 lrc: 0/0,0 mode: --/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9d4 expref: 584 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688507:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 3/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 584 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688508:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688508:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688511:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc4b48c/0xa29a79078f3bc41f lrc: 0/0,0 mode: --/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d5f expref: 583 pid: 142993 timeout: 13094 lvb_type: 1 00010000:00010000:0.0:1651529344.688511:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 4/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688514:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688515:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688516:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688521:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.688526:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 4/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688527:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+582:41279:x1731746396400448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.688529:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12152 00010000:00010000:1.0:1651529344.688532:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688534:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12154 00000100:00100000:0.0:1651529344.688536:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+581:41279:x1731746396400576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.688538:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+581:41279:x1731746396400704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.688538:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.688539:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 4/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 581 pid: 144527 timeout: 13094 lvb_type: 1 00000100:00100000:1.0:1651529344.688541:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12153 00010000:00010000:0.0:1651529344.688543:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688547:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688548:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084dcf43b/0xa29a79078f3b9a1f lrc: 0/0,0 mode: --/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce60e expref: 580 pid: 144527 timeout: 13094 lvb_type: 1 00010000:00010000:1.0:1651529344.688551:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688551:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688552:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688553:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688554:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688555:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 4/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688559:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688563:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688569:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+579:41279:x1731746396400576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.688571:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12154 00010000:00010000:0.0:1651529344.688578:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688582:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688585:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688588:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688621:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1483:39029:x1731745946519104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1048us (1133us total) trans 30064894049 rc 0/0 00000100:00100000:1.0:1651529344.688625:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153186 00010000:00010000:1.0:1651529344.688631:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688635:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688638:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688641:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688644:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1482:39029:x1731745946519296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1096us total) trans 30064894050 rc 0/0 00000100:00100000:0.0:1651529344.688647:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153191 00010000:00010000:0.0:1651529344.688661:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688665:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.688666:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688669:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 3/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688674:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 1/0,0 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688677:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bf8ec lrc: 0/0,0 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688681:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1482:39029:x1731745946519360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1048us (1155us total) trans 30064894051 rc 0/0 00010000:00010000:0.0:1651529344.688681:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688684:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153188 00010000:00010000:0.0:1651529344.688684:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.688685:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688690:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 3/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688692:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688693:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 1/0,0 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688695:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688696:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf90f lrc: 0/0,0 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688699:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688701:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688702:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.688703:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688703:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688705:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 3/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688708:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 1/0,0 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688711:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bf8fa lrc: 0/0,0 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688714:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688717:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529344.688718:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688721:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 3/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688724:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 1/0,0 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688726:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf916 lrc: 0/0,0 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688740:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688743:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688746:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688749:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688751:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1482:39029:x1731745946519424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1006us (1187us total) trans 30064894052 rc 0/0 00000100:00100000:1.0:1651529344.688754:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153192 00010000:00010000:1.0:1651529344.688761:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688764:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688767:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688770:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688795:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1483:39029:x1731745946519488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1156us (1262us total) trans 30064894053 rc 0/0 00000100:00100000:1.0:1651529344.688815:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1483:39029:x1731745946519168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1115us (1261us total) trans 30064894054 rc 0/0 00000100:00100000:0.0:1651529344.688821:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153189 00000100:00100000:1.0:1651529344.688824:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153190 00010000:00010000:0.0:1651529344.688828:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688831:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688832:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688835:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688837:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.688838:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688838:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688841:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 3/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688845:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 1/0,0 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688848:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf901 lrc: 0/0,0 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688852:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688855:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.688856:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688859:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 3/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688862:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 1/0,0 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688867:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf908 lrc: 0/0,0 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688870:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688872:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000353c57a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1482:39029:x1731745946519232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1297us (1357us total) trans 30064894055 rc 0/0 00010000:00010000:1.0:1651529344.688873:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529344.688874:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688875:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153187 00010000:00010000:1.0:1651529344.688876:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 3/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688879:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 1/0,0 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688882:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf8f3 lrc: 0/0,0 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.344143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.344172:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547840 00000100:00100000:0.0:1651529349.344195:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 307 00000100:00100000:0.0:1651529349.344197:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+1482:39030:x1731745946547840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529349.344215:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578368 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529349.344240:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000361a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+1482:39030:x1731745946547840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 42us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.344243:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 307 00000100:00100000:1.0:1651529349.375362:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.375377:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.375384:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547904 00000100:00100000:1.0:1651529349.375385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.375395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.375405:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547968 00000100:00100000:1.0:1651529349.375407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.375411:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548032 00000100:00100000:1.0:1651529349.375417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.375427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.375435:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548160 00000100:00100000:1.0:1651529349.375437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.375447:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548096 00000100:00100000:1.0:1651529349.375449:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548288 00000100:00100000:0.0:1651529349.375450:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548224 00000100:00100000:0.0:1651529349.375453:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548352 00000100:00100000:0.0:1651529349.375457:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153193 00000100:00100000:0.0:1651529349.375458:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946547904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.375461:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153194 00000100:00100000:1.0:1651529349.375463:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1489:39030:x1731745946547968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.375468:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177985 count 1 00002000:00080000:1.0:1651529349.375471:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177986 count 1 00010000:00010000:1.0:1651529349.375480:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.375480:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375489:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 2/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375489:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 2/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.375493:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375493:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375494:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375494:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375495:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 4/0,1 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.375495:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 4/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375509:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 3/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375509:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 3/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.375514:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 4/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.375514:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.375520:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966678720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.375521:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.375540:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.375542:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.375549:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153195 00000100:00100000:1.0:1651529349.375551:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153196 00000100:00100000:0.0:1651529349.375551:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946548032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.375553:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946548160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.375560:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177989 count 1 00010000:00010000:1.0:1651529349.375565:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.375567:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177987 count 1 00010000:00010000:1.0:1651529349.375570:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 2/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375572:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375573:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375574:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375574:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 4/0,1 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.375577:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 2/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375580:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375581:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 3/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375581:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375581:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 4/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375585:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 4/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.375589:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966678848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.375589:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375593:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.375597:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.375597:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.375604:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153197 00000100:00100000:1.0:1651529349.375605:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1489:39030:x1731745946548096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.375606:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.375610:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177988 count 1 00010000:00010000:1.0:1651529349.375613:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.375614:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153198 00000100:00100000:0.0:1651529349.375616:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1489:39030:x1731745946548224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.375618:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 2/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.375621:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529349.375621:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177990 count 1 00010000:00010000:1.0:1651529349.375622:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375622:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 4/0,1 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.375624:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375629:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 3/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375629:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 2/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.375632:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 4/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.375636:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966678976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.375640:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375641:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375641:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 4/0,1 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.375644:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.375649:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 3/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.375650:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153199 00000100:00100000:1.0:1651529349.375652:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1489:39030:x1731745946548352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.375653:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 4/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.375657:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177992 count 1 00000100:00100000:0.0:1651529349.375657:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.375661:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.375664:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.375665:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 2/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.375668:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375669:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.375669:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 4/0,1 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.375672:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153200 00000100:00100000:0.0:1651529349.375673:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946548288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.375678:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177991 count 1 00010000:00010000:1.0:1651529349.375679:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 3/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375682:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.375683:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 4/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.375687:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966679104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.375687:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 2/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375690:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375691:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.375691:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 4/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.375694:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.375701:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 3/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 578 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.375705:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.375709:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966679168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.375715:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.376075:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966678720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.376082:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376390:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.376457:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966678912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.376462:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.376479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.376480:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966679168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.376487:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.376495:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429056 00000100:00100000:1.0:1651529349.376497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.376502:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.376502:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 579 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.376512:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.376512:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429120 00010000:00010000:0.0:1651529349.376514:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 5/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 580 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376519:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429248 00000100:00100000:1.0:1651529349.376520:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429376 00010000:00010000:0.0:1651529349.376521:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 5/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 581 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376525:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429504 00010000:00010000:1.0:1651529349.376527:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 5/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376527:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376531:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429184 00010000:00010000:0.0:1651529349.376533:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 584 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376535:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429312 00010000:00010000:1.0:1651529349.376538:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 5/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 585 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376538:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429440 00010000:00010000:0.0:1651529349.376540:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 5/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376543:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12155 00000100:00100000:1.0:1651529349.376545:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41278:x1731746396429056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.376547:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12156 00000100:00100000:0.0:1651529349.376548:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41278:x1731746396429120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.376550:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.376552:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376552:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.376553:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 5/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376557:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 3/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376560:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 4/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376566:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf63b7d/0xa29a79078f3bc338 lrc: 0/0,0 mode: --/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a41 expref: 586 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376567:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376567:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376569:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376570:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376571:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376572:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376572:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 4/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376575:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 4/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376578:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.376585:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.376599:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+585:41278:x1731746396429120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.376603:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12156 00000100:00100000:1.0:1651529349.376604:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+585:41278:x1731746396429056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.376607:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12155 00000100:00100000:0.0:1651529349.376609:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12157 00000100:00100000:0.0:1651529349.376611:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+584:41278:x1731746396429248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.376614:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12158 00010000:00010000:0.0:1651529349.376614:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.376616:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+583:41278:x1731746396429504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.376616:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 5/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376619:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.376619:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 4/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376621:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376625:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376625:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376626:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376627:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 3/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376629:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 4/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376633:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3b9915 lrc: 0/0,0 mode: --/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce233 expref: 583 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376634:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.376636:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376637:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376638:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.376639:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+582:41278:x1731746396429248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.376641:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 4/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.376642:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12157 00000100:00100000:0.0:1651529349.376646:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12159 00000100:00100000:0.0:1651529349.376647:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+581:41278:x1731746396429376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.376650:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.376657:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+581:41278:x1731746396429504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.376657:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.376658:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 5/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 581 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376660:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12158 00010000:00010000:0.0:1651529349.376662:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 4/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 580 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376664:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12160 00000100:00100000:1.0:1651529349.376666:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+580:41278:x1731746396429184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.376667:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376668:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.376668:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376669:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376670:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 580 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376672:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 4/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376674:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 580 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376675:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.376679:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000883fb33/0xa29a79078f3bbc0e lrc: 0/0,0 mode: --/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dd8 expref: 580 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376682:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376683:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376684:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376686:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 4/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.376691:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+579:41278:x1731746396429376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.376694:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.376699:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12159 00000100:00100000:1.0:1651529349.376700:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+579:41278:x1731746396429184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.376702:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12160 00000100:00100000:1.0:1651529349.376707:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12161 00000100:00100000:1.0:1651529349.376708:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+577:41278:x1731746396429312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.376711:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.376712:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 5/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 577 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376713:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12162 00000100:00100000:0.0:1651529349.376715:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+577:41278:x1731746396429440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.376716:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 4/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 577 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.376718:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.376720:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376720:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 5/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 577 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376721:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.376722:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376724:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 4/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 577 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376725:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 4/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376729:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.376729:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376730:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.376730:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376741:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+577:41278:x1731746396429312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.376744:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12161 00010000:00010000:0.0:1651529349.376744:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 4/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376749:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.376756:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+576:41278:x1731746396429440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (244us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.376757:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe7a401/0xa29a79078f3ba4e5 lrc: 0/0,0 mode: --/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d124c expref: 576 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.376759:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12162 00000100:00100000:1.0:1651529349.376761:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966678784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.376765:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376768:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376770:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f6466b3/0xa29a79078f3bac9b lrc: 0/0,0 mode: --/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d310f expref: 574 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.376771:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.376774:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.376775:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376778:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376785:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376789:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376791:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376795:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376813:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.376900:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1491:39030:x1731745946548224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1472us total) trans 30064894056 rc 0/0 00000100:00100000:0.0:1651529349.376903:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153198 00000100:00100000:1.0:1651529349.376906:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1490:39030:x1731745946547968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1442us (1528us total) trans 30064894057 rc 0/0 00000100:00100000:1.0:1651529349.376910:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153194 00010000:00010000:0.0:1651529349.376912:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376916:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.376918:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376921:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 3/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376922:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d7354cd/0xa29a79078f3b9a49 lrc: 0/0,0 mode: --/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce703 expref: 573 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.376926:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966678848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.376930:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376934:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376936:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376936:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 1/0,0 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376939:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376939:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf924 lrc: 0/0,0 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.376942:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376945:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376947:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.376948:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376951:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 3/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376954:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 1/0,0 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376957:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf940 lrc: 0/0,0 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376960:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376963:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.376968:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376972:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 3/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376975:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 1/0,0 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376978:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf92b lrc: 0/0,0 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376982:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1490:39029:x1731745946548160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1428us (1586us total) trans 30064894058 rc 0/0 00010000:00010000:0.0:1651529349.376984:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.376985:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153196 00010000:00010000:0.0:1651529349.376987:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376990:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.376992:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377006:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d492b4e/0xa29a79078f3bb332 lrc: 0/0,0 mode: --/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4be2 expref: 572 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.377011:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966678976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.377014:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377017:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377020:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377023:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377026:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.377033:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1490:39029:x1731745946548288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1359us (1616us total) trans 30064894059 rc 0/0 00000100:00100000:0.0:1651529349.377037:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153200 00010000:00010000:0.0:1651529349.377044:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377048:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.377049:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377051:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 3/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377056:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 1/0,0 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377058:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf94e lrc: 0/0,0 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377062:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.377063:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1490:39030:x1731745946548096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1457us (1656us total) trans 30064894060 rc 0/0 00010000:00010000:0.0:1651529349.377065:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529349.377066:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153197 00010000:00010000:0.0:1651529349.377066:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377069:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 3/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377072:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 1/0,0 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377077:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebcb2dcb/0xa29a79078f3bb9f3 lrc: 0/0,0 mode: --/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65c0 expref: 571 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.377077:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf939 lrc: 0/0,0 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.377080:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966679104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.377083:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377084:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377086:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377089:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377092:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377095:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377098:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377101:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377103:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.377127:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1491:39029:x1731745946548032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1575us (1741us total) trans 30064894061 rc 0/0 00000100:00100000:0.0:1651529349.377130:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153195 00010000:00010000:0.0:1651529349.377137:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377140:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.377141:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.377143:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1490:39030:x1731745946548352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1489us (1705us total) trans 30064894062 rc 0/0 00010000:00010000:0.0:1651529349.377144:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 3/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.377145:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153199 00010000:00010000:0.0:1651529349.377148:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 1/0,0 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377151:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf932 lrc: 0/0,0 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377155:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377158:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.377159:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377159:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377161:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377162:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 3/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377164:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377167:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 1/0,0 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377167:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377177:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bf947 lrc: 0/0,0 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377183:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377185:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.377186:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377189:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 3/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377192:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 1/0,0 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377195:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bf91d lrc: 0/0,0 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.377202:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1490:39029:x1731745946547904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1743us (1841us total) trans 30064894063 rc 0/0 00000100:00100000:0.0:1651529349.377205:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153193 00000100:00100000:0.0:1651529349.377522:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.377531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.377540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.377542:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548480 00000100:00100000:0.0:1651529349.377546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.377560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.377561:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548416 00000100:00100000:1.0:1651529349.377570:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548544 00000100:00100000:0.0:1651529349.377570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.377575:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548608 00000100:00100000:0.0:1651529349.377577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.377584:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548672 00000100:00100000:0.0:1651529349.377587:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.377588:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548736 00000100:00100000:1.0:1651529349.377590:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548800 00000100:00100000:1.0:1651529349.377592:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548864 00000100:00100000:0.0:1651529349.377594:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153201 00000100:00100000:0.0:1651529349.377596:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946548480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.377597:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153202 00000100:00100000:1.0:1651529349.377599:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946548416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.377603:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177994 count 1 00002000:00080000:1.0:1651529349.377605:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177993 count 1 00010000:00010000:0.0:1651529349.377608:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377611:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377614:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 2/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377616:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 2/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 570 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377617:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377617:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377618:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 4/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377619:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377620:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377621:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 4/0,1 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377625:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 3/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377628:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 3/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 570 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377629:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.377632:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 4/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 570 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.377634:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966679232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.377637:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966679296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.377648:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.377655:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.377655:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153203 00000100:00100000:0.0:1651529349.377657:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1497:39029:x1731745946548544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.377662:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153204 00000100:00100000:1.0:1651529349.377664:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946548608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.377669:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177996 count 1 00002000:00080000:0.0:1651529349.377671:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177995 count 1 00010000:00010000:1.0:1651529349.377673:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377676:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377680:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 2/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377681:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 2/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 570 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377683:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377684:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377684:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377684:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377685:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 4/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377685:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 4/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377691:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 3/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377692:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 3/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 570 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377695:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.377696:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 570 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.377699:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966679360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.377700:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966679424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.377707:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.377709:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.377713:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153205 00000100:00100000:1.0:1651529349.377715:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1497:39029:x1731745946548672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.377715:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153206 00000100:00100000:0.0:1651529349.377717:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946548736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.377719:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177997 count 1 00002000:00080000:0.0:1651529349.377721:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177998 count 1 00010000:00010000:1.0:1651529349.377723:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377725:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377728:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 2/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377729:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 2/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377731:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377731:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377732:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 4/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377747:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377748:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377748:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 4/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377752:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 3/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.377755:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.377757:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 3/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.377760:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966679488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.377761:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.377765:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.377767:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.377773:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.377774:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153207 00000100:00100000:1.0:1651529349.377775:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1497:39029:x1731745946548800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.377779:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153208 00002000:00080000:1.0:1651529349.377780:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:177999 count 1 00000100:00100000:0.0:1651529349.377781:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946548864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.377784:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.377786:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178000 count 1 00010000:00010000:1.0:1651529349.377789:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 2/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377790:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377792:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377792:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377793:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 4/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.377795:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 2/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377798:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.377798:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.377799:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 3/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.377799:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 4/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.377820:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.377825:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966679616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.377829:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 3/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 570 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.377833:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.377833:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.377837:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966679680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.377845:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.378043:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966679232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.378067:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378142:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966679424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.378146:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378170:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966679360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.378175:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378184:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966679488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.378187:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378194:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966679296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.378196:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378323:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.378327:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966679616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.378327:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378333:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378334:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966679680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.378372:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.378423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.378423:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429632 00010000:00010000:0.0:1651529349.378429:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 4/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 571 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.378447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.378448:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429760 00010000:00010000:0.0:1651529349.378451:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 572 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.378456:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429568 00000100:00100000:1.0:1651529349.378458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.378458:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 573 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378462:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429888 00000100:00100000:1.0:1651529349.378463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.378464:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 574 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378468:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430016 00000100:00100000:1.0:1651529349.378469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.378470:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 575 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378474:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429696 00000100:00100000:1.0:1651529349.378476:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429824 00010000:00010000:0.0:1651529349.378476:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 576 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378480:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396429952 00010000:00010000:1.0:1651529349.378482:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378483:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 578 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378489:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12163 00000100:00100000:1.0:1651529349.378491:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+578:41278:x1731746396429632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.378494:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378496:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 4/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 578 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378498:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12164 00010000:00010000:1.0:1651529349.378500:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 3/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 578 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378500:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+578:41278:x1731746396429760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.378503:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.378505:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 578 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378506:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc292e43/0xa29a79078f3b9889 lrc: 0/0,0 mode: --/PR res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdffc expref: 578 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378509:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 3/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 578 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378510:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378511:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378512:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378515:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 4/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378515:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd814d7e/0xa29a79078f3b98d6 lrc: 0/0,0 mode: --/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce15a expref: 577 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378519:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378520:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378521:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378522:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.378524:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 4/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378530:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.378537:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+576:41278:x1731746396429632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.378540:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12163 00000100:00100000:0.0:1651529349.378544:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41278:x1731746396429760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.378546:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12165 00000100:00100000:1.0:1651529349.378547:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41279:x1731746396429568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.378547:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12164 00010000:00010000:1.0:1651529349.378550:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378552:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 574 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378552:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12166 00010000:00010000:1.0:1651529349.378556:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 3/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 574 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378561:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee38573a/0xa29a79078f3ba834 lrc: 0/0,0 mode: --/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d205a expref: 574 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378561:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+574:41278:x1731746396429888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.378564:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378565:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378565:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378566:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378566:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 573 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378569:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 4/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378570:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 3/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 573 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378577:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.378581:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000066e4e61/0xa29a79078f3bb28a lrc: 0/0,0 mode: --/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4869 expref: 573 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378583:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41279:x1731746396429568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.378585:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378585:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.378586:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12165 00010000:00010000:0.0:1651529349.378586:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378589:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 4/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378595:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12167 00010000:00010000:0.0:1651529349.378595:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.378597:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+571:41278:x1731746396430016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.378599:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378601:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 571 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378602:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+571:41278:x1731746396429888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.378605:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 3/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 571 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378605:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12166 00000100:00100000:0.0:1651529349.378609:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12168 00010000:00010000:1.0:1651529349.378610:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee0a1cd/0xa29a79078f3b9e1d lrc: 0/0,0 mode: --/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6e6 expref: 570 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378611:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+570:41279:x1731746396429696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.378613:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378613:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378614:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378615:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378615:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 569 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378618:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 4/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378626:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.378631:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 3/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 569 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378632:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41278:x1731746396430016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.378634:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12167 00010000:00010000:0.0:1651529349.378637:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e9ca3c/0xa29a79078f3bc27b lrc: 0/0,0 mode: --/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8754 expref: 569 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378639:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12169 00010000:00010000:0.0:1651529349.378640:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.378641:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41279:x1731746396429824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.378641:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378641:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378643:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378644:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 567 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378644:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 4/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378648:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 3/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 567 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378653:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.378660:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055f3a845/0xa29a79078f3bb27c lrc: 0/0,0 mode: --/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d484d expref: 567 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.378660:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41279:x1731746396429696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.378663:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12168 00010000:00010000:1.0:1651529349.378664:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378665:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.378665:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378667:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12170 00010000:00010000:1.0:1651529349.378668:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 4/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378669:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41279:x1731746396429952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.378672:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.378673:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.378673:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 565 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.378677:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 3/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 565 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.378679:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41279:x1731746396429824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.378682:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12169 00010000:00010000:1.0:1651529349.378688:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378689:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d13af881/0xa29a79078f3bbc7e lrc: 0/0,0 mode: --/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fc2 expref: 564 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.378691:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378693:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378693:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.378694:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378697:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378697:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 4/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378700:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378705:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.378711:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+563:41279:x1731746396429952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.378714:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12170 00010000:00010000:0.0:1651529349.378722:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378725:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378728:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378731:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378769:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1498:39030:x1731745946548416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1169us (1238us total) trans 30064894064 rc 0/0 00000100:00100000:1.0:1651529349.378773:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153202 00010000:00010000:1.0:1651529349.378780:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378783:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378786:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378789:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378821:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1498:39029:x1731745946548544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1163us (1280us total) trans 30064894065 rc 0/0 00000100:00100000:0.0:1651529349.378825:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153203 00010000:00010000:0.0:1651529349.378832:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378836:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.378837:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378840:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 3/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378845:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 1/0,0 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378848:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1498:39030:x1731745946548608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1183us (1301us total) trans 30064894066 rc 0/0 00010000:00010000:0.0:1651529349.378848:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bf95c lrc: 0/0,0 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378851:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153204 00010000:00010000:0.0:1651529349.378852:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378855:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.378856:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378859:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378861:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 3/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378865:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378865:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 1/0,0 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378867:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bf96a lrc: 0/0,0 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378868:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378870:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378871:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378873:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.378874:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378877:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 3/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378880:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 1/0,0 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378882:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bf963 lrc: 0/0,0 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378886:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378889:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.378890:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378892:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 3/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378895:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 1/0,0 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378898:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bf971 lrc: 0/0,0 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378902:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1498:39029:x1731745946548672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1186us (1347us total) trans 30064894067 rc 0/0 00010000:00010000:0.0:1651529349.378903:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.378904:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153205 00010000:00010000:0.0:1651529349.378906:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378909:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378911:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378911:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378914:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378917:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378919:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.378951:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1499:39030:x1731745946548480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1354us (1429us total) trans 30064894068 rc 0/0 00000100:00100000:1.0:1651529349.378952:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1499:39029:x1731745946548800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1176us (1375us total) trans 30064894069 rc 0/0 00000100:00100000:0.0:1651529349.378954:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153201 00000100:00100000:1.0:1651529349.378957:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153207 00010000:00010000:0.0:1651529349.378962:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378964:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378966:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378967:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.378968:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378969:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378971:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 3/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.378971:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378976:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 1/0,0 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378979:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bf955 lrc: 0/0,0 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378984:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378987:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.378988:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378990:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 3/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378996:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 1/0,0 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.378999:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bf97f lrc: 0/0,0 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379002:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379003:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1498:39030:x1731745946548736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1432us total) trans 30064894070 rc 0/0 00010000:00010000:1.0:1651529349.379005:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.379006:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379006:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153206 00010000:00010000:1.0:1651529349.379008:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 3/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379011:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 1/0,0 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379014:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bf978 lrc: 0/0,0 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379014:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379017:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379020:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379022:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379071:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1498:39030:x1731745946548864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1289us (1483us total) trans 30064894071 rc 0/0 00000100:00100000:0.0:1651529349.379074:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153208 00010000:00010000:0.0:1651529349.379080:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379084:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.379085:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379088:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 3/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379092:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 1/0,0 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379095:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bf986 lrc: 0/0,0 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.379244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.379275:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548928 00000100:00100000:0.0:1651529349.379282:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946548992 00000100:00100000:0.0:1651529349.379287:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153209 00000100:00100000:0.0:1651529349.379289:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1499:39030:x1731745946548928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.379294:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153210 00002000:00080000:0.0:1651529349.379294:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178001 count 1 00000100:00100000:1.0:1651529349.379296:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1499:39030:x1731745946548992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.379302:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178002 count 1 00010000:00010000:0.0:1651529349.379307:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379308:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379312:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 2/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379313:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 2/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 562 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379316:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379316:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379317:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379317:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379317:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 4/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379318:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 4/0,1 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379325:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 3/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 562 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.379325:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 3/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379329:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 4/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 562 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379329:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.379333:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379334:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966679808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379346:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.379346:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.379360:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.379397:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549056 00000100:00100000:0.0:1651529349.379405:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153211 00000100:00100000:0.0:1651529349.379407:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1500:39030:x1731745946549056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.379412:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178003 count 1 00000100:00100000:1.0:1651529349.379413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.379417:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379421:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 2/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.379425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.379431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.379435:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379441:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379442:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 4/0,1 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.379443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.379450:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 3/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.379451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.379454:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 4/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.379458:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549184 00000100:00100000:0.0:1651529349.379458:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966679872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379466:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549120 00000100:00100000:0.0:1651529349.379468:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.379469:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549312 00000100:00100000:1.0:1651529349.379471:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549248 00000100:00100000:1.0:1651529349.379473:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549376 00000100:00100000:0.0:1651529349.379475:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153212 00000100:00100000:0.0:1651529349.379476:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1505:39029:x1731745946549184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.379477:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153213 00000100:00100000:1.0:1651529349.379479:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1505:39030:x1731745946549120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.379481:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178005 count 1 00002000:00080000:1.0:1651529349.379484:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178004 count 1 00010000:00010000:0.0:1651529349.379485:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379489:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379490:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 2/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.379493:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379493:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379494:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 2/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 562 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.379494:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 4/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379497:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379498:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379499:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 4/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379506:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 3/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 562 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379509:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 562 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379511:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 3/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.379514:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966679936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.379515:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 4/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.379519:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966680000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379522:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.379527:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.379529:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153214 00000100:00100000:1.0:1651529349.379531:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1505:39029:x1731745946549312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.379533:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153215 00002000:00080000:1.0:1651529349.379535:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178007 count 1 00000100:00100000:0.0:1651529349.379535:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1505:39030:x1731745946549248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.379539:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.379539:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178006 count 1 00010000:00010000:0.0:1651529349.379543:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379545:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 2/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379548:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379548:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 2/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 562 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379549:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379549:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 4/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379551:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379551:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379552:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 4/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379556:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 3/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.379558:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 3/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 562 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379560:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379562:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 4/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 562 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.379564:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966680064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.379567:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379570:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.379574:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.379575:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153216 00000100:00100000:1.0:1651529349.379577:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072f60e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1505:39030:x1731745946549376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.379581:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178008 count 1 00010000:00010000:1.0:1651529349.379585:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379589:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 2/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379592:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379592:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379593:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 4/0,1 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379599:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 3/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 562 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.379629:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 4/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.379650:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379670:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.379760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.379763:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966679744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.379768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.379768:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.379781:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966679808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.379781:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430080 00010000:00010000:1.0:1651529349.379786:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379787:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 563 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.379794:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430144 00000100:00100000:0.0:1651529349.379795:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12171 00000100:00100000:0.0:1651529349.379797:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+564:41278:x1731746396430080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.379799:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 4/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 564 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379800:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.379802:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 564 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.379823:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12172 00000100:00100000:1.0:1651529349.379825:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+564:41278:x1731746396430144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.379825:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 3/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 564 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.379829:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.379830:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 4/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 564 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379831:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a0d9baf/0xa29a79078f3bae9a lrc: 0/0,0 mode: --/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38f6 expref: 564 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379835:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.379836:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379837:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 3/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 563 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379837:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379840:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 4/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379843:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd0b80b/0xa29a79078f3b77b9 lrc: 0/0,0 mode: --/PR res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb489 expref: 563 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.379846:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.379847:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379847:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.379848:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379852:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 4/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379855:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41278:x1731746396430080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.379858:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.379858:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12171 00010000:00010000:0.0:1651529349.379865:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.379866:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41278:x1731746396430144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.379868:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.379869:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12172 00010000:00010000:0.0:1651529349.379872:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.379874:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379880:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379891:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379894:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379899:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.379923:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1506:39030:x1731745946548928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 633us (688us total) trans 30064894072 rc 0/0 00000100:00100000:0.0:1651529349.379926:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153209 00000100:00100000:1.0:1651529349.379957:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1506:39030:x1731745946548992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 659us (712us total) trans 30064894073 rc 0/0 00000100:00100000:1.0:1651529349.379970:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153210 00010000:00010000:1.0:1651529349.379981:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.379995:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.379997:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380002:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 3/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380021:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 1/0,0 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380024:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bf98d lrc: 0/0,0 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380029:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380032:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.380033:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380036:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 3/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380051:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 1/0,0 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380055:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bf994 lrc: 0/0,0 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.380070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.380076:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966679936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.380078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.380087:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380101:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966680064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.380105:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.380113:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430272 00010000:00010000:1.0:1651529349.380118:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 561 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380124:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430400 00010000:00010000:1.0:1651529349.380126:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380130:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.380132:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430208 00010000:00010000:1.0:1651529349.380142:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 5/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 563 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380147:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430336 00010000:00010000:1.0:1651529349.380150:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 5/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 564 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.380169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.380175:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430464 00010000:00010000:1.0:1651529349.380178:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 5/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 565 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380182:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430528 00010000:00010000:1.0:1651529349.380185:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 5/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 566 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380189:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12173 00000100:00100000:1.0:1651529349.380191:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+566:41278:x1731746396430272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.380194:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.380195:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 566 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380198:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966680000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.380203:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380206:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 3/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 566 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.380212:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416ef89f/0xa29a79078f3b9357 lrc: 0/0,0 mode: --/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb3b expref: 566 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380212:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.380215:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380217:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380217:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380218:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380221:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 4/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380222:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12174 00000100:00100000:0.0:1651529349.380223:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41278:x1731746396430400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.380227:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.380228:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.380229:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 565 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380232:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 3/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 565 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380236:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41278:x1731746396430272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.380238:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a34e72ef/0xa29a79078f3bab1a lrc: 0/0,0 mode: --/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b82 expref: 565 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380239:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12173 00010000:00010000:0.0:1651529349.380242:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380243:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.380244:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12175 00010000:00010000:0.0:1651529349.380244:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380246:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+563:41279:x1731746396430208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.380247:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 4/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380248:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.380250:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 5/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 563 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.380253:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 4/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 563 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380256:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.380264:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+563:41278:x1731746396430400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.380266:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380266:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380267:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380267:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12174 00000100:00100000:0.0:1651529349.380272:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12176 00010000:00010000:1.0:1651529349.380273:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 4/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380274:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41279:x1731746396430336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.380277:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.380277:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.380278:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 4/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380282:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 3/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380283:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41279:x1731746396430208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.380286:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12175 00010000:00010000:0.0:1651529349.380287:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082539f59/0xa29a79078f3ba896 lrc: 0/0,0 mode: --/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21e2 expref: 562 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380290:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12177 00010000:00010000:0.0:1651529349.380291:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380291:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.380292:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+560:41279:x1731746396430464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.380292:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380294:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.380295:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 4/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 560 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380295:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 4/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380299:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 3/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 560 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380301:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.380304:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039e8aef1/0xa29a79078f3b77c7 lrc: 0/0,0 mode: --/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4dd expref: 560 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380306:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+560:41279:x1731746396430336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.380307:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380308:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380309:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380309:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12176 00010000:00010000:1.0:1651529349.380311:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 4/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380313:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12178 00000100:00100000:0.0:1651529349.380315:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396430528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.380318:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.380319:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 5/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.380323:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.380330:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396430464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.380330:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 4/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.380333:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12177 00010000:00010000:0.0:1651529349.380335:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380336:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380337:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380340:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 4/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380343:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adff1bbb/0xa29a79078f3bac86 lrc: 0/0,0 mode: --/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d309f expref: 557 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380344:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.380347:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.380349:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41279:x1731746396430528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.380351:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380352:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12178 00010000:00010000:1.0:1651529349.380354:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380357:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380359:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380360:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380362:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380362:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380365:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380368:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380416:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072f60e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1507:39030:x1731745946549376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 838us (965us total) trans 30064894074 rc 0/0 00000100:00100000:0.0:1651529349.380419:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1507:39030:x1731745946549248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 883us (975us total) trans 30064894075 rc 0/0 00000100:00100000:1.0:1651529349.380421:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153216 00000100:00100000:0.0:1651529349.380423:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153215 00000100:00100000:1.0:1651529349.380426:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549440 00010000:00010000:0.0:1651529349.380431:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380437:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153217 00000100:00100000:1.0:1651529349.380439:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1506:39030:x1731745946549440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.380441:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.380442:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.380444:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178009 count 1 00010000:00010000:0.0:1651529349.380445:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 3/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380449:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380450:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 1/0,0 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380452:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bf9be lrc: 0/0,0 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380453:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 2/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.380457:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380457:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380457:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380458:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 4/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380460:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.380461:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380464:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 3/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 555 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.380464:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 3/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380467:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 1/0,0 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380468:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 555 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.380469:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bf9b7 lrc: 0/0,0 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380473:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.380475:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380478:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380481:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.380481:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380483:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380487:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380499:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380502:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380505:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380529:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1508:39029:x1731745946549184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1052us (1117us total) trans 30064894076 rc 0/0 00000100:00100000:0.0:1651529349.380533:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153212 00010000:00010000:0.0:1651529349.380543:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063600881/0xa29a79078f3bb125 lrc: 0/0,0 mode: --/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4322 expref: 555 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380547:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966679872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.380548:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1507:39029:x1731745946549312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1016us (1116us total) trans 30064894077 rc 0/0 00000100:00100000:1.0:1651529349.380551:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153214 00010000:00010000:0.0:1651529349.380551:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380554:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380557:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380559:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380560:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380562:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380563:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.380564:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380567:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 3/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380571:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 1/0,0 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380574:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bf9a2 lrc: 0/0,0 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380579:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380582:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.380583:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380585:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 3/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380588:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 1/0,0 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380591:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bf9b0 lrc: 0/0,0 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380594:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380596:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1507:39030:x1731745946549056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1188us (1236us total) trans 30064894078 rc 0/0 00010000:00010000:1.0:1651529349.380597:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.380598:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380599:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153211 00010000:00010000:1.0:1651529349.380600:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 3/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380606:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 1/0,0 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380609:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bf99b lrc: 0/0,0 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380614:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380616:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380619:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380622:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.380628:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.380656:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1507:39030:x1731745946549120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1176us (1231us total) trans 30064894079 rc 0/0 00000100:00100000:1.0:1651529349.380659:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153213 00000100:00100000:0.0:1651529349.380701:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549504 00000100:00100000:0.0:1651529349.380709:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153218 00000100:00100000:0.0:1651529349.380710:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1507:39029:x1731745946549504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.380717:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178010 count 1 00010000:00010000:1.0:1651529349.380749:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380755:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.380756:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380756:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380759:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 3/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380763:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 2/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.380764:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 1/0,0 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380766:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380766:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.380767:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bf9a9 lrc: 0/0,0 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380767:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 4/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.380775:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 3/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.380779:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.380783:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.380795:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.380905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.380915:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549632 00000100:00100000:1.0:1651529349.380916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.380923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.380926:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549568 00000100:00100000:0.0:1651529349.380939:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549760 00000100:00100000:1.0:1651529349.380944:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.380945:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153219 00000100:00100000:1.0:1651529349.380950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.380954:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1510:39030:x1731745946549632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.380957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.380960:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178012 count 1 00010000:00010000:0.0:1651529349.380965:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.380968:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549696 00010000:00010000:0.0:1651529349.380970:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 2/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.380977:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549888 00000100:00100000:1.0:1651529349.380981:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549824 00000100:00100000:1.0:1651529349.380984:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153220 00000100:00100000:1.0:1651529349.380985:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1513:39029:x1731745946549568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.380990:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529349.380991:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178011 count 1 00010000:00010000:0.0:1651529349.380991:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.380992:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 4/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.380995:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381000:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 3/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381001:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 2/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.381004:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381008:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966680384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381010:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381011:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381012:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 4/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381023:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 3/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381028:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381034:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.381041:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966680448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.381042:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153221 00000100:00100000:0.0:1651529349.381044:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1513:39030:x1731745946549760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.381048:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178014 count 1 00000100:00100000:1.0:1651529349.381051:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.381053:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381058:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153222 00000100:00100000:1.0:1651529349.381060:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1513:39029:x1731745946549696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.381065:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178013 count 1 00010000:00010000:0.0:1651529349.381067:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 2/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381069:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381070:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381071:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381072:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 4/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381074:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 2/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381077:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381077:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381078:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 4/0,1 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381078:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 3/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.381082:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381086:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966680512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381087:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 3/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381091:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 4/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381094:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.381095:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966680576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.381100:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153223 00000100:00100000:1.0:1651529349.381101:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.381102:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1513:39030:x1731745946549888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.381107:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153224 00002000:00080000:0.0:1651529349.381107:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178016 count 1 00000100:00100000:1.0:1651529349.381108:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1513:39029:x1731745946549824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.381111:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.381112:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178015 count 1 00010000:00010000:0.0:1651529349.381115:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 2/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381116:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381118:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381121:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 2/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 554 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381124:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381124:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381125:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 4/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381126:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381127:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 4/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381130:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 3/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 554 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381134:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 554 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381134:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 3/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.381138:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966680640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.381138:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 4/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381141:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966680704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.381144:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.381149:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.381154:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381158:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.381178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.381193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.381198:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430592 00000100:00100000:0.0:1651529349.381202:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381204:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 555 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381206:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381216:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430656 00010000:00010000:1.0:1651529349.381219:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381223:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12179 00000100:00100000:0.0:1651529349.381225:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41278:x1731746396430592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.381228:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12180 00010000:00010000:0.0:1651529349.381229:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.381230:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41278:x1731746396430656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.381230:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.381233:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.381234:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381234:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 3/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.381238:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 3/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381243:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6e729ac/0xa29a79078f3b9c2c lrc: 0/0,0 mode: --/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee81 expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.381244:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d059d6e0/0xa29a79078f3bb228 lrc: 0/0,0 mode: --/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d470b expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381247:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381248:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381248:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381249:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381249:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381250:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381252:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 4/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381253:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 4/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381265:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.381265:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.381273:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746396430592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.381275:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746396430656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.381276:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12179 00000100:00100000:1.0:1651529349.381278:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12180 00010000:00010000:1.0:1651529349.381287:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381287:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381291:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381291:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381294:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381294:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381296:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381297:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381352:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1515:39030:x1731745946549440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 912us (1222us total) trans 30064894080 rc 0/0 00000100:00100000:1.0:1651529349.381355:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153217 00000100:00100000:0.0:1651529349.381359:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1514:39029:x1731745946549504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 648us (731us total) trans 30064894081 rc 0/0 00010000:00010000:1.0:1651529349.381363:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.381363:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153218 00010000:00010000:1.0:1651529349.381367:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.381368:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381370:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381371:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 3/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381374:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.381375:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 1/0,0 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381375:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381378:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bf9c5 lrc: 0/0,0 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381378:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 3/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381383:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 1/0,0 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381386:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bf9cc lrc: 0/0,0 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.381575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.381629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.381631:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966680448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381640:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381648:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946549952 00000100:00100000:0.0:1651529349.381649:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966680512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.381653:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381656:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550016 00000100:00100000:1.0:1651529349.381660:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153225 00000100:00100000:1.0:1651529349.381661:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1515:39029:x1731745946549952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.381661:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966680384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.381663:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.381667:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178017 count 1 00010000:00010000:1.0:1651529349.381671:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.381671:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153226 00000100:00100000:0.0:1651529349.381672:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1515:39030:x1731745946550016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.381678:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 2/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 552 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.381678:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178018 count 1 00010000:00010000:1.0:1651529349.381682:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381682:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.381683:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 4/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381683:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.381687:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 2/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 552 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.381690:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 552 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.381690:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381691:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.381692:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 4/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.381693:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 552 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.381697:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.381698:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 3/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 552 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.381702:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 552 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381706:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.381713:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.381722:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.381864:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966680576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381870:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.381904:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966680640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.381910:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.381916:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.381937:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430720 00000100:00100000:0.0:1651529349.381938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.381944:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 553 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.381960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.381961:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430848 00010000:00010000:1.0:1651529349.381965:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 4/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.381970:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430784 00010000:00010000:1.0:1651529349.381972:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 555 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.381976:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430976 00010000:00010000:1.0:1651529349.381983:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 5/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 556 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.381988:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396430912 00010000:00010000:1.0:1651529349.381991:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 557 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.381992:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966680704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.381994:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431040 00010000:00010000:1.0:1651529349.381996:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 558 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.381996:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382001:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12181 00000100:00100000:1.0:1651529349.382003:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396430720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.382004:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12182 00000100:00100000:0.0:1651529349.382006:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396430848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.382007:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.382009:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382010:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.382012:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 4/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382016:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 3/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382020:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 3/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382028:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea540809/0xa29a79078f3bb65e lrc: 0/0,0 mode: --/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d579d expref: 558 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382032:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382033:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382034:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382037:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 4/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382048:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff20f2e/0xa29a79078f3ba769 lrc: 0/0,0 mode: --/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d5f expref: 557 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382052:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382053:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382054:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382057:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 4/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382066:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.382073:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.382084:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41279:x1731746396430720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.382087:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12181 00000100:00100000:0.0:1651529349.382087:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41279:x1731746396430848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.382090:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12182 00000100:00100000:1.0:1651529349.382093:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12183 00000100:00100000:1.0:1651529349.382095:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746396430784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.382097:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12184 00010000:00010000:1.0:1651529349.382098:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.382099:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41279:x1731746396430976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.382100:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382102:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.382103:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 4/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382104:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 3/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382107:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 3/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382109:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005039a5c6/0xa29a79078f3bbfdb lrc: 0/0,0 mode: --/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c5d expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382112:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eec9f70/0xa29a79078f3bb443 lrc: 0/0,0 mode: --/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5034 expref: 554 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382113:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382114:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382114:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382115:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382116:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382117:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 4/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382117:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382120:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 4/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382124:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.382125:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.382130:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+552:41278:x1731746396430784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.382131:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+552:41279:x1731746396430976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.382132:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12183 00000100:00100000:0.0:1651529349.382134:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12184 00000100:00100000:1.0:1651529349.382136:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12185 00000100:00100000:1.0:1651529349.382138:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41278:x1731746396430912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.382138:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12186 00000100:00100000:0.0:1651529349.382140:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41278:x1731746396431040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.382141:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.382142:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382142:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.382144:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 550 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382146:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 3/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382148:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 3/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 550 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382150:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3ba093 lrc: 0/0,0 mode: --/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfffa expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382153:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731a28ba/0xa29a79078f3b93dc lrc: 0/0,0 mode: --/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd25 expref: 550 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382156:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382156:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382157:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382157:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382157:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382157:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382160:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 4/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382160:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 4/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382173:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.382173:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.382179:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396430912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.382180:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396431040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.382182:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12185 00000100:00100000:0.0:1651529349.382183:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12186 00010000:00010000:1.0:1651529349.382189:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382192:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382195:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382196:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382199:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382199:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382202:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382205:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382249:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1517:39029:x1731745946549568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1263us (1333us total) trans 30064894082 rc 0/0 00000100:00100000:0.0:1651529349.382251:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1517:39030:x1731745946549632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1296us (1346us total) trans 30064894083 rc 0/0 00000100:00100000:1.0:1651529349.382252:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153220 00000100:00100000:0.0:1651529349.382254:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153219 00010000:00010000:1.0:1651529349.382260:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382262:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382264:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.382265:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382265:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382268:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 3/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382268:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382270:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382273:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 1/0,0 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382276:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bf9da lrc: 0/0,0 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382280:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382283:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.382284:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382287:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 3/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382290:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 1/0,0 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382295:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bf9d3 lrc: 0/0,0 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382299:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382301:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.382302:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382303:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1516:39030:x1731745946549760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1258us (1380us total) trans 30064894084 rc 0/0 00010000:00010000:1.0:1651529349.382304:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 3/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382307:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 1/0,0 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382307:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153221 00010000:00010000:1.0:1651529349.382310:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bf9e1 lrc: 0/0,0 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382314:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382316:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382318:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382319:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382321:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382322:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382324:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382325:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382355:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1517:39030:x1731745946549888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1252us (1404us total) trans 30064894085 rc 0/0 00000100:00100000:0.0:1651529349.382358:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153223 00000100:00100000:1.0:1651529349.382362:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1516:39029:x1731745946549824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1253us (1405us total) trans 30064894086 rc 0/0 00010000:00010000:0.0:1651529349.382364:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382365:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153224 00010000:00010000:0.0:1651529349.382367:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.382368:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382371:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 3/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382373:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382375:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 1/0,0 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382376:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382379:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382379:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bf9ef lrc: 0/0,0 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382382:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382383:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382386:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.382387:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382390:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 3/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382393:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 1/0,0 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382396:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bf9f6 lrc: 0/0,0 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382399:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382402:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.382403:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382408:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 3/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382411:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 1/0,0 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382413:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bf9e8 lrc: 0/0,0 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382414:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1516:39029:x1731745946549696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1353us (1470us total) trans 30064894087 rc 0/0 00000100:00100000:1.0:1651529349.382417:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153222 00000100:00100000:0.0:1651529349.382422:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.382426:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382428:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.382432:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382440:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.382470:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.382486:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431104 00010000:00010000:0.0:1651529349.382498:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 547 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.382508:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431168 00010000:00010000:0.0:1651529349.382511:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 548 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.382519:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12187 00000100:00100000:0.0:1651529349.382521:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396431104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.382524:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.382526:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 548 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382530:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 548 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382535:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9356f3/0xa29a79078f3bbeca lrc: 0/0,0 mode: --/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7851 expref: 548 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382539:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382539:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382540:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382543:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 4/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382551:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.382558:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+547:41278:x1731746396431104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.382561:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12187 00000100:00100000:0.0:1651529349.382565:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12188 00000100:00100000:0.0:1651529349.382567:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+546:41278:x1731746396431168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.382569:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.382571:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382574:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 3/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382579:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000874e0031/0xa29a79078f3badb3 lrc: 0/0,0 mode: --/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35d8 expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.382583:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382583:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382584:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382587:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 4/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382592:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.382610:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+545:41278:x1731746396431168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.382613:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12188 00010000:00010000:0.0:1651529349.382620:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382634:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382645:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382651:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382654:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382656:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382659:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382662:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382716:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1517:39029:x1731745946549952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1054us (1142us total) trans 30064894089 rc 0/0 00000100:00100000:1.0:1651529349.382720:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153225 00010000:00010000:1.0:1651529349.382727:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382728:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1516:39030:x1731745946550016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1055us (1099us total) trans 30064894088 rc 0/0 00010000:00010000:1.0:1651529349.382731:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.382732:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382732:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153226 00010000:00010000:1.0:1651529349.382745:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 3/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382750:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382753:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 1/0,0 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382754:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.382755:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382756:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfa04 lrc: 0/0,0 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382771:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 3/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382777:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 1/0,0 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382780:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bf9fd lrc: 0/0,0 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.382836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.382842:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550144 00000100:00100000:1.0:1651529349.382844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.382853:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550080 00000100:00100000:1.0:1651529349.382855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.382864:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550272 00000100:00100000:1.0:1651529349.382866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.382869:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550400 00000100:00100000:0.0:1651529349.382875:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550208 00000100:00100000:0.0:1651529349.382882:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153227 00000100:00100000:1.0:1651529349.382883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.382884:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1520:39030:x1731745946550144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.382890:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550336 00002000:00080000:0.0:1651529349.382891:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178020 count 1 00010000:00010000:0.0:1651529349.382895:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382897:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153228 00000100:00100000:1.0:1651529349.382899:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946550080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.382900:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 2/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.382903:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529349.382904:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178019 count 1 00010000:00010000:0.0:1651529349.382904:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382905:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 4/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.382909:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382912:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 3/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.382914:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 2/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.382916:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.382917:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382918:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382918:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 4/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382920:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.382928:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 3/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.382935:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.382939:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.382942:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153229 00000100:00100000:0.0:1651529349.382944:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946550272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.382945:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680960:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.382949:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178022 count 1 00010000:00010000:0.0:1651529349.382953:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382955:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.382957:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 2/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.382960:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.382961:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153230 00010000:00010000:0.0:1651529349.382961:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.382961:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 4/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.382963:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946550400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.382968:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178024 count 1 00010000:00010000:0.0:1651529349.382968:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 3/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.382971:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.382971:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.382975:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966681024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.382976:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 2/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.382979:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382979:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.382980:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 4/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.382982:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.382986:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 3/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.382988:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153231 00010000:00010000:1.0:1651529349.382990:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.382990:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946550208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.382994:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966681088:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.382995:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178021 count 1 00010000:00010000:0.0:1651529349.382998:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383001:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.383002:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 2/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.383005:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383006:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383006:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 4/0,1 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383007:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153232 00000100:00100000:1.0:1651529349.383008:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946550336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.383013:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178023 count 1 00010000:00010000:0.0:1651529349.383015:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 3/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.383016:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383019:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 4/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383020:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 2/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.383022:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.383023:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383024:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383024:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 4/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383029:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.383030:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 3/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.383034:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383038:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966681216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.383044:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.383228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.383237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.383247:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550464 00000100:00100000:1.0:1651529349.383258:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550528 00000100:00100000:1.0:1651529349.383263:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153233 00000100:00100000:1.0:1651529349.383265:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1523:39029:x1731745946550464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.383283:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178025 count 1 00010000:00010000:1.0:1651529349.383288:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383294:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 2/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.383297:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383297:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383298:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 4/0,1 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383322:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966681024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.383326:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 3/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.383327:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383330:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 4/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383334:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966681280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.383334:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.383337:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383343:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966680896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.383345:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.383345:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383352:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153234 00000100:00100000:1.0:1651529349.383354:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1523:39029:x1731745946550528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.383359:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178026 count 1 00010000:00010000:1.0:1651529349.383363:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383368:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 2/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.383371:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383371:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383372:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 4/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383378:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 3/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 544 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.383381:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383385:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966681344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.383391:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.383401:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966681088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.383405:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383412:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966680960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.383415:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383502:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.383509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.383520:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966681216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.383521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.383530:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.383537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.383538:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431296 00010000:00010000:1.0:1651529349.383543:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 545 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.383544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.383549:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431232 00000100:00100000:0.0:1651529349.383550:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431424 00010000:00010000:1.0:1651529349.383551:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 547 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383555:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431552 00010000:00010000:0.0:1651529349.383555:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 547 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383558:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 548 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383562:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431488 00000100:00100000:0.0:1651529349.383562:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431360 00010000:00010000:1.0:1651529349.383564:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 4/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383564:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.383569:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12189 00000100:00100000:1.0:1651529349.383572:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12190 00000100:00100000:0.0:1651529349.383572:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41278:x1731746396431296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.383573:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41279:x1731746396431232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.383575:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.383576:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.383576:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383578:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383580:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 3/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383584:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 3/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383586:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56b649b/0xa29a79078f3bbb4a lrc: 0/0,0 mode: --/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ac8 expref: 550 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383589:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383590:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000256694d9/0xa29a79078f3ba0d9 lrc: 0/0,0 mode: --/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0158 expref: 549 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383590:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383591:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383594:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383594:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383594:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 4/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383595:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383599:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 4/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383601:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.383605:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.383613:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396431296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.383616:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12189 00000100:00100000:1.0:1651529349.383620:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+547:41279:x1731746396431232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.383621:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12191 00000100:00100000:1.0:1651529349.383623:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12190 00000100:00100000:0.0:1651529349.383623:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+547:41278:x1731746396431424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.383626:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.383627:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.383628:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12192 00000100:00100000:1.0:1651529349.383630:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+546:41278:x1731746396431552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.383631:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 3/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383633:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.383634:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383636:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53073eb/0xa29a79078f3bc036 lrc: 0/0,0 mode: --/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dbb expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383638:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 3/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 546 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383640:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383640:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383641:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383643:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed779fa2/0xa29a79078f3ba8ff lrc: 0/0,0 mode: --/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2378 expref: 545 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383644:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 4/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383646:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383647:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383648:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383651:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.383657:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41278:x1731746396431424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.383660:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 4/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383660:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12191 00000100:00100000:0.0:1651529349.383664:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12193 00000100:00100000:0.0:1651529349.383666:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41279:x1731746396431360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.383670:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.383679:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41278:x1731746396431552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.383682:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12192 00000100:00100000:1.0:1651529349.383687:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12194 00000100:00100000:1.0:1651529349.383689:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+542:41279:x1731746396431488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.383692:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.383697:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.383699:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 542 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383703:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 3/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 542 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383706:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 4/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 542 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383708:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce59fc3/0xa29a79078f3bc23c lrc: 0/0,0 mode: --/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8619 expref: 542 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.383711:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 3/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 541 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383712:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383712:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.383713:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383716:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 4/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383717:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c0c4f89/0xa29a79078f3baaa3 lrc: 0/0,0 mode: --/PR res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2944 expref: 541 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.383722:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.383724:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383724:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.383725:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383728:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 4/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383728:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396431360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.383731:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12193 00010000:00010000:1.0:1651529349.383746:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.383754:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41279:x1731746396431488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.383757:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12194 00010000:00010000:0.0:1651529349.383757:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383761:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383764:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383766:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383767:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383769:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383772:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383781:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383839:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1525:39030:x1731745946550272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (993us total) trans 30064894090 rc 0/0 00000100:00100000:0.0:1651529349.383842:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153229 00000100:00100000:1.0:1651529349.383845:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1524:39030:x1731745946550080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 945us (1008us total) trans 30064894091 rc 0/0 00000100:00100000:1.0:1651529349.383848:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153228 00010000:00010000:0.0:1651529349.383850:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383854:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383856:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383857:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383860:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383860:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383863:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383866:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.383895:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1525:39030:x1731745946550208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 904us (1029us total) trans 30064894092 rc 0/0 00000100:00100000:0.0:1651529349.383900:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153231 00010000:00010000:0.0:1651529349.383907:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383910:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529349.383911:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1524:39030:x1731745946550400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (1061us total) trans 30064894093 rc 0/0 00010000:00010000:0.0:1651529349.383911:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383914:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 3/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383915:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153230 00010000:00010000:0.0:1651529349.383919:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 1/0,0 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383922:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383922:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfa19 lrc: 0/0,0 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383926:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.383926:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383927:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383929:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.383929:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383930:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 3/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383932:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 3/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383935:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 1/0,0 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383938:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 1/0,0 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383941:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfa12 lrc: 0/0,0 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383941:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfa27 lrc: 0/0,0 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383944:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383947:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383947:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.383947:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383950:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383950:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 3/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383953:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383953:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 1/0,0 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.383956:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 2/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383956:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfa20 lrc: 0/0,0 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383959:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383962:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.383963:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 2/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383966:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 3/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383969:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 1/0,0 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383972:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfa2e lrc: 0/0,0 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383977:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383979:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383982:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.383985:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.383990:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1524:39030:x1731745946550336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1110us total) trans 30064894094 rc 0/0 00000100:00100000:1.0:1651529349.384000:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153232 00010000:00010000:1.0:1651529349.384007:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384010:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.384011:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384014:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 3/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384019:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 1/0,0 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384022:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfa0b lrc: 0/0,0 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.384025:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1524:39030:x1731745946550144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1140us (1240us total) trans 30064894095 rc 0/0 00000100:00100000:0.0:1651529349.384028:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153227 00000100:00100000:0.0:1651529349.384063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.384110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.384125:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966681344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.384129:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.384140:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431616 00010000:00010000:1.0:1651529349.384147:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 5/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 539 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384161:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431680 00010000:00010000:1.0:1651529349.384164:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.384176:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12195 00000100:00100000:1.0:1651529349.384178:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12196 00000100:00100000:0.0:1651529349.384178:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396431616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.384180:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396431680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.384182:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.384183:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.384184:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 5/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.384185:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.384189:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 4/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.384192:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 3/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.384195:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384196:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384196:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384197:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e494fe63/0xa29a79078f3bb94b lrc: 0/0,0 mode: --/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6335 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.384200:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 4/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384201:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384202:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384203:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384204:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.384206:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 4/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384212:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.384213:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41279:x1731746396431616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.384216:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12195 00000100:00100000:1.0:1651529349.384220:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+538:41279:x1731746396431680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.384223:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12196 00010000:00010000:1.0:1651529349.384229:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384233:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384236:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384241:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 2/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384258:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384262:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.384263:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 2/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384299:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 3/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.384312:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1524:39029:x1731745946550528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 957us (1075us total) trans 30064894096 rc 0/0 00000100:00100000:1.0:1651529349.384315:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153234 00010000:00010000:0.0:1651529349.384317:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 1/0,0 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384320:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfa3c lrc: 0/0,0 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384326:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3bb0b5 lrc: 0/0,0 mode: --/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d418c expref: 537 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384331:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966681280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.384334:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384338:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384341:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.384346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.384357:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384360:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.384371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384410:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550592 00000100:00100000:0.0:1651529349.384417:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550656 00000100:00100000:1.0:1651529349.384427:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1526:39029:x1731745946550464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1161us (1199us total) trans 30064894097 rc 0/0 00000100:00100000:0.0:1651529349.384427:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550720 00000100:00100000:1.0:1651529349.384430:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153233 00000100:00100000:0.0:1651529349.384433:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550784 00000100:00100000:0.0:1651529349.384437:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550848 00000100:00100000:1.0:1651529349.384440:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550912 00000100:00100000:0.0:1651529349.384441:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153235 00000100:00100000:0.0:1651529349.384443:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1529:39029:x1731745946550592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.384445:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153236 00000100:00100000:1.0:1651529349.384447:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946550656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.384449:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178027 count 1 00002000:00080000:1.0:1651529349.384452:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178028 count 1 00010000:00010000:0.0:1651529349.384453:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384457:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384458:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 2/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 536 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384461:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 2/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384464:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384465:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384466:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 4/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384469:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384470:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384470:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 4/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384472:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 3/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384476:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384480:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966681408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.384490:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.384493:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 3/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 536 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.384497:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153237 00000100:00100000:1.0:1651529349.384498:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1529:39029:x1731745946550720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.384498:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 536 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.384502:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966681472:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.384503:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178029 count 1 00010000:00010000:1.0:1651529349.384506:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384510:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 2/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.384512:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.384513:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384513:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384514:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 4/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.384519:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153238 00010000:00010000:1.0:1651529349.384520:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 3/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.384521:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946550784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.384524:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.384526:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178030 count 1 00000100:00100000:1.0:1651529349.384528:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966681536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.384529:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.384534:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.384534:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 2/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.384537:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384537:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384538:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 4/0,1 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.384540:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153239 00000100:00100000:1.0:1651529349.384542:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1529:39029:x1731745946550848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.384546:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178031 count 1 00010000:00010000:1.0:1651529349.384549:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384553:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 2/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 536 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384557:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384557:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384557:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 3/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384558:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 4/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384561:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 4/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.384564:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 3/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 536 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.384565:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.384567:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 536 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384571:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966681664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.384573:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.384577:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.384579:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153240 00000100:00100000:0.0:1651529349.384581:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946550912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.384582:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384585:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.384586:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.384586:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178032 count 1 00010000:00010000:1.0:1651529349.384589:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 3/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384589:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384594:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 2/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384596:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 1/0,0 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384597:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384597:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384598:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 4/0,1 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384599:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfa35 lrc: 0/0,0 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384604:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 3/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.384607:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 4/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.384619:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966681728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.384626:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.384633:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946550976 00000100:00100000:0.0:1651529349.384643:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153241 00000100:00100000:0.0:1651529349.384645:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1530:39029:x1731745946550976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.384650:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178033 count 1 00010000:00010000:0.0:1651529349.384654:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384659:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 2/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 536 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.384662:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384662:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.384663:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 4/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.384669:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 3/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 536 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.384672:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 4/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 536 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.384676:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966681792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.384683:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.384794:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.384827:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551040 00000100:00100000:1.0:1651529349.384839:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153242 00000100:00100000:1.0:1651529349.384846:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1531:39029:x1731745946551040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.384853:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178034 count 1 00010000:00010000:1.0:1651529349.384859:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384866:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 2/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384871:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384871:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.384872:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 4/0,1 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.384880:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 3/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 536 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.384884:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 4/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.384902:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966681856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.384917:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.384938:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966681408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.384942:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.384954:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966681472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.384959:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385154:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966681536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.385171:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.385217:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966681664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.385221:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.385233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.385238:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431808 00000100:00100000:0.0:1651529349.385241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.385243:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 537 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385247:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.385249:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431744 00010000:00010000:1.0:1651529349.385251:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 538 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.385255:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431872 00000100:00100000:0.0:1651529349.385256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.385257:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 539 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.385273:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432000 00000100:00100000:0.0:1651529349.385276:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.385277:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 540 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385280:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385281:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396431936 00010000:00010000:1.0:1651529349.385283:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 4/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 541 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.385287:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432128 00000100:00100000:0.0:1651529349.385287:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966681728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.385289:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 5/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 542 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385290:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385293:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432064 00010000:00010000:1.0:1651529349.385295:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 4/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 543 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385296:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966681792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.385298:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432192 00010000:00010000:0.0:1651529349.385298:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385300:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 5/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385305:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12197 00000100:00100000:1.0:1651529349.385307:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12198 00000100:00100000:0.0:1651529349.385307:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41278:x1731746396431808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.385309:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41278:x1731746396431744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.385311:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.385312:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.385312:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 544 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385314:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 544 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385316:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 3/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 544 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385322:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fadd3a8/0xa29a79078f3b7f6f lrc: 0/0,0 mode: --/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc77 expref: 544 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385326:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385326:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385327:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 3/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 543 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385327:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385330:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 4/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385333:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bccb723/0xa29a79078f3bb75a lrc: 0/0,0 mode: --/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b71 expref: 543 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385336:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.385337:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385337:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385338:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385342:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 4/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385348:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+542:41278:x1731746396431808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.385351:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12197 00010000:00010000:1.0:1651529349.385353:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.385357:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12199 00000100:00100000:0.0:1651529349.385359:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+541:41278:x1731746396431872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.385361:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+541:41278:x1731746396431744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.385362:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.385363:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 541 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.385364:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12198 00010000:00010000:0.0:1651529349.385367:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 3/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.385370:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12200 00000100:00100000:1.0:1651529349.385371:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396432000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.385372:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bfc5550/0xa29a79078f3bbab0 lrc: 0/0,0 mode: --/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6828 expref: 540 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385374:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.385376:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 539 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385376:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385376:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385377:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385379:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 3/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 539 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385380:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 4/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385388:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.385393:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41278:x1731746396431872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.385396:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12199 00010000:00010000:1.0:1651529349.385397:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a3467e6/0xa29a79078f3b8278 lrc: 0/0,0 mode: --/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe06 expref: 539 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385401:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.385401:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12201 00010000:00010000:1.0:1651529349.385402:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385402:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385402:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+537:41278:x1731746396431936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.385405:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 4/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385405:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.385406:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 4/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 537 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385410:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 3/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 537 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385411:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.385414:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3ba085 lrc: 0/0,0 mode: --/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffc9 expref: 537 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.385418:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41279:x1731746396432000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.385418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385419:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385421:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12200 00010000:00010000:0.0:1651529349.385422:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 4/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385427:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.385430:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12202 00000100:00100000:1.0:1651529349.385432:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41279:x1731746396432128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.385432:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41278:x1731746396431936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.385434:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.385435:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12201 00010000:00010000:1.0:1651529349.385436:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 4/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 535 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385439:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 3/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 534 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385439:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12203 00000100:00100000:0.0:1651529349.385440:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+534:41278:x1731746396432064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.385443:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.385444:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7193dac/0xa29a79078f3b9644 lrc: 0/0,0 mode: --/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd735 expref: 534 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385444:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 4/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 534 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385447:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 3/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 534 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385450:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385451:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385451:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385452:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bad35 lrc: 0/0,0 mode: --/PR res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d340a expref: 533 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.385454:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 4/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385458:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385458:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.385459:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385464:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.385468:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 4/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385470:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+532:41279:x1731746396432128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.385473:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12202 00010000:00010000:0.0:1651529349.385475:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.385478:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12204 00000100:00100000:1.0:1651529349.385479:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41278:x1731746396432192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.385481:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41278:x1731746396432064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (224us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.385482:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.385483:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 5/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 531 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.385484:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12203 00010000:00010000:1.0:1651529349.385487:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 4/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 530 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.385491:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385492:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385492:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.385493:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385494:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385497:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385498:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 4/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385500:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385502:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.385514:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+530:41278:x1731746396432192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.385516:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12204 00010000:00010000:1.0:1651529349.385527:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f009537/0xa29a79078f3ba3cd lrc: 0/0,0 mode: --/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d2f expref: 529 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.385532:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966681856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.385535:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385538:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385541:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385544:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385547:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385549:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1532:39029:x1731745946550592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1105us (1202us total) trans 30064894098 rc 0/0 00000100:00100000:0.0:1651529349.385552:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153235 00010000:00010000:0.0:1651529349.385565:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385569:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.385570:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385573:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 3/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385578:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 1/0,0 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385581:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfa43 lrc: 0/0,0 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385585:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385588:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.385589:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385592:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 3/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385595:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 1/0,0 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385600:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfa74 lrc: 0/0,0 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385606:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385608:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385610:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1532:39029:x1731745946551040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 762us (815us total) trans 30064894099 rc 0/0 00010000:00010000:0.0:1651529349.385612:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385613:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153242 00010000:00010000:0.0:1651529349.385614:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385627:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385631:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385634:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385637:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385664:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1533:39029:x1731745946550976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1018us (1045us total) trans 30064894100 rc 0/0 00000100:00100000:0.0:1651529349.385667:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153241 00010000:00010000:0.0:1651529349.385674:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385677:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1532:39030:x1731745946550656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1229us (1306us total) trans 30064894101 rc 0/0 00010000:00010000:0.0:1651529349.385677:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385680:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153236 00010000:00010000:0.0:1651529349.385680:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385685:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385688:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385691:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.385692:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385695:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 3/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385700:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 1/0,0 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385703:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfa6d lrc: 0/0,0 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385708:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385710:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.385711:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385714:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 3/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385717:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 1/0,0 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385720:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfa4a lrc: 0/0,0 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385723:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385726:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.385727:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385730:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 3/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385730:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1532:39030:x1731745946550912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1148us (1327us total) trans 30064894102 rc 0/0 00000100:00100000:0.0:1651529349.385733:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153240 00010000:00010000:1.0:1651529349.385741:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 1/0,0 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385744:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfa66 lrc: 0/0,0 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385749:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385751:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385753:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385754:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385756:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385757:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385759:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385760:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.385797:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946550784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1275us (1410us total) trans 30064894103 rc 0/0 00000100:00100000:0.0:1651529349.385800:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153238 00000100:00100000:1.0:1651529349.385829:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1532:39029:x1731745946550848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1285us (1433us total) trans 30064894104 rc 0/0 00010000:00010000:0.0:1651529349.385831:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385832:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153239 00010000:00010000:0.0:1651529349.385834:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.385835:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385838:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 3/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385839:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385843:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.385843:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 1/0,0 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385844:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385846:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfa58 lrc: 0/0,0 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385847:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 3/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385852:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 1/0,0 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385854:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfa5f lrc: 0/0,0 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385860:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385863:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385866:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.385869:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385929:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385933:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.385934:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385937:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 3/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385941:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 1/0,0 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.385944:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfa51 lrc: 0/0,0 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.385986:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1532:39029:x1731745946550720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1486us (1607us total) trans 30064894105 rc 0/0 00000100:00100000:1.0:1651529349.385990:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153237 00000100:00100000:1.0:1651529349.386122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.386150:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.386173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.386184:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.386184:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551168 00000100:00100000:1.0:1651529349.386193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.386206:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551104 00000100:00100000:0.0:1651529349.386213:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551296 00000100:00100000:1.0:1651529349.386216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.386219:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551232 00000100:00100000:0.0:1651529349.386225:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551424 00000100:00100000:0.0:1651529349.386230:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551360 00000100:00100000:1.0:1651529349.386232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.386233:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153243 00000100:00100000:0.0:1651529349.386235:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1537:39030:x1731745946551168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.386239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.386241:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178036 count 1 00000100:00100000:1.0:1651529349.386246:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551488 00010000:00010000:0.0:1651529349.386246:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386251:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551552 00010000:00010000:0.0:1651529349.386251:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 2/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.386254:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.386255:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153244 00010000:00010000:0.0:1651529349.386255:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386255:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 4/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386256:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1539:39029:x1731745946551104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.386262:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178035 count 1 00010000:00010000:0.0:1651529349.386262:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.386266:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.386267:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386270:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.386272:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 2/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.386275:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386276:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386276:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 4/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.386283:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 3/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.386283:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.386289:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153245 00010000:00010000:1.0:1651529349.386290:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 4/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.386291:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1539:39030:x1731745946551296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.386294:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966681984:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.386295:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178038 count 1 00010000:00010000:0.0:1651529349.386299:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386303:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.386304:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 2/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.386306:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386307:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386308:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 4/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386309:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153246 00000100:00100000:1.0:1651529349.386311:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1539:39029:x1731745946551232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.386314:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.386315:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178037 count 1 00010000:00010000:0.0:1651529349.386317:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.386319:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386321:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966682048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.386323:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 2/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.386326:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386327:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386327:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 4/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386328:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.386333:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 3/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.386334:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153247 00000100:00100000:0.0:1651529349.386335:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1539:39030:x1731745946551424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.386337:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 4/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.386339:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178040 count 1 00010000:00010000:0.0:1651529349.386343:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386344:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966682112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.386347:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 2/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 528 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.386350:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.386350:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386351:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386351:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 4/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386356:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153248 00010000:00010000:0.0:1651529349.386357:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 528 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.386358:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1539:39029:x1731745946551360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.386361:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 528 pid: 142994 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.386362:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178039 count 1 00010000:00010000:1.0:1651529349.386365:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386365:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966682176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.386369:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 2/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 528 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.386371:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.386372:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386373:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386373:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 4/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386376:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153249 00000100:00100000:0.0:1651529349.386378:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1539:39029:x1731745946551488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.386379:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 528 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.386382:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178041 count 1 00010000:00010000:1.0:1651529349.386383:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 4/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 528 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.386385:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386387:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966682240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.386389:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 2/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.386392:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.386393:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.386393:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.386393:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 4/0,1 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386398:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153250 00000100:00100000:1.0:1651529349.386400:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1539:39029:x1731745946551552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.386402:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 3/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.386404:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178042 count 1 00010000:00010000:0.0:1651529349.386405:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 4/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.386407:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386409:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.386411:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 2/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.386414:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386415:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.386415:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 4/0,1 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386415:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.386422:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 3/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 528 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.386425:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 4/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.386429:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966682368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.386435:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.386948:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966681920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.386959:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.386976:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966682048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.386979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.386979:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.386986:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966682176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.386989:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.386992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.387000:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.387003:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.387020:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.387025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.387029:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432256 00000100:00100000:1.0:1651529349.387030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.387035:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 529 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387041:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432384 00010000:00010000:0.0:1651529349.387043:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 530 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387048:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432512 00010000:00010000:0.0:1651529349.387050:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 531 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.387054:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432320 00010000:00010000:0.0:1651529349.387056:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 5/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 532 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387060:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432640 00010000:00010000:0.0:1651529349.387062:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 4/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 533 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387066:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432448 00010000:00010000:0.0:1651529349.387067:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 5/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 534 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387071:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432576 00000100:00100000:1.0:1651529349.387073:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966681984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.387073:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 5/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 535 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387078:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387080:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432704 00010000:00010000:0.0:1651529349.387082:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 5/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387086:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966682112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.387086:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12205 00000100:00100000:0.0:1651529349.387088:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41279:x1731746396432256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.387089:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387090:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.387092:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387095:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966682240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.387095:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387098:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387101:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000736e8b8/0xa29a79078f3b9b4c lrc: 0/0,0 mode: --/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb4e expref: 536 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387105:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12206 00010000:00010000:0.0:1651529349.387105:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387105:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387106:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387107:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41279:x1731746396432384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.387109:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 4/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387111:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.387113:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 535 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387116:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.387117:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 535 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387123:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0c4133e/0xa29a79078f3bb164 lrc: 0/0,0 mode: --/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43fb expref: 535 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387125:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41279:x1731746396432256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.387128:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12205 00010000:00010000:1.0:1651529349.387129:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387130:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387131:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387132:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12207 00010000:00010000:1.0:1651529349.387134:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 4/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387134:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746396432512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.387137:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.387138:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 533 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387142:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 533 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387145:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.387153:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746396432384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.387155:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016ce1abe/0xa29a79078f3b8b54 lrc: 0/0,0 mode: --/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc282 expref: 533 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387156:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12206 00010000:00010000:0.0:1651529349.387159:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387159:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387160:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387162:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12208 00010000:00010000:0.0:1651529349.387163:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 4/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387164:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41278:x1731746396432320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.387167:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.387168:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 4/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 531 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387168:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.387172:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 3/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 531 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387174:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41279:x1731746396432512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.387177:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006febf812/0xa29a79078f3bb2c2 lrc: 0/0,0 mode: --/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49b2 expref: 531 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.387177:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12207 00010000:00010000:1.0:1651529349.387180:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387181:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387182:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387185:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 4/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387186:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12209 00010000:00010000:1.0:1651529349.387191:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.387197:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+529:41278:x1731746396432320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.387197:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+529:41279:x1731746396432640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.387199:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12208 00010000:00010000:0.0:1651529349.387200:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.387202:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 4/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387203:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12210 00000100:00100000:1.0:1651529349.387205:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+528:41278:x1731746396432448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.387206:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 3/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387207:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.387209:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 4/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387211:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bbc5d80/0xa29a79078f3bbca1 lrc: 0/0,0 mode: --/PR res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7024 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387212:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 3/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387214:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387215:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387216:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387217:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e0e4c2b/0xa29a79078f3b9e9b lrc: 0/0,0 mode: --/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf891 expref: 527 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387219:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 4/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387220:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387221:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387221:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387225:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.387227:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 4/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387231:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41279:x1731746396432640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (212us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.387232:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.387234:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12209 00000100:00100000:1.0:1651529349.387237:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+525:41278:x1731746396432448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.387239:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12211 00000100:00100000:1.0:1651529349.387240:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12210 00000100:00100000:0.0:1651529349.387240:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+525:41278:x1731746396432576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.387243:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.387244:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 4/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 524 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387245:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12212 00000100:00100000:1.0:1651529349.387246:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41278:x1731746396432704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.387249:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.387250:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 5/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 524 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387254:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 4/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 524 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.387255:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 524 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387258:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387259:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.387259:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387260:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa665db8/0xa29a79078f3b98e4 lrc: 0/0,0 mode: --/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce176 expref: 524 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.387262:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 4/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387264:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387264:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.387265:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387266:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.387268:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 4/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387270:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41278:x1731746396432704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.387272:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12212 00010000:00010000:0.0:1651529349.387276:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.387283:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+522:41278:x1731746396432576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.387285:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12211 00010000:00010000:1.0:1651529349.387290:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074d59b04/0xa29a79078f3bbe45 lrc: 0/0,0 mode: --/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d767c expref: 521 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.387294:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e920db98 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966682368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.387294:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387297:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387297:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387300:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387301:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387303:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387306:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387309:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387312:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387355:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1541:39029:x1731745946551552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 953us (1114us total) trans 30064894106 rc 0/0 00000100:00100000:1.0:1651529349.387358:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153250 00000100:00100000:0.0:1651529349.387360:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1541:39030:x1731745946551424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1023us (1166us total) trans 30064894107 rc 0/0 00000100:00100000:0.0:1651529349.387363:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153247 00010000:00010000:1.0:1651529349.387364:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387370:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.387371:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387371:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387374:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 3/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387374:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.387375:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387378:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 3/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387379:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 1/0,0 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387381:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfaac lrc: 0/0,0 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387383:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 1/0,0 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387386:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfa97 lrc: 0/0,0 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387387:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387390:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387392:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387393:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387395:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387396:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387406:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387409:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387439:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1541:39029:x1731745946551360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1227us total) trans 30064894108 rc 0/0 00000100:00100000:1.0:1651529349.387442:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153248 00010000:00010000:1.0:1651529349.387449:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387450:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1540:39030:x1731745946551296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1158us (1276us total) trans 30064894109 rc 0/0 00010000:00010000:1.0:1651529349.387453:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.387453:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153245 00010000:00010000:1.0:1651529349.387454:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387456:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 3/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387460:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387461:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 1/0,0 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387463:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfa9e lrc: 0/0,0 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387464:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387467:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387467:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387470:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.387470:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387471:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387474:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 3/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387479:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 1/0,0 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387482:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfa89 lrc: 0/0,0 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387485:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387488:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.387489:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387491:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 3/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387494:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 1/0,0 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387497:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfaa5 lrc: 0/0,0 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387502:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387502:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1540:39029:x1731745946551488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1123us (1278us total) trans 30064894110 rc 0/0 00010000:00010000:1.0:1651529349.387505:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387505:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153249 00010000:00010000:1.0:1651529349.387508:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387511:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387512:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387518:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387521:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387524:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387545:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1541:39029:x1731745946551232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1233us (1360us total) trans 30064894111 rc 0/0 00000100:00100000:1.0:1651529349.387548:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153246 00010000:00010000:1.0:1651529349.387555:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387556:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1540:39030:x1731745946551168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1320us (1434us total) trans 30064894112 rc 0/0 00010000:00010000:1.0:1651529349.387558:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.387559:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153243 00010000:00010000:1.0:1651529349.387561:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.387564:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387565:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387568:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.387569:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387572:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 3/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387577:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 1/0,0 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387579:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfa90 lrc: 0/0,0 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387584:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387587:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.387588:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387591:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 3/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387594:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1540:39029:x1731745946551104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1337us (1451us total) trans 30064894113 rc 0/0 00010000:00010000:0.0:1651529349.387594:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 1/0,0 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387596:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfa7b lrc: 0/0,0 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387597:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153244 00010000:00010000:0.0:1651529349.387600:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387602:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.387603:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387606:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 3/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387611:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 1/0,0 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.387614:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfa82 lrc: 0/0,0 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.387922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.387951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.387962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.387963:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551616 00000100:00100000:1.0:1651529349.387969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.387977:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551680 00000100:00100000:1.0:1651529349.387978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.387982:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551744 00000100:00100000:1.0:1651529349.387984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.387994:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551808 00000100:00100000:0.0:1651529349.387999:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551872 00000100:00100000:0.0:1651529349.388004:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552000 00000100:00100000:1.0:1651529349.388007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.388008:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153251 00000100:00100000:0.0:1651529349.388010:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1545:39029:x1731745946551616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.388015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.388015:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178043 count 1 00010000:00010000:0.0:1651529349.388020:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388022:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946551936 00010000:00010000:0.0:1651529349.388025:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 2/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.388028:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552064 00010000:00010000:0.0:1651529349.388028:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388029:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388030:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 4/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388031:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153252 00000100:00100000:1.0:1651529349.388033:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946551680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.388037:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 3/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.388039:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178044 count 1 00010000:00010000:1.0:1651529349.388043:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388043:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388047:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966682432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388049:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 2/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388052:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388053:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388053:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 4/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.388059:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.388060:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 3/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388064:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388065:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153253 00000100:00100000:0.0:1651529349.388067:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1547:39029:x1731745946551744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.388068:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966682496:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.388071:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178045 count 1 00010000:00010000:0.0:1651529349.388075:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388078:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.388079:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 2/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 520 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.388082:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388083:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.388084:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153254 00010000:00010000:0.0:1651529349.388084:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 4/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388086:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946551808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.388090:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178046 count 1 00010000:00010000:0.0:1651529349.388090:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 3/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 520 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.388093:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 520 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388094:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388098:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 2/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.388100:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388101:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388101:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388102:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 4/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.388107:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.388108:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 3/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388112:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388113:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153255 00000100:00100000:0.0:1651529349.388114:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1547:39029:x1731745946551872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.388115:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966682624:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.388118:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178047 count 1 00000100:00100000:1.0:1651529349.388122:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.388122:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388126:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 2/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.388128:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153256 00010000:00010000:0.0:1651529349.388129:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388129:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.388130:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1547:39029:x1731745946552000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.388130:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 4/0,1 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.388134:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178049 count 1 00010000:00010000:0.0:1651529349.388135:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 3/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388137:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388139:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 4/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388141:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 2/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 520 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.388143:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966682688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388144:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388144:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388145:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 4/0,1 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.388149:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.388151:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 3/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 520 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.388154:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153257 00010000:00010000:1.0:1651529349.388155:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 4/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 520 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388156:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946551936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.388159:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966682752:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.388160:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178048 count 1 00000100:00100000:1.0:1651529349.388164:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.388164:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388168:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 2/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.388170:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153258 00010000:00010000:0.0:1651529349.388171:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388171:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.388172:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946552064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.388172:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 4/0,1 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.388176:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178050 count 1 00010000:00010000:0.0:1651529349.388177:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 3/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388179:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388181:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 4/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388183:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 2/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.388184:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966682816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388189:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388190:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388190:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 4/0,1 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.388190:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.388196:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 3/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 520 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.388199:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 4/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.388203:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966682880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.388210:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.388623:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966682432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.388628:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388634:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966682496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.388636:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388639:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388639:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.388647:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966682624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.388650:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.388759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.388765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.388772:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432832 00000100:00100000:0.0:1651529349.388772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.388778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.388779:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 521 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.388792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.388794:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432960 00010000:00010000:1.0:1651529349.388797:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 522 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388816:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.388823:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432768 00010000:00010000:1.0:1651529349.388827:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 523 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388827:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.388832:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433088 00000100:00100000:0.0:1651529349.388833:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396432896 00010000:00010000:1.0:1651529349.388834:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 5/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 524 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.388838:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433024 00010000:00010000:0.0:1651529349.388839:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 526 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388841:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 5/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 526 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.388845:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433152 00000100:00100000:0.0:1651529349.388846:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433216 00010000:00010000:1.0:1651529349.388847:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 5/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388848:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 5/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.388853:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12213 00000100:00100000:1.0:1651529349.388854:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+528:41278:x1731746396432832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.388855:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12214 00000100:00100000:0.0:1651529349.388856:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+528:41278:x1731746396432960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.388857:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.388859:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388859:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.388861:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388865:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 3/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388865:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 3/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388871:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb50df89/0xa29a79078f3bac1d lrc: 0/0,0 mode: --/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2efb expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388871:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f11d0/0xa29a79078f3bb5fc lrc: 0/0,0 mode: --/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d565b expref: 528 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388875:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388876:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388876:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388876:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388877:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388879:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 4/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388880:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 4/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388887:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.388890:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.388901:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41278:x1731746396432960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.388904:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12214 00000100:00100000:1.0:1651529349.388905:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41278:x1731746396432832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.388908:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12213 00000100:00100000:0.0:1651529349.388910:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12215 00000100:00100000:0.0:1651529349.388912:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41279:x1731746396432768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.388914:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.388916:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 524 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.388918:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12216 00000100:00100000:1.0:1651529349.388920:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41278:x1731746396433088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.388920:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 3/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 524 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388923:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.388924:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 5/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 524 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388925:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc46aea7/0xa29a79078f3babad lrc: 0/0,0 mode: --/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d49 expref: 524 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388928:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 4/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 523 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388928:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388929:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388930:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388933:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388933:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 4/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388934:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388934:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388938:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 4/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388939:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.388942:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.388944:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41279:x1731746396432768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.388947:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41278:x1731746396433088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.388947:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12215 00000100:00100000:1.0:1651529349.388949:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12216 00000100:00100000:0.0:1651529349.388951:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12217 00000100:00100000:0.0:1651529349.388953:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41279:x1731746396432896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.388954:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12218 00000100:00100000:1.0:1651529349.388955:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41279:x1731746396433024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.388955:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.388957:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 521 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388958:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.388959:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 5/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 521 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388960:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 3/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 521 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388963:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 4/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 521 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388965:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e6baff0/0xa29a79078f3b927e lrc: 0/0,0 mode: --/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7bb expref: 521 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.388967:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388967:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.388968:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388968:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388968:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.388969:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388973:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 4/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.388975:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 4/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.388977:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.388980:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.388981:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41279:x1731746396433024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.388983:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12218 00000100:00100000:0.0:1651529349.388985:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41279:x1731746396432896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.388987:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12219 00000100:00100000:1.0:1651529349.388989:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41278:x1731746396433152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.388989:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12217 00010000:00010000:1.0:1651529349.388991:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.388992:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 5/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.388993:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12220 00000100:00100000:0.0:1651529349.388995:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+518:41279:x1731746396433216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.388996:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 4/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.388997:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.388998:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 5/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.389000:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.389000:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.389001:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389002:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 4/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.389004:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 4/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389006:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.389007:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.389007:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.389007:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389010:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 4/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.389012:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+518:41278:x1731746396433152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.389014:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.389015:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12219 00000100:00100000:0.0:1651529349.389019:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+517:41279:x1731746396433216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.389021:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12220 00010000:00010000:1.0:1651529349.389025:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3b972b lrc: 0/0,0 mode: --/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaae expref: 516 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.389029:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966682752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.389032:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389033:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ec2a879/0xa29a79078f3bb18e lrc: 0/0,0 mode: --/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44a3 expref: 515 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.389036:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.389037:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966682688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.389038:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389041:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389041:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389044:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389044:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389047:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389050:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389053:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.389117:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946552000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 986us (1132us total) trans 30064894114 rc 0/0 00000100:00100000:1.0:1651529349.389121:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153256 00000100:00100000:0.0:1651529349.389123:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946551872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1145us total) trans 30064894115 rc 0/0 00000100:00100000:0.0:1651529349.389126:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153255 00010000:00010000:1.0:1651529349.389134:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004031b880/0xa29a79078f3b9c8e lrc: 0/0,0 mode: --/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf064 expref: 514 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.389134:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.389140:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966682880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.389140:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389143:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389144:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389145:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389147:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389150:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389153:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389156:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.389181:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946551744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1113us (1218us total) trans 30064894116 rc 0/0 00000100:00100000:0.0:1651529349.389184:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153253 00010000:00010000:0.0:1651529349.389190:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389194:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.389195:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389197:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 3/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.389200:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1548:39030:x1731745946552064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1184us total) trans 30064894117 rc 0/0 00010000:00010000:0.0:1651529349.389202:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 1/0,0 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.389203:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153258 00010000:00010000:0.0:1651529349.389205:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfad6 lrc: 0/0,0 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389209:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389211:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389212:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.389213:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389214:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.389215:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389216:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 3/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389219:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 1/0,0 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389221:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 3/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389221:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfacf lrc: 0/0,0 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389225:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389226:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 1/0,0 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389228:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.389228:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.389229:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfac1 lrc: 0/0,0 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389231:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 3/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389237:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 1/0,0 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389240:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfae4 lrc: 0/0,0 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389249:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae771ba/0xa29a79078f3baca9 lrc: 0/0,0 mode: --/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3163 expref: 513 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.389252:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966682816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.389255:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389258:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389261:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389264:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389267:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389301:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389304:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389307:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.389310:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.389563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.389573:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.389580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.389587:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.389596:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552128 00000100:00100000:0.0:1651529349.389605:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552192 00000100:00100000:0.0:1651529349.389610:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552256 00000100:00100000:0.0:1651529349.389615:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552320 00000100:00100000:0.0:1651529349.389618:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153259 00000100:00100000:0.0:1651529349.389620:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1553:39029:x1731745946552128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.389626:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153260 00000100:00100000:0.0:1651529349.389628:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1553:39030:x1731745946552192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.390234:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153261 00000100:00100000:1.0:1651529349.390236:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1553:39029:x1731745946552256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.390243:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153262 00000100:00100000:1.0:1651529349.390244:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1553:39030:x1731745946552320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.390249:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390253:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.390254:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390257:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 3/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390262:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 1/0,0 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390268:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfadd lrc: 0/0,0 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390272:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390275:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.390275:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390278:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 3/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390281:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 1/0,0 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390284:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfab3 lrc: 0/0,0 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390289:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390292:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390295:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390307:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390327:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390332:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.390333:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390334:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390336:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 3/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390337:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390340:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390342:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 1/0,0 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390343:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390344:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfac8 lrc: 0/0,0 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390349:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390352:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.390353:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390356:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 3/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390359:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 1/0,0 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390361:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfaba lrc: 0/0,0 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.390797:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1553:39030:x1731745946551936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2640us (2798us total) trans 30064894118 rc 0/0 00000100:00100000:0.0:1651529349.390801:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153257 00000100:00100000:1.0:1651529349.390848:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1553:39030:x1731745946551808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2761us (2878us total) trans 30064894120 rc 0/0 00000100:00100000:0.0:1651529349.390849:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1553:39029:x1731745946551616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2838us (2928us total) trans 30064894119 rc 0/0 00000100:00100000:1.0:1651529349.390852:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153254 00000100:00100000:0.0:1651529349.390853:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153251 00002000:00080000:0.0:1651529349.390866:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178051 count 1 00010000:00010000:0.0:1651529349.390871:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390876:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 2/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.390880:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.390880:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.390881:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 4/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390888:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.390892:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.390897:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.390912:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.390923:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178052 count 1 00010000:00010000:0.0:1651529349.390927:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390934:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 2/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.390937:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529349.390938:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178053 count 1 00010000:00010000:0.0:1651529349.390938:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.390938:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 4/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390944:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.390944:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 3/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.390948:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.390950:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 2/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 512 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.390952:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966683008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.390953:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.390959:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.390962:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.390963:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 4/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.390972:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 3/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 512 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.390976:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 4/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 512 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.390980:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.390990:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.391025:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178054 count 1 00010000:00010000:1.0:1651529349.391039:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.391045:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 2/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.391048:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.391049:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.391049:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 4/0,1 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.391057:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 3/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.391060:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 4/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391076:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966683136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.391095:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.391150:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1552:39030:x1731745946551680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3115us (3203us total) trans 30064894121 rc 0/0 00000100:00100000:1.0:1651529349.391153:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153252 00000100:00100000:0.0:1651529349.391163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.391200:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552384 00000100:00100000:0.0:1651529349.391207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.391212:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153263 00000100:00100000:1.0:1651529349.391214:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1552:39029:x1731745946552384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.391224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.391225:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178055 count 1 00010000:00010000:1.0:1651529349.391229:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.391231:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552448 00010000:00010000:1.0:1651529349.391235:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 2/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.391241:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552512 00010000:00010000:1.0:1651529349.391243:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.391244:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.391247:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153264 00010000:00010000:1.0:1651529349.391248:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 4/0,1 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.391249:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1554:39030:x1731745946552448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.391255:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178056 count 1 00010000:00010000:0.0:1651529349.391259:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391267:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 2/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.391270:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391271:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391271:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 4/0,1 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391279:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 3/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.391283:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 4/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391287:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966683200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.391312:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 3/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.391327:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.391334:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153265 00010000:00010000:1.0:1651529349.391336:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 4/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391336:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1554:39030:x1731745946552512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.391355:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178057 count 1 00000100:00100000:1.0:1651529349.391356:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966683264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.391359:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391364:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 2/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.391368:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.391368:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391368:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391369:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 4/0,1 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391376:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 3/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.391391:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 4/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391392:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.391395:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966683328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.391404:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.391436:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552576 00000100:00100000:1.0:1651529349.391467:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153266 00000100:00100000:1.0:1651529349.391470:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1555:39030:x1731745946552576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.391478:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178058 count 1 00010000:00010000:1.0:1651529349.391483:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.391488:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 2/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.391491:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.391492:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.391493:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 4/0,1 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.391500:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 3/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 512 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.391503:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 4/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391508:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966683392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.391582:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.391775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.391789:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966683008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.391794:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.391835:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966682944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.391838:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.391838:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.391847:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433344 00000100:00100000:1.0:1651529349.391848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.391859:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 5/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 513 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.391876:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433280 00000100:00100000:1.0:1651529349.391886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.391886:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 514 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391894:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433408 00000100:00100000:1.0:1651529349.391900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.391902:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 515 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.391907:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433472 00010000:00010000:0.0:1651529349.391909:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 5/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 516 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391913:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433536 00010000:00010000:0.0:1651529349.391915:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 5/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 517 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391919:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433600 00010000:00010000:0.0:1651529349.391921:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 5/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391924:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433664 00000100:00100000:1.0:1651529349.391927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.391927:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 5/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 519 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391931:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433728 00010000:00010000:0.0:1651529349.391933:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 5/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 520 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391937:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12221 00000100:00100000:0.0:1651529349.391939:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41278:x1731746396433344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.391943:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.391945:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 5/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 520 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.391948:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 4/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 520 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.391951:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.391954:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000614bb968/0xa29a79078f3b9613 lrc: 0/0,0 mode: --/PR res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd67f expref: 520 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.391956:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391958:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391959:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.391960:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.391963:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 4/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.391973:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12222 00010000:00010000:0.0:1651529349.391976:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.391980:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41279:x1731746396433280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.391984:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.391986:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 519 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391986:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41278:x1731746396433344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.391989:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12221 00010000:00010000:1.0:1651529349.391990:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 519 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.391996:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cf1cf6/0xa29a79078f3bb5cb lrc: 0/0,0 mode: --/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55cf expref: 518 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.391999:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12223 00010000:00010000:1.0:1651529349.392000:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392001:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.392001:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+517:41279:x1731746396433408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.392002:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392004:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.392005:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 4/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392005:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 517 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392012:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 3/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 517 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.392015:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.392023:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+517:41279:x1731746396433280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.392025:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12222 00010000:00010000:0.0:1651529349.392025:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ee85a8/0xa29a79078f3bbf33 lrc: 0/0,0 mode: --/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79d2 expref: 517 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392028:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392029:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392030:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392032:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12224 00000100:00100000:1.0:1651529349.392033:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41278:x1731746396433472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.392033:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 4/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392036:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.392038:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 5/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 515 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392038:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.392042:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 4/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 515 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.392044:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41279:x1731746396433408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.392047:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392047:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.392047:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12223 00010000:00010000:1.0:1651529349.392048:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392051:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 4/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392052:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12225 00000100:00100000:0.0:1651529349.392054:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41278:x1731746396433536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.392055:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.392056:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.392057:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 5/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 514 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392060:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41278:x1731746396433472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.392061:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 4/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 514 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392063:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12224 00010000:00010000:0.0:1651529349.392066:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392066:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.392067:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12226 00010000:00010000:0.0:1651529349.392067:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392068:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+513:41278:x1731746396433600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.392070:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 4/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392071:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.392072:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 5/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 513 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392074:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.392076:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 4/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 513 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.392079:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+513:41278:x1731746396433536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.392080:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392081:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392081:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392081:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12225 00010000:00010000:1.0:1651529349.392084:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 4/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392085:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12227 00000100:00100000:0.0:1651529349.392086:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41278:x1731746396433664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.392088:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.392088:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.392090:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 5/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392092:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41278:x1731746396433600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.392093:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 4/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392095:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12226 00010000:00010000:0.0:1651529349.392098:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392098:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.392099:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12228 00010000:00010000:0.0:1651529349.392099:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392100:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+511:41278:x1731746396433728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.392102:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.392104:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 5/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 511 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392104:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 4/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392108:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 4/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 511 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392108:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.392112:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.392112:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+511:41278:x1731746396433664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.392113:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392113:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392115:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12227 00010000:00010000:1.0:1651529349.392116:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 4/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392120:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.392124:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41278:x1731746396433728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (197us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.392125:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e61cf42d/0xa29a79078f3ba15e lrc: 0/0,0 mode: --/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0342 expref: 510 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392127:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12228 00000100:00100000:0.0:1651529349.392129:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966683328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.392132:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392135:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392138:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392140:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000544eca2f/0xa29a79078f3ba444 lrc: 0/0,0 mode: --/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f20 expref: 508 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392141:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392144:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966683136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.392144:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392147:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392151:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392164:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392167:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392170:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392218:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946552512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (993us total) trans 30064894122 rc 0/0 00000100:00100000:0.0:1651529349.392222:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153265 00000100:00100000:1.0:1651529349.392224:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946552320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1978us (2637us total) trans 30064894123 rc 0/0 00000100:00100000:1.0:1651529349.392228:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153262 00010000:00010000:0.0:1651529349.392233:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f3794e/0xa29a79078f3b9aab lrc: 0/0,0 mode: --/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8f4 expref: 507 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.392235:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392237:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966683200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392241:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 3/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392244:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392247:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392248:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 1/0,0 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392250:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392251:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfb15 lrc: 0/0,0 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392252:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392255:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392258:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392259:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392262:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 3/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392265:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 1/0,0 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392268:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfb00 lrc: 0/0,0 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392271:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392274:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392275:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392277:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 3/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392283:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 1/0,0 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392285:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfb0e lrc: 0/0,0 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392290:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1556:39030:x1731745946552448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1039us (1082us total) trans 30064894124 rc 0/0 00010000:00010000:1.0:1651529349.392291:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392293:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153264 00010000:00010000:1.0:1651529349.392294:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392297:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392300:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392301:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392304:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392307:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392310:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392346:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1557:39029:x1731745946552256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2109us (2765us total) trans 30064894125 rc 0/0 00000100:00100000:1.0:1651529349.392350:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153261 00000100:00100000:0.0:1651529349.392351:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1557:39029:x1731745946552128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2730us (2789us total) trans 30064894126 rc 0/0 00000100:00100000:0.0:1651529349.392354:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153259 00010000:00010000:1.0:1651529349.392357:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392360:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392361:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392361:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392364:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 3/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392364:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392367:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392369:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 1/0,0 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392370:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392371:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfaf9 lrc: 0/0,0 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392376:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392378:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392379:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392382:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 3/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392385:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 1/0,0 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392388:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfaeb lrc: 0/0,0 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392391:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392394:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392395:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392397:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 3/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392401:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 1/0,0 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392403:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfaf2 lrc: 0/0,0 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392407:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1556:39030:x1731745946552192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2779us (2834us total) trans 30064894127 rc 0/0 00000100:00100000:0.0:1651529349.392410:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153260 00010000:00010000:1.0:1651529349.392413:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ffaad4/0xa29a79078f3b9ba0 lrc: 0/0,0 mode: --/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec20 expref: 506 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392416:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966683264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392419:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392422:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392425:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392430:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392433:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392524:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1556:39029:x1731745946552384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1308us (1361us total) trans 30064894128 rc 0/0 00000100:00100000:1.0:1651529349.392530:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153263 00010000:00010000:1.0:1651529349.392540:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392543:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392544:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392547:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 3/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392561:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 1/0,0 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392564:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfb07 lrc: 0/0,0 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392575:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c3588e/0xa29a79078f3baf42 lrc: 0/0,0 mode: --/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b73 expref: 505 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.392579:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966683392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392582:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392585:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392588:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392591:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392594:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392651:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1556:39030:x1731745946552576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1181us (1259us total) trans 30064894129 rc 0/0 00000100:00100000:1.0:1651529349.392655:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153266 00010000:00010000:1.0:1651529349.392662:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392665:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.392666:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392671:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 3/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392676:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 1/0,0 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392679:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfb1c lrc: 0/0,0 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.392760:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552640 00000100:00100000:0.0:1651529349.392760:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.392770:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.392781:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552704 00000100:00100000:1.0:1651529349.392785:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552768 00000100:00100000:0.0:1651529349.392785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.392789:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552832 00000100:00100000:0.0:1651529349.392792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.392802:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552896 00000100:00100000:0.0:1651529349.392820:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.392821:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153267 00000100:00100000:1.0:1651529349.392823:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1560:39029:x1731745946552640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.392831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.392834:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178059 count 1 00000100:00100000:0.0:1651529349.392837:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946552960 00010000:00010000:1.0:1651529349.392838:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392843:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 2/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.392843:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553024 00010000:00010000:1.0:1651529349.392846:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.392846:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153268 00010000:00010000:1.0:1651529349.392847:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392848:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 4/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392848:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1562:39030:x1731745946552704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.392853:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178060 count 1 00010000:00010000:1.0:1651529349.392858:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 3/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.392858:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392862:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 4/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.392863:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 2/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.392866:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966683456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.392866:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392867:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392867:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 4/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392878:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.392884:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153269 00000100:00100000:1.0:1651529349.392886:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946552768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.392891:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178061 count 1 00010000:00010000:1.0:1651529349.392894:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392894:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 3/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.392898:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 2/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.392898:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 4/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.392901:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392902:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392903:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 4/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.392903:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966683520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392909:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 3/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.392912:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 4/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.392913:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.392917:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.392919:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153270 00000100:00100000:0.0:1651529349.392921:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1562:39030:x1731745946552832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.392924:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.392926:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178062 count 1 00000100:00100000:1.0:1651529349.392929:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153271 00010000:00010000:0.0:1651529349.392930:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392931:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946552896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.392934:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 2/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.392935:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178063 count 1 00010000:00010000:0.0:1651529349.392937:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392937:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392938:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392938:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 4/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392943:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 2/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 504 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.392944:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 3/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.392946:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392946:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392947:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 4/0,1 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392948:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.392952:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966683648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392953:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 3/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 504 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.392956:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 4/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 504 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.392958:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.392960:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966683712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.392964:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153272 00000100:00100000:1.0:1651529349.392966:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.392966:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946552960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.392970:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178064 count 1 00000100:00100000:1.0:1651529349.392972:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153273 00010000:00010000:0.0:1651529349.392973:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.392974:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946553024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.392978:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178065 count 1 00010000:00010000:0.0:1651529349.392978:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 2/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.392980:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392981:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392981:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.392981:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 4/0,1 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.392985:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 2/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.392987:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 3/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.392988:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392989:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.392989:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 4/0,1 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.392991:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 4/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.392995:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 3/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.392995:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966683776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.392998:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 4/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393001:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.393002:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966683840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.393009:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.393018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.393123:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553088 00000100:00100000:1.0:1651529349.393133:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153274 00000100:00100000:1.0:1651529349.393135:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1563:39030:x1731745946553088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.393140:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178066 count 1 00010000:00010000:1.0:1651529349.393144:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393151:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 2/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.393155:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393155:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393156:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 4/0,1 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393162:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 3/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 504 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.393166:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 4/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393170:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966683904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.393185:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.393577:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966683520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.393581:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393617:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966683648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.393618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.393620:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.393625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.393631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.393639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.393639:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433856 00010000:00010000:0.0:1651529349.393650:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 5/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 505 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393661:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433984 00000100:00100000:1.0:1651529349.393664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.393664:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 506 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393668:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433792 00000100:00100000:1.0:1651529349.393669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.393670:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 4/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 507 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393674:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396433920 00000100:00100000:1.0:1651529349.393675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.393676:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 5/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 508 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393680:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434048 00000100:00100000:1.0:1651529349.393681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.393682:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 5/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 509 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393686:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434176 00010000:00010000:0.0:1651529349.393688:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 5/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 510 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393690:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966683456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.393691:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434112 00010000:00010000:0.0:1651529349.393693:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 5/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 511 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.393695:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393697:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434240 00010000:00010000:0.0:1651529349.393699:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 5/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393703:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.393703:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12229 00010000:00010000:1.0:1651529349.393705:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393705:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41278:x1731746396433856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.393708:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393709:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 4/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393712:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12230 00010000:00010000:0.0:1651529349.393713:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 3/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393714:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41278:x1731746396433984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.393718:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393719:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a859ae08/0xa29a79078f3ba881 lrc: 0/0,0 mode: --/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2172 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.393720:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 512 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393722:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393723:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393724:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 3/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 511 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393724:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393727:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 4/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393730:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4687d7/0xa29a79078f3baeb6 lrc: 0/0,0 mode: --/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3966 expref: 511 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393743:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.393747:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393748:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393749:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393752:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 4/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393754:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41278:x1731746396433856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.393757:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12229 00010000:00010000:1.0:1651529349.393762:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.393768:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12231 00000100:00100000:1.0:1651529349.393770:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+509:41278:x1731746396433984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.393770:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+509:41279:x1731746396433792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.393773:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12230 00010000:00010000:0.0:1651529349.393773:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393775:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 4/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 509 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393778:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 3/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 508 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393780:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12232 00000100:00100000:1.0:1651529349.393781:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+508:41279:x1731746396433920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.393784:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393784:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05a3245/0xa29a79078f3ba452 lrc: 0/0,0 mode: --/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f82 expref: 508 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.393786:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 4/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 508 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393787:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393787:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393788:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393790:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 3/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 507 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393791:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 4/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393795:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe20cc9/0xa29a79078f3b9f19 lrc: 0/0,0 mode: --/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa7b expref: 507 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393797:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.393798:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393799:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393799:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393820:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 4/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393821:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+506:41279:x1731746396433792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.393824:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12231 00010000:00010000:1.0:1651529349.393827:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.393830:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12233 00000100:00100000:0.0:1651529349.393831:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+505:41279:x1731746396434048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.393834:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+505:41279:x1731746396433920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (194us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.393834:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393836:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 5/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 505 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393837:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12232 00010000:00010000:0.0:1651529349.393840:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 4/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 504 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393842:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12234 00000100:00100000:1.0:1651529349.393844:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746396434176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.393845:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393845:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393846:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393847:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.393848:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 5/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393849:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 4/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393852:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 4/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 504 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393853:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.393857:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393858:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393858:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393859:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746396434048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.393861:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 4/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393862:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12233 00010000:00010000:1.0:1651529349.393865:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.393866:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12235 00000100:00100000:0.0:1651529349.393867:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+503:41278:x1731746396434112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.393870:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+503:41279:x1731746396434176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.393870:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.393871:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 5/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 503 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393872:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12234 00000100:00100000:1.0:1651529349.393876:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12236 00010000:00010000:0.0:1651529349.393877:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 4/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 502 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.393878:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+502:41278:x1731746396434240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.393880:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.393881:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 5/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 502 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393882:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393882:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.393883:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393886:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 4/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393888:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 4/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 502 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393889:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.393892:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393892:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.393893:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393894:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+502:41278:x1731746396434112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.393896:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 4/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393896:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12235 00010000:00010000:1.0:1651529349.393900:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.393905:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41278:x1731746396434240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.393907:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12236 00010000:00010000:0.0:1651529349.393910:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e940877/0xa29a79078f3bb569 lrc: 0/0,0 mode: --/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54d3 expref: 500 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.393914:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23cab47 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966683776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.393917:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393918:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000000c00ab/0xa29a79078f3b8821 lrc: 0/0,0 mode: --/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0de expref: 499 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.393921:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.393922:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966683712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.393923:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393925:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393927:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393928:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393930:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393931:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393935:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.393937:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.393979:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1565:39029:x1731745946552960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1158us total) trans 30064894130 rc 0/0 00000100:00100000:0.0:1651529349.393982:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153272 00010000:00010000:0.0:1651529349.393990:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393993:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b4498e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.393994:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.393997:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 3/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.393999:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946552896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1067us (1207us total) trans 30064894131 rc 0/0 00010000:00010000:0.0:1651529349.394002:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 1/0,0 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394003:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153271 00010000:00010000:0.0:1651529349.394005:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfb46 lrc: 0/0,0 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394009:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394012:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.394013:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394014:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bafff lrc: 0/0,0 mode: --/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ebb expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.394015:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 3/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394019:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 1/0,0 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394021:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966683840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.394021:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfb3f lrc: 0/0,0 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394026:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394027:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394030:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394031:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394036:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394041:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394049:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394050:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394054:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394098:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1565:39029:x1731745946553024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1122us (1266us total) trans 30064894132 rc 0/0 00000100:00100000:1.0:1651529349.394101:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153273 00000100:00100000:0.0:1651529349.394102:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1565:39030:x1731745946552832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1180us (1317us total) trans 30064894133 rc 0/0 00000100:00100000:0.0:1651529349.394106:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153270 00010000:00010000:1.0:1651529349.394112:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ef9991/0xa29a79078f3bb7a7 lrc: 0/0,0 mode: --/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cc1 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.394114:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394116:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966683904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.394117:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394120:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394120:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394123:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394123:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394126:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394129:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394132:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.394155:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1565:39030:x1731745946552704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1306us (1395us total) trans 30064894134 rc 0/0 00000100:00100000:0.0:1651529349.394158:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153268 00010000:00010000:0.0:1651529349.394165:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394168:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1564:39030:x1731745946553088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1032us (1150us total) trans 30064894135 rc 0/0 00010000:00010000:0.0:1651529349.394168:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.394169:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394171:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153274 00010000:00010000:0.0:1651529349.394172:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 3/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394176:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 1/0,0 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394178:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394179:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfb4d lrc: 0/0,0 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394181:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.394182:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394185:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 3/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394185:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394187:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.394188:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394190:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 1/0,0 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394191:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 3/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394193:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfb38 lrc: 0/0,0 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394194:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 1/0,0 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394197:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfb2a lrc: 0/0,0 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394198:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394200:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.394201:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394207:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 3/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394210:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 1/0,0 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394212:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfb54 lrc: 0/0,0 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394218:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394221:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394224:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394226:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394289:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394293:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.394294:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394299:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 3/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394318:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 1/0,0 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394326:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946552768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1438us (1554us total) trans 30064894136 rc 0/0 00010000:00010000:0.0:1651529349.394327:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfb31 lrc: 0/0,0 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394331:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153269 00010000:00010000:1.0:1651529349.394341:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394366:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394369:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394372:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.394418:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946552640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1594us (1702us total) trans 30064894137 rc 0/0 00000100:00100000:1.0:1651529349.394421:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153267 00010000:00010000:1.0:1651529349.394451:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394455:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.394456:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394459:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 3/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394464:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 1/0,0 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394466:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfb23 lrc: 0/0,0 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.394497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.394511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.394521:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553152 00000100:00100000:1.0:1651529349.394529:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553216 00000100:00100000:1.0:1651529349.394537:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153275 00000100:00100000:1.0:1651529349.394539:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1565:39029:x1731745946553152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.394544:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178067 count 1 00010000:00010000:1.0:1651529349.394548:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.394560:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153276 00000100:00100000:0.0:1651529349.394562:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1565:39030:x1731745946553216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.394569:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 2/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.394569:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178068 count 1 00010000:00010000:1.0:1651529349.394572:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394573:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394573:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394574:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 4/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394579:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 2/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.394581:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 3/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394582:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394582:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394583:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 4/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394585:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 496 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.394589:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.394590:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 3/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394594:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 496 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.394599:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966684032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.394604:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.394615:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.394617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.394655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.394684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.394695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.394695:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553280 00000100:00100000:1.0:1651529349.394701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.394713:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553344 00000100:00100000:0.0:1651529349.394720:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553408 00000100:00100000:1.0:1651529349.394724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.394726:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553472 00000100:00100000:0.0:1651529349.394730:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553536 00000100:00100000:0.0:1651529349.394742:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553600 00000100:00100000:1.0:1651529349.394744:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153277 00000100:00100000:1.0:1651529349.394747:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1571:39029:x1731745946553280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.394748:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153278 00000100:00100000:0.0:1651529349.394750:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1571:39030:x1731745946553344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.394752:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178069 count 1 00002000:00080000:0.0:1651529349.394755:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178070 count 1 00010000:00010000:1.0:1651529349.394757:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394760:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394762:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 2/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394764:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 2/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 496 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.394765:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394766:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394766:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 4/0,1 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394767:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394768:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394769:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 4/0,1 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394773:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 3/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394775:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 3/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 496 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.394777:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 4/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 496 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.394781:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966684096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.394782:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 4/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 496 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.394786:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966684160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.394797:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.394827:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153279 00000100:00100000:1.0:1651529349.394829:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1571:39029:x1731745946553408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.394836:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.394844:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153280 00002000:00080000:1.0:1651529349.394845:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178071 count 1 00000100:00100000:0.0:1651529349.394846:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1571:39030:x1731745946553472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.394849:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.394851:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178072 count 1 00010000:00010000:1.0:1651529349.394854:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 2/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394855:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394858:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 4/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394859:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 2/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394862:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394863:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394863:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 4/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394865:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 3/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.394870:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 496 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.394870:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 3/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 496 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394874:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 496 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.394877:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966684224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.394880:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966684288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.394890:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.394898:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153281 00000100:00100000:1.0:1651529349.394900:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1571:39030:x1731745946553536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.394900:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.394905:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178073 count 1 00000100:00100000:0.0:1651529349.394908:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153282 00010000:00010000:1.0:1651529349.394909:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.394909:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1571:39030:x1731745946553600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.394913:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 2/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 496 pid: 142993 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.394914:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178074 count 1 00010000:00010000:1.0:1651529349.394917:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.394917:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394917:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394918:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 4/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.394922:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 2/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 496 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.394924:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 3/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 496 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394925:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394925:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.394926:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 4/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.394928:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 4/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 496 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.394932:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966684352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.394932:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 3/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 496 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.394936:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 496 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.394939:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.394940:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966684416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.394947:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.394998:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966683968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.395033:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.395069:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966684032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.395079:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.395088:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434304 00000100:00100000:1.0:1651529349.395094:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434368 00010000:00010000:1.0:1651529349.395100:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395107:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.395109:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12237 00000100:00100000:1.0:1651529349.395111:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41278:x1731746396434368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.395114:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395116:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.395116:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12238 00000100:00100000:0.0:1651529349.395118:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41278:x1731746396434304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.395121:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395122:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 3/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395122:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395126:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 3/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395131:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b919009/0xa29a79078f3ba188 lrc: 0/0,0 mode: --/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ea expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395137:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395137:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395138:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395141:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 4/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395145:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a6dbf2/0xa29a79078f3b9e40 lrc: 0/0,0 mode: --/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf772 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395149:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395152:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.395154:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395156:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395159:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 4/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395163:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+496:41278:x1731746396434368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.395166:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12237 00010000:00010000:0.0:1651529349.395171:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.395179:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395179:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41278:x1731746396434304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.395182:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12238 00010000:00010000:1.0:1651529349.395183:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395189:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395190:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395191:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395193:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395196:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395199:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395233:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1573:39029:x1731745946553152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 693us (736us total) trans 30064894138 rc 0/0 00000100:00100000:1.0:1651529349.395236:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153275 00000100:00100000:0.0:1651529349.395241:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1572:39030:x1731745946553216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 678us (729us total) trans 30064894139 rc 0/0 00010000:00010000:1.0:1651529349.395243:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395244:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153276 00010000:00010000:1.0:1651529349.395247:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395248:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395250:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 3/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395251:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395254:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000386c4efa already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395255:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 1/0,0 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395255:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395258:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfb5b lrc: 0/0,0 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395261:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 3/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395266:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 1/0,0 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395268:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3bfb62 lrc: 0/0,0 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395327:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966684096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.395334:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395389:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966684224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.395391:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.395393:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.395401:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966684352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.395402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.395404:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.395420:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.395422:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434432 00000100:00100000:0.0:1651529349.395425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.395427:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 4/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 495 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.395433:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434496 00000100:00100000:0.0:1651529349.395434:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966684288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.395435:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 5/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 496 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395438:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395440:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434560 00010000:00010000:1.0:1651529349.395442:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.395445:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966684416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.395446:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434624 00010000:00010000:1.0:1651529349.395448:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 498 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395448:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395454:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434688 00010000:00010000:1.0:1651529349.395456:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 4/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 499 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.395460:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434752 00010000:00010000:1.0:1651529349.395462:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 500 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.395473:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12239 00000100:00100000:1.0:1651529349.395475:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+500:41279:x1731746396434432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.395475:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12240 00000100:00100000:0.0:1651529349.395477:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+500:41278:x1731746396434496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.395478:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395479:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 4/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 500 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395481:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395483:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 3/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 500 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395483:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 5/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 500 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395486:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 4/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 500 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395488:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028adaa60/0xa29a79078f3bb8f7 lrc: 0/0,0 mode: --/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6216 expref: 500 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395492:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395492:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395492:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395493:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395493:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395494:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395496:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 4/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395497:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 4/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395501:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.395503:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.395510:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+499:41278:x1731746396434496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.395511:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+499:41279:x1731746396434432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.395513:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12240 00000100:00100000:1.0:1651529349.395514:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12239 00000100:00100000:0.0:1651529349.395518:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12241 00000100:00100000:1.0:1651529349.395520:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12242 00000100:00100000:0.0:1651529349.395520:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+497:41279:x1731746396434560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.395522:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+497:41278:x1731746396434624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.395523:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395524:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.395524:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395526:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395528:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 3/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395530:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 3/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395534:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fffd6bb/0xa29a79078f3b9ee1 lrc: 0/0,0 mode: --/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf971 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395535:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000020fbdda/0xa29a79078f3bb1e2 lrc: 0/0,0 mode: --/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4639 expref: 497 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395538:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395538:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395539:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395539:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395539:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395540:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395541:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 4/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395543:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 4/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395547:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.395548:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.395552:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41278:x1731746396434624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.395553:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41279:x1731746396434560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.395554:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12242 00000100:00100000:0.0:1651529349.395556:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12241 00000100:00100000:1.0:1651529349.395558:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12243 00000100:00100000:1.0:1651529349.395560:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41279:x1731746396434688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.395562:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.395564:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 4/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 493 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.395565:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12244 00000100:00100000:0.0:1651529349.395566:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41278:x1731746396434752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.395567:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 3/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 493 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395569:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.395570:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 493 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395572:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024a12e86/0xa29a79078f3b8431 lrc: 0/0,0 mode: --/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbedf expref: 493 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.395574:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 3/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 493 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395575:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395576:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.395576:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395579:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 4/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395579:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d48340/0xa29a79078f3b77d5 lrc: 0/0,0 mode: --/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4f9 expref: 492 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395584:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.395585:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395585:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.395586:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395589:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+491:41279:x1731746396434688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.395589:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 4/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395591:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12243 00010000:00010000:0.0:1651529349.395594:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.395597:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395599:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41278:x1731746396434752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.395600:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395602:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12244 00010000:00010000:1.0:1651529349.395604:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395606:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395607:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395611:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395614:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395616:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395657:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1573:39030:x1731745946553536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 755us (955us total) trans 30064894140 rc 0/0 00000100:00100000:1.0:1651529349.395660:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153281 00000100:00100000:0.0:1651529349.395662:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1573:39030:x1731745946553472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 815us (966us total) trans 30064894141 rc 0/0 00000100:00100000:0.0:1651529349.395665:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153280 00010000:00010000:1.0:1651529349.395667:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395671:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395672:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395672:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395674:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 3/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395676:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395679:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 1/0,0 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395679:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395681:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395682:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfb85 lrc: 0/0,0 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395686:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395689:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a79ef65 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395690:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395693:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 3/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395696:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 1/0,0 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395698:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3bfb7e lrc: 0/0,0 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395702:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395704:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000566545e3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395705:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395708:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 3/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395713:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 1/0,0 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395714:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1572:39030:x1731745946553600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 803us (990us total) trans 30064894142 rc 0/0 00010000:00010000:1.0:1651529349.395716:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3bfb8c lrc: 0/0,0 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395716:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153282 00010000:00010000:1.0:1651529349.395722:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395724:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395727:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395727:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc556379/0xa29a79078f3b93d5 lrc: 0/0,0 mode: --/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd09 expref: 489 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.395730:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395731:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966684160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.395745:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395748:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395751:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395756:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395759:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395786:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1573:39029:x1731745946553408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 956us (1102us total) trans 30064894143 rc 0/0 00000100:00100000:1.0:1651529349.395789:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153279 00010000:00010000:1.0:1651529349.395797:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395800:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1572:39030:x1731745946553344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1049us (1145us total) trans 30064894144 rc 0/0 00010000:00010000:1.0:1651529349.395801:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395802:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395820:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153278 00010000:00010000:1.0:1651529349.395826:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 3/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395830:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 1/0,0 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395833:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfb77 lrc: 0/0,0 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.395837:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395840:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015f46ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.395841:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395844:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 3/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395847:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 1/0,0 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395850:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3bfb70 lrc: 0/0,0 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.395850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.395862:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395865:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395868:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395871:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395919:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395923:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.395924:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395927:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 3/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395933:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 1/0,0 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395935:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfb69 lrc: 0/0,0 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.395946:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1572:39029:x1731745946553280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1198us (1328us total) trans 30064894145 rc 0/0 00000100:00100000:1.0:1651529349.395951:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153277 00000100:00100000:0.0:1651529349.395951:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553728 00000100:00100000:1.0:1651529349.395959:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553664 00000100:00100000:0.0:1651529349.395959:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153283 00000100:00100000:0.0:1651529349.395978:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1573:39030:x1731745946553728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.395983:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153284 00000100:00100000:1.0:1651529349.395985:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1573:39029:x1731745946553664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.395988:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178076 count 1 00002000:00080000:1.0:1651529349.395990:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178075 count 1 00010000:00010000:0.0:1651529349.395993:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.395995:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.395998:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 2/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.396000:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 2/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396001:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396001:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396002:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 4/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396003:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396003:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396004:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 4/0,1 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396009:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396013:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396017:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966684480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.396022:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 3/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.396026:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.396027:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 4/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396031:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966684544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.396040:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.396104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.396114:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.396125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.396125:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553856 00000100:00100000:1.0:1651529349.396134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.396147:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553792 00000100:00100000:0.0:1651529349.396154:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553920 00000100:00100000:1.0:1651529349.396158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.396171:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554048 00000100:00100000:0.0:1651529349.396178:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946553984 00000100:00100000:0.0:1651529349.396182:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153285 00000100:00100000:0.0:1651529349.396184:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1578:39030:x1731745946553856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.396189:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178078 count 1 00010000:00010000:0.0:1651529349.396193:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396198:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 2/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.396199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.396201:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396201:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396202:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 4/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396207:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554112 00010000:00010000:0.0:1651529349.396209:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 3/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396212:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396213:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153286 00000100:00100000:1.0:1651529349.396215:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1579:39029:x1731745946553792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.396216:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966684608:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.396220:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178077 count 1 00010000:00010000:1.0:1651529349.396225:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.396228:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.396230:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 2/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.396233:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.396234:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153287 00000100:00100000:0.0:1651529349.396235:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1579:39029:x1731745946553920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.396240:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178079 count 1 00010000:00010000:1.0:1651529349.396242:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396243:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 4/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396243:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396247:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 2/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396250:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396251:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 3/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396251:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396252:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 4/0,1 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396255:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 4/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396257:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 3/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.396259:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966684672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.396261:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 4/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396265:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966684736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.396268:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.396271:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.396275:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153288 00000100:00100000:1.0:1651529349.396277:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1579:39029:x1731745946554048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.396277:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153289 00000100:00100000:0.0:1651529349.396279:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1579:39029:x1731745946553984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.396282:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178081 count 1 00002000:00080000:0.0:1651529349.396283:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178080 count 1 00010000:00010000:1.0:1651529349.396285:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396286:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396290:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 2/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396290:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 2/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.396293:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396293:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396294:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 4/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396296:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396296:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396297:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 4/0,1 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396300:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 3/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396302:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 3/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.396306:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 4/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396309:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966684864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.396315:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.396318:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 4/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396325:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966684800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.396336:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.396353:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153290 00000100:00100000:1.0:1651529349.396355:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1579:39030:x1731745946554112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.396372:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178082 count 1 00010000:00010000:1.0:1651529349.396383:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.396385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.396392:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 2/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.396396:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396396:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396397:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 4/0,1 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.396397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.396404:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 3/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 488 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.396407:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 4/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396421:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966684480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.396425:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396431:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966684928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.396432:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434816 00010000:00010000:0.0:1651529349.396437:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396448:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.396450:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434880 00010000:00010000:0.0:1651529349.396454:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 5/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396461:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12245 00000100:00100000:1.0:1651529349.396465:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41278:x1731746396434816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.396469:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.396471:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396481:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12246 00000100:00100000:0.0:1651529349.396483:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41278:x1731746396434880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.396487:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396495:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f443636/0xa29a79078f3b9a2d lrc: 0/0,0 mode: --/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce64d expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396495:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.396497:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 5/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396499:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396499:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396500:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396501:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 4/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396503:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 4/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396507:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396508:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396509:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396514:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.396518:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 4/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396522:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41278:x1731746396434816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.396523:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.396526:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12245 00000100:00100000:0.0:1651529349.396531:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+488:41278:x1731746396434880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.396534:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12246 00010000:00010000:1.0:1651529349.396540:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e18dd0fa/0xa29a79078f3ba6ba lrc: 0/0,0 mode: --/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a1e expref: 487 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396542:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396544:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966684544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.396545:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396548:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396550:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396551:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396553:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396554:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396557:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396566:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.396604:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1581:39030:x1731745946553728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 626us (767us total) trans 30064894146 rc 0/0 00000100:00100000:0.0:1651529349.396608:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153283 00000100:00100000:1.0:1651529349.396611:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1580:39029:x1731745946553664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 625us (761us total) trans 30064894147 rc 0/0 00000100:00100000:1.0:1651529349.396614:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153284 00010000:00010000:0.0:1651529349.396615:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396618:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f782055 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.396619:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396622:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396622:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 3/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396627:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 1/0,0 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396628:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.396629:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396630:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3bfb93 lrc: 0/0,0 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396632:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 3/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396637:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 1/0,0 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396640:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfb9a lrc: 0/0,0 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.396676:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966684608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.396680:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.396773:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396434944 00010000:00010000:0.0:1651529349.396788:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 487 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.396796:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435072 00010000:00010000:0.0:1651529349.396799:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 5/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 488 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396801:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.396825:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.396831:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.396838:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435008 00010000:00010000:0.0:1651529349.396842:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 5/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396846:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435200 00010000:00010000:0.0:1651529349.396848:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 5/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396852:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435136 00000100:00100000:1.0:1651529349.396855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.396855:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 5/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 491 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396859:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12247 00000100:00100000:0.0:1651529349.396861:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+491:41278:x1731746396434944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.396864:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.396865:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 491 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396869:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 3/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 491 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.396872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.396894:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966684672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.396898:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021f79274/0xa29a79078f3bb117 lrc: 0/0,0 mode: --/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42dc expref: 491 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396899:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396902:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396902:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396903:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396906:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 4/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396907:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966684800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.396911:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396913:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.396918:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12248 00000100:00100000:1.0:1651529349.396920:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41279:x1731746396435072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.396921:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41278:x1731746396434944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.396923:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.396923:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12247 00010000:00010000:1.0:1651529349.396925:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 5/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 490 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396929:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 4/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396929:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12249 00000100:00100000:0.0:1651529349.396930:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41278:x1731746396435008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.396933:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.396934:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 4/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396935:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396935:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396936:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396938:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 3/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396939:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 4/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396943:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73b775c/0xa29a79078f3bb386 lrc: 0/0,0 mode: --/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cd0 expref: 489 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396944:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.396946:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396947:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396948:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.396950:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 4/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.396951:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+488:41279:x1731746396435072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.396954:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12248 00010000:00010000:0.0:1651529349.396959:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.396965:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+487:41278:x1731746396435008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.396968:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12250 00000100:00100000:0.0:1651529349.396969:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12249 00000100:00100000:1.0:1651529349.396970:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+487:41279:x1731746396435200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.396974:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.396975:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 4/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 486 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396978:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12251 00010000:00010000:1.0:1651529349.396980:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 3/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 486 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.396980:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+486:41278:x1731746396435136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.396982:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.396984:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 5/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 486 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396987:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 4/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 486 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.396989:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000defd86e3/0xa29a79078f3bb5c4 lrc: 0/0,0 mode: --/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55a5 expref: 486 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.396992:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396993:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.396994:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.396995:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396995:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.396997:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397001:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 4/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397012:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.397012:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 4/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397020:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.397021:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41279:x1731746396435200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.397026:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12250 00000100:00100000:0.0:1651529349.397030:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+484:41278:x1731746396435136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.397034:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12251 00010000:00010000:1.0:1651529349.397038:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397041:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397046:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdce4b20/0xa29a79078f3b99fc lrc: 0/0,0 mode: --/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce59e expref: 483 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.397047:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397050:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397050:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966684736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.397054:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397057:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397060:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397063:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397066:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.397093:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1581:39029:x1731745946554048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 815us (959us total) trans 30064894148 rc 0/0 00000100:00100000:1.0:1651529349.397096:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153288 00000100:00100000:1.0:1651529349.397101:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554240 00000100:00100000:1.0:1651529349.397108:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554176 00000100:00100000:0.0:1651529349.397111:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946553920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 874us (985us total) trans 30064894149 rc 0/0 00000100:00100000:1.0:1651529349.397112:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153291 00000100:00100000:1.0:1651529349.397113:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1582:39030:x1731745946554240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.397114:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153287 00002000:00080000:1.0:1651529349.397118:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178084 count 1 00000100:00100000:0.0:1651529349.397119:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153292 00000100:00100000:0.0:1651529349.397121:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1581:39029:x1731745946554176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.397123:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.397126:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178083 count 1 00010000:00010000:1.0:1651529349.397127:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 2/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 482 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397130:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397130:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397131:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397132:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 4/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397135:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 2/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 482 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397138:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 3/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 482 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397138:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397138:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397139:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 4/0,1 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397142:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 482 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397146:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966684992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.397146:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 3/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 482 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397150:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 4/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 482 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397154:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.397154:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.397160:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397161:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.397163:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.397164:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397167:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 3/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397170:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acc54fc/0xa29a79078f3bb69d lrc: 0/0,0 mode: --/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58b5 expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.397171:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 1/0,0 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397174:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfbb6 lrc: 0/0,0 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397174:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966684864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.397177:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397178:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397180:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397181:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f25ba4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.397182:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397183:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397185:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 3/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397185:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397188:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 1/0,0 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397188:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 2/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397191:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3bfbaf lrc: 0/0,0 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397194:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397206:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095cff58f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.397207:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 2/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397209:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 3/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397213:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 1/0,0 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397215:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3bfbbd lrc: 0/0,0 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397226:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397229:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397231:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946553984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1072us total) trans 30064894150 rc 0/0 00010000:00010000:1.0:1651529349.397232:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397234:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153289 00010000:00010000:1.0:1651529349.397235:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397244:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397248:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.397249:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397252:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 3/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397257:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 1/0,0 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397260:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfba8 lrc: 0/0,0 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397267:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397270:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.397273:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946553792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1057us (1158us total) trans 30064894151 rc 0/0 00010000:00010000:0.0:1651529349.397273:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.397276:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153286 00010000:00010000:0.0:1651529349.397276:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397293:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397297:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040c1504b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.397298:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397301:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 3/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397305:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 1/0,0 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397309:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3bfba1 lrc: 0/0,0 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397317:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1582:39030:x1731745946553856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1132us (1213us total) trans 30064894152 rc 0/0 00000100:00100000:0.0:1651529349.397320:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153285 00000100:00100000:0.0:1651529349.397348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.397374:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435264 00010000:00010000:0.0:1651529349.397380:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 5/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.397388:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12252 00000100:00100000:0.0:1651529349.397390:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41278:x1731746396435264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.397393:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.397394:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 5/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.397398:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 4/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.397403:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397404:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397405:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397408:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 4/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397413:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.397421:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c29efc5c/0xa29a79078f3ba6c1 lrc: 0/0,0 mode: --/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a3a expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.397428:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41278:x1731746396435264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.397430:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12252 00000100:00100000:1.0:1651529349.397435:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966684928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.397440:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397445:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397448:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397451:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397454:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397467:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397471:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.397472:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397475:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 3/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397480:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 1/0,0 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397483:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfbc4 lrc: 0/0,0 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.397503:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1582:39030:x1731745946554112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1147us (1303us total) trans 30064894153 rc 0/0 00000100:00100000:1.0:1651529349.397506:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153290 00000100:00100000:0.0:1651529349.397573:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.397584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.397591:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554304 00000100:00100000:1.0:1651529349.397595:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966684992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.397600:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554368 00010000:00010000:1.0:1651529349.397610:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397620:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153293 00000100:00100000:1.0:1651529349.397623:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153294 00000100:00100000:1.0:1651529349.397626:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1583:39030:x1731745946554368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.397635:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1583:39029:x1731745946554304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.397640:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178086 count 1 00002000:00080000:0.0:1651529349.397641:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178085 count 1 00010000:00010000:1.0:1651529349.397644:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397646:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397649:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 2/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397651:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 2/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397652:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397653:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397654:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 4/0,1 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397654:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397654:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397655:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 4/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397660:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 3/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397664:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 4/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397668:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966685120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.397675:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 3/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.397677:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.397679:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.397684:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966685184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.397693:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.397705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.397721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.397744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.397755:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435328 00010000:00010000:0.0:1651529349.397765:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 481 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.397778:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12253 00000100:00100000:0.0:1651529349.397784:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41278:x1731746396435328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.397786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.397788:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.397789:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 481 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.397793:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 3/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 481 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.397819:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e86021/0xa29a79078f3b982e lrc: 0/0,0 mode: --/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf1c expref: 481 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.397823:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554496 00010000:00010000:0.0:1651529349.397826:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397826:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397827:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397830:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 4/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.397831:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554432 00000100:00100000:1.0:1651529349.397834:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554560 00010000:00010000:0.0:1651529349.397839:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.397844:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554624 00000100:00100000:0.0:1651529349.397846:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41278:x1731746396435328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.397849:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153295 00000100:00100000:0.0:1651529349.397849:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12253 00000100:00100000:1.0:1651529349.397850:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1587:39030:x1731745946554496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.397854:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435392 00002000:00080000:1.0:1651529349.397856:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178088 count 1 00010000:00010000:0.0:1651529349.397857:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 5/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 480 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.397860:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.397867:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12254 00000100:00100000:0.0:1651529349.397868:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746396435392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.397871:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 2/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397871:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.397872:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 5/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 480 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.397874:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397875:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397876:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 4/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397876:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 4/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 480 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.397881:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397882:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397882:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397883:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 3/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397885:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 4/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397886:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.397889:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.397891:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966685248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.397894:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746396435392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.397897:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12254 00000100:00100000:1.0:1651529349.397901:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.397905:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153296 00000100:00100000:0.0:1651529349.397907:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1587:39030:x1731745946554432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.397908:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153297 00000100:00100000:1.0:1651529349.397910:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1587:39030:x1731745946554560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.397912:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178087 count 1 00002000:00080000:1.0:1651529349.397914:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178089 count 1 00010000:00010000:0.0:1651529349.397915:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397918:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397920:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 2/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397922:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 2/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397923:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397923:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397924:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 4/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397925:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397926:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.397926:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 4/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397930:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 3/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.397933:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 3/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397934:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 479 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.397937:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 4/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 479 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.397938:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966685312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.397941:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966685376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.397946:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.397948:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.397952:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153298 00000100:00100000:0.0:1651529349.397954:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1587:39030:x1731745946554624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.397957:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.397958:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178090 count 1 00010000:00010000:1.0:1651529349.397960:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397962:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397964:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.397966:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397966:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 2/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397969:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397969:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.397970:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 4/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.397976:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 3/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 479 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.397980:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 4/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 479 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.397984:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966685440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.397990:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.397997:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a116377a/0xa29a79078f3b955d lrc: 0/0,0 mode: --/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd314 expref: 479 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398002:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.398005:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.398008:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1588:39030:x1731745946554240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 894us (1160us total) trans 30064894154 rc 0/0 00010000:00010000:0.0:1651529349.398008:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398011:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.398012:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153291 00010000:00010000:0.0:1651529349.398014:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398016:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398019:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398023:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.398031:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398035:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 3/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398040:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 1/0,0 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398043:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfbcb lrc: 0/0,0 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398047:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398050:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4f97720 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.398051:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398054:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 3/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398057:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 1/0,0 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398059:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3bfbd2 lrc: 0/0,0 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.398061:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1588:39029:x1731745946554176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 939us (1189us total) trans 30064894155 rc 0/0 00000100:00100000:0.0:1651529349.398064:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153292 00000100:00100000:0.0:1651529349.398251:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.398259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.398269:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554752 00000100:00100000:1.0:1651529349.398270:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966685120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.398277:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554688 00010000:00010000:1.0:1651529349.398280:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.398284:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153299 00000100:00100000:0.0:1651529349.398285:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1589:39030:x1731745946554752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.398292:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178092 count 1 00000100:00100000:1.0:1651529349.398293:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153300 00000100:00100000:1.0:1651529349.398294:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1589:39029:x1731745946554688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.398296:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.398300:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178091 count 1 00010000:00010000:0.0:1651529349.398301:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 2/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.398304:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398304:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398305:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398305:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 4/0,1 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398309:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 2/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.398312:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 3/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.398314:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398315:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398315:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 4/0,1 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398316:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 4/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 478 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398320:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.398323:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 3/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 478 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.398326:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 4/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 478 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.398331:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966685568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.398334:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.398346:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.398485:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966685184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.398489:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.398498:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966685248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.398504:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.398574:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966685312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.398586:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.398626:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966685440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.398628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.398630:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.398637:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.398643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.398651:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435456 00000100:00100000:1.0:1651529349.398652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.398661:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 4/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 479 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.398668:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.398676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.398678:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435520 00010000:00010000:0.0:1651529349.398681:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398692:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435648 00010000:00010000:0.0:1651529349.398703:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 481 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398709:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435776 00010000:00010000:0.0:1651529349.398711:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 4/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 482 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398715:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435584 00010000:00010000:0.0:1651529349.398717:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 483 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398721:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435712 00000100:00100000:1.0:1651529349.398723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.398723:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 5/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 484 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398727:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435840 00010000:00010000:0.0:1651529349.398729:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 5/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.398743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.398743:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12255 00000100:00100000:0.0:1651529349.398745:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41278:x1731746396435456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.398748:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.398749:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 4/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398753:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 3/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.398754:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966685376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.398758:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398759:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff7a3eb/0xa29a79078f3bab83 lrc: 0/0,0 mode: --/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2cbd expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398763:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398763:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398764:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.398766:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435904 00010000:00010000:0.0:1651529349.398767:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 4/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398771:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 5/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398777:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.398784:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12256 00000100:00100000:1.0:1651529349.398786:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41278:x1731746396435520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.398787:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41278:x1731746396435456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.398790:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.398790:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12255 00010000:00010000:1.0:1651529349.398791:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 485 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398795:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 3/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 484 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.398796:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12257 00000100:00100000:0.0:1651529349.398797:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+484:41278:x1731746396435648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.398800:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.398801:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077bb1ec0/0xa29a79078f3bb20c lrc: 0/0,0 mode: --/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46c5 expref: 484 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398801:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 484 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398822:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398822:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 3/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 483 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398823:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398824:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398827:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 4/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398827:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3ba2ae lrc: 0/0,0 mode: --/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0907 expref: 483 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398831:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398832:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398832:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398835:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 4/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398838:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.398846:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41278:x1731746396435520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.398846:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.398849:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12256 00000100:00100000:0.0:1651529349.398852:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41278:x1731746396435648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.398855:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12257 00000100:00100000:1.0:1651529349.398860:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12258 00000100:00100000:1.0:1651529349.398862:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41278:x1731746396435776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.398862:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12259 00000100:00100000:0.0:1651529349.398864:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746396435584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.398865:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.398866:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 4/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398866:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.398868:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398870:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 3/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398871:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 3/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398876:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005375ef31/0xa29a79078f3b9bfb lrc: 0/0,0 mode: --/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedd2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398876:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1633c76/0xa29a79078f3bb102 lrc: 0/0,0 mode: --/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42b2 expref: 480 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398879:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398880:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398880:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398880:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398880:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398881:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398883:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 4/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398884:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 4/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398897:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.398899:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.398903:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+478:41279:x1731746396435584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.398906:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+478:41278:x1731746396435776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.398906:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12259 00000100:00100000:1.0:1651529349.398909:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12258 00000100:00100000:0.0:1651529349.398911:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12260 00000100:00100000:0.0:1651529349.398912:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+476:41279:x1731746396435712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.398914:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12261 00010000:00010000:0.0:1651529349.398915:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.398916:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+476:41279:x1731746396435840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.398916:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 4/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 476 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398918:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.398920:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 5/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 476 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398920:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 3/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 476 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398924:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 4/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 476 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398925:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f347bf/0xa29a79078f3bb810 lrc: 0/0,0 mode: --/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e49 expref: 476 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.398928:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398929:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398929:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398930:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398932:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 4/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398933:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 4/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398937:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.398941:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.398948:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746396435840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.398949:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746396435712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.398951:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12261 00000100:00100000:0.0:1651529349.398952:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12260 00000100:00100000:1.0:1651529349.398955:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12262 00000100:00100000:1.0:1651529349.398957:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41278:x1731746396435904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.398960:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.398961:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 5/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398962:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398965:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 4/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.398966:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398969:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.398969:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398970:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.398971:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398974:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 4/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.398974:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.398977:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.398982:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41278:x1731746396435904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.398984:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12262 00010000:00010000:1.0:1651529349.398994:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051145e18/0xa29a79078f3b9da6 lrc: 0/0,0 mode: --/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4b6 expref: 472 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.398999:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966685568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.399002:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399005:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399010:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399014:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399016:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399021:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1590:39030:x1731745946554624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1066us (1225us total) trans 30064894156 rc 0/0 00000100:00100000:0.0:1651529349.399024:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153298 00010000:00010000:0.0:1651529349.399032:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399036:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa865cce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.399037:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399040:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 3/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399044:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 1/0,0 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399047:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3bfbfc lrc: 0/0,0 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399051:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399054:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.399055:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399058:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 3/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399061:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 1/0,0 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399064:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3bfc0a lrc: 0/0,0 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399067:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1590:39029:x1731745946554688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 771us (807us total) trans 30064894157 rc 0/0 00010000:00010000:0.0:1651529349.399069:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399070:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153300 00010000:00010000:0.0:1651529349.399072:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399074:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399077:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399077:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399081:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399091:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399094:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399123:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1591:39029:x1731745946554304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1500us (1551us total) trans 30064894158 rc 0/0 00000100:00100000:0.0:1651529349.399127:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153293 00010000:00010000:0.0:1651529349.399133:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399134:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1590:39030:x1731745946554368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1507us (1550us total) trans 30064894159 rc 0/0 00010000:00010000:0.0:1651529349.399137:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399139:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153294 00010000:00010000:0.0:1651529349.399140:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399143:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399146:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399150:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399153:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399155:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399174:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946554432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1267us (1440us total) trans 30064894160 rc 0/0 00000100:00100000:0.0:1651529349.399177:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153296 00010000:00010000:0.0:1651529349.399183:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399186:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1590:39030:x1731745946554496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1335us (1466us total) trans 30064894161 rc 0/0 00010000:00010000:0.0:1651529349.399187:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000590e4cfe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.399188:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399189:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153295 00010000:00010000:0.0:1651529349.399190:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 3/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399195:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 1/0,0 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399196:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399197:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3bfbe0 lrc: 0/0,0 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399199:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.399200:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399202:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399203:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 3/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399204:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b4498e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.399205:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399208:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 1/0,0 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399208:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 3/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399211:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfbd9 lrc: 0/0,0 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399211:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 1/0,0 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399214:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3bfbee lrc: 0/0,0 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399215:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399217:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.399218:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399221:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 3/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399223:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000388d508a/0xa29a79078f3bb8fe lrc: 0/0,0 mode: --/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d622b expref: 471 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.399224:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 1/0,0 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399226:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.399227:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfbe7 lrc: 0/0,0 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399230:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399233:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399233:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399235:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399238:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399238:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399241:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399241:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399243:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399286:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946554560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1375us (1510us total) trans 30064894162 rc 0/0 00000100:00100000:1.0:1651529349.399289:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153297 00000100:00100000:0.0:1651529349.399293:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1590:39030:x1731745946554752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1042us total) trans 30064894163 rc 0/0 00010000:00010000:1.0:1651529349.399296:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399296:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153299 00010000:00010000:1.0:1651529349.399299:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.399300:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399303:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 3/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399303:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399306:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.399307:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 1/0,0 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399307:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399310:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3bfbf5 lrc: 0/0,0 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399310:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 3/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399314:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 1/0,0 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399317:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfc03 lrc: 0/0,0 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.399538:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554816 00000100:00100000:0.0:1651529349.399553:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153301 00000100:00100000:0.0:1651529349.399578:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1590:39029:x1731745946554816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.399584:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178093 count 1 00010000:00010000:0.0:1651529349.399589:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399594:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 2/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.399597:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.399597:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.399598:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 4/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399600:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.399605:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 3/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.399607:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554880 00010000:00010000:0.0:1651529349.399609:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.399613:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.399614:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153302 00000100:00100000:1.0:1651529349.399615:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946554880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.399621:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178094 count 1 00000100:00100000:0.0:1651529349.399625:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.399626:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399631:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 2/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399634:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399635:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399635:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 4/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399643:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 3/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399654:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399659:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966685696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.399667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.399668:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.399674:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946554944 00000100:00100000:1.0:1651529349.399681:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153303 00000100:00100000:1.0:1651529349.399682:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1592:39029:x1731745946554944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.399687:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178095 count 1 00010000:00010000:1.0:1651529349.399690:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399695:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 2/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399698:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399698:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399699:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 4/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399706:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.399715:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 3/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399719:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399722:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966685760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.399729:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.399747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.399754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.399765:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.399768:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.399779:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555008 00000100:00100000:1.0:1651529349.399786:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555072 00000100:00100000:0.0:1651529349.399791:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555200 00000100:00100000:0.0:1651529349.399797:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555136 00000100:00100000:0.0:1651529349.399800:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555264 00000100:00100000:1.0:1651529349.399802:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153304 00000100:00100000:1.0:1651529349.399825:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1597:39030:x1731745946555008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.399831:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178096 count 1 00000100:00100000:0.0:1651529349.399832:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153305 00000100:00100000:0.0:1651529349.399834:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1597:39029:x1731745946555200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.399835:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.399839:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178099 count 1 00010000:00010000:1.0:1651529349.399841:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 2/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.399844:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399846:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399847:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399848:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 4/0,1 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399849:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 2/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.399852:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.399852:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399859:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 3/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399863:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 4/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399867:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966685824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.399867:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 4/0,1 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.399876:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 3/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.399882:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.399886:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 4/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399890:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153306 00000100:00100000:1.0:1651529349.399891:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1597:39029:x1731745946555072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.399891:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966685888:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.399896:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178097 count 1 00010000:00010000:1.0:1651529349.399900:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399902:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.399905:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 2/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399908:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399908:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399909:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 4/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399909:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153307 00000100:00100000:0.0:1651529349.399910:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1597:39030:x1731745946555136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.399915:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 3/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 470 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.399915:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178098 count 1 00010000:00010000:0.0:1651529349.399919:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399921:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.399923:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 2/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 470 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.399925:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966685952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.399926:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.399927:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.399928:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 4/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.399932:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.399934:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 470 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.399937:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 470 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399939:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153308 00000100:00100000:1.0:1651529349.399940:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1597:39030:x1731745946555264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.399941:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686016:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.399944:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178100 count 1 00010000:00010000:1.0:1651529349.399947:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.399948:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.399951:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 2/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 470 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399954:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399955:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.399955:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 4/0,1 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.399961:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 3/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 470 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.399965:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 4/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 470 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.399973:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966686080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.400002:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.400081:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966685696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.400082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.400086:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.400099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.400100:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966685760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.400108:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400110:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966685632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.400115:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436032 00010000:00010000:0.0:1651529349.400115:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400120:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 471 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400122:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396435968 00010000:00010000:0.0:1651529349.400127:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 472 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400134:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436096 00010000:00010000:1.0:1651529349.400140:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400140:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12263 00000100:00100000:0.0:1651529349.400142:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41278:x1731746396436032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.400149:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12264 00000100:00100000:1.0:1651529349.400151:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41278:x1731746396435968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.400155:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.400156:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400164:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.400166:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400170:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 3/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400171:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 3/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400176:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eaede97/0xa29a79078f3b9b84 lrc: 0/0,0 mode: --/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebbe expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400177:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007243f39/0xa29a79078f3ba268 lrc: 0/0,0 mode: --/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07b7 expref: 473 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400179:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400180:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400181:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400181:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400181:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400182:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400184:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 4/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400186:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 4/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400192:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.400193:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.400205:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41278:x1731746396435968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.400208:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12264 00000100:00100000:0.0:1651529349.400209:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41278:x1731746396436032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.400213:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12263 00000100:00100000:1.0:1651529349.400214:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12265 00000100:00100000:1.0:1651529349.400216:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396436096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.400219:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.400220:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 469 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400224:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 3/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 469 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400224:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400228:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400229:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e3a369/0xa29a79078f3ba0cb lrc: 0/0,0 mode: --/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0119 expref: 469 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400231:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400233:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400233:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400233:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400234:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400237:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 4/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400248:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.400254:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41278:x1731746396436096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.400257:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12265 00010000:00010000:1.0:1651529349.400265:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400270:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.400271:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400276:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 3/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400277:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1598:39029:x1731745946554816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 698us (745us total) trans 30064894164 rc 0/0 00000100:00100000:0.0:1651529349.400280:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153301 00010000:00010000:1.0:1651529349.400283:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 1/0,0 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400293:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfc11 lrc: 0/0,0 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400303:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400306:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400309:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400312:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.400401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.400409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.400422:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1598:39029:x1731745946554944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 738us (764us total) trans 30064894165 rc 0/0 00000100:00100000:0.0:1651529349.400422:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.400426:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153303 00010000:00010000:1.0:1651529349.400433:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400437:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.400438:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.400448:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 3/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400452:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966685888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.400454:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 1/0,0 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400456:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400457:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3bfc1f lrc: 0/0,0 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400463:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.400466:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400468:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966685952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.400472:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400479:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436288 00010000:00010000:1.0:1651529349.400483:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 468 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400486:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436160 00000100:00100000:1.0:1651529349.400488:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436416 00010000:00010000:1.0:1651529349.400490:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 5/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 470 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400492:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 5/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400494:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436224 00010000:00010000:1.0:1651529349.400497:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 4/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 471 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400498:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436352 00010000:00010000:0.0:1651529349.400500:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 472 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400501:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12266 00000100:00100000:1.0:1651529349.400503:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+472:41278:x1731746396436288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.400505:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12267 00010000:00010000:1.0:1651529349.400506:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.400507:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 472 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400507:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+472:41278:x1731746396436416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.400510:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.400511:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 3/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 472 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400511:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 5/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 472 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400515:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 4/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 472 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400516:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc34c689/0xa29a79078f3bc20b lrc: 0/0,0 mode: --/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d855c expref: 472 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400519:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400519:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400520:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400521:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400522:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400523:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 4/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400530:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.400536:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400537:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41278:x1731746396436288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.400539:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12266 00010000:00010000:0.0:1651529349.400543:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 4/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400544:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12268 00000100:00100000:1.0:1651529349.400545:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41278:x1731746396436160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.400548:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.400548:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.400549:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 5/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400553:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 4/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 470 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400556:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41278:x1731746396436416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.400557:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400558:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400559:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400559:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12267 00010000:00010000:1.0:1651529349.400562:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 4/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400564:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12269 00010000:00010000:1.0:1651529349.400565:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.400566:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396436224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.400568:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.400570:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396436160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.400570:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 4/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 469 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400573:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12268 00010000:00010000:0.0:1651529349.400574:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 3/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 469 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400576:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12270 00000100:00100000:1.0:1651529349.400578:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41278:x1731746396436352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.400579:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006226d5fb/0xa29a79078f3ba842 lrc: 0/0,0 mode: --/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2084 expref: 468 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400580:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.400581:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 468 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400582:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400583:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.400583:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400585:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 467 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.400586:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 4/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400589:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001995acc8/0xa29a79078f3b963d lrc: 0/0,0 mode: --/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd727 expref: 467 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.400593:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400593:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.400594:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400595:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.400597:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 4/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400607:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.400612:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41278:x1731746396436352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.400615:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12270 00000100:00100000:0.0:1651529349.400619:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+465:41278:x1731746396436224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.400621:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400622:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12269 00010000:00010000:1.0:1651529349.400624:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400627:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400630:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400633:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400642:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400646:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400648:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400679:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1599:39029:x1731745946555072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 786us (950us total) trans 30064894166 rc 0/0 00000100:00100000:1.0:1651529349.400682:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153306 00010000:00010000:1.0:1651529349.400692:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da1883b/0xa29a79078f3b8dfb lrc: 0/0,0 mode: --/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d2 expref: 464 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.400693:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1598:39030:x1731745946555136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 781us (938us total) trans 30064894167 rc 0/0 00000100:00100000:0.0:1651529349.400696:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153307 00000100:00100000:1.0:1651529349.400699:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966686080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.400702:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400703:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400705:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400706:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.400708:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400708:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400711:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400713:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 3/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400714:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400718:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 1/0,0 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400720:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3bfc34 lrc: 0/0,0 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400725:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400728:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.400729:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400731:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 3/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400745:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 1/0,0 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400747:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfc3b lrc: 0/0,0 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400751:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400754:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.400755:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400758:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 3/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400761:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 1/0,0 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400763:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3bfc42 lrc: 0/0,0 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400764:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1598:39030:x1731745946555264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 823us (996us total) trans 30064894168 rc 0/0 00000100:00100000:1.0:1651529349.400767:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153308 00010000:00010000:0.0:1651529349.400769:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400771:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400774:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400777:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400780:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c69e3d74/0xa29a79078f3b99cb lrc: 0/0,0 mode: --/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce50b expref: 463 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.400784:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966685824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.400787:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400791:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400793:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400796:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400799:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.400832:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1598:39029:x1731745946555200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 997us (1084us total) trans 30064894169 rc 0/0 00000100:00100000:0.0:1651529349.400835:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153305 00010000:00010000:0.0:1651529349.400846:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400849:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.400850:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400853:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 3/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400856:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1598:39030:x1731745946555008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1149us total) trans 30064894170 rc 0/0 00010000:00010000:0.0:1651529349.400858:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 1/0,0 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400859:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153304 00010000:00010000:0.0:1651529349.400860:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfc2d lrc: 0/0,0 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400864:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400867:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400867:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.400868:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400870:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400871:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 3/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400873:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.400876:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 2/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400876:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 1/0,0 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400879:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3bfc26 lrc: 0/0,0 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400883:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400885:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.400886:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 2/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400889:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 3/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400892:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 1/0,0 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.400895:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3bfc18 lrc: 0/0,0 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.400910:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1598:39030:x1731745946554880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1293us (1310us total) trans 30064894171 rc 0/0 00000100:00100000:1.0:1651529349.400913:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153302 00000100:00100000:0.0:1651529349.400921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.400939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.400947:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555328 00000100:00100000:1.0:1651529349.400953:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555392 00000100:00100000:1.0:1651529349.400961:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153309 00000100:00100000:1.0:1651529349.400963:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1599:39029:x1731745946555328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.400980:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178101 count 1 00000100:00100000:0.0:1651529349.401002:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153310 00000100:00100000:0.0:1651529349.401004:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1599:39030:x1731745946555392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.401009:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.401010:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178102 count 1 00010000:00010000:1.0:1651529349.401015:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 2/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 462 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401015:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401018:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401019:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401020:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 4/0,1 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401028:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 3/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 462 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.401034:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 4/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 462 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.401036:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 2/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401040:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401040:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.401041:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966686144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.401050:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 4/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401060:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.401064:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 3/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401069:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.401073:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966686208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.401082:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.401218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.401226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.401236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.401255:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555456 00000100:00100000:0.0:1651529349.401266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.401273:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555520 00000100:00100000:1.0:1651529349.401281:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555584 00000100:00100000:1.0:1651529349.401285:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555648 00000100:00100000:0.0:1651529349.401285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.401298:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555712 00000100:00100000:0.0:1651529349.401300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.401302:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153311 00000100:00100000:1.0:1651529349.401303:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1604:39029:x1731745946555456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.401306:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555776 00002000:00080000:1.0:1651529349.401311:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178103 count 1 00000100:00100000:0.0:1651529349.401313:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153312 00000100:00100000:0.0:1651529349.401315:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1605:39030:x1731745946555520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.401317:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401325:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 2/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.401328:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401328:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401329:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 4/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401337:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 3/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.401341:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.401343:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178104 count 1 00010000:00010000:0.0:1651529349.401348:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.401353:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 2/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 462 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401356:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401356:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401357:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 4/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401358:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966686272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.401364:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 3/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 462 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401368:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 462 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.401369:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.401372:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.401377:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153313 00000100:00100000:1.0:1651529349.401378:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1605:39029:x1731745946555584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.401381:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.401383:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178105 count 1 00010000:00010000:1.0:1651529349.401387:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.401389:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966686208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.401392:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 2/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401392:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401395:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401395:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401396:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 4/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.401400:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153314 00000100:00100000:0.0:1651529349.401401:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1605:39030:x1731745946555648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.401402:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 3/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.401406:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.401410:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966686400:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.401415:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178106 count 1 00000100:00100000:1.0:1651529349.401416:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.401419:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401423:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153315 00010000:00010000:0.0:1651529349.401423:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 2/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.401424:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1605:39029:x1731745946555712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.401426:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401427:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401427:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 4/0,1 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.401428:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178107 count 1 00010000:00010000:1.0:1651529349.401431:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.401434:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 3/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.401437:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 4/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.401441:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966686464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.401449:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 2/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.401449:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.401452:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401452:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401453:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 4/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.401455:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153316 00000100:00100000:0.0:1651529349.401457:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1605:39030:x1731745946555776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.401460:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.401461:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178108 count 1 00010000:00010000:1.0:1651529349.401464:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 4/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.401464:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401468:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966686528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.401468:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 2/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 462 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.401475:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.401479:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401480:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.401480:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 4/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401486:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966686144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.401487:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 3/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 462 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.401490:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.401491:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 462 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.401495:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966686592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.401502:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.401506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.401513:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436480 00010000:00010000:1.0:1651529349.401525:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 4/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 463 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.401536:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12271 00000100:00100000:1.0:1651529349.401576:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41279:x1731746396436480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.401581:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.401583:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 4/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 463 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401587:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 3/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 463 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401593:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe46048/0xa29a79078f3b8d5a lrc: 0/0,0 mode: --/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc37e expref: 463 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401597:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401598:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401599:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401604:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 4/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401614:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.401630:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41279:x1731746396436480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.401634:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12271 00010000:00010000:1.0:1651529349.401642:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401645:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401667:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401670:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401727:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1606:39029:x1731745946555328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 763us (805us total) trans 30064894172 rc 0/0 00000100:00100000:1.0:1651529349.401731:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153309 00010000:00010000:1.0:1651529349.401749:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401766:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.401768:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401771:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 3/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401776:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 1/0,0 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.401779:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfc49 lrc: 0/0,0 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.401882:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.401903:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966686400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.401908:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.401909:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401916:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966686528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.401918:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966686464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.401919:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.401921:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401925:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966686272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.401928:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.401928:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966686592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.401930:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.401934:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436544 00010000:00010000:1.0:1651529349.401939:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.401952:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12272 00000100:00100000:1.0:1651529349.401955:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41279:x1731746396436544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.401960:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.401962:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401969:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 3/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401975:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df574e9/0xa29a79078f3b9b6f lrc: 0/0,0 mode: --/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb94 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.401979:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401980:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.401981:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.401987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.402006:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 4/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.402017:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.402022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.402032:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+461:41279:x1731746396436544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.402035:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12272 00000100:00100000:1.0:1651529349.402041:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436608 00010000:00010000:1.0:1651529349.402045:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 461 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.402050:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436736 00010000:00010000:1.0:1651529349.402052:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.402057:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436864 00010000:00010000:1.0:1651529349.402059:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 4/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 463 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.402063:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436672 00010000:00010000:1.0:1651529349.402065:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 464 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.402071:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436800 00000100:00100000:1.0:1651529349.402072:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436928 00010000:00010000:1.0:1651529349.402074:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 466 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402077:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 4/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.402078:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12273 00000100:00100000:1.0:1651529349.402080:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41279:x1731746396436608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.402082:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.402083:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402084:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12274 00000100:00100000:0.0:1651529349.402086:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41279:x1731746396436736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.402089:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.402091:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402094:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 3/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402100:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 3/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402100:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb3560a/0xa29a79078f3bbf25 lrc: 0/0,0 mode: --/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7970 expref: 466 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402104:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.402105:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402106:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045007505/0xa29a79078f3ba73f lrc: 0/0,0 mode: --/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cb0 expref: 465 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402110:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402110:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402111:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402114:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 4/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402114:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402117:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 4/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402121:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.402127:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.402139:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+464:41279:x1731746396436608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.402142:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12273 00000100:00100000:0.0:1651529349.402144:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+464:41279:x1731746396436736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.402147:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12274 00000100:00100000:1.0:1651529349.402149:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12275 00000100:00100000:1.0:1651529349.402151:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41279:x1731746396436864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.402153:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.402153:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12276 00010000:00010000:1.0:1651529349.402155:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 4/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402155:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41278:x1731746396436672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.402158:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.402159:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402160:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 462 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402164:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004853e0fe/0xa29a79078f3b9bca lrc: 0/0,0 mode: --/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecf2 expref: 462 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402164:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 3/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 462 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402167:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402168:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402168:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402169:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a23222/0xa29a79078f3b9510 lrc: 0/0,0 mode: --/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1b6 expref: 461 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402171:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 4/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402172:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.402173:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.402174:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402177:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.402177:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 4/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402183:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+460:41279:x1731746396436864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.402186:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12275 00000100:00100000:1.0:1651529349.402190:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12277 00010000:00010000:0.0:1651529349.402191:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.402192:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+459:41278:x1731746396436928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.402194:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.402195:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 459 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402199:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 3/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 459 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402199:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+459:41278:x1731746396436672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.402201:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12276 00010000:00010000:1.0:1651529349.402203:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa62c74/0xa29a79078f3b95d4 lrc: 0/0,0 mode: --/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5bb expref: 459 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402206:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402207:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.402207:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12278 00010000:00010000:1.0:1651529349.402208:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402208:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41278:x1731746396436800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.402211:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 4/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402211:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.402212:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 4/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 457 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402216:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 3/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 457 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.402219:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.402225:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41278:x1731746396436928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.402227:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12277 00010000:00010000:0.0:1651529349.402228:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe5dc4f/0xa29a79078f3b9969 lrc: 0/0,0 mode: --/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce375 expref: 457 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.402232:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.402232:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402233:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402233:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402236:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 4/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402237:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402242:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402242:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.402245:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402247:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746396436800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.402259:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12278 00010000:00010000:0.0:1651529349.402272:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402275:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402278:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402281:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402305:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1606:39029:x1731745946555712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 879us (1020us total) trans 30064894173 rc 0/0 00000100:00100000:1.0:1651529349.402308:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153315 00000100:00100000:1.0:1651529349.402313:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555840 00000100:00100000:1.0:1651529349.402319:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153317 00000100:00100000:1.0:1651529349.402321:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1607:39030:x1731745946555840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.402326:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178109 count 1 00000100:00100000:0.0:1651529349.402327:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1607:39030:x1731745946555392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1323us (1388us total) trans 30064894174 rc 0/0 00010000:00010000:1.0:1651529349.402330:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402331:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153310 00010000:00010000:1.0:1651529349.402335:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 2/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 454 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.402338:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402338:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.402338:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402339:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 4/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402342:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.402343:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402345:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 3/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 454 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.402346:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 3/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402351:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 1/0,0 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402352:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 454 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.402356:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966686656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.402361:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfc73 lrc: 0/0,0 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402364:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.402366:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402369:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.402369:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402370:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402372:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 3/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402373:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402376:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402376:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 1/0,0 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402378:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfc50 lrc: 0/0,0 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402379:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402384:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402387:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402390:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402397:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402426:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1608:39029:x1731745946555584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1046us (1189us total) trans 30064894175 rc 0/0 00000100:00100000:1.0:1651529349.402429:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153313 00010000:00010000:1.0:1651529349.402436:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402437:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1607:39030:x1731745946555648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1035us (1171us total) trans 30064894176 rc 0/0 00010000:00010000:1.0:1651529349.402439:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.402440:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402440:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153314 00010000:00010000:1.0:1651529349.402444:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 3/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402448:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402449:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 1/0,0 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402451:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfc65 lrc: 0/0,0 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402451:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402454:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402456:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402457:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402458:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.402459:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402462:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 3/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402465:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 1/0,0 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402468:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfc6c lrc: 0/0,0 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402471:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402475:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.402475:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402478:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 3/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402481:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 1/0,0 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402484:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfc7a lrc: 0/0,0 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402488:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1607:39030:x1731745946555776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1187us total) trans 30064894177 rc 0/0 00010000:00010000:1.0:1651529349.402491:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402491:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153316 00010000:00010000:1.0:1651529349.402494:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402497:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402497:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402499:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402500:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402506:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402508:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402542:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1608:39029:x1731745946555456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1238us (1324us total) trans 30064894178 rc 0/0 00000100:00100000:1.0:1651529349.402546:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153311 00000100:00100000:0.0:1651529349.402546:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1608:39030:x1731745946555520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1230us (1319us total) trans 30064894179 rc 0/0 00000100:00100000:0.0:1651529349.402549:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153312 00010000:00010000:1.0:1651529349.402553:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402556:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.402556:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402557:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402559:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.402560:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 3/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402560:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402563:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 3/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402564:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 1/0,0 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402567:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfc57 lrc: 0/0,0 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402567:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 1/0,0 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.402570:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfc5e lrc: 0/0,0 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.402835:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966686656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.402839:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402884:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.402904:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555968 00000100:00100000:1.0:1651529349.402915:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153318 00000100:00100000:0.0:1651529349.402919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.402931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.402939:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1607:39029:x1731745946555968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.402940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.402946:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178111 count 1 00000100:00100000:0.0:1651529349.402946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.402954:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.402955:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.402960:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 2/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 454 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.402961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.402968:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402969:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.402970:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 4/0,1 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.402970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.402977:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 3/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 454 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.402977:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946555904 00010000:00010000:1.0:1651529349.402981:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 4/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 454 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.402987:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556096 00000100:00100000:1.0:1651529349.402990:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966686720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.402992:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556032 00000100:00100000:0.0:1651529349.402995:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556224 00000100:00100000:0.0:1651529349.402997:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556160 00000100:00100000:0.0:1651529349.402999:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556288 00000100:00100000:0.0:1651529349.403001:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153319 00000100:00100000:0.0:1651529349.403003:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946555904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.403010:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.403015:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178110 count 1 00000100:00100000:1.0:1651529349.403016:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396436992 00010000:00010000:0.0:1651529349.403020:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403022:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 455 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.403025:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 2/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.403032:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12279 00010000:00010000:0.0:1651529349.403033:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.403034:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746396436992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.403034:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403035:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 4/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403037:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.403038:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 455 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.403043:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 3/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403045:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 3/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 455 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403050:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3aac74/0xa29a79078f3b95b1 lrc: 0/0,0 mode: --/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4f0 expref: 455 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.403050:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403054:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403054:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.403054:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403055:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403058:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 4/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403063:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.403065:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.403070:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153320 00000100:00100000:0.0:1651529349.403071:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1613:39029:x1731745946556096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.403072:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41278:x1731746396436992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.403074:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12279 00002000:00080000:0.0:1651529349.403076:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178113 count 1 00010000:00010000:0.0:1651529349.403079:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.403082:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153321 00010000:00010000:0.0:1651529349.403083:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 2/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.403084:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946556032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.403086:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403087:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403087:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 4/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.403088:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178112 count 1 00010000:00010000:1.0:1651529349.403092:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403093:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 3/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403096:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 2/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.403097:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 4/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403101:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403102:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403103:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 4/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403104:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966686848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403109:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 3/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.403110:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.403113:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.403116:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153322 00000100:00100000:1.0:1651529349.403117:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966686912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.403117:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1613:39029:x1731745946556224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.403121:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178115 count 1 00000100:00100000:1.0:1651529349.403124:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.403124:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403129:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 2/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 453 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.403130:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153323 00010000:00010000:0.0:1651529349.403131:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.403132:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946556160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.403132:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403132:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 4/0,1 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.403136:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178114 count 1 00010000:00010000:0.0:1651529349.403138:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 3/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 453 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403139:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403142:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 4/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 453 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403144:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 2/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.403145:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966686976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403146:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403147:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403147:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 4/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403152:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.403156:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 3/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.403157:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153324 00010000:00010000:1.0:1651529349.403159:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.403159:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946556288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.403163:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687040:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.403163:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178116 count 1 00010000:00010000:0.0:1651529349.403166:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.403169:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.403170:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 2/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.403173:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403173:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403174:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 4/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403175:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403178:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403179:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 3/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 453 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403182:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403183:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 4/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403184:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403187:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966687104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.403193:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.403224:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1614:39030:x1731745946555840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 902us (1261us total) trans 30064894180 rc 0/0 00000100:00100000:1.0:1651529349.403227:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153317 00010000:00010000:1.0:1651529349.403246:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403253:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.403255:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403257:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 3/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403262:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 1/0,0 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403265:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfc81 lrc: 0/0,0 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403517:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.403570:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.403572:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966686784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.403580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.403582:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.403587:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437056 00000100:00100000:0.0:1651529349.403590:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437120 00010000:00010000:1.0:1651529349.403593:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 5/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.403596:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.403604:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12280 00000100:00100000:1.0:1651529349.403606:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746396437056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.403614:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12281 00010000:00010000:1.0:1651529349.403615:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.403616:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 5/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.403616:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746396437120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.403619:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.403621:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403623:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 4/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.403625:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 3/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403630:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403631:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd407ebb/0xa29a79078f3b7bda lrc: 0/0,0 mode: --/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba94 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.403633:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 4/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403635:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403635:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.403636:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403638:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.403639:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 4/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403646:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.403651:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41278:x1731746396437056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.403654:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12280 00000100:00100000:0.0:1651529349.403659:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41278:x1731746396437120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.403662:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556352 00000100:00100000:0.0:1651529349.403662:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12281 00000100:00100000:1.0:1651529349.403669:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153325 00000100:00100000:1.0:1651529349.403670:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1614:39030:x1731745946556352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.403670:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403673:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.403675:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178117 count 1 00010000:00010000:0.0:1651529349.403676:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403679:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.403679:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403683:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 2/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 452 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403693:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403694:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.403695:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 4/0,1 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403702:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 3/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 452 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.403706:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 4/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 452 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.403710:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.403718:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.403723:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403727:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.403728:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403731:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 3/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403745:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1615:39030:x1731745946555904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 740us (813us total) trans 30064894181 rc 0/0 00000100:00100000:0.0:1651529349.403748:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153319 00010000:00010000:1.0:1651529349.403749:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 1/0,0 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403751:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfc8f lrc: 0/0,0 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403766:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3b9293 lrc: 0/0,0 mode: --/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc816 expref: 452 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.403770:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966686720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403773:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403776:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403779:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403789:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.403801:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.403909:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1615:39029:x1731745946555968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 986us (1020us total) trans 30064894182 rc 0/0 00000100:00100000:1.0:1651529349.403913:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153318 00000100:00100000:1.0:1651529349.403924:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403928:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.403953:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966686912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.403956:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.403956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.403962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.403964:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437248 00000100:00100000:0.0:1651529349.403968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.403969:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 5/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 452 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.403977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.403984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.403986:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437376 00010000:00010000:1.0:1651529349.403992:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404000:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437184 00010000:00010000:1.0:1651529349.404004:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 454 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404008:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437312 00010000:00010000:1.0:1651529349.404010:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 5/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 455 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404014:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437440 00010000:00010000:0.0:1651529349.404014:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404018:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.404019:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404022:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 3/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404028:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 1/0,0 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404030:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 5/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 456 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.404031:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfc88 lrc: 0/0,0 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404036:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12282 00000100:00100000:1.0:1651529349.404038:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+456:41279:x1731746396437248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.404041:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.404042:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 4/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 456 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.404043:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966686848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.404046:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 3/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 456 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.404051:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404053:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007814c31/0xa29a79078f3baafe lrc: 0/0,0 mode: --/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ad3 expref: 456 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404057:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404058:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.404058:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966686976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.404059:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404061:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404062:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 4/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404072:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.404080:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41279:x1731746396437248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.404083:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12282 00000100:00100000:1.0:1651529349.404088:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12283 00000100:00100000:1.0:1651529349.404089:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41279:x1731746396437376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.404089:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966687104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.404092:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.404092:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404093:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 454 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404099:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 3/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 454 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.404100:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12284 00000100:00100000:0.0:1651529349.404102:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41278:x1731746396437184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.404104:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3ba7c4 lrc: 0/0,0 mode: --/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ec4 expref: 454 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.404105:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.404107:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404107:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404108:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404109:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404111:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 4/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404114:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 3/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404118:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.404119:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824ad893/0xa29a79078f3b99d2 lrc: 0/0,0 mode: --/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce519 expref: 453 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404122:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+452:41279:x1731746396437376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.404122:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404123:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404124:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404125:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12283 00010000:00010000:0.0:1651529349.404127:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 4/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404129:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12285 00000100:00100000:1.0:1651529349.404130:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+451:41278:x1731746396437312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.404133:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.404134:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 4/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 451 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.404137:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.404145:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 3/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 451 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.404145:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+451:41278:x1731746396437184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.404148:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12284 00010000:00010000:1.0:1651529349.404150:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005de59b9b/0xa29a79078f3b8e8e lrc: 0/0,0 mode: --/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc426 expref: 451 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404154:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404154:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404155:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404158:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 4/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404159:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12286 00000100:00100000:0.0:1651529349.404161:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746396437440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.404163:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.404166:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.404171:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 4/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404172:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746396437312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.404175:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12285 00010000:00010000:0.0:1651529349.404176:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 3/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404181:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404181:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015ddaccc/0xa29a79078f3ba10a lrc: 0/0,0 mode: --/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0215 expref: 448 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404185:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404185:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404185:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404186:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404188:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404189:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 4/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404191:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404194:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.404200:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746396437440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.404203:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12286 00010000:00010000:0.0:1651529349.404210:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404213:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404216:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404219:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404246:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946556032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1300us total) trans 30064894183 rc 0/0 00000100:00100000:1.0:1651529349.404250:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153321 00000100:00100000:1.0:1651529349.404255:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556416 00000100:00100000:1.0:1651529349.404262:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153326 00000100:00100000:1.0:1651529349.404263:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946556416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.404264:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1616:39029:x1731745946556224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1146us (1310us total) trans 30064894184 rc 0/0 00002000:00080000:1.0:1651529349.404268:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178118 count 1 00000100:00100000:0.0:1651529349.404268:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153322 00010000:00010000:1.0:1651529349.404272:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404275:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404277:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 2/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 446 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404279:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404280:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404281:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404281:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 4/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404282:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404284:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404288:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 3/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 446 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.404292:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 446 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404296:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966687232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.404305:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.404310:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404313:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.404314:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404316:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946556288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1156us (1345us total) trans 30064894185 rc 0/0 00010000:00010000:1.0:1651529349.404317:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 3/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404319:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153324 00010000:00010000:1.0:1651529349.404321:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 1/0,0 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404324:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfc9d lrc: 0/0,0 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404325:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404328:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404328:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404331:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.404331:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404332:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404334:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 3/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404336:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404337:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 1/0,0 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404340:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfca4 lrc: 0/0,0 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404344:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404347:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.404347:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404350:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 3/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404353:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 1/0,0 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404355:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfcb2 lrc: 0/0,0 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404359:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404361:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.404362:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404365:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1616:39029:x1731745946556096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1293us (1425us total) trans 30064894186 rc 0/0 00010000:00010000:1.0:1651529349.404367:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 3/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404368:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153320 00010000:00010000:1.0:1651529349.404371:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 1/0,0 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404373:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfc96 lrc: 0/0,0 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404379:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404382:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404385:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404395:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.404421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.404438:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946556160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1305us (1477us total) trans 30064894187 rc 0/0 00000100:00100000:1.0:1651529349.404441:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153323 00000100:00100000:1.0:1651529349.404446:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556480 00000100:00100000:1.0:1651529349.404462:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153327 00000100:00100000:1.0:1651529349.404470:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946556480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.404484:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178119 count 1 00010000:00010000:1.0:1651529349.404490:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404495:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404499:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.404500:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404503:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 3/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404505:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 2/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 446 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404508:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 1/0,0 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404509:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404509:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404510:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 4/0,1 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404511:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfcab lrc: 0/0,0 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404519:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 3/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 446 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.404519:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437504 00010000:00010000:1.0:1651529349.404525:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 4/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 447 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404532:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.404542:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 5/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404549:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.404557:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12287 00000100:00100000:1.0:1651529349.404559:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746396437504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.404562:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.404564:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 5/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404571:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 4/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404576:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404577:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404578:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404591:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 4/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404598:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.404614:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746396437504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.404617:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12287 00010000:00010000:1.0:1651529349.404630:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f3c25/0xa29a79078f3b93b9 lrc: 0/0,0 mode: --/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccca7 expref: 446 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404634:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.404638:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404654:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404656:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404660:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404663:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.404701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.404707:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.404726:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.404727:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1617:39030:x1731745946556352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1055us (1209us total) trans 30064894188 rc 0/0 00000100:00100000:1.0:1651529349.404730:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153325 00000100:00100000:1.0:1651529349.404746:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556544 00000100:00100000:1.0:1651529349.404755:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556608 00000100:00100000:1.0:1651529349.404773:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556672 00000100:00100000:0.0:1651529349.404776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.404778:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556736 00000100:00100000:1.0:1651529349.404780:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556800 00000100:00100000:0.0:1651529349.404782:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.404783:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153328 00000100:00100000:1.0:1651529349.404791:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1621:39030:x1731745946556544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.404792:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153329 00000100:00100000:0.0:1651529349.404794:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1621:39029:x1731745946556608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.404799:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178120 count 1 00002000:00080000:0.0:1651529349.404801:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178121 count 1 00010000:00010000:1.0:1651529349.404824:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404831:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404832:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 2/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 445 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.404837:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404838:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404839:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 4/0,1 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.404845:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 2/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 445 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404848:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404849:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404850:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 3/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 445 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404850:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 4/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404854:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 4/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 445 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404858:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.404858:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 3/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 445 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404862:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 445 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404867:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.404869:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966687424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.404875:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153330 00000100:00100000:1.0:1651529349.404877:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1621:39030:x1731745946556672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.404881:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178122 count 1 00010000:00010000:1.0:1651529349.404885:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404889:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 2/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.404891:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.404892:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404893:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404894:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 4/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404899:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153331 00010000:00010000:1.0:1651529349.404900:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 3/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.404901:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1621:39029:x1731745946556736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.404903:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.404906:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178123 count 1 00000100:00100000:1.0:1651529349.404907:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966687488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.404909:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404914:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.404914:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 2/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 445 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.404917:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404917:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.404918:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 4/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.404920:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153332 00000100:00100000:1.0:1651529349.404922:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096b262e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1621:39030:x1731745946556800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.404924:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 3/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 445 pid: 142995 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.404926:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178124 count 1 00010000:00010000:0.0:1651529349.404928:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 445 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.404929:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404932:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966687552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.404934:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 2/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 445 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.404936:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404937:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.404937:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 4/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404938:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.404943:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 3/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 445 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.404947:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 4/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 445 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.404951:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966687616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.404957:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.404961:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.404988:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.404989:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.404993:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 3/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.404996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.404998:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 1/0,0 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405001:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfcb9 lrc: 0/0,0 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405010:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556864 00000100:00100000:0.0:1651529349.405028:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153333 00000100:00100000:0.0:1651529349.405030:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1622:39030:x1731745946556864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.405036:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178125 count 1 00010000:00010000:0.0:1651529349.405040:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405044:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 2/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 445 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.405048:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405048:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405049:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 4/0,1 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405056:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 3/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 445 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.405059:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966687232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.405059:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 4/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 445 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405063:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966687680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.405064:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405071:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437568 00000100:00100000:0.0:1651529349.405073:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.405076:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 446 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405079:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437632 00010000:00010000:0.0:1651529349.405084:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 5/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 447 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405095:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12288 00000100:00100000:1.0:1651529349.405097:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746396437568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.405100:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.405102:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405107:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 3/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405112:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3b9747 lrc: 0/0,0 mode: --/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb17 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405119:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12289 00000100:00100000:0.0:1651529349.405121:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41279:x1731746396437632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.405123:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405124:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405125:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405125:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.405126:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 5/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 446 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405128:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 4/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405130:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 4/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 446 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405134:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.405136:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405137:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405138:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405141:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 4/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405142:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41278:x1731746396437568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.405144:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12288 00010000:00010000:0.0:1651529349.405145:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.405151:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405153:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41279:x1731746396437632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.405154:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405155:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12289 00010000:00010000:1.0:1651529349.405157:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405160:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405225:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1623:39030:x1731745946556416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 960us (1286us total) trans 30064894189 rc 0/0 00000100:00100000:1.0:1651529349.405228:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153326 00010000:00010000:1.0:1651529349.405236:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.405240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 3/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405248:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 1/0,0 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405259:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfcc0 lrc: 0/0,0 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405270:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fd1ec9a/0xa29a79078f3b9dad lrc: 0/0,0 mode: --/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4cb expref: 444 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405273:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.405277:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405281:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405283:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405286:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405289:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405307:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405312:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.405313:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405316:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 3/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405330:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 1/0,0 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405347:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1623:39030:x1731745946556480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 880us (945us total) trans 30064894190 rc 0/0 00000100:00100000:1.0:1651529349.405350:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153327 00010000:00010000:0.0:1651529349.405362:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfcc7 lrc: 0/0,0 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.405436:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966687424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.405441:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.405449:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966687552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.405450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.405451:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405463:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437760 00000100:00100000:1.0:1651529349.405467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.405479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.405484:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 444 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405490:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437696 00010000:00010000:0.0:1651529349.405493:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 5/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 445 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405497:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437888 00010000:00010000:0.0:1651529349.405499:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 446 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.405526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.405535:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966687488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.405545:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437824 00010000:00010000:1.0:1651529349.405546:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405549:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 447 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405553:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396437952 00010000:00010000:0.0:1651529349.405555:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 5/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 448 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405558:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966687616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.405559:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438016 00010000:00010000:1.0:1651529349.405561:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405561:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 5/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405565:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12290 00000100:00100000:0.0:1651529349.405567:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41279:x1731746396437760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.405568:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12291 00000100:00100000:1.0:1651529349.405569:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746396437696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.405570:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.405571:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405573:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.405574:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 5/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 449 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.405575:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 3/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405578:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 4/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 449 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.405581:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a91ae59d/0xa29a79078f3bbc54 lrc: 0/0,0 mode: --/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f36 expref: 449 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405584:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405585:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405585:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405585:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405588:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 4/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405592:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405593:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.405593:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405597:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 4/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405602:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+448:41278:x1731746396437696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.405604:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.405605:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12291 00000100:00100000:1.0:1651529349.405611:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12292 00000100:00100000:1.0:1651529349.405612:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41279:x1731746396437888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.405612:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41279:x1731746396437760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.405615:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.405615:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12290 00010000:00010000:1.0:1651529349.405616:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 447 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405620:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 3/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 446 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405625:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d5f0a23/0xa29a79078f3b79db lrc: 0/0,0 mode: --/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb97c expref: 446 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405625:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12293 00000100:00100000:0.0:1651529349.405627:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41278:x1731746396437824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.405629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405629:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405629:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.405630:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405631:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405633:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 4/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405635:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 3/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.405639:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2558b4f/0xa29a79078f3b94fb lrc: 0/0,0 mode: --/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd162 expref: 445 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405643:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.405649:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41279:x1731746396437888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.405650:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405651:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.405652:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12292 00010000:00010000:0.0:1651529349.405652:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405657:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12294 00000100:00100000:1.0:1651529349.405658:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+443:41278:x1731746396437952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.405660:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.405662:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 4/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 443 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.405664:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 4/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405666:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 3/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 443 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.405670:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c23819/0xa29a79078f3b9381 lrc: 0/0,0 mode: --/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbd5 expref: 443 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.405673:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.405680:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+442:41278:x1731746396437824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.405681:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405681:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405682:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405683:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12293 00010000:00010000:1.0:1651529349.405685:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 4/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405688:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12295 00000100:00100000:0.0:1651529349.405689:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+441:41278:x1731746396438016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.405690:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.405692:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.405693:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 5/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 441 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405696:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+441:41278:x1731746396437952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.405697:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 4/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 441 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405699:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12294 00010000:00010000:0.0:1651529349.405702:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405703:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.405704:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405705:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405707:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 4/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405708:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405710:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.405711:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405714:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405715:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396438016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.405717:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12295 00010000:00010000:0.0:1651529349.405728:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4a7578c/0xa29a79078f3b9a8f lrc: 0/0,0 mode: --/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce830 expref: 439 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.405732:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966687680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.405745:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405748:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405751:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405754:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405757:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405786:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096b262e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 863us (1010us total) trans 30064894191 rc 0/0 00000100:00100000:1.0:1651529349.405790:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153332 00000100:00100000:1.0:1651529349.405795:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556928 00000100:00100000:1.0:1651529349.405802:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153334 00000100:00100000:0.0:1651529349.405821:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 771us (818us total) trans 30064894192 rc 0/0 00000100:00100000:1.0:1651529349.405824:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.405825:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153333 00002000:00080000:1.0:1651529349.405829:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178126 count 1 00010000:00010000:1.0:1651529349.405833:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405833:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405838:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 2/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.405839:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405841:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405842:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.405842:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 4/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405842:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405844:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405850:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 3/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.405854:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 4/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405860:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966687744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.405869:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.405875:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405878:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.405879:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405880:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1624:39029:x1731745946556736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 979us (1154us total) trans 30064894193 rc 0/0 00010000:00010000:1.0:1651529349.405882:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 3/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405883:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153331 00010000:00010000:1.0:1651529349.405886:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 1/0,0 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405889:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfcea lrc: 0/0,0 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405889:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405893:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405893:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.405894:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405896:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.405896:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 3/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405897:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405899:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 3/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405901:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 1/0,0 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405904:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfcf1 lrc: 0/0,0 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405910:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405912:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 1/0,0 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405913:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405915:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfce3 lrc: 0/0,0 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405915:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405918:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405922:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405924:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405928:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405930:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.405951:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1624:39029:x1731745946556608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1156us (1250us total) trans 30064894194 rc 0/0 00000100:00100000:0.0:1651529349.405953:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153329 00010000:00010000:0.0:1651529349.405959:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405963:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.405963:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405966:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 3/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405971:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 1/0,0 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405974:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfcd5 lrc: 0/0,0 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405977:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1099us (1269us total) trans 30064894195 rc 0/0 00010000:00010000:0.0:1651529349.405978:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.405980:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153330 00010000:00010000:0.0:1651529349.405980:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.405981:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405984:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 3/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405987:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 1/0,0 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.405990:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfcdc lrc: 0/0,0 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.405995:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000231d8deb/0xa29a79078f3b9246 lrc: 0/0,0 mode: --/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6fe expref: 438 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.405999:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.406003:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.406018:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406021:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406024:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406026:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.406128:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1341us (1437us total) trans 30064894196 rc 0/0 00000100:00100000:1.0:1651529349.406133:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153328 00000100:00100000:1.0:1651529349.406164:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946556992 00000100:00100000:1.0:1651529349.406172:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153335 00000100:00100000:1.0:1651529349.406174:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946556992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.406179:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178127 count 1 00010000:00010000:1.0:1651529349.406183:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406188:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 2/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406191:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406200:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406201:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 4/0,1 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406208:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 3/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406212:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 4/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406217:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.406230:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.406236:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406239:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ead11881 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.406240:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406243:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 3/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406248:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 1/0,0 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406252:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfcce lrc: 0/0,0 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.406307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.406308:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557120 00000100:00100000:1.0:1651529349.406319:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557248 00000100:00100000:1.0:1651529349.406323:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153336 00000100:00100000:1.0:1651529349.406325:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1626:39029:x1731745946557120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.406330:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178129 count 1 00000100:00100000:0.0:1651529349.406333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.406334:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406338:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 2/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406341:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.406341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.406342:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406343:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 4/0,1 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.406358:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 3/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.406358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.406367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.406372:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 4/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406378:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.406400:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557056 00000100:00100000:1.0:1651529349.406404:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.406406:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557184 00000100:00100000:0.0:1651529349.406408:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557312 00000100:00100000:0.0:1651529349.406410:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557376 00000100:00100000:1.0:1651529349.406414:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153337 00000100:00100000:1.0:1651529349.406417:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1630:39029:x1731745946557248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.406423:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178131 count 1 00000100:00100000:0.0:1651529349.406424:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153338 00000100:00100000:0.0:1651529349.406426:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1630:39029:x1731745946557056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.406427:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406432:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 2/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.406432:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178128 count 1 00010000:00010000:1.0:1651529349.406435:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406435:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406436:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 4/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406436:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406441:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 2/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406442:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 3/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406444:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406445:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406446:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.406446:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 4/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.406450:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966687936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.406453:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 3/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406456:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406458:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.406461:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966688000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.406465:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153339 00000100:00100000:1.0:1651529349.406466:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1630:39029:x1731745946557184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.406470:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178130 count 1 00000100:00100000:0.0:1651529349.406470:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.406473:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406477:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 2/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.406477:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153340 00000100:00100000:0.0:1651529349.406479:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1630:39029:x1731745946557312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.406481:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406481:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406482:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 4/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.406483:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178132 count 1 00010000:00010000:1.0:1651529349.406487:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 3/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406487:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406491:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 4/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.406491:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 2/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406494:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.406495:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966688064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.406495:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406496:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 4/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.406501:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.406502:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 3/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 437 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406505:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406508:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966687744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.406509:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966688128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.406512:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406515:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.406519:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153341 00000100:00100000:1.0:1651529349.406520:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1630:39030:x1731745946557376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.406522:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438080 00002000:00080000:1.0:1651529349.406525:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178133 count 1 00010000:00010000:0.0:1651529349.406526:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 4/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.406528:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406532:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 2/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 438 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.406534:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12296 00000100:00100000:0.0:1651529349.406536:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41278:x1731746396438080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.406537:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406538:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406538:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 4/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406540:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.406542:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 4/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.406544:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 3/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 438 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.406545:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 3/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.406548:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.406551:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c492d13/0xa29a79078f3ba74d lrc: 0/0,0 mode: --/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cc5 expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406552:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966688192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.406554:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406555:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406555:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.406558:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.406559:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 4/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406570:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.406577:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41278:x1731746396438080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.406579:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12296 00010000:00010000:1.0:1651529349.406605:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406609:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.406612:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406615:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.406616:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438144 00010000:00010000:0.0:1651529349.406620:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 5/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.406627:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12297 00000100:00100000:0.0:1651529349.406629:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41279:x1731746396438144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.406631:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.406633:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 5/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.406637:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 4/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.406642:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406643:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.406643:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406646:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 4/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406651:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.406662:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946556928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 838us (1250us total) trans 30064894197 rc 0/0 00000100:00100000:1.0:1651529349.406666:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153334 00000100:00100000:0.0:1651529349.406667:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41279:x1731746396438144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.406670:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12297 00010000:00010000:1.0:1651529349.406674:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406677:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.406678:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406681:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 3/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406686:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 1/0,0 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406689:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfcf8 lrc: 0/0,0 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406706:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61570c1/0xa29a79078f3bbfaa lrc: 0/0,0 mode: --/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bb5 expref: 436 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406710:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966687808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.406714:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406717:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406722:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406725:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406728:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406748:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406752:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.406753:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406756:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 3/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406761:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 1/0,0 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.406764:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfcff lrc: 0/0,0 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.406798:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946556992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 622us (793us total) trans 30064894198 rc 0/0 00000100:00100000:1.0:1651529349.406823:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153335 00000100:00100000:0.0:1651529349.406871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.406940:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557440 00000100:00100000:1.0:1651529349.406949:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153342 00000100:00100000:1.0:1651529349.406950:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946557440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.406956:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178134 count 1 00010000:00010000:1.0:1651529349.406960:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406965:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 2/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406968:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406969:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.406969:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 4/0,1 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.406979:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 3/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.406982:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 4/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 435 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.406986:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966688256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.407010:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.407016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.407054:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557504 00000100:00100000:1.0:1651529349.407067:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153343 00000100:00100000:1.0:1651529349.407069:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1632:39030:x1731745946557504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.407074:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178135 count 1 00010000:00010000:1.0:1651529349.407078:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407082:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 2/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.407085:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407086:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407087:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 4/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407093:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 3/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 435 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.407099:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 435 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407103:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966688320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.407116:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.407321:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966688000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.407331:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.407342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.407349:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966688128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.407350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.407352:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407357:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.407361:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438272 00000100:00100000:1.0:1651529349.407363:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.407366:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 5/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 436 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.407371:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438400 00010000:00010000:0.0:1651529349.407374:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 5/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.407378:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438208 00010000:00010000:0.0:1651529349.407390:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 438 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.407395:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438336 00010000:00010000:0.0:1651529349.407397:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 439 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407398:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966687936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.407401:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438464 00010000:00010000:1.0:1651529349.407402:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407403:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.407407:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12298 00000100:00100000:0.0:1651529349.407409:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41279:x1731746396438272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.407410:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966688064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.407412:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.407413:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407413:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 5/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407417:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 4/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407419:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966688192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.407421:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407423:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407423:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407424:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407427:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 4/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407432:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12299 00000100:00100000:1.0:1651529349.407435:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41279:x1731746396438400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.407440:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.407443:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 4/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407449:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 3/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407455:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac08edd/0xa29a79078f3bb8aa lrc: 0/0,0 mode: --/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60db expref: 440 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407455:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.407460:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407461:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407462:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407469:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41279:x1731746396438272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.407477:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 4/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407482:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12298 00010000:00010000:1.0:1651529349.407485:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.407493:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12300 00000100:00100000:1.0:1651529349.407494:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41279:x1731746396438400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.407495:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41278:x1731746396438208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.407497:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12299 00010000:00010000:0.0:1651529349.407498:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.407500:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407503:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12301 00010000:00010000:0.0:1651529349.407504:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 3/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407505:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41278:x1731746396438336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.407508:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.407509:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a42552ab/0xa29a79078f3baf2d lrc: 0/0,0 mode: --/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b1f expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407510:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 437 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407513:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407513:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407514:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407516:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 3/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 436 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407517:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 4/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407522:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d666a3a8/0xa29a79078f3bb213 lrc: 0/0,0 mode: --/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46e1 expref: 436 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407524:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.407525:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407526:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407526:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407529:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 4/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407530:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41278:x1731746396438208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.407535:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.407541:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41278:x1731746396438336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.407542:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12300 00000100:00100000:1.0:1651529349.407543:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12301 00000100:00100000:0.0:1651529349.407547:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12302 00000100:00100000:0.0:1651529349.407549:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+433:41278:x1731746396438464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.407551:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407551:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.407553:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407555:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407557:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 3/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407558:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407562:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099e62c82/0xa29a79078f3bb730 lrc: 0/0,0 mode: --/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b0f expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407563:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407566:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407566:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407567:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407570:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 4/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407576:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.407582:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41278:x1731746396438464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.407584:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12302 00010000:00010000:0.0:1651529349.407591:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407601:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407603:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1633:39029:x1731745946557184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1136us (1250us total) trans 30064894199 rc 0/0 00010000:00010000:0.0:1651529349.407605:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407606:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153339 00010000:00010000:0.0:1651529349.407607:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407624:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407628:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.407629:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407632:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 3/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407637:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 1/0,0 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407639:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfd1b lrc: 0/0,0 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407644:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407647:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.407648:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407651:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 3/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407652:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1633:39029:x1731745946557312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1293us total) trans 30064894200 rc 0/0 00010000:00010000:1.0:1651529349.407654:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 1/0,0 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407656:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153340 00010000:00010000:1.0:1651529349.407657:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bfd22 lrc: 0/0,0 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407663:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407667:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3babec lrc: 0/0,0 mode: --/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e45 expref: 431 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407667:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407670:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966687872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.407670:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407672:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407673:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407676:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407679:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407682:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407687:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407704:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1633:39029:x1731745946557056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1278us (1362us total) trans 30064894201 rc 0/0 00000100:00100000:0.0:1651529349.407709:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153338 00010000:00010000:0.0:1651529349.407715:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407719:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.407720:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407722:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 3/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407725:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1633:39029:x1731745946557120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1399us (1437us total) trans 30064894202 rc 0/0 00010000:00010000:0.0:1651529349.407727:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 1/0,0 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407728:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153336 00010000:00010000:0.0:1651529349.407730:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bfd14 lrc: 0/0,0 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407745:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407746:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407748:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.407749:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407749:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407752:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407752:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 3/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407755:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407757:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 1/0,0 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407760:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfd06 lrc: 0/0,0 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407764:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407766:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.407767:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407770:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 3/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407773:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 1/0,0 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407775:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfd0d lrc: 0/0,0 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.407790:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1633:39029:x1731745946557248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1372us (1483us total) trans 30064894203 rc 0/0 00000100:00100000:1.0:1651529349.407793:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153337 00000100:00100000:0.0:1651529349.407845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.407854:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966688320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.407856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.407859:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.407878:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438528 00010000:00010000:1.0:1651529349.407883:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 431 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407894:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438656 00010000:00010000:1.0:1651529349.407897:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407901:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438592 00000100:00100000:0.0:1651529349.407910:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12303 00000100:00100000:0.0:1651529349.407912:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+433:41279:x1731746396438528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.407916:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.407918:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407922:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 3/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407928:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c48d49b/0xa29a79078f3ba44b lrc: 0/0,0 mode: --/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f58 expref: 433 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407932:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407932:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.407933:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407936:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 5/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407936:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 4/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.407946:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.407953:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12304 00000100:00100000:1.0:1651529349.407956:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41279:x1731746396438656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.407961:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.407963:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407967:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 3/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.407974:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bebe0626/0xa29a79078f3bb4eb lrc: 0/0,0 mode: --/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5280 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.407974:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41279:x1731746396438528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.407977:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.407977:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12303 00010000:00010000:1.0:1651529349.407978:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.407979:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.407982:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 4/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.407983:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12305 00000100:00100000:0.0:1651529349.407985:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+430:41278:x1731746396438592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.407988:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.407989:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.407989:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 5/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 430 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.407996:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 4/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 430 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.407997:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+430:41279:x1731746396438656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.408000:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12304 00010000:00010000:0.0:1651529349.408001:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408002:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408003:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408006:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 4/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408007:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408010:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.408011:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408014:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408015:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41278:x1731746396438592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.408016:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408018:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12305 00010000:00010000:0.0:1651529349.408036:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408039:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.408040:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408043:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 3/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408047:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 1/0,0 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408053:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfd29 lrc: 0/0,0 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.408069:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1633:39030:x1731745946557376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1548us (1701us total) trans 30064894204 rc 0/0 00000100:00100000:1.0:1651529349.408072:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153341 00010000:00010000:1.0:1651529349.408079:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408085:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408097:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408100:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.408141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.408150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.408155:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.408163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.408169:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557632 00000100:00100000:0.0:1651529349.408178:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557760 00000100:00100000:0.0:1651529349.408182:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557568 00000100:00100000:0.0:1651529349.408187:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557696 00000100:00100000:0.0:1651529349.408191:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557824 00000100:00100000:0.0:1651529349.408194:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153344 00000100:00100000:1.0:1651529349.408200:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1638:39030:x1731745946557504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1129us (1183us total) trans 30064894205 rc 0/0 00000100:00100000:0.0:1651529349.408214:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1638:39029:x1731745946557632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.408215:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153343 00000100:00100000:1.0:1651529349.408220:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153345 00002000:00080000:0.0:1651529349.408220:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178137 count 1 00000100:00100000:1.0:1651529349.408222:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1637:39029:x1731745946557760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.408225:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.408227:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178139 count 1 00010000:00010000:0.0:1651529349.408230:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 2/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408231:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408234:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408234:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408235:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 4/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408236:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 2/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408240:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408240:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408241:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 4/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408243:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 3/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.408247:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.408250:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 3/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.408251:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966688384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.408254:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408259:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966688448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.408261:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.408267:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.408267:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153346 00000100:00100000:0.0:1651529349.408269:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1637:39030:x1731745946557568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.408274:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178136 count 1 00000100:00100000:1.0:1651529349.408275:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153347 00000100:00100000:1.0:1651529349.408276:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1637:39030:x1731745946557696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.408277:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.408281:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178138 count 1 00010000:00010000:0.0:1651529349.408281:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 2/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408284:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408284:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408285:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408285:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 4/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408288:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 2/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 428 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408291:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408291:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 3/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408292:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408293:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 4/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408295:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.408299:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 428 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408302:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 428 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.408302:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966688512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408306:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966688576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.408308:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.408313:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.408314:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153348 00000100:00100000:0.0:1651529349.408316:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1637:39030:x1731745946557824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.408318:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.408320:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178140 count 1 00010000:00010000:1.0:1651529349.408321:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.408322:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408323:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408325:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 3/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408327:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 2/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408329:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 1/0,0 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408330:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408331:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408331:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 4/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408332:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfd37 lrc: 0/0,0 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408337:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 3/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.408340:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.408344:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966688640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.408346:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fa921d5/0xa29a79078f3ba4b4 lrc: 0/0,0 mode: --/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d116c expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408349:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966688256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.408350:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.408353:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408358:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408361:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.408364:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408366:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408409:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557888 00000100:00100000:0.0:1651529349.408420:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153349 00000100:00100000:0.0:1651529349.408422:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1639:39030:x1731745946557888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.408427:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178141 count 1 00010000:00010000:0.0:1651529349.408431:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408436:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 2/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.408439:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408439:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408440:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 4/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408446:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 3/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.408450:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 427 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.408454:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966688704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408464:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1639:39030:x1731745946557440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1512us (1592us total) trans 30064894206 rc 0/0 00000100:00100000:1.0:1651529349.408467:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153342 00010000:00010000:1.0:1651529349.408476:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408480:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.408480:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408483:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 3/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408487:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.408488:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 1/0,0 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408491:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfd30 lrc: 0/0,0 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.408549:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946557952 00000100:00100000:1.0:1651529349.408557:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153350 00000100:00100000:1.0:1651529349.408559:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1639:39030:x1731745946557952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.408564:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178142 count 1 00010000:00010000:1.0:1651529349.408568:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408573:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 2/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408576:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408577:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408577:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 4/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408584:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 3/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408588:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 427 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408592:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966688768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408603:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.408655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.408665:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558016 00000100:00100000:1.0:1651529349.408672:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153351 00000100:00100000:1.0:1651529349.408675:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1640:39030:x1731745946558016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.408682:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178143 count 1 00010000:00010000:1.0:1651529349.408688:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408695:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 2/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408698:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408699:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408700:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 4/0,1 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408707:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 3/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 427 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.408710:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 4/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 427 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408715:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966688832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408743:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.408837:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966688384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.408850:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.408854:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.408860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.408868:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966688512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.408876:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.408877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.408883:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966688640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.408884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.408886:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408892:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438784 00000100:00100000:1.0:1651529349.408893:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966688448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.408897:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408898:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.408903:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438720 00010000:00010000:0.0:1651529349.408905:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 429 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408908:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966688576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.408909:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438912 00010000:00010000:0.0:1651529349.408911:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 430 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.408912:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.408915:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438848 00010000:00010000:0.0:1651529349.408917:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 431 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408923:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396438976 00010000:00010000:1.0:1651529349.408929:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 432 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.408936:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12306 00000100:00100000:1.0:1651529349.408938:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41279:x1731746396438784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.408940:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.408951:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12307 00000100:00100000:0.0:1651529349.408953:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41278:x1731746396438720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.408956:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.408957:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.408961:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 3/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.408962:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.408966:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 3/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.408967:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000770b4c5/0xa29a79078f3bbe7d lrc: 0/0,0 mode: --/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7724 expref: 432 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.408971:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.408971:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408972:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eefd15/0xa29a79078f3bbac5 lrc: 0/0,0 mode: --/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6860 expref: 431 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.408972:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408975:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 4/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408976:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408977:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.408978:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.408981:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 4/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.408982:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.408988:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.408990:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+430:41278:x1731746396438720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.408992:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12307 00000100:00100000:1.0:1651529349.408996:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41279:x1731746396438784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.408997:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12308 00000100:00100000:1.0:1651529349.408999:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12306 00000100:00100000:0.0:1651529349.408999:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41279:x1731746396438912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.409001:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.409003:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409005:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12309 00010000:00010000:0.0:1651529349.409006:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 3/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409007:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+428:41278:x1731746396438976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.409010:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.409011:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 428 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409011:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73163e1/0xa29a79078f3b9de5 lrc: 0/0,0 mode: --/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5b2 expref: 428 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409014:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409014:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409015:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 427 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409015:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409018:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 4/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409019:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0935bc4/0xa29a79078f3b92a8 lrc: 0/0,0 mode: --/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc840 expref: 427 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409023:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409023:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409024:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409024:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.409029:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 4/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409029:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+426:41279:x1731746396438912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.409031:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12308 00010000:00010000:1.0:1651529349.409035:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.409035:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12310 00000100:00100000:0.0:1651529349.409037:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41278:x1731746396438848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.409039:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.409040:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41278:x1731746396438976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.409040:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 425 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409043:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12309 00010000:00010000:0.0:1651529349.409044:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 3/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 425 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409049:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409049:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ff39730/0xa29a79078f3ba436 lrc: 0/0,0 mode: --/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ee1 expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409052:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409052:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409052:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409053:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409055:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409056:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 4/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409058:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409061:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.409073:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+423:41278:x1731746396438848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.409076:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12310 00010000:00010000:0.0:1651529349.409083:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409086:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.409087:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409090:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 3/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409094:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 1/0,0 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409100:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfd45 lrc: 0/0,0 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409105:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409108:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409111:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.409112:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1641:39029:x1731745946557760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 889us (971us total) trans 30064894207 rc 0/0 00010000:00010000:0.0:1651529349.409114:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.409116:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153345 00010000:00010000:1.0:1651529349.409131:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409135:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409138:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409141:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409169:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1642:39030:x1731745946557824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 852us (1005us total) trans 30064894208 rc 0/0 00000100:00100000:0.0:1651529349.409172:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153348 00000100:00100000:1.0:1651529349.409178:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1641:39030:x1731745946557696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 900us (1022us total) trans 30064894209 rc 0/0 00000100:00100000:1.0:1651529349.409180:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153347 00010000:00010000:0.0:1651529349.409180:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409183:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409186:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409188:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409191:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.409191:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409192:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409195:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 3/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409200:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 1/0,0 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409202:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bfd5a lrc: 0/0,0 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409207:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409210:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.409211:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409213:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 3/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409216:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 1/0,0 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409219:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfd53 lrc: 0/0,0 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409222:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409225:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.409226:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409226:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1641:39030:x1731745946557568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 956us (1075us total) trans 30064894210 rc 0/0 00010000:00010000:1.0:1651529349.409228:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 3/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409229:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153346 00010000:00010000:1.0:1651529349.409231:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 1/0,0 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409236:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfd4c lrc: 0/0,0 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409236:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409239:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409242:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409245:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.409277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.409286:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1641:39029:x1731745946557632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1167us total) trans 30064894211 rc 0/0 00000100:00100000:0.0:1651529349.409289:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153344 00000100:00100000:0.0:1651529349.409299:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966688704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.409303:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.409311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.409311:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409321:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.409322:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409325:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 3/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409330:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 1/0,0 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409332:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bfd3e lrc: 0/0,0 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409340:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439040 00010000:00010000:0.0:1651529349.409345:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 423 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409346:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966688768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.409351:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409352:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439104 00010000:00010000:0.0:1651529349.409354:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409359:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12311 00000100:00100000:0.0:1651529349.409365:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12312 00000100:00100000:0.0:1651529349.409366:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+424:41278:x1731746396439104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.409367:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+424:41278:x1731746396439040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.409369:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.409371:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.409371:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409373:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409375:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 3/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409377:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 3/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409380:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e95abed6/0xa29a79078f3bb308 lrc: 0/0,0 mode: --/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b3a expref: 424 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.409382:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0110c53/0xa29a79078f3b9d13 lrc: 0/0,0 mode: --/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2b0 expref: 423 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409383:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409383:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409384:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409386:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409387:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409387:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409387:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 4/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409393:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 4/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409395:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.409407:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.409415:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.409418:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12311 00010000:00010000:1.0:1651529349.409425:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409425:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+421:41278:x1731746396439104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (92us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.409429:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409429:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12312 00010000:00010000:1.0:1651529349.409432:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409434:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409445:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409449:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409454:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409474:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.409485:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1641:39030:x1731745946557952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (944us total) trans 30064894212 rc 0/0 00000100:00100000:1.0:1651529349.409488:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153350 00010000:00010000:1.0:1651529349.409495:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409498:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.409499:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409502:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 3/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409507:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 1/0,0 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409509:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bfd68 lrc: 0/0,0 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409513:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409516:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.409517:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409520:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 3/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409523:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 1/0,0 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409526:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfd61 lrc: 0/0,0 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.409541:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1641:39030:x1731745946557888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1118us (1178us total) trans 30064894213 rc 0/0 00000100:00100000:0.0:1651529349.409545:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153349 00000100:00100000:1.0:1651529349.409564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.409583:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558080 00000100:00100000:0.0:1651529349.409599:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153352 00000100:00100000:0.0:1651529349.409600:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1641:39029:x1731745946558080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.409606:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178144 count 1 00010000:00010000:0.0:1651529349.409611:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409615:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 2/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409618:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409619:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409620:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 4/0,1 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409626:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 3/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409633:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 4/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.409636:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966688896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.409645:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.409658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.409672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.409678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.409699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.409707:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558208 00000100:00100000:1.0:1651529349.409729:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558336 00000100:00100000:0.0:1651529349.409742:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558144 00000100:00100000:1.0:1651529349.409748:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558272 00000100:00100000:1.0:1651529349.409753:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153353 00000100:00100000:1.0:1651529349.409755:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1645:39030:x1731745946558208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.409765:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153354 00000100:00100000:0.0:1651529349.409767:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1645:39030:x1731745946558336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.409769:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178146 count 1 00002000:00080000:0.0:1651529349.409773:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178148 count 1 00010000:00010000:1.0:1651529349.409776:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409777:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409782:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 2/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.409784:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 2/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409785:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409789:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409790:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409791:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 4/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.409798:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409799:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 3/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409799:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 4/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409825:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 4/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.409827:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 3/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.409830:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966688960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.409831:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.409836:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966689024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.409840:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.409845:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.409847:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153355 00000100:00100000:1.0:1651529349.409850:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1645:39029:x1731745946558272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.409851:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153356 00000100:00100000:0.0:1651529349.409853:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1645:39029:x1731745946558144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.409855:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178147 count 1 00010000:00010000:1.0:1651529349.409858:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.409858:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178145 count 1 00010000:00010000:0.0:1651529349.409862:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409865:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 2/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409866:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 2/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 420 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409869:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409869:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409870:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.409870:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.409870:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 4/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409871:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 4/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.409882:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.409886:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409891:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966689088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.409891:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 3/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 420 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.409895:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 420 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.409898:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.409902:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966689152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.409910:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.409924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.409937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.409950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.409958:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558464 00000100:00100000:0.0:1651529349.409979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.409990:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558400 00000100:00100000:1.0:1651529349.409992:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153357 00000100:00100000:1.0:1651529349.409994:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1647:39030:x1731745946558464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.409999:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153358 00000100:00100000:0.0:1651529349.410001:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1647:39029:x1731745946558400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.410005:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178150 count 1 00002000:00080000:0.0:1651529349.410006:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178149 count 1 00010000:00010000:1.0:1651529349.410009:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410011:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410014:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 2/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.410015:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 2/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.410017:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410018:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410018:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 4/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410018:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410019:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410020:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 4/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410025:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 3/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.410027:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 3/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 420 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.410029:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.410031:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.410033:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966689216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.410035:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966689280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.410042:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.410044:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.410049:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439168 00000100:00100000:0.0:1651529349.410050:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439232 00010000:00010000:1.0:1651529349.410053:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 5/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.410054:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 5/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.410066:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12313 00000100:00100000:1.0:1651529349.410073:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.410076:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.410076:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12314 00010000:00010000:1.0:1651529349.410078:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 5/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410078:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.410081:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.410083:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 5/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.410084:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 4/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.410087:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 4/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.410090:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410091:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410091:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410093:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410093:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410094:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 4/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410094:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410097:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 4/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410099:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.410102:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.410106:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.410108:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.410109:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12313 00000100:00100000:0.0:1651529349.410111:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12314 00010000:00010000:1.0:1651529349.410120:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000188b0bf6/0xa29a79078f3bbfb1 lrc: 0/0,0 mode: --/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bc3 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.410122:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2c8477c/0xa29a79078f3bb737 lrc: 0/0,0 mode: --/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b1d expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.410125:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966688832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.410126:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966688896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.410128:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410130:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410132:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410133:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410134:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410136:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410138:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410139:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410141:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410142:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 2/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410197:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1649:39030:x1731745946558016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1522us (1542us total) trans 30064894214 rc 0/0 00000100:00100000:1.0:1651529349.410200:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153351 00000100:00100000:0.0:1651529349.410204:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1648:39029:x1731745946558080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 602us (640us total) trans 30064894215 rc 0/0 00000100:00100000:0.0:1651529349.410207:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153352 00010000:00010000:1.0:1651529349.410208:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410211:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.410212:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410214:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 2/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410215:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 3/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410217:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.410218:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 2/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410220:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 1/0,0 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410223:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bfd6f lrc: 0/0,0 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410224:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 3/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410228:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 1/0,0 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410231:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bfd76 lrc: 0/0,0 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.410427:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558592 00000100:00100000:0.0:1651529349.410439:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153359 00000100:00100000:1.0:1651529349.410440:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.410441:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1648:39030:x1731745946558592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.410446:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178152 count 1 00000100:00100000:1.0:1651529349.410448:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558528 00010000:00010000:0.0:1651529349.410451:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410455:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153360 00010000:00010000:0.0:1651529349.410456:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 2/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 418 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.410457:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1649:39029:x1731745946558528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.410459:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410459:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410460:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 4/0,1 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.410462:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178151 count 1 00010000:00010000:1.0:1651529349.410467:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410467:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 3/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 418 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.410472:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 2/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 418 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.410473:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 4/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.410475:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410475:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410476:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 4/0,1 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410477:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.410483:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 3/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 418 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.410487:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 4/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 418 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410489:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.410491:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966689408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.410500:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.410591:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966689024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.410594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.410611:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.410628:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439296 00010000:00010000:0.0:1651529349.410634:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 5/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 419 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410657:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439360 00010000:00010000:0.0:1651529349.410661:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410677:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12315 00000100:00100000:0.0:1651529349.410678:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746396439296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.410682:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.410683:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 5/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.410687:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 4/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.410699:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966688960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.410704:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c02b8fb/0xa29a79078f3ba7a1 lrc: 0/0,0 mode: --/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e38 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.410705:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410708:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410708:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.410709:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410712:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 4/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410722:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.410726:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12316 00000100:00100000:1.0:1651529349.410728:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41278:x1731746396439360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.410731:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.410731:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41278:x1731746396439296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.410742:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 419 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410742:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12315 00010000:00010000:1.0:1651529349.410746:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 3/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.410752:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001992ef41/0xa29a79078f3bbccb lrc: 0/0,0 mode: --/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7086 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.410753:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966689152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.410756:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410757:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.410757:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410757:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410761:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 4/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410765:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966689280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.410767:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410770:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.410778:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41278:x1731746396439360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.410779:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410781:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12316 00010000:00010000:0.0:1651529349.410791:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410792:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966689088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.410795:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410796:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.410797:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410831:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966689216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.410837:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410855:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410861:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.410862:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410867:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 3/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410873:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 1/0,0 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410875:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfd84 lrc: 0/0,0 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410883:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410899:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946558336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1131us (1227us total) trans 30064894216 rc 0/0 00010000:00010000:1.0:1651529349.410901:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410903:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153354 00010000:00010000:1.0:1651529349.410904:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410907:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410917:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.410921:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.410970:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946558208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1213us (1311us total) trans 30064894217 rc 0/0 00000100:00100000:0.0:1651529349.410973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.410975:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153353 00010000:00010000:1.0:1651529349.410986:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.410990:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.410991:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.410992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.410994:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 3/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411007:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 1/0,0 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411010:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfd7d lrc: 0/0,0 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411019:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.411035:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439488 00000100:00100000:0.0:1651529349.411041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.411048:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 417 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.411054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.411055:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439552 00010000:00010000:1.0:1651529349.411057:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411060:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439424 00000100:00100000:1.0:1651529349.411062:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439744 00010000:00010000:1.0:1651529349.411064:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 5/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 420 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411066:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 420 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.411068:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439616 00010000:00010000:1.0:1651529349.411070:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 421 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.411074:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439680 00010000:00010000:1.0:1651529349.411076:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 4/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.411080:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12317 00000100:00100000:1.0:1651529349.411081:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.411084:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.411084:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12318 00010000:00010000:1.0:1651529349.411085:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 422 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411086:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746396439552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.411089:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.411091:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411092:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 3/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 422 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411094:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 3/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 422 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411097:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3b8f67 lrc: 0/0,0 mode: --/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc496 expref: 422 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411101:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411101:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3bb0c3 lrc: 0/0,0 mode: --/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41b6 expref: 421 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411102:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411105:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 4/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411105:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411105:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411106:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411109:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 4/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411116:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.411125:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.411134:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746396439488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.411137:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12317 00000100:00100000:0.0:1651529349.411137:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746396439552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.411140:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12318 00000100:00100000:1.0:1651529349.411142:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12319 00000100:00100000:1.0:1651529349.411144:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746396439744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.411146:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.411146:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12320 00010000:00010000:1.0:1651529349.411148:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 5/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 418 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411152:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 4/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 418 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411154:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41279:x1731746396439616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.411157:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411157:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411158:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411158:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.411159:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411161:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 4/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411163:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 3/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411165:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.411169:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd5000c6/0xa29a79078f3bbe8b lrc: 0/0,0 mode: --/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7740 expref: 418 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.411171:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746396439744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.411173:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12319 00000100:00100000:1.0:1651529349.411177:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12321 00000100:00100000:1.0:1651529349.411178:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41279:x1731746396439680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.411180:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.411182:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 4/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 417 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411185:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 3/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 417 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411187:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411188:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411189:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411190:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3ba7bd lrc: 0/0,0 mode: --/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ea1 expref: 416 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411193:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411193:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411194:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411197:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 4/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411201:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 4/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411206:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.411211:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+415:41279:x1731746396439680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.411213:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.411214:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12321 00000100:00100000:1.0:1651529349.411218:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12322 00000100:00100000:1.0:1651529349.411219:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+414:41279:x1731746396439424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.411220:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+414:41279:x1731746396439616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.411221:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.411223:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411223:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12320 00010000:00010000:1.0:1651529349.411226:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 413 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411230:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411231:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f085fe8c/0xa29a79078f3ba94c lrc: 0/0,0 mode: --/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2458 expref: 413 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.411234:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411234:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411235:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411235:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411238:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 4/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411245:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.411247:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411249:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41279:x1731746396439424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (230us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.411250:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411252:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12322 00010000:00010000:1.0:1651529349.411263:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411266:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411269:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411272:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411292:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1651:39029:x1731745946558144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1438us (1613us total) trans 30064894218 rc 0/0 00000100:00100000:0.0:1651529349.411295:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153356 00010000:00010000:0.0:1651529349.411302:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411305:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411309:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411311:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1650:39029:x1731745946558272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1461us (1623us total) trans 30064894219 rc 0/0 00010000:00010000:0.0:1651529349.411311:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411314:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153355 00010000:00010000:1.0:1651529349.411329:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411333:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411336:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411339:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411350:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1650:39029:x1731745946558400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1348us (1399us total) trans 30064894220 rc 0/0 00000100:00100000:0.0:1651529349.411353:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153358 00010000:00010000:0.0:1651529349.411360:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411373:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946558464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1378us (1449us total) trans 30064894221 rc 0/0 00010000:00010000:0.0:1651529349.411373:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.411374:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411376:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153357 00010000:00010000:0.0:1651529349.411377:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 3/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411383:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411383:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 1/0,0 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411385:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfd92 lrc: 0/0,0 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411387:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.411388:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411390:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 3/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411390:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411393:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.411394:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411395:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 1/0,0 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411396:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 3/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411398:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfd8b lrc: 0/0,0 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411399:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 1/0,0 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411402:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411405:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.411406:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411409:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 3/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411409:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfda0 lrc: 0/0,0 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411412:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 1/0,0 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411415:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfd99 lrc: 0/0,0 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411416:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411418:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411422:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411424:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3b97cc lrc: 0/0,0 mode: --/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd5c expref: 411 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411425:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411427:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966689408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.411431:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411434:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411436:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411439:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411445:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411461:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946558592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1020us (1048us total) trans 30064894222 rc 0/0 00000100:00100000:0.0:1651529349.411464:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153359 00010000:00010000:0.0:1651529349.411471:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411474:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.411475:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411478:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 3/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411481:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1650:39029:x1731745946558528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1023us (1046us total) trans 30064894223 rc 0/0 00000100:00100000:1.0:1651529349.411484:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153360 00010000:00010000:0.0:1651529349.411490:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 1/0,0 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411491:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411494:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.411494:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfda7 lrc: 0/0,0 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411495:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411498:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 3/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411502:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 1/0,0 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411505:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfdae lrc: 0/0,0 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.411538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.411549:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558720 00000100:00100000:0.0:1651529349.411565:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558656 00000100:00100000:0.0:1651529349.411570:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153361 00000100:00100000:0.0:1651529349.411572:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1651:39030:x1731745946558720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.411577:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178154 count 1 00010000:00010000:0.0:1651529349.411582:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411586:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 2/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411589:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411590:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411591:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 4/0,1 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411597:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 3/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411604:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 4/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411608:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.411617:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.411623:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153362 00000100:00100000:0.0:1651529349.411625:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1651:39029:x1731745946558656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.411629:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178153 count 1 00010000:00010000:0.0:1651529349.411633:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411651:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 2/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411655:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411656:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411656:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 4/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.411663:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 3/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411667:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411673:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966689536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.411687:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.411749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.411760:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.411761:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558784 00000100:00100000:1.0:1651529349.411775:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558848 00000100:00100000:1.0:1651529349.411784:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153363 00000100:00100000:1.0:1651529349.411785:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1653:39029:x1731745946558784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.411796:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178155 count 1 00010000:00010000:1.0:1651529349.411801:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.411821:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153364 00000100:00100000:0.0:1651529349.411823:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1653:39030:x1731745946558848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.411829:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178156 count 1 00010000:00010000:0.0:1651529349.411833:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411840:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 2/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.411845:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411846:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.411847:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 4/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.411855:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 3/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411856:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 2/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 410 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.411859:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.411859:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411860:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.411861:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 4/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.411863:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966689600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.411873:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.411877:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 3/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 410 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.411881:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 4/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 410 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.411885:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966689664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.411894:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.411915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.411947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.411955:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558912 00000100:00100000:0.0:1651529349.411972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.411979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.411988:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946558976 00000100:00100000:0.0:1651529349.411989:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.412000:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559040 00000100:00100000:0.0:1651529349.412002:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.412004:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559104 00000100:00100000:1.0:1651529349.412007:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153365 00000100:00100000:1.0:1651529349.412009:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1657:39030:x1731745946558912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.412009:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153366 00000100:00100000:0.0:1651529349.412011:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1657:39030:x1731745946558976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.412014:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178157 count 1 00002000:00080000:0.0:1651529349.412017:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178158 count 1 00010000:00010000:1.0:1651529349.412018:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412021:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412024:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 2/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412026:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 2/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.412027:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412027:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412028:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 4/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412029:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412029:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412030:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 4/0,1 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412035:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412037:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 3/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.412039:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 4/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412041:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 4/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412043:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966689728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.412045:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966689792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.412052:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.412054:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.412059:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153367 00000100:00100000:1.0:1651529349.412061:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1657:39029:x1731745946559040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.412062:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966689536:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.412065:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178159 count 1 00010000:00010000:0.0:1651529349.412066:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412068:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412073:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 2/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 410 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.412073:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439808 00010000:00010000:1.0:1651529349.412076:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412076:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412077:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 4/0,1 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412077:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 5/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412083:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 3/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 411 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.412088:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439872 00010000:00010000:0.0:1651529349.412091:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412095:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 4/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412097:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12323 00000100:00100000:1.0:1651529349.412099:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966689856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.412099:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41278:x1731746396439808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.412102:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.412103:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 5/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412107:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.412107:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 4/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412112:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153368 00010000:00010000:0.0:1651529349.412113:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412113:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.412114:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1657:39030:x1731745946559104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.412114:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412117:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 4/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.412118:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178160 count 1 00010000:00010000:1.0:1651529349.412122:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412122:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.412126:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 2/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 412 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.412128:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41278:x1731746396439808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.412129:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412129:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412130:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 4/0,1 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412131:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12323 00000100:00100000:0.0:1651529349.412135:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12324 00000100:00100000:0.0:1651529349.412137:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+411:41279:x1731746396439872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.412139:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 3/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 411 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412139:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.412141:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412143:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 4/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412144:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 3/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412146:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966689920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.412149:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002932e568/0xa29a79078f3bc385 lrc: 0/0,0 mode: --/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b28 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412152:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.412152:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412152:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412153:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412156:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 4/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412162:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.412167:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+410:41279:x1731746396439872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.412169:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12324 00010000:00010000:0.0:1651529349.412175:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412179:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412182:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412184:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412230:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1658:39029:x1731745946558656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 603us (691us total) trans 30064894224 rc 0/0 00000100:00100000:0.0:1651529349.412233:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153362 00010000:00010000:0.0:1651529349.412239:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412242:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.412243:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412245:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 3/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412250:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 1/0,0 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412253:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfdbc lrc: 0/0,0 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412262:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583089b4/0xa29a79078f3b9cb8 lrc: 0/0,0 mode: --/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf152 expref: 409 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412266:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.412269:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412272:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412275:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412296:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412299:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412315:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412320:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.412321:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412325:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 3/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412340:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 1/0,0 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412344:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfdb5 lrc: 0/0,0 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412367:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1658:39030:x1731745946558720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 794us (846us total) trans 30064894225 rc 0/0 00000100:00100000:0.0:1651529349.412383:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153361 00000100:00100000:0.0:1651529349.412423:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001745b514 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966689664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.412427:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.412433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.412457:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559168 00000100:00100000:1.0:1651529349.412458:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966689600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.412462:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412465:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153369 00000100:00100000:0.0:1651529349.412466:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1658:39030:x1731745946559168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.412470:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966689728:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.412472:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178161 count 1 00010000:00010000:1.0:1651529349.412473:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412476:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412480:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 2/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 408 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412483:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412484:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412485:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 4/0,1 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412491:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 3/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 408 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412495:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 4/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 408 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412499:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.412512:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.412578:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.412625:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966689856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.412625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.412630:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.412638:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966689920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.412639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.412640:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.412655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.412658:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396439936 00000100:00100000:0.0:1651529349.412661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.412663:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 409 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412667:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559232 00000100:00100000:1.0:1651529349.412669:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440064 00010000:00010000:1.0:1651529349.412671:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 4/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 410 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412677:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153370 00000100:00100000:0.0:1651529349.412679:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1659:39030:x1731745946559232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.412681:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440192 00010000:00010000:1.0:1651529349.412684:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 5/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.412684:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178162 count 1 00000100:00100000:1.0:1651529349.412688:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440000 00010000:00010000:0.0:1651529349.412688:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412690:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 4/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 412 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412693:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 2/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 412 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.412696:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.412697:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440128 00010000:00010000:0.0:1651529349.412697:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412697:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 4/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412701:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 4/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 413 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412704:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 3/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 413 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.412709:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440256 00010000:00010000:1.0:1651529349.412713:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 4/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412721:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12325 00000100:00100000:1.0:1651529349.412723:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+414:41279:x1731746396439936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.412729:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412741:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966690048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.412742:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.412744:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412748:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 3/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412754:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000561d0381/0xa29a79078f3b9f58 lrc: 0/0,0 mode: --/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfba1 expref: 414 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.412754:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.412758:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412759:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412759:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412761:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966689792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.412762:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 4/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412765:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412769:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.412773:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12326 00000100:00100000:0.0:1651529349.412775:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41279:x1731746396440064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.412777:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41279:x1731746396439936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.412778:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.412779:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 4/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 413 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412780:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12325 00010000:00010000:0.0:1651529349.412783:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412786:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12327 00000100:00100000:1.0:1651529349.412787:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41279:x1731746396440192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.412789:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044e3b395/0xa29a79078f3ba58d lrc: 0/0,0 mode: --/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14fa expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412790:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.412791:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 4/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 412 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412792:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412793:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412794:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412795:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 3/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412797:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 4/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412800:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8dab678/0xa29a79078f3bb404 lrc: 0/0,0 mode: --/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f38 expref: 411 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412818:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.412826:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412826:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412827:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412831:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+410:41279:x1731746396440064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.412833:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 4/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412834:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12326 00010000:00010000:1.0:1651529349.412841:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.412847:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41279:x1731746396440192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.412850:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12328 00000100:00100000:1.0:1651529349.412851:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12327 00000100:00100000:0.0:1651529349.412852:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41278:x1731746396440000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.412854:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.412856:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 4/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 408 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.412857:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12329 00000100:00100000:1.0:1651529349.412858:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+408:41278:x1731746396440128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.412860:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 3/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 408 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412861:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.412862:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 4/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 408 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412865:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009734abe5/0xa29a79078f3b9858 lrc: 0/0,0 mode: --/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf8c expref: 408 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412866:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 3/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 408 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412869:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412869:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412870:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412871:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7740402/0xa29a79078f3bba0f lrc: 0/0,0 mode: --/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d661b expref: 407 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412873:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 4/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412875:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.412876:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412879:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 4/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412879:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.412885:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41278:x1731746396440000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.412888:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.412888:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12328 00000100:00100000:0.0:1651529349.412892:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12330 00000100:00100000:1.0:1651529349.412893:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746396440128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.412894:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746396440256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.412895:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12329 00010000:00010000:0.0:1651529349.412896:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.412898:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 4/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.412902:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 3/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412904:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412906:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000266de9b/0xa29a79078f3baccc lrc: 0/0,0 mode: --/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31b7 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.412907:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412910:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412910:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412910:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.412911:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412913:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412914:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 4/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412923:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.412929:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+403:41278:x1731746396440256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.412931:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12330 00010000:00010000:0.0:1651529349.412941:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412944:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412950:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.412952:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.412961:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1660:39029:x1731745946558784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1175us (1213us total) trans 30064894226 rc 0/0 00000100:00100000:1.0:1651529349.412964:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153363 00010000:00010000:1.0:1651529349.412971:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412975:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412978:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.412981:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.412992:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946558848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1231us total) trans 30064894227 rc 0/0 00000100:00100000:0.0:1651529349.412995:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153364 00010000:00010000:0.0:1651529349.413003:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413006:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413007:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413010:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 3/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413015:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946558912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1100us total) trans 30064894228 rc 0/0 00010000:00010000:0.0:1651529349.413015:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 1/0,0 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413017:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153365 00010000:00010000:0.0:1651529349.413017:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfdc3 lrc: 0/0,0 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413022:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413024:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413025:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413025:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413028:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413028:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 3/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413029:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413031:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 3/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413031:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 1/0,0 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413034:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3bfdca lrc: 0/0,0 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413036:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 1/0,0 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413039:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfdd1 lrc: 0/0,0 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413039:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413042:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413044:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413045:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413047:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413048:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413051:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413054:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413083:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1661:39030:x1731745946558976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1136us total) trans 30064894229 rc 0/0 00000100:00100000:0.0:1651529349.413086:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153366 00000100:00100000:1.0:1651529349.413089:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946559104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 974us (1100us total) trans 30064894230 rc 0/0 00000100:00100000:1.0:1651529349.413092:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153368 00010000:00010000:0.0:1651529349.413094:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413097:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413098:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413099:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413101:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 3/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413102:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413105:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413105:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 1/0,0 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413108:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413108:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3bfdd8 lrc: 0/0,0 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413112:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413115:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413116:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413118:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 3/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413124:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 1/0,0 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413126:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfde6 lrc: 0/0,0 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413130:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413132:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413133:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413136:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 3/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413139:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1660:39029:x1731745946559040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1077us (1166us total) trans 30064894231 rc 0/0 00010000:00010000:0.0:1651529349.413139:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 1/0,0 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413141:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153367 00010000:00010000:0.0:1651529349.413141:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfddf lrc: 0/0,0 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413184:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966689984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.413188:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.413241:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440320 00010000:00010000:0.0:1651529349.413248:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 4/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 403 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.413256:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12331 00000100:00100000:0.0:1651529349.413258:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+403:41278:x1731746396440320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.413260:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.413262:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 4/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 403 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.413266:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 3/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 403 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.413271:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3b929a lrc: 0/0,0 mode: --/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc824 expref: 403 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.413274:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413275:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413276:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413279:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 4/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413285:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.413292:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746396440320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.413295:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12331 00010000:00010000:0.0:1651529349.413319:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413323:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413326:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413340:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413386:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946559168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 918us (953us total) trans 30064894232 rc 0/0 00000100:00100000:0.0:1651529349.413389:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153369 00010000:00010000:0.0:1651529349.413396:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413414:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.413415:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413419:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 3/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413431:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 1/0,0 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413445:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3bfded lrc: 0/0,0 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.413467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.413482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.413491:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966690048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.413494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.413495:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413502:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440384 00000100:00100000:1.0:1651529349.413503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.413513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.413513:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 402 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.413521:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12332 00000100:00100000:0.0:1651529349.413522:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746396440384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.413530:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559296 00010000:00010000:0.0:1651529349.413530:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.413532:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 402 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.413536:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 3/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 402 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413537:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559360 00000100:00100000:1.0:1651529349.413540:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559424 00010000:00010000:0.0:1651529349.413541:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df00314/0xa29a79078f3ba777 lrc: 0/0,0 mode: --/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d90 expref: 402 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413543:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559552 00010000:00010000:0.0:1651529349.413545:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413545:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.413546:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559488 00010000:00010000:0.0:1651529349.413546:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413548:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559616 00010000:00010000:0.0:1651529349.413549:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 4/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413552:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153371 00000100:00100000:1.0:1651529349.413553:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1665:39029:x1731745946559296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.413555:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529349.413559:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178163 count 1 00010000:00010000:1.0:1651529349.413564:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413569:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 2/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 401 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413572:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413572:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413573:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 4/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413582:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+401:41278:x1731746396440384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.413585:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12332 00010000:00010000:1.0:1651529349.413587:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 3/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 401 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413591:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 400 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.413594:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153372 00000100:00100000:0.0:1651529349.413595:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1665:39030:x1731745946559360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.413599:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966690112:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.413601:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178164 count 1 00010000:00010000:0.0:1651529349.413605:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413609:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.413609:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 2/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 400 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.413612:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413613:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413614:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 4/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413615:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153373 00000100:00100000:1.0:1651529349.413617:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1665:39029:x1731745946559424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.413620:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 3/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 400 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.413621:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178165 count 1 00010000:00010000:0.0:1651529349.413624:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 400 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.413625:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413628:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966690176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.413629:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 2/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413632:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413633:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413634:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 4/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413637:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.413640:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 3/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413644:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.413644:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153374 00000100:00100000:0.0:1651529349.413645:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1665:39029:x1731745946559552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.413648:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966690240:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.413650:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178167 count 1 00010000:00010000:0.0:1651529349.413653:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413654:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.413658:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 2/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.413660:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153375 00010000:00010000:0.0:1651529349.413660:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413661:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.413661:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 4/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413662:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1665:39029:x1731745946559488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.413665:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178166 count 1 00010000:00010000:0.0:1651529349.413667:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 3/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413669:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413671:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.413673:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 2/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.413675:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966690304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.413676:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413676:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413677:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 4/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413681:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.413683:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 3/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.413685:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413686:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.413689:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413690:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966690368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.413692:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.413694:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.413696:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.413709:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153376 00000100:00100000:1.0:1651529349.413711:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1665:39029:x1731745946559616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.413715:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178168 count 1 00010000:00010000:1.0:1651529349.413718:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413725:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 2/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413728:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413729:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413729:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 4/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413744:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1666:39030:x1731745946559232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1064us (1167us total) trans 30064894233 rc 0/0 00010000:00010000:1.0:1651529349.413746:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 3/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.413747:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153370 00010000:00010000:1.0:1651529349.413749:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413753:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966690432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.413760:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.413765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.413778:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559680 00000100:00100000:1.0:1651529349.413785:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153377 00000100:00100000:1.0:1651529349.413787:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1666:39030:x1731745946559680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.413792:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178169 count 1 00010000:00010000:1.0:1651529349.413834:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413840:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 2/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413857:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413858:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413859:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 4/0,1 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413870:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 3/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413874:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 4/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413878:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966690496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.413893:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.413899:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413902:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ead11881 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.413904:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413907:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 3/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413921:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 1/0,0 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413928:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3bfdf4 lrc: 0/0,0 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.413937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.413949:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559744 00000100:00100000:1.0:1651529349.413957:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153378 00000100:00100000:1.0:1651529349.413958:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1667:39030:x1731745946559744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.413963:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178170 count 1 00010000:00010000:1.0:1651529349.413967:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413972:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 2/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413975:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413975:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.413976:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 4/0,1 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.413982:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 3/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 400 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.413986:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 4/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.413990:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966690560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.414001:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.414224:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966690112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.414235:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.414248:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966690240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.414250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.414251:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.414258:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966690368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.414265:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.414266:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.414277:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440512 00010000:00010000:1.0:1651529349.414287:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 401 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414287:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966690176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.414292:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414293:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440640 00010000:00010000:1.0:1651529349.414295:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 402 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414299:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440448 00000100:00100000:0.0:1651529349.414300:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966690304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.414301:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 403 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414302:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414305:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440576 00010000:00010000:1.0:1651529349.414307:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414309:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440704 00010000:00010000:0.0:1651529349.414314:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 405 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414320:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12333 00000100:00100000:1.0:1651529349.414323:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746396440512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.414328:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.414330:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 405 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414334:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 3/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 405 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414341:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000073c0632/0xa29a79078f3b92cb lrc: 0/0,0 mode: --/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8c5 expref: 405 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414349:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12334 00010000:00010000:1.0:1651529349.414364:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414365:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414366:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414369:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+404:41278:x1731746396440640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.414370:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 4/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414373:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.414375:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414380:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.414385:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 3/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414392:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+404:41278:x1731746396440512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.414395:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12333 00010000:00010000:0.0:1651529349.414396:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f07ff2/0xa29a79078f3bc0bb lrc: 0/0,0 mode: --/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fe4 expref: 404 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414400:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.414401:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.414402:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414405:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12335 00010000:00010000:0.0:1651529349.414405:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 4/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414407:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41279:x1731746396440448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.414410:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.414412:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 402 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414414:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.414422:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 3/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 402 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414422:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746396440640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 71us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.414425:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12334 00010000:00010000:1.0:1651529349.414428:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8968eac/0xa29a79078f3b7845 lrc: 0/0,0 mode: --/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6b2 expref: 402 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414431:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12336 00010000:00010000:1.0:1651529349.414432:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414432:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414433:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414433:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41279:x1731746396440576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.414435:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.414436:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 4/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414437:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414441:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 3/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414442:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.414446:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b3e1570/0xa29a79078f3ba738 lrc: 0/0,0 mode: --/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c94 expref: 400 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414448:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41279:x1731746396440448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.414449:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.414450:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12335 00010000:00010000:0.0:1651529349.414450:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.414451:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414453:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 4/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414455:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12337 00000100:00100000:1.0:1651529349.414457:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41279:x1731746396440704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.414459:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.414459:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.414460:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414464:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 3/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414465:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41279:x1731746396440576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.414467:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12336 00010000:00010000:1.0:1651529349.414469:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d0ea3b5/0xa29a79078f3bbec3 lrc: 0/0,0 mode: --/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77fd expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414472:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414472:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414473:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414474:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414476:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 4/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414477:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414480:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414481:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.414483:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414487:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41279:x1731746396440704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.414489:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12337 00000100:00100000:1.0:1651529349.414507:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966690432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.414510:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414516:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414519:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.414521:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414524:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 3/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414528:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 1/0,0 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414531:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3bfe10 lrc: 0/0,0 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414536:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414536:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1668:39029:x1731745946559552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 890us (1033us total) trans 30064894234 rc 0/0 00010000:00010000:1.0:1651529349.414539:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414539:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153374 00010000:00010000:1.0:1651529349.414542:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414545:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414547:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414550:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414560:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414563:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.414598:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1669:39029:x1731745946559424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 980us (1110us total) trans 30064894235 rc 0/0 00000100:00100000:1.0:1651529349.414601:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153373 00000100:00100000:0.0:1651529349.414603:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1669:39030:x1731745946559360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1135us total) trans 30064894236 rc 0/0 00000100:00100000:0.0:1651529349.414608:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153372 00010000:00010000:1.0:1651529349.414609:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414613:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.414614:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414616:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 3/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414620:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414621:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 1/0,0 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414624:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfe09 lrc: 0/0,0 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414624:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.414625:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414628:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 3/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414630:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414633:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414633:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 1/0,0 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414635:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3bfe02 lrc: 0/0,0 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414636:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414638:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.414689:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.414700:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1668:39029:x1731745946559488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1037us (1187us total) trans 30064894237 rc 0/0 00000100:00100000:0.0:1651529349.414707:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.414713:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153375 00000100:00100000:1.0:1651529349.414721:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440832 00010000:00010000:1.0:1651529349.414726:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 5/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414762:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440768 00000100:00100000:0.0:1651529349.414762:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440896 00010000:00010000:1.0:1651529349.414769:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414769:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 5/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.414776:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12338 00000100:00100000:1.0:1651529349.414778:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12339 00000100:00100000:0.0:1651529349.414778:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41279:x1731746396440832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.414780:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746396440896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.414782:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.414783:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.414783:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 5/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414784:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 5/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414787:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 4/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414788:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 4/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 398 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.414793:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.414793:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414794:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.414794:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414795:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414795:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414798:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 4/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414828:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.414830:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 4/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.414836:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.414847:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746396440896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.414850:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12339 00000100:00100000:0.0:1651529349.414851:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41279:x1731746396440832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.414854:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12338 00000100:00100000:1.0:1651529349.414856:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12340 00000100:00100000:1.0:1651529349.414858:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41278:x1731746396440768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.414861:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.414863:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414867:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 3/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414872:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d72e8a41/0xa29a79078f3bc14e lrc: 0/0,0 mode: --/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8299 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.414876:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414876:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.414877:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414880:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 4/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414900:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.414914:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+395:41278:x1731746396440768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.414917:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12340 00000100:00100000:0.0:1651529349.414937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.414940:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec94a1d0/0xa29a79078f3bb4ba lrc: 0/0,0 mode: --/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51e6 expref: 394 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.414951:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966690496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.414955:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414958:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414961:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414964:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.414967:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.414983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.414991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.415000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.415007:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559808 00000100:00100000:0.0:1651529349.415016:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559872 00000100:00100000:0.0:1651529349.415020:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946559936 00000100:00100000:0.0:1651529349.415022:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560000 00000100:00100000:0.0:1651529349.415038:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153379 00000100:00100000:0.0:1651529349.415041:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1672:39029:x1731745946559808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.415047:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178171 count 1 00000100:00100000:1.0:1651529349.415052:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1672:39030:x1731745946559680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1264us (1286us total) trans 30064894238 rc 0/0 00000100:00100000:1.0:1651529349.415055:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153377 00010000:00010000:0.0:1651529349.415057:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415061:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153380 00010000:00010000:0.0:1651529349.415062:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 2/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.415063:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946559872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.415065:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415066:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415066:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 4/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.415068:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178172 count 1 00010000:00010000:1.0:1651529349.415072:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415074:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 3/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.415078:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 393 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.415082:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966690624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.415085:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 2/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 393 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415088:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415088:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415089:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 4/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415091:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.415096:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 3/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 393 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.415098:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153381 00010000:00010000:1.0:1651529349.415100:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 393 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.415100:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1671:39029:x1731745946559936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.415104:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966690688:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529349.415104:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178173 count 1 00010000:00010000:0.0:1651529349.415108:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415112:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 2/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 393 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.415113:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.415115:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415116:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415116:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 4/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415120:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153382 00000100:00100000:1.0:1651529349.415122:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946560000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.415122:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 3/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 393 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.415126:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 393 pid: 161133 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.415127:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178174 count 1 00000100:00100000:0.0:1651529349.415130:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966690752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.415131:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415135:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 2/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.415136:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.415138:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415139:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415139:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 4/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415145:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 3/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415149:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 393 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.415153:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966690816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.415159:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.415173:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415177:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415180:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415191:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415207:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415211:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.415212:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415215:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 3/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415220:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 1/0,0 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415225:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3bfe17 lrc: 0/0,0 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415229:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415232:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.415233:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415251:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1672:39029:x1731745946559616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1539us (1729us total) trans 30064894239 rc 0/0 00000100:00100000:1.0:1651529349.415254:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153376 00010000:00010000:0.0:1651529349.415255:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 3/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415259:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 1/0,0 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415262:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415262:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3bfe25 lrc: 0/0,0 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415266:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.415267:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415270:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 3/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415275:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 1/0,0 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415278:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3bfe1e lrc: 0/0,0 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415285:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415288:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415299:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415303:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.415318:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415322:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.415323:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415329:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 3/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415333:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 1/0,0 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415336:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bfdfb lrc: 0/0,0 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415351:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1672:39029:x1731745946559296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1796us (1900us total) trans 30064894240 rc 0/0 00000100:00100000:1.0:1651529349.415354:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153371 00000100:00100000:1.0:1651529349.415359:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560064 00000100:00100000:1.0:1651529349.415368:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153383 00000100:00100000:1.0:1651529349.415377:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1672:39030:x1731745946560064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.415382:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178175 count 1 00010000:00010000:1.0:1651529349.415386:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415391:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 2/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415394:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415394:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415395:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 4/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415402:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 3/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 393 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415405:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 393 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.415409:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966690880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.415420:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.415425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.415433:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000878dde9b/0xa29a79078f3bb8db lrc: 0/0,0 mode: --/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6191 expref: 393 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.415444:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966690560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.415449:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415452:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415454:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415457:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415460:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.415546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.415560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.415561:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1673:39030:x1731745946559744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1601us (1624us total) trans 30064894241 rc 0/0 00000100:00100000:1.0:1651529349.415564:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153378 00000100:00100000:1.0:1651529349.415570:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560128 00000100:00100000:1.0:1651529349.415573:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560192 00000100:00100000:1.0:1651529349.415576:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153384 00000100:00100000:1.0:1651529349.415578:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1674:39030:x1731745946560128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.415582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.415590:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178176 count 1 00000100:00100000:0.0:1651529349.415590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.415595:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415596:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153385 00000100:00100000:0.0:1651529349.415599:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1674:39030:x1731745946560192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.415602:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 2/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 392 pid: 142994 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.415604:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178177 count 1 00010000:00010000:1.0:1651529349.415607:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415607:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415609:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 4/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415609:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415619:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 3/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 392 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415623:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 4/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 392 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.415627:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966690944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.415629:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 2/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 392 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.415632:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415633:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415633:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 4/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415637:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.415641:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 392 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.415642:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415645:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.415645:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 392 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415647:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415649:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 3/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415650:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.415657:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 1/0,0 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415658:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.415660:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bfe2c lrc: 0/0,0 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415666:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966690624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.415669:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966690816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.415670:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415673:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.415678:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966690752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.415682:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966690688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.415685:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415692:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396440960 00010000:00010000:1.0:1651529349.415696:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 393 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415696:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415702:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441024 00010000:00010000:1.0:1651529349.415704:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 394 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.415704:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441088 00000100:00100000:1.0:1651529349.415708:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441152 00010000:00010000:0.0:1651529349.415709:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 396 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415710:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.415715:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12341 00000100:00100000:0.0:1651529349.415717:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41279:x1731746396440960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.415718:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12342 00000100:00100000:1.0:1651529349.415720:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41278:x1731746396441024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.415720:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.415722:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.415722:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415723:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 396 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415726:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 3/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415727:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 3/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 396 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415731:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa86288/0xa29a79078f3ba33a lrc: 0/0,0 mode: --/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b37 expref: 396 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415732:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1cf740/0xa29a79078f3b9580 lrc: 0/0,0 mode: --/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd402 expref: 396 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415745:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415745:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415746:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415746:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415747:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415748:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415749:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 4/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415751:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 4/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415756:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.415758:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.415764:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41279:x1731746396440960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.415766:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396441024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.415767:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12341 00000100:00100000:1.0:1651529349.415769:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12342 00000100:00100000:0.0:1651529349.415772:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12343 00000100:00100000:0.0:1651529349.415773:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396441088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.415774:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12344 00000100:00100000:1.0:1651529349.415776:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396441152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.415776:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.415777:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 392 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415778:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.415780:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 392 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415781:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 3/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 392 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415783:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 3/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 392 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415786:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25384f0/0xa29a79078f3b95db lrc: 0/0,0 mode: --/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5c9 expref: 392 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.415789:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4145c15/0xa29a79078f3ba3fe lrc: 0/0,0 mode: --/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dfa expref: 392 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.415790:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415790:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.415791:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415792:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415792:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.415793:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415794:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 4/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415796:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 4/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415799:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.415801:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.415826:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41278:x1731746396441152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.415827:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41279:x1731746396441088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.415829:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12344 00000100:00100000:0.0:1651529349.415830:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12343 00010000:00010000:1.0:1651529349.415835:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415838:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415839:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415841:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415844:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415845:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415847:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415848:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415887:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1676:39030:x1731745946560000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 764us (887us total) trans 30064894242 rc 0/0 00000100:00100000:1.0:1651529349.415890:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153382 00000100:00100000:0.0:1651529349.415892:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1676:39029:x1731745946559808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 850us (955us total) trans 30064894243 rc 0/0 00000100:00100000:0.0:1651529349.415895:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153379 00010000:00010000:1.0:1651529349.415897:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415901:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.415902:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415902:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415904:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 3/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415905:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.415906:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415909:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 1/0,0 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415909:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 3/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415912:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bfe48 lrc: 0/0,0 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415914:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 1/0,0 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415917:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3bfe33 lrc: 0/0,0 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415918:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415921:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415922:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415924:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415925:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415926:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415928:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.415931:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.415970:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1676:39030:x1731745946559872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 906us (987us total) trans 30064894244 rc 0/0 00000100:00100000:0.0:1651529349.415972:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1676:39029:x1731745946559936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 871us (981us total) trans 30064894245 rc 0/0 00000100:00100000:1.0:1651529349.415973:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153380 00000100:00100000:0.0:1651529349.415975:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153381 00010000:00010000:1.0:1651529349.415980:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415983:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.415984:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415986:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 3/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.415991:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 1/0,0 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416001:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bfe3a lrc: 0/0,0 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416005:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416008:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.416008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.416009:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416012:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 3/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416015:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 1/0,0 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416018:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3bfe41 lrc: 0/0,0 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.416028:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966690880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.416032:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416039:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441216 00010000:00010000:1.0:1651529349.416043:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.416081:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12345 00000100:00100000:1.0:1651529349.416084:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+389:41278:x1731746396441216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.416087:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560256 00000100:00100000:0.0:1651529349.416098:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153386 00000100:00100000:0.0:1651529349.416100:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1675:39030:x1731745946560256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.416102:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.416104:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.416106:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178178 count 1 00010000:00010000:1.0:1651529349.416109:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 3/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416118:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be6b4d2/0xa29a79078f3ba80a lrc: 0/0,0 mode: --/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fdc expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416124:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416125:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416126:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416131:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 4/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416132:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416138:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 2/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 388 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416139:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.416141:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416142:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416143:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 4/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416153:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41278:x1731746396441216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.416156:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12345 00010000:00010000:0.0:1651529349.416156:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 3/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 388 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.416163:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 387 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416164:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416167:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416167:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.416173:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416176:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416177:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.416191:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416195:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.416196:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416199:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 3/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416204:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 1/0,0 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416216:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1676:39030:x1731745946560064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 838us (911us total) trans 30064894246 rc 0/0 00000100:00100000:1.0:1651529349.416219:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153383 00010000:00010000:0.0:1651529349.416219:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bfe4f lrc: 0/0,0 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.416258:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560320 00000100:00100000:1.0:1651529349.416288:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153387 00000100:00100000:1.0:1651529349.416291:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1676:39029:x1731745946560320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.416298:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178179 count 1 00010000:00010000:1.0:1651529349.416303:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416308:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 2/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416311:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416312:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416313:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 4/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.416338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.416339:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 3/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 387 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416344:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 387 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.416346:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.416348:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966691136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.416351:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416358:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441280 00000100:00100000:1.0:1651529349.416363:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.416369:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 5/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 388 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.416375:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966690944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.416389:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416394:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441344 00000100:00100000:1.0:1651529349.416398:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12346 00010000:00010000:0.0:1651529349.416398:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.416400:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+389:41278:x1731746396441280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.416404:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.416408:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12347 00000100:00100000:0.0:1651529349.416410:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+389:41279:x1731746396441344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.416413:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 4/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 389 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.416414:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.416415:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416419:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 3/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 389 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.416419:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 389 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416428:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0f9b001/0xa29a79078f3b8901 lrc: 0/0,0 mode: --/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc14e expref: 389 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416433:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416433:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416434:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416436:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090af2fc1/0xa29a79078f3bab3d lrc: 0/0,0 mode: --/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bcf expref: 388 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416438:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 4/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416440:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416440:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416441:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416444:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 4/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416445:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.416452:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+387:41278:x1731746396441280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (122us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.416452:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.416455:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12346 00000100:00100000:0.0:1651529349.416459:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41279:x1731746396441344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.416462:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12347 00010000:00010000:1.0:1651529349.416463:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416467:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416470:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416472:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416474:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416478:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416481:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416484:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416520:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1678:39030:x1731745946560128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (1094us total) trans 30064894247 rc 0/0 00000100:00100000:1.0:1651529349.416523:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153384 00000100:00100000:0.0:1651529349.416529:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1677:39030:x1731745946560192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1017us total) trans 30064894248 rc 0/0 00010000:00010000:1.0:1651529349.416530:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416532:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153385 00010000:00010000:1.0:1651529349.416533:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.416534:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416537:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 3/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416542:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 1/0,0 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416544:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bfe56 lrc: 0/0,0 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416549:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416551:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.416552:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416555:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 3/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416558:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 1/0,0 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416560:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3bfe5d lrc: 0/0,0 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.416583:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.416587:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416604:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.416623:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441408 00010000:00010000:1.0:1651529349.416640:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.416645:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560384 00000100:00100000:0.0:1651529349.416656:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153388 00000100:00100000:0.0:1651529349.416657:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1677:39030:x1731745946560384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.416668:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12348 00002000:00080000:0.0:1651529349.416668:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178180 count 1 00000100:00100000:1.0:1651529349.416670:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41279:x1731746396441408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.416673:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.416673:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416675:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.416678:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 2/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 386 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416679:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 3/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.416681:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416681:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416682:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 4/0,1 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416685:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000950b40ee/0xa29a79078f3b96c9 lrc: 0/0,0 mode: --/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8f5 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416688:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416689:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416689:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 3/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 385 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416690:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416692:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 4/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.416693:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 4/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416697:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.416702:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.416712:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41279:x1731746396441408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.416715:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12348 00000100:00100000:0.0:1651529349.416716:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.416722:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416725:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.416731:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416742:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.416793:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.416829:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1678:39030:x1731745946560256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 728us (821us total) trans 30064894249 rc 0/0 00000100:00100000:0.0:1651529349.416833:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153386 00000100:00100000:1.0:1651529349.416846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.416853:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560448 00000100:00100000:0.0:1651529349.416862:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560512 00000100:00100000:0.0:1651529349.416866:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560576 00000100:00100000:0.0:1651529349.416871:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560640 00000100:00100000:0.0:1651529349.416876:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153389 00000100:00100000:0.0:1651529349.416877:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1681:39029:x1731745946560448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.416892:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178181 count 1 00000100:00100000:1.0:1651529349.416896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.416897:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416902:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 2/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.416905:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416906:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416906:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 4/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.416916:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 3/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.416928:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560704 00000100:00100000:1.0:1651529349.416935:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153390 00000100:00100000:1.0:1651529349.416943:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000093e60af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1682:39030:x1731745946560512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.416943:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.416948:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691264:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.416949:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178182 count 1 00010000:00010000:1.0:1651529349.416953:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.416958:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.416959:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 2/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 384 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.416962:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.416963:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.416963:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416964:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 4/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416966:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.416967:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.416970:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 3/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416975:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 3/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 384 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.416975:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 1/0,0 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.416982:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 384 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.416993:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3bfe64 lrc: 0/0,0 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.416998:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966691328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.417003:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153391 00000100:00100000:0.0:1651529349.417004:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1682:39030:x1731745946560576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.417009:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.417010:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178183 count 1 00010000:00010000:0.0:1651529349.417013:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417016:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153392 00010000:00010000:0.0:1651529349.417017:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 2/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.417018:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1682:39030:x1731745946560640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.417020:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417021:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417022:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 4/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.417023:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178184 count 1 00010000:00010000:1.0:1651529349.417028:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417028:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.417031:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 4/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417032:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 2/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.417035:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417036:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417036:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 4/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417036:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966691392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.417043:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 3/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.417043:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.417046:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417050:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966691456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.417052:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153393 00000100:00100000:0.0:1651529349.417053:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1682:39029:x1731745946560704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.417057:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.417058:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178185 count 1 00010000:00010000:0.0:1651529349.417061:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417065:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 2/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.417068:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966691136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417069:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417069:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417070:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 4/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417072:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417076:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 3/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 384 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.417079:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417083:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966691520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.417089:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.417095:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441472 00010000:00010000:0.0:1651529349.417100:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417113:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12349 00000100:00100000:0.0:1651529349.417114:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41278:x1731746396441472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.417117:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.417124:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417128:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 3/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.417145:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048494220/0xa29a79078f3b9d0c lrc: 0/0,0 mode: --/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf29b expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.417149:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417150:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417159:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 4/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417167:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.417175:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746396441472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.417177:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12349 00000100:00100000:0.0:1651529349.417182:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441536 00010000:00010000:0.0:1651529349.417186:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 5/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417195:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12350 00000100:00100000:0.0:1651529349.417197:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396441536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.417199:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.417201:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 5/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417204:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 4/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417216:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417217:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417217:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417220:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 4/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417222:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560768 00010000:00010000:0.0:1651529349.417225:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.417232:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153394 00000100:00100000:0.0:1651529349.417235:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396441536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.417237:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12350 00000100:00100000:1.0:1651529349.417240:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1683:39030:x1731745946560768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.417245:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178186 count 1 00010000:00010000:0.0:1651529349.417249:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aed4c6d/0xa29a79078f3bbfcd lrc: 0/0,0 mode: --/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c33 expref: 383 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417251:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417253:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417256:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417259:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 2/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 382 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.417260:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417264:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417265:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417266:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 4/0,1 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417276:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 3/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 382 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.417278:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417281:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417282:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 4/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 382 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417288:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966691584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417298:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417320:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.417327:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417330:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.417331:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417335:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 3/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417342:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 1/0,0 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417347:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3bfe72 lrc: 0/0,0 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417358:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417361:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417364:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417365:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1684:39030:x1731745946560384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 707us (762us total) trans 30064894250 rc 0/0 00010000:00010000:1.0:1651529349.417366:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417369:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153388 00000100:00100000:0.0:1651529349.417450:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966691392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417454:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417460:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1684:39029:x1731745946560320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1168us (1225us total) trans 30064894251 rc 0/0 00000100:00100000:1.0:1651529349.417464:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153387 00000100:00100000:0.0:1651529349.417468:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417471:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417472:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417476:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.417477:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417480:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 3/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417485:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 1/0,0 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417487:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bfe6b lrc: 0/0,0 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417508:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966691328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.417514:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417565:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966691456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.417570:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.417593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.417610:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441600 00010000:00010000:1.0:1651529349.417616:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 383 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.417638:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441728 00010000:00010000:1.0:1651529349.417642:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 4/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 384 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417648:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.417657:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441664 00010000:00010000:1.0:1651529349.417660:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 385 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417665:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12351 00000100:00100000:1.0:1651529349.417667:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41279:x1731746396441600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.417670:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.417672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.417678:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.417683:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 3/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.417689:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3bad2e lrc: 0/0,0 mode: --/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33cb expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417698:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417699:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.417699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.417700:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417703:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 4/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417707:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966691520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.417712:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.417716:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417723:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396441600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.417726:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12351 00000100:00100000:1.0:1651529349.417731:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441856 00000100:00100000:0.0:1651529349.417741:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441792 00010000:00010000:1.0:1651529349.417743:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417747:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 385 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.417749:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441920 00010000:00010000:1.0:1651529349.417752:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 5/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 386 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.417754:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12352 00000100:00100000:0.0:1651529349.417756:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41279:x1731746396441728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.417757:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12353 00000100:00100000:1.0:1651529349.417758:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41278:x1731746396441664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.417759:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.417760:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 4/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 386 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417761:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.417763:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417764:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 386 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417767:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 3/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 386 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417770:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000166ec80e/0xa29a79078f3bb86b lrc: 0/0,0 mode: --/PR res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fed expref: 386 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417774:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417774:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417775:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecefcbe8/0xa29a79078f3b9900 lrc: 0/0,0 mode: --/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1f4 expref: 385 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417775:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417778:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417778:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 4/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417779:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417780:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417783:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 4/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417785:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.417790:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.417792:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396441728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.417796:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746396441664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.417796:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12352 00000100:00100000:1.0:1651529349.417799:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12353 00000100:00100000:0.0:1651529349.417800:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12354 00000100:00100000:0.0:1651529349.417802:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+382:41279:x1731746396441856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.417824:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12355 00010000:00010000:0.0:1651529349.417825:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.417826:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+382:41278:x1731746396441792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.417827:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 382 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417829:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.417831:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 382 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417831:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 3/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 382 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417835:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 3/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 382 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417836:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9bd67d/0xa29a79078f3bb952 lrc: 0/0,0 mode: --/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d634a expref: 382 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417839:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417840:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417841:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38225b8/0xa29a79078f3bc12b lrc: 0/0,0 mode: --/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81f8 expref: 381 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417841:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417843:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 4/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417847:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417847:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417848:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417850:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.417851:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 4/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417856:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41279:x1731746396441856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.417857:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.417859:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12354 00000100:00100000:1.0:1651529349.417864:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+379:41278:x1731746396441792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.417867:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12355 00000100:00100000:0.0:1651529349.417869:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12356 00000100:00100000:0.0:1651529349.417870:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41278:x1731746396441920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.417873:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.417874:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417874:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 5/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 378 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417877:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417878:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 4/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 378 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.417880:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417883:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417883:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417884:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417884:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417887:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 4/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417899:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.417904:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41278:x1731746396441920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.417907:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12356 00010000:00010000:0.0:1651529349.417914:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417917:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417920:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.417926:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.417943:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000093e60af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1684:39030:x1731745946560512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1005us (1189us total) trans 30064894252 rc 0/0 00000100:00100000:1.0:1651529349.417946:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153390 00000100:00100000:1.0:1651529349.417952:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560832 00000100:00100000:1.0:1651529349.417958:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560896 00000100:00100000:1.0:1651529349.417962:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153395 00000100:00100000:1.0:1651529349.417963:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1686:39030:x1731745946560832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.417969:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178187 count 1 00000100:00100000:0.0:1651529349.417971:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1686:39030:x1731745946560576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 965us (1177us total) trans 30064894253 rc 0/0 00010000:00010000:1.0:1651529349.417973:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.417974:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153391 00010000:00010000:1.0:1651529349.417978:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 2/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 377 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.417979:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153396 00010000:00010000:1.0:1651529349.417981:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.417981:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.417981:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1685:39030:x1731745946560896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.417982:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 4/0,1 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.417985:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178188 count 1 00010000:00010000:1.0:1651529349.417988:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 3/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.417990:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.417992:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 4/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 377 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.417994:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 2/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 377 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.417996:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966691648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.417997:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417998:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.417999:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 4/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418005:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.418006:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 3/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 377 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418009:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 377 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.418010:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418014:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.418015:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418016:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966691712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.418018:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 3/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418023:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 1/0,0 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418025:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.418026:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bfe80 lrc: 0/0,0 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418030:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418032:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418033:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.418033:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418035:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418036:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 3/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418038:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418039:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 1/0,0 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418041:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418042:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3bfe87 lrc: 0/0,0 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418055:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418059:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.418060:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418062:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 3/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418066:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 1/0,0 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418068:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bfe95 lrc: 0/0,0 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418077:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418080:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418082:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1686:39029:x1731745946560704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1028us (1187us total) trans 30064894254 rc 0/0 00010000:00010000:1.0:1651529349.418083:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418085:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153393 00010000:00010000:1.0:1651529349.418086:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418102:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418105:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418108:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418114:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418134:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946560640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1115us (1288us total) trans 30064894255 rc 0/0 00000100:00100000:1.0:1651529349.418138:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153392 00010000:00010000:1.0:1651529349.418149:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081375b17/0xa29a79078f3b9238 lrc: 0/0,0 mode: --/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc69c expref: 377 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.418152:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1686:39029:x1731745946560448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1273us (1421us total) trans 30064894256 rc 0/0 00000100:00100000:1.0:1651529349.418153:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966691584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.418155:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153389 00010000:00010000:1.0:1651529349.418157:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418160:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418162:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418165:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418168:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418175:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418179:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.418180:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418182:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 3/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418187:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 1/0,0 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418190:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bfe8e lrc: 0/0,0 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418194:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418197:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.418198:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418201:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 3/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418203:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1686:39030:x1731745946560768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 963us (1068us total) trans 30064894257 rc 0/0 00010000:00010000:0.0:1651529349.418204:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 1/0,0 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418206:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153394 00010000:00010000:0.0:1651529349.418207:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3bfe79 lrc: 0/0,0 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418210:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418213:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.418213:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418216:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 3/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418219:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 1/0,0 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418221:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bfe9c lrc: 0/0,0 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.418424:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.418426:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946560960 00000100:00100000:1.0:1651529349.418442:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561024 00000100:00100000:1.0:1651529349.418447:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153397 00000100:00100000:1.0:1651529349.418449:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1687:39029:x1731745946560960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.418455:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178189 count 1 00010000:00010000:1.0:1651529349.418465:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,1 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418472:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153398 00000100:00100000:0.0:1651529349.418474:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946561024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.418480:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178190 count 1 00010000:00010000:1.0:1651529349.418482:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 2/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418487:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418488:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418490:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 4/0,1 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418501:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418502:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 3/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418508:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 4/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.418515:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966691776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.418522:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 2/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 376 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418527:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418528:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.418529:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.418530:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 4/0,1 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418540:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 3/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 376 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418544:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 4/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.418545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.418549:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.418571:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.418596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.418640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.418642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.418650:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.418664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.418666:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966691712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.418675:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418680:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396441984 00010000:00010000:1.0:1651529349.418699:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 5/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 377 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.418711:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442048 00010000:00010000:1.0:1651529349.418714:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.418716:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12357 00000100:00100000:0.0:1651529349.418718:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41279:x1731746396441984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.418721:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12358 00010000:00010000:0.0:1651529349.418721:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.418722:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41278:x1731746396442048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.418723:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 5/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.418727:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 4/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.418728:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.418730:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.418746:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 3/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.418748:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418749:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418750:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418753:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059e34498/0xa29a79078f3ba91b lrc: 0/0,0 mode: --/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23a9 expref: 378 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.418753:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 4/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418757:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418757:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418758:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418758:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.418762:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 4/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418777:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41279:x1731746396441984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.418780:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12357 00010000:00010000:1.0:1651529349.418781:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.418799:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561088 00000100:00100000:1.0:1651529349.418800:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746396442048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.418823:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12358 00000100:00100000:0.0:1651529349.418823:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561152 00000100:00100000:0.0:1651529349.418830:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561216 00000100:00100000:0.0:1651529349.418836:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561280 00000100:00100000:0.0:1651529349.418839:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153399 00000100:00100000:1.0:1651529349.418847:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153400 00000100:00100000:1.0:1651529349.418850:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1691:39030:x1731745946561152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.418850:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1691:39030:x1731745946561088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.418856:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178192 count 1 00002000:00080000:0.0:1651529349.418856:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178191 count 1 00010000:00010000:1.0:1651529349.418861:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418861:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418866:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 2/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418866:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 2/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418869:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418869:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418869:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418870:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418870:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 4/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418870:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 4/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418877:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 3/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418878:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 3/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418880:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 375 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.418881:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 375 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.418885:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.418886:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966691968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.418894:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.418896:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.418901:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153401 00000100:00100000:0.0:1651529349.418903:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1691:39029:x1731745946561216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.418904:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153402 00000100:00100000:1.0:1651529349.418905:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1691:39030:x1731745946561280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.418907:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178193 count 1 00010000:00010000:0.0:1651529349.418911:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418915:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 2/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418918:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418918:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.418919:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 4/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.418920:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178194 count 1 00010000:00010000:1.0:1651529349.418923:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418925:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 3/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 375 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418928:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 2/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 375 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.418928:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 375 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.418931:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418931:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.418932:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 4/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.418932:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.418938:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.418939:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 3/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 375 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.418942:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 375 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.418946:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966692096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.418946:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418949:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.418952:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.418954:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.418955:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418971:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014351043/0xa29a79078f3bae62 lrc: 0/0,0 mode: --/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3801 expref: 375 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.418976:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966691648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.418980:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418993:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418996:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.418999:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419001:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419001:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1692:39030:x1731745946560896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1019us (1329us total) trans 30064894258 rc 0/0 00000100:00100000:0.0:1651529349.419004:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153396 00000100:00100000:0.0:1651529349.419046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.419077:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1692:39030:x1731745946560832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1112us (1453us total) trans 30064894259 rc 0/0 00000100:00100000:1.0:1651529349.419080:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153395 00000100:00100000:0.0:1651529349.419086:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.419088:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419098:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.419099:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419102:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 3/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419117:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 1/0,0 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419126:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442112 00010000:00010000:0.0:1651529349.419132:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 5/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 375 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.419139:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442176 00010000:00010000:0.0:1651529349.419142:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 5/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.419143:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3bfeaa lrc: 0/0,0 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419147:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12359 00010000:00010000:1.0:1651529349.419158:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419161:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.419162:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419164:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41279:x1731746396442112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.419165:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 3/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419167:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.419169:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 5/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.419170:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 1/0,0 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419173:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 4/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.419175:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3bfea3 lrc: 0/0,0 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419179:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419180:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419181:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419192:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094085464/0xa29a79078f3baeaf lrc: 0/0,0 mode: --/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3958 expref: 376 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419197:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966691776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419197:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 4/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419201:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 4/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419203:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.419207:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419210:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419212:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+375:41279:x1731746396442112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.419213:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419215:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419215:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12359 00000100:00100000:0.0:1651529349.419220:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12360 00000100:00100000:0.0:1651529349.419222:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+374:41278:x1731746396442176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.419231:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.419233:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 5/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 374 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419237:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 4/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 374 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419253:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419254:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419255:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419258:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 4/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419260:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1692:39029:x1731745946560960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 810us (848us total) trans 30064894260 rc 0/0 00010000:00010000:0.0:1651529349.419262:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.419263:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153397 00000100:00100000:0.0:1651529349.419268:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+374:41278:x1731746396442176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.419271:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12360 00000100:00100000:1.0:1651529349.419281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.419282:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb93e7b/0xa29a79078f3bae8c lrc: 0/0,0 mode: --/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38cc expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.419286:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966691840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419289:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419293:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.419295:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419298:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419301:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419350:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419355:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.419359:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1692:39030:x1731745946561024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 884us (935us total) trans 30064894261 rc 0/0 00010000:00010000:1.0:1651529349.419362:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419363:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153398 00010000:00010000:1.0:1651529349.419366:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 3/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419368:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561408 00010000:00010000:1.0:1651529349.419374:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 1/0,0 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419374:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561344 00010000:00010000:1.0:1651529349.419376:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3bfeb1 lrc: 0/0,0 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419380:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153403 00000100:00100000:0.0:1651529349.419382:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1693:39030:x1731745946561408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.419386:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.419387:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178196 count 1 00010000:00010000:1.0:1651529349.419389:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.419390:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419392:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 3/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419392:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419396:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 1/0,0 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419396:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 2/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.419398:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3bfeb8 lrc: 0/0,0 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419399:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419400:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419401:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 4/0,1 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419407:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 3/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.419408:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153404 00010000:00010000:0.0:1651529349.419410:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 4/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419411:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1693:39029:x1731745946561344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.419415:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966692160:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.419419:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178195 count 1 00010000:00010000:1.0:1651529349.419424:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419432:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 2/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.419435:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419436:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419436:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 4/0,1 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419444:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 3/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.419445:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.419448:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 4/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419453:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966692224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.419462:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.419483:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966691904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419487:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.419532:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561472 00000100:00100000:0.0:1651529349.419543:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419546:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419557:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153405 00000100:00100000:1.0:1651529349.419559:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1694:39030:x1731745946561472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.419564:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178197 count 1 00010000:00010000:1.0:1651529349.419568:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419573:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 2/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.419579:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419579:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419580:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 4/0,1 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419587:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 3/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 372 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.419590:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 4/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419594:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966692288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.419610:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.419636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.419647:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.419665:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442240 00010000:00010000:0.0:1651529349.419671:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419672:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966691968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.419677:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419679:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12361 00000100:00100000:0.0:1651529349.419681:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41279:x1731746396442240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.419683:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.419685:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419687:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966692096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419688:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 3/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.419690:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419694:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7b29aab/0xa29a79078f3bb260 lrc: 0/0,0 mode: --/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47eb expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419696:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561536 00010000:00010000:0.0:1651529349.419698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419698:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419699:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419702:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 4/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419708:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153406 00000100:00100000:1.0:1651529349.419710:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1695:39030:x1731745946561536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.419715:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529349.419716:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178198 count 1 00010000:00010000:1.0:1651529349.419720:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.419723:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41279:x1731746396442240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.419724:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 2/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 372 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.419726:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12361 00010000:00010000:1.0:1651529349.419727:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419728:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.419729:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 4/0,1 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419744:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 3/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 371 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.419747:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.419748:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 4/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 371 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419751:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419752:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966692352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.419754:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419757:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.419761:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.419788:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.419850:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1696:39030:x1731745946561088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1008us (1304us total) trans 30064894262 rc 0/0 00000100:00100000:0.0:1651529349.419866:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153399 00000100:00100000:1.0:1651529349.419868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.419882:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442304 00010000:00010000:0.0:1651529349.419887:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.419897:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442368 00010000:00010000:0.0:1651529349.419900:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.419908:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12362 00000100:00100000:0.0:1651529349.419910:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41278:x1731746396442304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.419924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.419925:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.419926:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419930:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 3/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419936:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c7a76c/0xa29a79078f3baf3b lrc: 0/0,0 mode: --/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b57 expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419939:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419940:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419941:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419944:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 4/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.419951:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.419965:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396442304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.419968:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12362 00000100:00100000:0.0:1651529349.419973:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442432 00010000:00010000:0.0:1651529349.419976:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 372 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.419981:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12363 00000100:00100000:0.0:1651529349.419983:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41279:x1731746396442368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.419985:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.419986:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419990:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 3/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.419994:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ca3b84/0xa29a79078f3bc258 lrc: 0/0,0 mode: --/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d869e expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.419996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.419998:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419998:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.419999:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.420002:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 4/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420011:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.420018:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+371:41279:x1731746396442368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.420020:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12363 00000100:00100000:1.0:1651529349.420027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.420034:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442496 00010000:00010000:0.0:1651529349.420038:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 5/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 371 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420044:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442560 00010000:00010000:0.0:1651529349.420046:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 5/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420050:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442624 00010000:00010000:0.0:1651529349.420052:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 5/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 373 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420067:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12364 00000100:00100000:0.0:1651529349.420079:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41278:x1731746396442432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.420083:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.420084:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 373 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420088:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 3/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 373 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420093:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063b4b56/0xa29a79078f3b7e34 lrc: 0/0,0 mode: --/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbd6 expref: 373 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420096:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420097:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420098:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420101:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 4/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.420128:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.420132:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.420136:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396442432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.420139:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12364 00000100:00100000:0.0:1651529349.420144:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442688 00010000:00010000:0.0:1651529349.420147:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 5/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 372 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420152:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12365 00000100:00100000:0.0:1651529349.420154:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396442496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.420156:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.420157:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 5/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420161:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 4/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 372 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.420165:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420165:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420166:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420167:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420169:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 4/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420170:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.420171:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420174:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 3/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420174:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.420179:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 1/0,0 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420185:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396442496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.420188:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12365 00010000:00010000:1.0:1651529349.420189:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3bfec6 lrc: 0/0,0 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420192:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12366 00000100:00100000:0.0:1651529349.420194:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+371:41278:x1731746396442560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.420196:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.420197:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 5/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 371 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.420198:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12367 00000100:00100000:1.0:1651529349.420201:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+371:41279:x1731746396442624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.420201:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 4/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 371 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.420205:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.420206:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 5/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 371 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420206:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420206:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420207:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420210:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 4/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 371 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420210:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 4/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420214:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.420215:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.420216:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.420217:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420219:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+371:41278:x1731746396442560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.420220:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 4/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420221:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12366 00010000:00010000:1.0:1651529349.420225:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.420225:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12368 00000100:00100000:0.0:1651529349.420226:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41278:x1731746396442688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.420228:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.420230:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 5/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 370 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.420232:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41279:x1731746396442624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.420235:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12367 00010000:00010000:0.0:1651529349.420236:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 4/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 370 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420240:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420241:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420242:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420244:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 4/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420248:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f873451/0xa29a79078f3b9e01 lrc: 0/0,0 mode: --/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf622 expref: 369 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420248:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.420252:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966692224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.420253:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41278:x1731746396442688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.420255:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420255:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12368 00010000:00010000:1.0:1651529349.420258:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420261:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420264:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420266:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420267:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420269:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420272:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420275:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420309:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1697:39029:x1731745946561344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 898us (1014us total) trans 30064894263 rc 0/0 00000100:00100000:1.0:1651529349.420313:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153404 00000100:00100000:0.0:1651529349.420317:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1696:39029:x1731745946561216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1413us (1675us total) trans 30064894264 rc 0/0 00000100:00100000:1.0:1651529349.420318:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561600 00000100:00100000:0.0:1651529349.420320:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153401 00000100:00100000:0.0:1651529349.420333:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153407 00000100:00100000:0.0:1651529349.420335:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1696:39030:x1731745946561600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.420338:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.420340:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178199 count 1 00010000:00010000:1.0:1651529349.420342:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420344:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420345:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420348:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420349:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 2/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.420352:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420353:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420353:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 4/0,1 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420360:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 3/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 367 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.420364:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 4/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 367 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420368:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.420377:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.420382:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420384:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1697:39030:x1731745946561152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1534us (1788us total) trans 30064894265 rc 0/0 00010000:00010000:0.0:1651529349.420385:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.420386:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420387:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153400 00010000:00010000:0.0:1651529349.420389:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 3/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420394:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420394:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 1/0,0 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420396:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3bfee2 lrc: 0/0,0 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420398:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420401:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420401:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420403:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.420404:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420404:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420407:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 3/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420410:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 1/0,0 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420415:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3bfecd lrc: 0/0,0 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420419:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420421:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.420422:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420425:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 3/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420428:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 1/0,0 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420430:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3bfebf lrc: 0/0,0 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420433:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1697:39030:x1731745946561280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1527us (1770us total) trans 30064894266 rc 0/0 00010000:00010000:0.0:1651529349.420433:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420436:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153402 00010000:00010000:0.0:1651529349.420436:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.420437:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420442:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 3/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420445:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 1/0,0 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420447:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3bb0a7 lrc: 0/0,0 mode: --/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d415b expref: 367 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420448:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3bfed4 lrc: 0/0,0 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420451:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966692288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.420455:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420458:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420458:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000617b5c83/0xa29a79078f3bae2a lrc: 0/0,0 mode: --/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d373d expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.420461:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420461:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966692160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.420464:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420464:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420466:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420467:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420470:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420473:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420476:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420502:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1698:39030:x1731745946561472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 942us (1003us total) trans 30064894267 rc 0/0 00000100:00100000:1.0:1651529349.420505:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153405 00010000:00010000:1.0:1651529349.420511:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420514:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.420515:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420517:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1697:39030:x1731745946561408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1133us (1235us total) trans 30064894268 rc 0/0 00010000:00010000:1.0:1651529349.420518:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 3/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420520:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153403 00010000:00010000:1.0:1651529349.420523:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 1/0,0 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420525:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3bfee9 lrc: 0/0,0 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420527:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420531:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.420532:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420535:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3b97e8 lrc: 0/0,0 mode: --/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddf6 expref: 365 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420535:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 3/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420539:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966692352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.420539:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 1/0,0 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420542:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420542:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3bfedb lrc: 0/0,0 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420547:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420550:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420553:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420556:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420613:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1697:39030:x1731745946561536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 888us (953us total) trans 30064894269 rc 0/0 00000100:00100000:1.0:1651529349.420625:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153406 00010000:00010000:1.0:1651529349.420633:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420636:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.420637:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420642:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 3/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420649:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 1/0,0 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.420654:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3bfef0 lrc: 0/0,0 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.420892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.420902:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561728 00000100:00100000:0.0:1651529349.420902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.420909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.420913:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561664 00000100:00100000:1.0:1651529349.420918:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561856 00000100:00100000:1.0:1651529349.420922:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153408 00000100:00100000:0.0:1651529349.420922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.420924:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1699:39029:x1731745946561728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.420932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.420939:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178201 count 1 00000100:00100000:0.0:1651529349.420941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.420948:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.420949:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.420957:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 2/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.420959:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442752 00010000:00010000:1.0:1651529349.420961:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.420961:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.420962:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 4/0,1 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.420964:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 5/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.420969:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 3/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 365 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.420973:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 4/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.420973:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12369 00000100:00100000:0.0:1651529349.420974:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746396442752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.420978:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.420979:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 5/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.420980:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966692480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.420983:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 4/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.420989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.420990:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420992:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.420993:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 4/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.420997:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561792 00010000:00010000:0.0:1651529349.420998:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.421002:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561984 00000100:00100000:1.0:1651529349.421004:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946561920 00000100:00100000:0.0:1651529349.421005:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746396442752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.421006:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562048 00000100:00100000:0.0:1651529349.421008:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12369 00000100:00100000:1.0:1651529349.421009:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153409 00000100:00100000:1.0:1651529349.421011:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946561664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.421015:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178200 count 1 00000100:00100000:0.0:1651529349.421015:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153410 00000100:00100000:0.0:1651529349.421017:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946561856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.421019:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421023:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 2/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.421023:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178203 count 1 00010000:00010000:1.0:1651529349.421026:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421027:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421027:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 4/0,1 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421027:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421031:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 2/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.421033:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 3/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421034:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421035:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421036:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 4/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421037:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 4/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.421042:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 3/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.421043:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966692544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.421046:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421050:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.421050:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966692608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.421056:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153411 00000100:00100000:1.0:1651529349.421058:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946561792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.421058:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.421062:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178202 count 1 00000100:00100000:0.0:1651529349.421064:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153412 00010000:00010000:1.0:1651529349.421065:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421066:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946561984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.421069:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 2/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.421070:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178205 count 1 00010000:00010000:1.0:1651529349.421072:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421073:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421073:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 4/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421073:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421077:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 2/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 364 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.421079:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 3/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421080:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421081:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421081:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 4/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421082:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 4/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421087:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966692672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.421087:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 3/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 364 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421091:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 364 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421092:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.421094:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966692736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.421098:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153413 00000100:00100000:1.0:1651529349.421100:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946561920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.421100:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.421104:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178204 count 1 00000100:00100000:0.0:1651529349.421106:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153414 00010000:00010000:1.0:1651529349.421107:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421108:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946562048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.421111:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 2/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.421112:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178206 count 1 00010000:00010000:1.0:1651529349.421114:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421115:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421115:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 4/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421115:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421119:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 2/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.421121:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 3/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421122:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421123:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421123:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 4/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421125:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421129:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966692800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.421132:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 364 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.421135:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.421136:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.421140:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966692864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.421146:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.421154:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041b212eb/0xa29a79078f3bacc5 lrc: 0/0,0 mode: --/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d319b expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.421158:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.421161:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421165:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421167:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421170:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421173:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421237:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1704:39030:x1731745946561600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 901us (1134us total) trans 30064894270 rc 0/0 00000100:00100000:0.0:1651529349.421240:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153407 00010000:00010000:1.0:1651529349.421245:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421250:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.421251:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421260:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 3/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421274:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 1/0,0 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421278:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3bfef7 lrc: 0/0,0 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.421395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.421406:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562112 00000100:00100000:0.0:1651529349.421417:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153415 00000100:00100000:0.0:1651529349.421418:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1704:39030:x1731745946562112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.421424:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178207 count 1 00010000:00010000:0.0:1651529349.421428:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421433:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 2/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 363 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421436:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421437:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421437:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 4/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421444:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 3/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 363 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.421448:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 363 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.421452:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.421464:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.421562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.421564:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966692608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.421571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.421578:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.421579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.421586:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442816 00010000:00010000:0.0:1651529349.421591:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 5/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421593:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966692544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.421597:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421601:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442944 00010000:00010000:0.0:1651529349.421604:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.421608:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396442880 00010000:00010000:0.0:1651529349.421611:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 5/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421612:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966692480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.421614:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421615:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12370 00000100:00100000:0.0:1651529349.421617:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41278:x1731746396442816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.421620:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.421621:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12371 00010000:00010000:0.0:1651529349.421621:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 4/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421624:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41278:x1731746396442944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.421625:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 3/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.421628:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.421630:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090410b8e/0xa29a79078f3bb371 lrc: 0/0,0 mode: --/PR res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c98 expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.421631:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 366 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.421634:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421635:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421636:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421637:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 3/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.421639:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 4/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421646:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe039e1/0xa29a79078f3b9c79 lrc: 0/0,0 mode: --/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf010 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.421650:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421651:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.421652:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421657:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 4/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421662:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.421681:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.421699:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41278:x1731746396442944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 74us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.421702:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12371 00000100:00100000:0.0:1651529349.421706:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41278:x1731746396442816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.421709:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12370 00000100:00100000:0.0:1651529349.421715:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12372 00000100:00100000:0.0:1651529349.421717:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+362:41279:x1731746396442880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.421720:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.421722:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 4/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 362 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.421726:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 3/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 362 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.421728:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966692672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.421731:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a25813/0xa29a79078f3b9e63 lrc: 0/0,0 mode: --/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7d4 expref: 362 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.421732:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421743:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421743:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.421744:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421747:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 4/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421750:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421756:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.421760:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421763:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41279:x1731746396442880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.421764:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421765:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12372 00010000:00010000:1.0:1651529349.421767:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421772:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421782:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421785:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.421787:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.421845:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1706:39030:x1731745946561664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 833us (942us total) trans 30064894271 rc 0/0 00000100:00100000:1.0:1651529349.421849:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153409 00010000:00010000:1.0:1651529349.421856:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421860:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.421861:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421864:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 3/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421869:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 1/0,0 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421871:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bff05 lrc: 0/0,0 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421874:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1705:39029:x1731745946561856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 856us (964us total) trans 30064894272 rc 0/0 00010000:00010000:1.0:1651529349.421876:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421878:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153410 00010000:00010000:1.0:1651529349.421879:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.421880:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421882:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 3/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421885:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 1/0,0 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421888:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3bff0c lrc: 0/0,0 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421893:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421896:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421906:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.421909:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.421926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.421949:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.421970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.421980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.421996:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1705:39029:x1731745946561728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1104us total) trans 30064894273 rc 0/0 00000100:00100000:0.0:1651529349.421996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.421999:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153408 00000100:00100000:1.0:1651529349.422010:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966692800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.422018:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966692736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.422023:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422023:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422030:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422031:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966692864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.422033:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.422033:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422034:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422037:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 3/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422040:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.422041:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 1/0,0 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422042:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422044:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfefe lrc: 0/0,0 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.422051:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443008 00010000:00010000:1.0:1651529349.422056:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 4/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422065:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443136 00010000:00010000:0.0:1651529349.422070:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 362 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.422074:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443072 00000100:00100000:0.0:1651529349.422076:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443200 00010000:00010000:1.0:1651529349.422077:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422079:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 364 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.422081:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443264 00000100:00100000:0.0:1651529349.422083:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12373 00010000:00010000:1.0:1651529349.422084:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422085:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41279:x1731746396443008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.422088:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.422089:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12374 00000100:00100000:1.0:1651529349.422090:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41279:x1731746396443136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.422090:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 4/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422093:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.422094:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 3/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422095:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 365 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422099:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 3/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 365 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422099:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e862592f/0xa29a79078f3baea8 lrc: 0/0,0 mode: --/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3920 expref: 365 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422103:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422103:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422104:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000466df4f/0xa29a79078f3b9277 lrc: 0/0,0 mode: --/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ad expref: 364 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422104:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422107:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 4/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422108:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422108:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422109:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422112:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 4/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422134:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.422136:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.422142:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41279:x1731746396443136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.422145:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12374 00000100:00100000:0.0:1651529349.422145:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41279:x1731746396443008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.422148:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12373 00000100:00100000:1.0:1651529349.422150:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12375 00000100:00100000:1.0:1651529349.422152:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746396443072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.422154:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12376 00010000:00010000:1.0:1651529349.422155:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.422155:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746396443200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.422156:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422158:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.422160:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 3/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422160:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422164:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422165:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ae2400/0xa29a79078f3ba237 lrc: 0/0,0 mode: --/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d069f expref: 361 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422168:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422169:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422169:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3ba52b lrc: 0/0,0 mode: --/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d138e expref: 360 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422170:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422173:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 4/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422173:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422173:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422174:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422177:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 4/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422179:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.422184:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+359:41278:x1731746396443072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.422184:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.422194:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12375 00000100:00100000:0.0:1651529349.422202:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41278:x1731746396443200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.422204:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12377 00000100:00100000:0.0:1651529349.422205:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12376 00000100:00100000:1.0:1651529349.422206:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41278:x1731746396443264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.422208:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.422210:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 357 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422212:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422214:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 3/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 357 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422216:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422219:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fe35711/0xa29a79078f3bb59a lrc: 0/0,0 mode: --/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5543 expref: 357 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.422219:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422222:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422222:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422223:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422223:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422226:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 4/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422235:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.422242:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746396443264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.422244:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12377 00010000:00010000:1.0:1651529349.422251:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422261:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422264:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422267:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422282:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1705:39030:x1731745946562048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1331us total) trans 30064894274 rc 0/0 00000100:00100000:0.0:1651529349.422285:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153414 00010000:00010000:0.0:1651529349.422293:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422296:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.422297:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422300:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 3/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422305:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 1/0,0 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.422308:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1705:39030:x1731745946561920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1207us (1367us total) trans 30064894275 rc 0/0 00010000:00010000:0.0:1651529349.422308:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3bff28 lrc: 0/0,0 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.422311:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153413 00010000:00010000:0.0:1651529349.422312:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422315:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.422316:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422318:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422321:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 3/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422322:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422324:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 1/0,0 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422325:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422327:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422327:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bff21 lrc: 0/0,0 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422332:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422335:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422338:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422340:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.422359:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1706:39030:x1731745946561792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1300us (1436us total) trans 30064894276 rc 0/0 00000100:00100000:1.0:1651529349.422371:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153411 00000100:00100000:0.0:1651529349.422376:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1705:39029:x1731745946561984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1309us (1443us total) trans 30064894277 rc 0/0 00010000:00010000:1.0:1651529349.422378:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422379:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153412 00010000:00010000:1.0:1651529349.422381:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.422382:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422385:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 3/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422386:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422390:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 1/0,0 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422392:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422393:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bff13 lrc: 0/0,0 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422395:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422397:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422397:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422400:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.422401:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422403:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 3/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422414:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 1/0,0 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422417:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3bff1a lrc: 0/0,0 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422421:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422424:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.422424:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422427:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 3/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422427:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1705:39030:x1731745946562112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1031us total) trans 30064894278 rc 0/0 00000100:00100000:0.0:1651529349.422429:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153415 00010000:00010000:1.0:1651529349.422430:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 1/0,0 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422433:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3bff2f lrc: 0/0,0 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.422475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.422489:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562176 00000100:00100000:0.0:1651529349.422503:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562240 00000100:00100000:0.0:1651529349.422511:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153416 00000100:00100000:0.0:1651529349.422513:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1706:39030:x1731745946562176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.422518:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178208 count 1 00010000:00010000:0.0:1651529349.422522:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422527:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 2/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 355 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422530:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422531:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422532:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 4/0,1 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422539:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 3/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 355 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422543:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 4/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 355 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422547:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.422551:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153417 00000100:00100000:1.0:1651529349.422554:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1706:39029:x1731745946562240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.422563:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178209 count 1 00010000:00010000:1.0:1651529349.422568:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422580:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.422587:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 2/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.422591:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422591:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422592:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 4/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.422600:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 3/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.422603:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 4/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.422607:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966693056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.422625:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562304 00000100:00100000:1.0:1651529349.422642:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.422647:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153418 00000100:00100000:0.0:1651529349.422649:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1707:39030:x1731745946562304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.422654:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178210 count 1 00010000:00010000:0.0:1651529349.422658:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422663:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 2/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422666:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422667:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422667:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 4/0,1 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.422669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.422674:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 3/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.422678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.422678:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 4/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422682:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966693120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.422688:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562432 00000100:00100000:1.0:1651529349.422703:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562368 00000100:00100000:1.0:1651529349.422710:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153419 00000100:00100000:1.0:1651529349.422712:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0bfd62c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1709:39030:x1731745946562432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.422728:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.422732:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178212 count 1 00000100:00100000:0.0:1651529349.422744:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153420 00010000:00010000:1.0:1651529349.422746:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.422746:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1709:39029:x1731745946562368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.422752:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 2/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.422752:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178211 count 1 00010000:00010000:1.0:1651529349.422755:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422755:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422756:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422756:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 4/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422760:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 2/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.422763:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 3/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422763:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422764:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422764:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 4/0,1 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422767:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 4/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.422771:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966693184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.422771:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 3/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.422780:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.422788:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 4/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422796:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966693248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.422816:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.422836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.422861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.422874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.422894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.422904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.422905:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562496 00000100:00100000:1.0:1651529349.422913:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562560 00000100:00100000:0.0:1651529349.422914:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562624 00000100:00100000:1.0:1651529349.422918:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153421 00000100:00100000:1.0:1651529349.422919:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1712:39030:x1731745946562496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.422925:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153422 00000100:00100000:0.0:1651529349.422927:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1712:39030:x1731745946562560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.422929:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178213 count 1 00002000:00080000:0.0:1651529349.422932:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178214 count 1 00010000:00010000:1.0:1651529349.422934:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422937:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.422939:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 2/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422941:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 2/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422944:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422945:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.422945:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422946:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.422946:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 4/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422946:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 4/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.422952:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 3/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.422953:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 3/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 355 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.422956:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.422957:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.422960:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966693312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.422961:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966693376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.422975:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.422980:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.422981:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443328 00010000:00010000:0.0:1651529349.422986:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 5/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 356 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.422987:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153423 00000100:00100000:1.0:1651529349.422989:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1712:39029:x1731745946562624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.422995:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443392 00010000:00010000:0.0:1651529349.422998:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 5/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 357 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.422999:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178215 count 1 00010000:00010000:1.0:1651529349.423003:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423005:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12378 00000100:00100000:0.0:1651529349.423006:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41279:x1731746396443328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.423007:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 2/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 357 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.423009:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.423010:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423010:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 5/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 357 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423011:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423011:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 4/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423014:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 4/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 357 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423020:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 357 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.423020:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423021:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423021:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423024:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 357 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423024:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 4/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423027:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966693440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.423029:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.423036:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41279:x1731746396443328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.423037:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.423039:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12378 00000100:00100000:0.0:1651529349.423043:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12379 00000100:00100000:1.0:1651529349.423045:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966693056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.423045:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41279:x1731746396443392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.423047:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.423048:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423048:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 4/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423052:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 3/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423057:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab39f13/0xa29a79078f3bb792 lrc: 0/0,0 mode: --/PR res: [0x2b821:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c27 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423060:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423060:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423061:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423064:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 4/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423073:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.423108:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+355:41279:x1731746396443392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.423121:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12379 00010000:00010000:0.0:1651529349.423140:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009121d9d5/0xa29a79078f3b9621 lrc: 0/0,0 mode: --/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6c5 expref: 354 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423144:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966692992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.423148:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423157:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.423159:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423167:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423170:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.423209:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1713:39030:x1731745946562176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 696us (747us total) trans 30064894279 rc 0/0 00000100:00100000:1.0:1651529349.423215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.423229:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153416 00010000:00010000:0.0:1651529349.423249:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423253:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.423254:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423265:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 3/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423267:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423273:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423277:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423283:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 1/0,0 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423286:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 2/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423286:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3bff36 lrc: 0/0,0 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423291:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423294:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.423295:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 2/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423298:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 3/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423301:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 1/0,0 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423304:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3bff3d lrc: 0/0,0 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423312:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443520 00010000:00010000:0.0:1651529349.423317:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 5/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 354 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423322:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443456 00010000:00010000:0.0:1651529349.423324:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 5/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423329:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443584 00000100:00100000:1.0:1651529349.423330:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1713:39029:x1731745946562240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 776us (854us total) trans 30064894280 rc 0/0 00010000:00010000:0.0:1651529349.423331:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 5/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423334:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153417 00000100:00100000:0.0:1651529349.423335:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12380 00000100:00100000:0.0:1651529349.423337:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41279:x1731746396443520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.423339:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.423345:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966693184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.423350:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423354:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 4/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423357:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12381 00010000:00010000:0.0:1651529349.423358:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 3/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423359:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41279:x1731746396443456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.423363:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.423363:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f462635a/0xa29a79078f3bae85 lrc: 0/0,0 mode: --/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a2 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423364:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 5/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 356 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423367:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423367:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423368:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 4/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 355 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423368:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423374:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423374:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 4/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423375:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423376:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423379:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 4/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423384:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.423392:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.423392:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+355:41279:x1731746396443520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.423394:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12380 00000100:00100000:1.0:1651529349.423399:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41279:x1731746396443456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.423400:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12382 00000100:00100000:0.0:1651529349.423401:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41279:x1731746396443584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.423402:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12381 00010000:00010000:0.0:1651529349.423404:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.423405:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 5/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423409:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 4/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423414:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423414:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423414:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423415:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423418:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 4/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423419:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423422:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.423424:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423429:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423441:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41279:x1731746396443584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.423444:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12382 00010000:00010000:0.0:1651529349.423460:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000122debe3/0xa29a79078f3badc8 lrc: 0/0,0 mode: --/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3610 expref: 352 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423465:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966693120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.423468:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423471:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423474:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423477:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423480:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423481:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0bfd62c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1713:39030:x1731745946562432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 768us (812us total) trans 30064894281 rc 0/0 00000100:00100000:1.0:1651529349.423484:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153419 00010000:00010000:1.0:1651529349.423492:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423496:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.423497:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423500:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 3/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423508:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 1/0,0 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423511:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3bff4b lrc: 0/0,0 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423516:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423519:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.423519:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423520:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1713:39030:x1731745946562304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 870us (924us total) trans 30064894282 rc 0/0 00010000:00010000:1.0:1651529349.423522:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 3/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423523:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153418 00010000:00010000:1.0:1651529349.423526:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 1/0,0 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423528:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3bff44 lrc: 0/0,0 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423546:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faec463a/0xa29a79078f3bbb27 lrc: 0/0,0 mode: --/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69f6 expref: 351 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423553:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966693248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.423556:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423560:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423562:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423565:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423568:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.423596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.423621:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1713:39029:x1731745946562368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 874us (943us total) trans 30064894283 rc 0/0 00000100:00100000:0.0:1651529349.423624:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153420 00000100:00100000:0.0:1651529349.423629:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562688 00000100:00100000:0.0:1651529349.423639:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153424 00000100:00100000:0.0:1651529349.423641:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1713:39030:x1731745946562688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.423645:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178216 count 1 00010000:00010000:0.0:1651529349.423650:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.423665:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 2/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 350 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.423668:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423669:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.423669:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 4/0,1 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423676:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 3/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 350 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.423680:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 4/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.423684:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966693504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.423691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.423693:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.423699:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423702:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.423703:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423706:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 3/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423720:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 1/0,0 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423723:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3bff52 lrc: 0/0,0 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423741:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966693312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.423745:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423752:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443648 00010000:00010000:0.0:1651529349.423756:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 351 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423759:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966693376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.423764:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423771:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966693440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.423774:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423784:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443712 00010000:00010000:0.0:1651529349.423788:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 352 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423790:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443776 00000100:00100000:0.0:1651529349.423793:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12383 00000100:00100000:0.0:1651529349.423795:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41278:x1731746396443648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.423797:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423797:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.423799:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.423830:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12384 00000100:00100000:1.0:1651529349.423832:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41278:x1731746396443712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.423835:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.423837:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423841:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 3/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423845:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 3/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423847:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e77a2a0e/0xa29a79078f3b9adc lrc: 0/0,0 mode: --/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9e2 expref: 353 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423851:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423852:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423853:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423858:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 4/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423864:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a729385/0xa29a79078f3bc22e lrc: 0/0,0 mode: --/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85f6 expref: 352 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423869:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.423878:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.423879:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+351:41278:x1731746396443712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.423879:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.423882:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12384 00010000:00010000:0.0:1651529349.423887:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423889:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12385 00010000:00010000:0.0:1651529349.423890:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 4/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423891:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396443776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.423895:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.423898:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.423898:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.423904:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423911:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a73abe/0xa29a79078f3ba173 lrc: 0/0,0 mode: --/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d037a expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.423915:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.423915:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.423915:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41278:x1731746396443648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 120us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.423916:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423919:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 4/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.423919:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12383 00010000:00010000:0.0:1651529349.423926:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423929:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.423930:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.423933:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423936:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746396443776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (245us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.423936:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.423938:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12385 00010000:00010000:1.0:1651529349.423946:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423949:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423959:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.423963:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424010:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1715:39030:x1731745946562560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1082us (1157us total) trans 30064894284 rc 0/0 00000100:00100000:0.0:1651529349.424014:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153422 00000100:00100000:1.0:1651529349.424016:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1715:39029:x1731745946562624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1026us (1141us total) trans 30064894285 rc 0/0 00000100:00100000:1.0:1651529349.424019:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153423 00010000:00010000:0.0:1651529349.424021:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424025:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.424026:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424027:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424029:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 3/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424031:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.424032:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424033:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 1/0,0 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424036:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3bff60 lrc: 0/0,0 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424037:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 3/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424042:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 1/0,0 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424045:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3bff67 lrc: 0/0,0 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424051:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424054:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424057:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424059:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.424089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.424111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.424112:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1714:39030:x1731745946562496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1277us total) trans 30064894286 rc 0/0 00000100:00100000:0.0:1651529349.424123:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.424128:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153421 00000100:00100000:1.0:1651529349.424134:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562752 00000100:00100000:0.0:1651529349.424154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.424165:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562816 00000100:00100000:1.0:1651529349.424166:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562944 00000100:00100000:0.0:1651529349.424172:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946562880 00000100:00100000:1.0:1651529349.424174:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153425 00000100:00100000:1.0:1651529349.424176:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1717:39029:x1731745946562752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.424180:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153426 00000100:00100000:0.0:1651529349.424182:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1717:39030:x1731745946562816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.424186:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178217 count 1 00002000:00080000:0.0:1651529349.424188:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178218 count 1 00010000:00010000:1.0:1651529349.424191:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424192:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424196:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 2/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424197:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 2/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.424199:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424200:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424201:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 4/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424208:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 3/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.424211:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424216:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966693568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.424216:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424217:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424217:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 4/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424226:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 3/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.424232:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.424236:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424239:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153427 00000100:00100000:0.0:1651529349.424240:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966693632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.424241:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1717:39030:x1731745946562944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.424246:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178220 count 1 00010000:00010000:1.0:1651529349.424249:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424250:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.424256:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 2/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.424257:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153428 00010000:00010000:1.0:1651529349.424259:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.424259:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1717:39030:x1731745946562880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.424260:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424261:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 4/0,1 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.424263:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178219 count 1 00010000:00010000:1.0:1651529349.424267:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 3/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424267:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424270:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 4/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424274:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966693696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.424274:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 2/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424277:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424277:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424278:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 4/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.424282:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.424284:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424287:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424289:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424291:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966693760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.424292:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.424293:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424296:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 3/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424303:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 1/0,0 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424306:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3bff59 lrc: 0/0,0 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424334:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.424335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.424341:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443840 00010000:00010000:0.0:1651529349.424346:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 5/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 348 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.424357:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12386 00000100:00100000:0.0:1651529349.424359:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41279:x1731746396443840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.424362:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.424364:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 5/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 348 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424367:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.424370:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 4/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 348 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424376:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424376:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424377:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424380:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 4/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424385:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.424395:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41279:x1731746396443840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.424398:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12386 00000100:00100000:0.0:1651529349.424406:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563072 00000100:00100000:0.0:1651529349.424413:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563008 00000100:00100000:0.0:1651529349.424417:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563136 00000100:00100000:0.0:1651529349.424420:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153429 00000100:00100000:0.0:1651529349.424422:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1720:39030:x1731745946563072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.424423:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153430 00000100:00100000:1.0:1651529349.424426:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1720:39029:x1731745946563008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.424427:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178222 count 1 00010000:00010000:0.0:1651529349.424430:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.424434:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178221 count 1 00010000:00010000:0.0:1651529349.424435:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 2/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.424439:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424447:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 2/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.424450:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424451:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424452:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 4/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424455:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424456:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424457:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 4/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424459:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 3/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.424463:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424465:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 3/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 347 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.424468:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966693824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.424469:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.424473:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966693888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.424477:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.424482:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.424484:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153431 00000100:00100000:1.0:1651529349.424486:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1720:39029:x1731745946563136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.424490:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178223 count 1 00010000:00010000:0.0:1651529349.424490:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb7e691/0xa29a79078f3bb73e lrc: 0/0,0 mode: --/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b32 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424493:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424494:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966693504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.424498:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 2/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 346 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424498:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424501:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424501:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424501:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424502:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 4/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424504:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424508:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 3/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 346 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.424509:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424512:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 346 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424512:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.424516:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966693952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.424522:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.424551:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1721:39030:x1731745946562688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (954us total) trans 30064894287 rc 0/0 00000100:00100000:0.0:1651529349.424554:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153424 00010000:00010000:0.0:1651529349.424561:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424565:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.424566:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424569:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 3/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424573:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 1/0,0 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424576:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3bff6e lrc: 0/0,0 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.424722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.424774:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966693568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.424778:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.424790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.424794:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966693696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.424797:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.424815:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.424825:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443968 00010000:00010000:1.0:1651529349.424835:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 4/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.424840:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966693632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.424842:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444032 00010000:00010000:0.0:1651529349.424844:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424845:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 348 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424849:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396443904 00010000:00010000:1.0:1651529349.424851:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 349 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.424852:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966693760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.424855:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444096 00010000:00010000:0.0:1651529349.424855:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424857:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424861:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12387 00000100:00100000:1.0:1651529349.424863:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396443968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.424864:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12388 00000100:00100000:0.0:1651529349.424866:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396444032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.424868:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.424869:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.424871:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 4/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424871:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424874:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 3/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424877:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 3/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424886:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dd11005/0xa29a79078f3ba3aa lrc: 0/0,0 mode: --/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ca3 expref: 350 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424891:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424891:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424892:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.424895:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 4/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424907:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063447cdd/0xa29a79078f3bc300 lrc: 0/0,0 mode: --/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8945 expref: 349 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.424912:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424913:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424920:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.424936:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746396443968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.424939:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12387 00010000:00010000:0.0:1651529349.424940:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424944:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 4/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.424945:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12389 00000100:00100000:1.0:1651529349.424947:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+347:41279:x1731746396443904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.424950:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.424950:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.424951:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424955:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 3/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.424958:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+347:41278:x1731746396444032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 92us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.424961:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a4f08d/0xa29a79078f3bb474 lrc: 0/0,0 mode: --/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ce expref: 347 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.424961:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12388 00010000:00010000:1.0:1651529349.424965:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424965:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.424966:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424968:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12390 00010000:00010000:1.0:1651529349.424969:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 4/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.424969:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396444096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.424972:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.424974:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.424976:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.424978:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424982:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396443904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.424983:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0502f49/0xa29a79078f3b9af1 lrc: 0/0,0 mode: --/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea28 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.424985:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12389 00010000:00010000:0.0:1651529349.424986:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424987:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.424988:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424990:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 4/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.424999:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.425000:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966693824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.425004:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425004:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396444096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.425007:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12390 00010000:00010000:1.0:1651529349.425009:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425012:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425013:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425015:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425016:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425019:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425019:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425022:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425067:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1722:39029:x1731745946562752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 890us (1001us total) trans 30064894288 rc 0/0 00000100:00100000:0.0:1651529349.425069:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1722:39030:x1731745946562880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 809us (914us total) trans 30064894289 rc 0/0 00000100:00100000:1.0:1651529349.425070:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153425 00000100:00100000:0.0:1651529349.425072:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153428 00000100:00100000:1.0:1651529349.425076:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563200 00010000:00010000:0.0:1651529349.425079:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425083:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425087:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153432 00000100:00100000:1.0:1651529349.425089:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1721:39030:x1731745946563200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.425093:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.425094:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178224 count 1 00010000:00010000:0.0:1651529349.425096:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425099:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425103:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 2/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 342 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425106:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425107:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425108:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 4/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425114:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 3/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 342 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425118:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 4/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 342 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.425125:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966694016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.425130:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1722:39030:x1731745946562816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (1041us total) trans 30064894290 rc 0/0 00000100:00100000:0.0:1651529349.425133:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153426 00000100:00100000:1.0:1651529349.425134:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.425140:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425140:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425143:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.425143:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.425144:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425144:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425147:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 3/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425147:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 3/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425152:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 1/0,0 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425152:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 1/0,0 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425155:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3bff8a lrc: 0/0,0 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425155:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3bff75 lrc: 0/0,0 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425159:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425161:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.425162:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425165:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 3/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425169:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 1/0,0 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425171:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3bff7c lrc: 0/0,0 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425177:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425180:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425183:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425193:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.425216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.425226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.425242:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1722:39030:x1731745946562944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1000us (1118us total) trans 30064894291 rc 0/0 00000100:00100000:1.0:1651529349.425245:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153427 00000100:00100000:1.0:1651529349.425255:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966693952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.425266:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425280:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966693888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.425284:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425287:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444160 00000100:00100000:0.0:1651529349.425292:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444224 00010000:00010000:1.0:1651529349.425294:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 344 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425296:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 344 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425302:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444288 00000100:00100000:1.0:1651529349.425303:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12391 00010000:00010000:0.0:1651529349.425304:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.425305:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396444160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.425308:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.425309:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425309:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12392 00000100:00100000:0.0:1651529349.425311:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41278:x1731746396444224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.425314:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.425315:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 3/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425315:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425319:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 3/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.425323:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d77b1ca/0xa29a79078f3ba5d3 lrc: 0/0,0 mode: --/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16a5 expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425324:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006861bf8d/0xa29a79078f3bba01 lrc: 0/0,0 mode: --/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65dc expref: 345 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.425330:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425331:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425332:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425335:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 4/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425342:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.425346:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425346:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425347:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425353:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 4/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425357:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396444160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.425360:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12391 00010000:00010000:0.0:1651529349.425365:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.425366:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12393 00000100:00100000:1.0:1651529349.425368:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+342:41279:x1731746396444288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.425370:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.425372:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 342 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425373:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+342:41278:x1731746396444224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.425376:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 3/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 342 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425376:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12392 00010000:00010000:1.0:1651529349.425381:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009060d9f6/0xa29a79078f3baa48 lrc: 0/0,0 mode: --/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2799 expref: 341 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425383:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425385:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425385:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425386:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425387:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.425388:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425389:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 4/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425391:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 3/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425395:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.425395:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 1/0,0 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425398:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3bff83 lrc: 0/0,0 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425401:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+340:41279:x1731746396444288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.425403:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12393 00010000:00010000:0.0:1651529349.425404:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425407:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425409:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425410:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425412:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425413:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425418:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425427:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425474:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1723:39029:x1731745946563008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1048us (1124us total) trans 30064894292 rc 0/0 00000100:00100000:1.0:1651529349.425478:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153430 00010000:00010000:1.0:1651529349.425485:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425489:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.425490:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425493:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 3/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425496:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1722:39030:x1731745946563072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1072us (1160us total) trans 30064894293 rc 0/0 00010000:00010000:1.0:1651529349.425497:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 1/0,0 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425499:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153429 00010000:00010000:1.0:1651529349.425500:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3bff91 lrc: 0/0,0 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425504:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425507:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.425508:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425511:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 3/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425514:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 1/0,0 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425516:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3bff98 lrc: 0/0,0 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425521:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425524:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.425537:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425540:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.425575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.425597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.425606:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1722:39029:x1731745946563136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1107us (1226us total) trans 30064894294 rc 0/0 00000100:00100000:1.0:1651529349.425610:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153431 00000100:00100000:1.0:1651529349.425615:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563328 00000100:00100000:0.0:1651529349.425631:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.425643:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563264 00000100:00100000:0.0:1651529349.425648:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563456 00000100:00100000:1.0:1651529349.425651:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563392 00000100:00100000:1.0:1651529349.425657:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153433 00000100:00100000:1.0:1651529349.425658:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1725:39030:x1731745946563328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.425668:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178226 count 1 00010000:00010000:1.0:1651529349.425673:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425676:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153434 00010000:00010000:1.0:1651529349.425678:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 2/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.425678:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1725:39029:x1731745946563264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.425681:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425681:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425682:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 4/0,1 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.425684:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178225 count 1 00010000:00010000:0.0:1651529349.425688:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425689:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 3/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425692:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 4/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425694:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 2/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.425696:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966694080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.425697:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425697:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425707:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 4/0,1 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.425711:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.425719:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153435 00000100:00100000:1.0:1651529349.425721:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1725:39029:x1731745946563392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.425721:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 3/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.425725:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178227 count 1 00010000:00010000:0.0:1651529349.425725:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 4/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.425729:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425729:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966694144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.425742:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 2/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425746:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425746:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425747:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 4/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425754:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 3/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425757:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425757:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.425761:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966694208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.425762:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425766:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529349.425769:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.425775:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153436 00000100:00100000:1.0:1651529349.425777:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1725:39030:x1731745946563456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.425782:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178228 count 1 00010000:00010000:1.0:1651529349.425785:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425788:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425792:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 3/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425797:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 1/0,0 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425800:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3bff9f lrc: 0/0,0 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.425818:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 2/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425821:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425822:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.425822:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 4/0,1 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.425826:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444352 00010000:00010000:1.0:1651529349.425829:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 3/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 339 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.425833:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 4/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.425837:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966694272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.425838:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 5/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.425844:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.425849:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12394 00000100:00100000:0.0:1651529349.425851:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+340:41278:x1731746396444352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.425854:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.425855:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 5/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.425859:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 4/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.425863:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966694016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.425865:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029bbe14c/0xa29a79078f3b992a lrc: 0/0,0 mode: --/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2cd expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.425867:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425868:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425869:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425870:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425873:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 4/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425881:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.425888:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746396444352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.425891:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12394 00000100:00100000:1.0:1651529349.425893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.425899:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563584 00000100:00100000:1.0:1651529349.425908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.425915:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563520 00000100:00100000:0.0:1651529349.425919:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153437 00000100:00100000:0.0:1651529349.425920:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1727:39030:x1731745946563584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.425925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.425925:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178230 count 1 00010000:00010000:0.0:1651529349.425929:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425934:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 2/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.425937:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425937:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425938:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 4/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425945:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 3/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.425948:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 338 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.425952:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966694336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.425961:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.425967:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563648 00000100:00100000:0.0:1651529349.425972:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153438 00000100:00100000:0.0:1651529349.425973:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1728:39029:x1731745946563520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.425977:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178229 count 1 00010000:00010000:0.0:1651529349.425988:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.425993:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 2/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 338 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.425996:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425996:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.425997:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 4/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426003:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 3/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 338 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.426016:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153439 00000100:00100000:1.0:1651529349.426018:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1728:39030:x1731745946563648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.426023:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 4/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 338 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426028:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966694400:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.426034:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178231 count 1 00010000:00010000:1.0:1651529349.426039:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426042:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.426050:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 2/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 338 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.426053:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426054:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426055:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 4/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426064:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 3/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 338 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.426080:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 338 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.426085:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966694464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.426101:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.426109:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426112:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426115:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426134:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426183:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1729:39030:x1731745946563200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1093us (1462us total) trans 30064894295 rc 0/0 00000100:00100000:1.0:1651529349.426186:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153432 00010000:00010000:1.0:1651529349.426194:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426198:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.426206:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426210:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 3/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426215:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 1/0,0 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426218:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3bffa6 lrc: 0/0,0 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.426366:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563712 00000100:00100000:0.0:1651529349.426367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.426374:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153440 00000100:00100000:0.0:1651529349.426374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.426376:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1729:39030:x1731745946563712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.426383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.426388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.426393:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178232 count 1 00000100:00100000:0.0:1651529349.426395:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.426398:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426403:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966694144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.426405:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 2/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 338 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.426408:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426409:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426410:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426411:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 4/0,1 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426422:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 3/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 338 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.426434:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 4/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 338 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426437:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966694336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.426438:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966694528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.426441:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426447:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444416 00000100:00100000:1.0:1651529349.426453:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.426458:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 5/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.426462:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966694208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.426464:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444544 00010000:00010000:1.0:1651529349.426466:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426467:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 4/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426471:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444672 00000100:00100000:1.0:1651529349.426473:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966694272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.426473:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 341 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426476:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426476:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444480 00010000:00010000:0.0:1651529349.426478:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 342 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426482:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444608 00010000:00010000:0.0:1651529349.426484:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 4/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.426488:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12395 00000100:00100000:1.0:1651529349.426491:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396444416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.426491:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12396 00000100:00100000:0.0:1651529349.426493:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396444544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.426496:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.426499:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 5/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426503:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 4/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426509:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426510:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426511:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426514:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 4/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426517:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.426519:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 4/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.426523:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 3/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.426529:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a17281/0xa29a79078f3ba8c0 lrc: 0/0,0 mode: --/PR res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d226e expref: 343 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426532:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.426533:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426534:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426535:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426538:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 4/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426540:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+342:41279:x1731746396444416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.426543:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12395 00010000:00010000:0.0:1651529349.426545:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.426549:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12397 00000100:00100000:1.0:1651529349.426551:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41279:x1731746396444672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.426552:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41279:x1731746396444544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.426553:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.426555:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 341 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426555:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12396 00010000:00010000:1.0:1651529349.426559:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 3/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426564:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3d56af5/0xa29a79078f3ba5fd lrc: 0/0,0 mode: --/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1731 expref: 340 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426565:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12398 00010000:00010000:1.0:1651529349.426567:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.426567:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746396444480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.426568:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426569:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426570:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.426571:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426572:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 4/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426577:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 3/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426582:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.426588:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41279:x1731746396444672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.426590:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3345c08/0xa29a79078f3b9dfa lrc: 0/0,0 mode: --/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf606 expref: 339 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.426591:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12397 00010000:00010000:0.0:1651529349.426594:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426594:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426595:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426596:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12399 00000100:00100000:1.0:1651529349.426597:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+337:41278:x1731746396444608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.426598:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 4/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426600:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.426601:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 4/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 337 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.426607:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.426611:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 3/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 337 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426613:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+337:41278:x1731746396444480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.426616:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12398 00010000:00010000:1.0:1651529349.426617:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063ba0db9/0xa29a79078f3bb221 lrc: 0/0,0 mode: --/PR res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46fd expref: 337 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426620:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426621:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426622:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426624:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 4/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426624:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426627:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426630:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.426630:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426635:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+335:41278:x1731746396444608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.426636:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426638:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12399 00010000:00010000:1.0:1651529349.426644:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426648:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426651:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426653:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426697:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1731:39030:x1731745946563456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 918us (1099us total) trans 30064894297 rc 0/0 00000100:00100000:1.0:1651529349.426700:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153436 00000100:00100000:0.0:1651529349.426701:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1731:39030:x1731745946563584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 779us (807us total) trans 30064894296 rc 0/0 00000100:00100000:0.0:1651529349.426704:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153437 00010000:00010000:1.0:1651529349.426707:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426710:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000528fa145 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.426711:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426712:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426714:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 3/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426715:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.426716:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426719:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 1/0,0 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426719:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 3/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426721:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3bffc9 lrc: 0/0,0 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426724:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 1/0,0 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426727:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426727:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3bffc2 lrc: 0/0,0 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426730:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426742:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426744:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426746:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426747:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426749:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426752:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426791:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1731:39029:x1731745946563392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1070us (1160us total) trans 30064894298 rc 0/0 00000100:00100000:0.0:1651529349.426793:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1731:39029:x1731745946563264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1114us (1231us total) trans 30064894299 rc 0/0 00000100:00100000:1.0:1651529349.426794:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153435 00000100:00100000:0.0:1651529349.426796:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153434 00010000:00010000:1.0:1651529349.426801:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426824:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.426825:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426828:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 3/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426832:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 1/0,0 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426835:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3bffbb lrc: 0/0,0 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.426839:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426848:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.426849:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426852:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 3/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426860:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 1/0,0 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426863:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3bffb4 lrc: 0/0,0 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.426873:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966694464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.426877:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.426885:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444736 00010000:00010000:1.0:1651529349.426896:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 5/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426917:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966694400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.426922:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.426929:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444800 00010000:00010000:0.0:1651529349.426934:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 336 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.426940:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12400 00000100:00100000:0.0:1651529349.426942:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41278:x1731746396444736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.426943:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12401 00000100:00100000:1.0:1651529349.426945:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41278:x1731746396444800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.426945:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.426946:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 4/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 336 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426949:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.426951:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 336 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426955:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 3/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 336 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426962:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090b0e31c/0xa29a79078f3b84bd lrc: 0/0,0 mode: --/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf17 expref: 336 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426968:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.426969:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426969:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 3/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426970:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.426975:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 4/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426975:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d80700c/0xa29a79078f3bb3b7 lrc: 0/0,0 mode: --/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4da2 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.426986:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.426988:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426989:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.426990:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.426993:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 4/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.427000:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746396444800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.427004:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12401 00010000:00010000:0.0:1651529349.427005:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.427011:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427013:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+333:41278:x1731746396444736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (176us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.427015:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427016:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12400 00010000:00010000:1.0:1651529349.427018:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427021:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427023:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427027:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427036:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427041:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.427080:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1730:39030:x1731745946563648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1061us (1154us total) trans 30064894300 rc 0/0 00000100:00100000:1.0:1651529349.427085:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153439 00010000:00010000:1.0:1651529349.427095:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427099:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.427100:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427103:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 3/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427108:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 1/0,0 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427110:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3bffd7 lrc: 0/0,0 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427115:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427116:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1730:39029:x1731745946563520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1141us (1207us total) trans 30064894301 rc 0/0 00010000:00010000:1.0:1651529349.427118:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.427118:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427119:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153438 00010000:00010000:1.0:1651529349.427124:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 3/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427127:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 1/0,0 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427129:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3bffd0 lrc: 0/0,0 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427139:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff36fde/0xa29a79078f3b9a81 lrc: 0/0,0 mode: --/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7c0 expref: 332 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427143:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966694080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.427149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.427156:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427160:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427163:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427171:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427174:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.427199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.427218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.427226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.427235:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563776 00000100:00100000:0.0:1651529349.427242:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563840 00000100:00100000:0.0:1651529349.427247:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563904 00000100:00100000:0.0:1651529349.427256:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946563968 00000100:00100000:1.0:1651529349.427257:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1734:39030:x1731745946563328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1597us (1728us total) trans 30064894302 rc 0/0 00000100:00100000:1.0:1651529349.427264:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153433 00000100:00100000:0.0:1651529349.427267:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153441 00000100:00100000:0.0:1651529349.427268:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1733:39029:x1731745946563776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.427271:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153442 00000100:00100000:1.0:1651529349.427272:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1733:39030:x1731745946563840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.427274:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178233 count 1 00002000:00080000:1.0:1651529349.427278:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178234 count 1 00010000:00010000:0.0:1651529349.427278:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427282:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427283:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 2/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427286:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427286:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427287:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 2/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427287:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 4/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427290:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427291:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427292:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 4/0,1 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427294:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 3/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.427298:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 3/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427298:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 4/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 331 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.427302:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 4/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 331 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.427302:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966694592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.427306:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966694656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.427311:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.427315:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.427317:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444864 00000100:00100000:1.0:1651529349.427322:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153443 00010000:00010000:0.0:1651529349.427322:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 5/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 332 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427324:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1733:39029:x1731745946563904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.427329:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178235 count 1 00000100:00100000:0.0:1651529349.427329:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12402 00010000:00010000:1.0:1651529349.427332:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427336:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 2/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.427339:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427339:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427340:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 4/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427346:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 3/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 332 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.427347:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41278:x1731746396444864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.427349:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 332 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.427351:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.427352:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 5/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 332 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427353:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966694720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.427356:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 4/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 332 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427359:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.427362:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427362:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427363:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.427366:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153444 00000100:00100000:1.0:1651529349.427367:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1733:39030:x1731745946563968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.427372:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178236 count 1 00010000:00010000:1.0:1651529349.427375:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427377:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 4/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427381:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 2/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 332 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427383:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.427384:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427384:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427385:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 4/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427390:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 3/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 332 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.427390:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41278:x1731746396444864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.427393:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12402 00010000:00010000:1.0:1651529349.427394:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 332 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427397:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966694784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.427404:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.427409:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.427412:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.427413:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427416:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 3/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427423:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 1/0,0 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427426:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3bffad lrc: 0/0,0 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.427442:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564096 00000100:00100000:1.0:1651529349.427454:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564032 00000100:00100000:1.0:1651529349.427457:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153445 00000100:00100000:1.0:1651529349.427459:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1735:39030:x1731745946564096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.427463:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178238 count 1 00010000:00010000:1.0:1651529349.427467:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427475:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153446 00000100:00100000:0.0:1651529349.427477:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946564032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.427483:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178237 count 1 00010000:00010000:0.0:1651529349.427487:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427492:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 2/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427495:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427496:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427496:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 4/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427503:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 3/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.427506:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 2/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.427511:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427512:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.427513:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 4/0,1 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427524:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 3/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 331 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.427527:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 4/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 331 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.427530:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 331 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427535:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966694912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.427545:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.427547:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966694848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.427557:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.427558:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000169d74b/0xa29a79078f3b875d lrc: 0/0,0 mode: --/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc06e expref: 331 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427562:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966694528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.427565:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427569:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427571:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.427574:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.427577:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427605:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564160 00000100:00100000:0.0:1651529349.427613:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153447 00000100:00100000:0.0:1651529349.427615:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1737:39030:x1731745946564160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.427620:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178239 count 1 00010000:00010000:0.0:1651529349.427624:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427628:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 2/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 330 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427631:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427632:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.427633:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 4/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.427643:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1737:39030:x1731745946563712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1265us (1311us total) trans 30064894303 rc 0/0 00000100:00100000:1.0:1651529349.427646:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153440 00010000:00010000:0.0:1651529349.427646:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 3/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 330 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.427650:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 330 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.427664:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966694976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.427678:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.427683:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427686:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.427688:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427690:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 3/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427695:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 1/0,0 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.427698:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3bffde lrc: 0/0,0 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.427840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.427880:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966694720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.427885:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.427912:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966694784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.427913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.427915:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.427922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.427923:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444992 00000100:00100000:0.0:1651529349.427927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.427928:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 331 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427945:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445120 00010000:00010000:1.0:1651529349.427948:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 332 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427953:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396444928 00000100:00100000:0.0:1651529349.427953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.427960:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564224 00010000:00010000:1.0:1651529349.427974:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 5/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.427986:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153448 00000100:00100000:0.0:1651529349.427988:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a920734 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1737:39030:x1731745946564224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.427989:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445056 00010000:00010000:1.0:1651529349.427993:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 5/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 334 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.427997:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445184 00010000:00010000:1.0:1651529349.428000:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 5/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.428001:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178240 count 1 00010000:00010000:0.0:1651529349.428005:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.428007:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12403 00000100:00100000:1.0:1651529349.428008:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+335:41278:x1731746396444992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.428010:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 2/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 335 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.428011:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.428013:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428013:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428014:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428015:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 4/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428016:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 3/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428022:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a449205/0xa29a79078f3b9c95 lrc: 0/0,0 mode: --/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf080 expref: 335 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428022:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 3/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 335 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.428025:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 334 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428026:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428026:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428027:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428029:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.428031:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 4/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428039:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.428042:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.428051:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746396444992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.428056:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12403 00000100:00100000:0.0:1651529349.428063:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966694592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.428067:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12404 00010000:00010000:0.0:1651529349.428067:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428079:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12405 00000100:00100000:1.0:1651529349.428080:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+333:41278:x1731746396445120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.428081:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+333:41278:x1731746396444928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.428083:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.428084:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428086:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.428087:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 4/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428088:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 3/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428091:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 3/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428094:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1224db6/0xa29a79078f3bb36a lrc: 0/0,0 mode: --/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c83 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428097:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2a6004/0xa29a79078f3b9c72 lrc: 0/0,0 mode: --/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceff4 expref: 333 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428098:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428098:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428099:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428100:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428101:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428101:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428102:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 4/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428104:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 4/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428109:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.428111:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.428116:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+331:41278:x1731746396445120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.428118:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+331:41278:x1731746396444928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.428119:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12404 00000100:00100000:0.0:1651529349.428121:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12405 00000100:00100000:1.0:1651529349.428123:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12406 00000100:00100000:1.0:1651529349.428125:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746396445056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.428126:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12407 00010000:00010000:1.0:1651529349.428127:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.428128:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746396445184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.428129:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 5/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428131:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.428132:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 5/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428138:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 4/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428140:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 4/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428142:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428143:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428144:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428145:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428145:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428146:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428147:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 4/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428149:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 4/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428151:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.428153:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.428155:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746396445184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.428157:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12407 00000100:00100000:1.0:1651529349.428160:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41278:x1731746396445056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.428162:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12406 00010000:00010000:0.0:1651529349.428164:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428167:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428169:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428170:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428172:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428173:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428175:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428178:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428221:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1739:39029:x1731745946563776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 952us (1071us total) trans 30064894304 rc 0/0 00000100:00100000:0.0:1651529349.428224:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153441 00000100:00100000:1.0:1651529349.428232:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1738:39030:x1731745946563968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 864us (1006us total) trans 30064894305 rc 0/0 00000100:00100000:1.0:1651529349.428235:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153444 00010000:00010000:1.0:1651529349.428243:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428247:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428262:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428266:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 3/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428271:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 1/0,0 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.428274:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3bffe5 lrc: 0/0,0 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428286:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.428289:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428290:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428302:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 3/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428316:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 1/0,0 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428324:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966694848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.428328:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428335:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966694976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.428338:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428344:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445248 00010000:00010000:0.0:1651529349.428349:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 328 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428351:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3bfffa lrc: 0/0,0 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428355:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445312 00010000:00010000:0.0:1651529349.428358:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428361:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428363:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12408 00010000:00010000:1.0:1651529349.428364:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428364:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746396445248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.428367:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.428369:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428369:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428372:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 3/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428374:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428377:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac97712/0xa29a79078f3ba222 lrc: 0/0,0 mode: --/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d062f expref: 329 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428406:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428407:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428408:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428411:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 4/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428417:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.428426:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1738:39029:x1731745946563904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1101us (1208us total) trans 30064894306 rc 0/0 00000100:00100000:1.0:1651529349.428430:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153443 00000100:00100000:0.0:1651529349.428432:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41278:x1731746396445248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.428434:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12408 00000100:00100000:1.0:1651529349.428448:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12409 00000100:00100000:1.0:1651529349.428450:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41278:x1731746396445312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.428453:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.428455:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 327 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428455:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428458:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428459:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 3/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 327 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428460:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428463:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 3/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428465:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078468dde/0xa29a79078f3b919e lrc: 0/0,0 mode: --/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ae expref: 327 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428467:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 1/0,0 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428470:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428470:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3bfff3 lrc: 0/0,0 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428473:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 4/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428476:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428479:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428482:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.428488:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.428489:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+326:41278:x1731746396445312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.428491:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.428492:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12409 00010000:00010000:1.0:1651529349.428515:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030dd38e5/0xa29a79078f3bac63 lrc: 0/0,0 mode: --/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3013 expref: 325 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.428522:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966694912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.428529:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428532:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428535:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428538:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428541:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428549:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1738:39029:x1731745946564032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1071us (1112us total) trans 30064894307 rc 0/0 00000100:00100000:0.0:1651529349.428552:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153446 00010000:00010000:0.0:1651529349.428560:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428563:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428568:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428571:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.428594:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1739:39030:x1731745946564096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1134us (1183us total) trans 30064894308 rc 0/0 00000100:00100000:1.0:1651529349.428598:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153445 00010000:00010000:1.0:1651529349.428606:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428609:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428610:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428613:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 3/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428618:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 1/0,0 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428619:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1738:39030:x1731745946564160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1003us (1047us total) trans 30064894309 rc 0/0 00010000:00010000:1.0:1651529349.428621:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0008 lrc: 0/0,0 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428622:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153447 00010000:00010000:1.0:1651529349.428625:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428628:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428629:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428629:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428631:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 3/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428632:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.428633:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428635:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 1/0,0 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428636:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 3/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428637:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0001 lrc: 0/0,0 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428641:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 1/0,0 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428644:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c000f lrc: 0/0,0 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428647:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018720c2c/0xa29a79078f3bc091 lrc: 0/0,0 mode: --/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f6d expref: 324 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.428650:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966694656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.428654:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.428659:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428662:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428665:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428667:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.428706:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.428731:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1738:39030:x1731745946563840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1457us (1554us total) trans 30064894310 rc 0/0 00000100:00100000:1.0:1651529349.428744:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153442 00000100:00100000:1.0:1651529349.428757:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564352 00000100:00100000:0.0:1651529349.428768:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.428772:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428780:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564288 00000100:00100000:1.0:1651529349.428800:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153449 00000100:00100000:1.0:1651529349.428802:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1739:39030:x1731745946564352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.428820:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153450 00002000:00080000:1.0:1651529349.428824:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178242 count 1 00010000:00010000:1.0:1651529349.428828:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428833:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 2/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.428835:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1739:39029:x1731745946564288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.428837:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428838:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428838:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 4/0,1 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.428841:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178241 count 1 00010000:00010000:1.0:1651529349.428845:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 3/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.428845:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428849:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 4/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.428850:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 2/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.428853:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.428853:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428854:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.428854:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 4/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.428861:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 3/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.428865:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.428868:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.428873:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428876:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.428877:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428877:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.428880:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 3/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428885:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 1/0,0 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428887:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3bffec lrc: 0/0,0 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.428887:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.428898:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445376 00010000:00010000:1.0:1651529349.428903:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 324 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.428913:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12410 00000100:00100000:1.0:1651529349.428926:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41278:x1731746396445376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.428932:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.428934:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 324 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428938:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 3/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 324 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428944:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb61def/0xa29a79078f3b9eda lrc: 0/0,0 mode: --/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf955 expref: 324 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.428947:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428948:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.428949:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428953:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 4/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.428968:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.428978:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d86431b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41278:x1731746396445376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.428981:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12410 00000100:00100000:0.0:1651529349.428995:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.429020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.429047:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564480 00000100:00100000:0.0:1651529349.429061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.429064:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564416 00000100:00100000:1.0:1651529349.429069:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564608 00000100:00100000:0.0:1651529349.429076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.429088:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564544 00000100:00100000:1.0:1651529349.429100:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153451 00000100:00100000:1.0:1651529349.429102:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1743:39030:x1731745946564480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.429107:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178244 count 1 00000100:00100000:0.0:1651529349.429109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.429112:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429117:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 2/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 322 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429120:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429121:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429121:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 4/0,1 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.429136:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429140:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429143:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429151:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 3/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 322 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429155:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 4/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 322 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.429158:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429160:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966695232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.429177:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.429183:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564672 00000100:00100000:1.0:1651529349.429189:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153452 00000100:00100000:1.0:1651529349.429191:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1745:39029:x1731745946564416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.429196:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178243 count 1 00010000:00010000:1.0:1651529349.429199:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429204:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 2/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 322 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429207:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429207:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429208:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 4/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429211:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a920734 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1745:39030:x1731745946564224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1222us (1372us total) trans 30064894311 rc 0/0 00010000:00010000:1.0:1651529349.429214:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 3/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 322 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.429215:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153448 00010000:00010000:1.0:1651529349.429218:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 322 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429222:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966695296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.429229:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.429233:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153453 00000100:00100000:0.0:1651529349.429235:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1744:39030:x1731745946564608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.429236:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153454 00000100:00100000:1.0:1651529349.429237:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1744:39029:x1731745946564544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.429240:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178246 count 1 00002000:00080000:1.0:1651529349.429241:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178245 count 1 00010000:00010000:1.0:1651529349.429244:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429244:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429249:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 2/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.429251:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 2/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 322 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429252:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429252:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429253:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 4/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429254:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.429255:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.429256:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 4/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429258:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 3/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429262:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.429262:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 3/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 322 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.429265:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966695360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.429266:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 322 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.429270:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.429271:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.429276:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429278:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.429279:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.429280:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429283:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 3/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429285:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153455 00000100:00100000:0.0:1651529349.429287:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1744:39029:x1731745946564672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.429290:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 1/0,0 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.429291:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178247 count 1 00010000:00010000:1.0:1651529349.429293:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0016 lrc: 0/0,0 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429294:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429299:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 2/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 322 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.429301:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.429302:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445440 00010000:00010000:0.0:1651529349.429302:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.429303:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 4/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429306:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 5/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.429309:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 3/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 323 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.429312:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 4/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 323 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429313:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12411 00000100:00100000:1.0:1651529349.429315:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41279:x1731746396445440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.429316:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966695488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.429318:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.429319:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 5/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.429322:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.429323:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 4/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.429327:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429328:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429329:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429331:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.429332:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 4/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429335:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429339:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.429345:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41279:x1731746396445440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.429347:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12411 00000100:00100000:0.0:1651529349.429348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.429353:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445504 00010000:00010000:1.0:1651529349.429356:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429368:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12412 00000100:00100000:1.0:1651529349.429370:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41278:x1731746396445504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.429372:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.429373:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.429377:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 3/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.429382:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005e1ec14/0xa29a79078f3ba63c lrc: 0/0,0 mode: --/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1834 expref: 323 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.429394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429394:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429395:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429398:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 4/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429441:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.429445:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429449:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429452:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429457:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746396445504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 86us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.429459:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429462:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12412 00010000:00010000:1.0:1651529349.429477:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bbad577/0xa29a79078f3b9cf7 lrc: 0/0,0 mode: --/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf24e expref: 321 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429481:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.429485:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429488:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429491:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429494:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429497:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429528:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1746:39029:x1731745946564288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 705us (847us total) trans 30064894312 rc 0/0 00000100:00100000:0.0:1651529349.429532:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153450 00000100:00100000:1.0:1651529349.429538:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1745:39030:x1731745946564352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 735us (879us total) trans 30064894313 rc 0/0 00010000:00010000:0.0:1651529349.429540:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429543:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153449 00010000:00010000:0.0:1651529349.429543:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.429544:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429547:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 3/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429550:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429552:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 1/0,0 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429554:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.429555:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429555:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c0024 lrc: 0/0,0 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429558:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 3/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429562:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 1/0,0 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429565:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c001d lrc: 0/0,0 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.429615:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564736 00000100:00100000:1.0:1651529349.429628:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153456 00000100:00100000:1.0:1651529349.429629:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1745:39030:x1731745946564736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.429635:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178248 count 1 00010000:00010000:1.0:1651529349.429639:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429643:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 2/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429649:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429649:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429650:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 4/0,1 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429657:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 3/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429661:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 4/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 320 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429668:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.429687:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.429746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.429754:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564800 00000100:00100000:0.0:1651529349.429767:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153457 00000100:00100000:0.0:1651529349.429769:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1746:39029:x1731745946564800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.429774:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178249 count 1 00010000:00010000:0.0:1651529349.429778:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.429783:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 2/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.429784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.429786:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.429787:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.429788:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 4/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429793:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564864 00010000:00010000:0.0:1651529349.429794:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 3/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.429798:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 320 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429801:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153458 00000100:00100000:0.0:1651529349.429802:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.429818:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1747:39030:x1731745946564864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.429824:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178250 count 1 00010000:00010000:1.0:1651529349.429829:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429833:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.429840:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 2/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429843:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429843:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.429844:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 4/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.429856:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 3/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 320 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.429860:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 4/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 320 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429866:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966695680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.429874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.429896:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.429901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.429917:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966695296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.429922:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429953:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966695360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.429955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.429957:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.429961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.429964:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445568 00010000:00010000:1.0:1651529349.429969:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 5/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 321 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.429969:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.429974:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445632 00010000:00010000:1.0:1651529349.429976:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 322 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.429977:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.429981:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429983:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445760 00010000:00010000:1.0:1651529349.429985:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 5/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 323 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.429989:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445696 00010000:00010000:1.0:1651529349.429991:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 324 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.429991:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966695488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.429994:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.429995:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445824 00010000:00010000:1.0:1651529349.429997:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 325 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.430001:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12413 00000100:00100000:1.0:1651529349.430003:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12414 00000100:00100000:0.0:1651529349.430003:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746396445568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.430005:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746396445632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.430006:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.430008:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 5/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 325 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430009:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.430011:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 325 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430012:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 4/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 325 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430017:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 3/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 325 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430018:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430018:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430019:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430026:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070f92a76/0xa29a79078f3bbc85 lrc: 0/0,0 mode: --/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fd0 expref: 325 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430033:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430034:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430034:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430038:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 4/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430041:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 4/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430045:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.430046:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.430053:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41278:x1731746396445632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.430054:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41278:x1731746396445568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.430056:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12414 00000100:00100000:0.0:1651529349.430057:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12413 00000100:00100000:1.0:1651529349.430061:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12415 00000100:00100000:1.0:1651529349.430063:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746396445760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.430064:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12416 00010000:00010000:1.0:1651529349.430066:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.430066:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41279:x1731746396445696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.430067:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 4/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 322 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430068:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.430070:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430071:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 3/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 322 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430074:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 3/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430078:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dcf3376/0xa29a79078f3b91e4 lrc: 0/0,0 mode: --/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5d8 expref: 322 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430079:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000821aeeba/0xa29a79078f3b987b lrc: 0/0,0 mode: --/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfe0 expref: 322 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430083:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430083:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430084:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430084:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430085:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430086:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430094:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 4/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430105:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.430112:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 4/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430123:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.430130:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41278:x1731746396445760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.430131:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41279:x1731746396445696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.430133:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12415 00000100:00100000:0.0:1651529349.430135:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12416 00000100:00100000:1.0:1651529349.430139:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12417 00000100:00100000:1.0:1651529349.430141:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41279:x1731746396445824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.430144:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.430145:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430145:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430148:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430149:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 3/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430151:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430154:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430155:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a663c58/0xa29a79078f3b7a75 lrc: 0/0,0 mode: --/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9c9 expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430158:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430159:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430160:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430172:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 4/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430189:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.430197:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042c699be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41279:x1731746396445824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.430200:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12417 00010000:00010000:1.0:1651529349.430212:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430215:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430216:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430219:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 3/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430224:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 1/0,0 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430227:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0047 lrc: 0/0,0 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430233:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430233:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1748:39029:x1731745946564672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 944us (1135us total) trans 30064894314 rc 0/0 00010000:00010000:1.0:1651529349.430235:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430236:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153455 00010000:00010000:1.0:1651529349.430241:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430243:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430244:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430246:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430250:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430259:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.430295:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1749:39029:x1731745946564544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1056us (1218us total) trans 30064894315 rc 0/0 00000100:00100000:1.0:1651529349.430298:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153454 00000100:00100000:0.0:1651529349.430299:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946564608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1063us (1238us total) trans 30064894316 rc 0/0 00000100:00100000:0.0:1651529349.430302:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153453 00010000:00010000:1.0:1651529349.430305:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430308:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430309:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430310:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430312:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 3/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430316:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 1/0,0 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430316:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.430317:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430319:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0040 lrc: 0/0,0 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430320:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 3/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430325:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430325:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 1/0,0 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430327:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c0039 lrc: 0/0,0 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430328:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430331:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430334:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.430389:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1748:39029:x1731745946564416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1197us (1368us total) trans 30064894317 rc 0/0 00000100:00100000:0.0:1651529349.430389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.430392:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153452 00010000:00010000:1.0:1651529349.430398:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.430401:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430402:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430405:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 3/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430409:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 1/0,0 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430412:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0032 lrc: 0/0,0 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430428:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc2573a/0xa29a79078f3b7b55 lrc: 0/0,0 mode: --/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba47 expref: 316 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.430432:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966695232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.430441:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.430445:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430446:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430452:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430453:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445888 00010000:00010000:1.0:1651529349.430455:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430457:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 5/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430458:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430461:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430463:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396445952 00010000:00010000:0.0:1651529349.430465:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.430478:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446016 00010000:00010000:0.0:1651529349.430481:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 5/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.430502:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12418 00000100:00100000:0.0:1651529349.430504:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746396445888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.430507:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.430509:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 5/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.430515:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1748:39030:x1731745946564480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1412us (1526us total) trans 30064894318 rc 0/0 00000100:00100000:1.0:1651529349.430518:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153451 00010000:00010000:0.0:1651529349.430519:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 4/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 318 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430525:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430525:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430526:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430527:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430530:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 4/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430531:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430532:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430535:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 3/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430535:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.430539:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 1/0,0 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430542:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c002b lrc: 0/0,0 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430542:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746396445888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.430545:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12418 00000100:00100000:0.0:1651529349.430550:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12419 00000100:00100000:1.0:1651529349.430552:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966695680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.430556:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430560:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41279:x1731746396445952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.430563:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12420 00010000:00010000:0.0:1651529349.430563:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.430564:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.430565:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41279:x1731746396446016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.430568:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.430568:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 3/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430570:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 4/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430573:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005923e4e4/0xa29a79078f3bba2b lrc: 0/0,0 mode: --/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66a0 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430574:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 3/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 317 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430576:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430577:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430578:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430581:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189ff768/0xa29a79078f3b9d4b lrc: 0/0,0 mode: --/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf374 expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.430581:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 4/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430584:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430585:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430586:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430588:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 4/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430595:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.430600:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.430601:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41279:x1731746396446016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.430604:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12420 00010000:00010000:1.0:1651529349.430610:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430614:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430616:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41279:x1731746396445952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.430617:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430619:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430619:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12419 00010000:00010000:0.0:1651529349.430627:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430637:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430649:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430652:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.430675:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946564864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 871us (891us total) trans 30064894319 rc 0/0 00000100:00100000:1.0:1651529349.430678:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153458 00010000:00010000:1.0:1651529349.430685:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430688:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430689:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430692:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 3/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430695:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1748:39029:x1731745946564800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 925us (949us total) trans 30064894320 rc 0/0 00010000:00010000:1.0:1651529349.430697:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 1/0,0 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430698:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153457 00010000:00010000:1.0:1651529349.430699:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c005c lrc: 0/0,0 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430704:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430706:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.430707:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430712:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 3/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430716:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 1/0,0 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430718:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c0055 lrc: 0/0,0 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.430747:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8167a27/0xa29a79078f3ba627 lrc: 0/0,0 mode: --/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17ee expref: 313 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.430750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.430751:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.430759:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430763:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430765:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.430773:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430776:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.430777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.430824:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564992 00000100:00100000:0.0:1651529349.430832:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946564928 00000100:00100000:0.0:1651529349.430838:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565056 00000100:00100000:0.0:1651529349.430842:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565120 00000100:00100000:0.0:1651529349.430864:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153459 00000100:00100000:0.0:1651529349.430865:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1752:39030:x1731745946564992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.430873:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1752:39030:x1731745946564736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1242us (1302us total) trans 30064894321 rc 0/0 00000100:00100000:1.0:1651529349.430876:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153456 00002000:00080000:0.0:1651529349.430876:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178252 count 1 00010000:00010000:0.0:1651529349.430881:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.430882:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153460 00000100:00100000:1.0:1651529349.430884:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1751:39029:x1731745946564928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.430886:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 2/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.430890:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178251 count 1 00010000:00010000:1.0:1651529349.430894:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430899:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 2/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.430899:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430900:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430901:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 4/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430902:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430903:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430904:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 4/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430908:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 3/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.430911:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 3/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.430913:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.430915:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.430917:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.430919:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.430926:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.430928:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.430935:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153461 00000100:00100000:1.0:1651529349.430937:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1751:39029:x1731745946565056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.430942:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178253 count 1 00010000:00010000:1.0:1651529349.430945:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.430949:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 2/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.430949:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153462 00000100:00100000:0.0:1651529349.430951:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1751:39030:x1731745946565120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.430954:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430955:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.430956:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 4/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.430956:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178254 count 1 00010000:00010000:0.0:1651529349.430960:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.430964:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 2/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.430967:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 3/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.430972:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.430979:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966695872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.430979:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430981:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.430982:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 4/0,1 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.430990:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.430998:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431003:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.431005:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431007:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 3/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.431010:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 3/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431012:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 4/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431016:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 1/0,0 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431016:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.431018:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c004e lrc: 0/0,0 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431025:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.431085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.431101:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565184 00000100:00100000:0.0:1651529349.431113:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153463 00000100:00100000:0.0:1651529349.431115:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1752:39029:x1731745946565184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.431116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.431120:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178255 count 1 00010000:00010000:0.0:1651529349.431124:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.431129:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 2/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.431132:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431132:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431133:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 4/0,1 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431138:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565248 00000100:00100000:1.0:1651529349.431148:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565312 00000100:00100000:1.0:1651529349.431158:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153464 00000100:00100000:1.0:1651529349.431160:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1754:39030:x1731745946565248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.431160:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 3/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.431165:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178256 count 1 00010000:00010000:1.0:1651529349.431169:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431174:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 2/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.431177:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431178:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431179:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 4/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431185:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 4/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431188:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 3/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.431189:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966696000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.431192:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.431196:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.431204:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.431212:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153465 00000100:00100000:0.0:1651529349.431213:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1754:39029:x1731745946565312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.431216:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.431218:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178257 count 1 00010000:00010000:0.0:1651529349.431234:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.431239:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 2/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.431242:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431242:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431243:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 4/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431272:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 3/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 312 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.431276:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 4/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 312 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.431296:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966696128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.431305:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.431313:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966695744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.431317:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431357:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565376 00000100:00100000:1.0:1651529349.431366:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153466 00000100:00100000:1.0:1651529349.431367:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1755:39030:x1731745946565376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.431373:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178258 count 1 00010000:00010000:1.0:1651529349.431377:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431382:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 2/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.431385:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431385:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431386:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 4/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431393:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 3/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 312 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.431399:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 4/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 312 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.431403:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966696192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.431414:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.431426:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966695808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.431432:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.431522:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966695872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.431528:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431540:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446144 00000100:00100000:0.0:1651529349.431551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.431558:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 313 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.431563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.431579:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446080 00010000:00010000:1.0:1651529349.431582:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 314 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.431584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.431587:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446208 00010000:00010000:1.0:1651529349.431589:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 5/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 315 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.431596:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446272 00010000:00010000:1.0:1651529349.431598:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.431608:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d33ef30e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966695936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.431610:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12421 00010000:00010000:0.0:1651529349.431612:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431613:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746396446144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.431618:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.431620:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.431621:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12422 00010000:00010000:1.0:1651529349.431626:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 3/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431633:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b37af34/0xa29a79078f3b9b45 lrc: 0/0,0 mode: --/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb40 expref: 316 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431637:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431637:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431639:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431643:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41278:x1731746396446080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.431647:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.431649:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 315 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431654:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 4/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431666:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.431674:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 3/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 315 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.431685:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a6b148/0xa29a79078f3b9946 lrc: 0/0,0 mode: --/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce321 expref: 315 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.431692:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41278:x1731746396446144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.431697:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12421 00000100:00100000:1.0:1651529349.431704:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12423 00000100:00100000:1.0:1651529349.431706:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41278:x1731746396446208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.431708:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431709:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.431709:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431710:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431711:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 4/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 313 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.431713:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 4/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431715:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 3/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 313 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.431720:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654095cd/0xa29a79078f3b994d lrc: 0/0,0 mode: --/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce32f expref: 313 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.431723:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.431731:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41278:x1731746396446080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 108us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.431732:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431741:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.431742:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431742:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12422 00010000:00010000:1.0:1651529349.431746:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 4/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431748:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12424 00000100:00100000:0.0:1651529349.431750:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746396446272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.431755:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.431760:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.431762:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.431763:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746396446208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.431765:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12423 00010000:00010000:0.0:1651529349.431766:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 3/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.431772:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071e423dd/0xa29a79078f3bc3e0 lrc: 0/0,0 mode: --/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c94 expref: 310 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.431775:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.431776:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.431777:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.431777:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431780:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 4/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431781:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431788:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.431795:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431795:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009bc4918e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+309:41278:x1731746396446272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.431798:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12424 00010000:00010000:1.0:1651529349.431799:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431816:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431819:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431831:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431835:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431838:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431841:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431876:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1757:39029:x1731745946564928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 991us (1125us total) trans 30064894322 rc 0/0 00000100:00100000:1.0:1651529349.431880:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153460 00010000:00010000:1.0:1651529349.431887:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431891:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.431892:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431895:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 3/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.431898:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1756:39030:x1731745946564992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1031us (1170us total) trans 30064894323 rc 0/0 00000100:00100000:0.0:1651529349.431901:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153459 00010000:00010000:1.0:1651529349.431902:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 1/0,0 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431905:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c006a lrc: 0/0,0 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431909:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431912:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.431913:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431913:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431916:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 3/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431919:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 1/0,0 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431919:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431921:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0063 lrc: 0/0,0 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431922:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431924:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431927:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431930:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431940:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431943:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.431985:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1757:39029:x1731745946565056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1220us total) trans 30064894325 rc 0/0 00000100:00100000:1.0:1651529349.431988:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153461 00000100:00100000:0.0:1651529349.431988:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1757:39030:x1731745946565120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1036us (1210us total) trans 30064894324 rc 0/0 00000100:00100000:0.0:1651529349.431991:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153462 00010000:00010000:1.0:1651529349.431995:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.431998:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.431999:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.431999:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432002:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 3/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432003:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.432004:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432007:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 1/0,0 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432007:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 3/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432009:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c0078 lrc: 0/0,0 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432012:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 1/0,0 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432015:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c0071 lrc: 0/0,0 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.432025:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966696128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.432035:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.432043:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446400 00010000:00010000:0.0:1651529349.432053:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 4/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 309 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.432056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.432069:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446336 00010000:00010000:0.0:1651529349.432072:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 5/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 310 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.432076:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446464 00010000:00010000:0.0:1651529349.432078:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.432083:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12425 00000100:00100000:0.0:1651529349.432084:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746396446400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.432087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.432087:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.432089:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 4/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432092:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 3/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432100:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d14ff2ef/0xa29a79078f3bb77d lrc: 0/0,0 mode: --/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5be1 expref: 311 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432104:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432104:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432105:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432108:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 4/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432115:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.432122:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41278:x1731746396446400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.432124:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12425 00000100:00100000:0.0:1651529349.432128:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446528 00010000:00010000:0.0:1651529349.432131:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 5/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 310 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.432136:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12426 00000100:00100000:0.0:1651529349.432138:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41278:x1731746396446336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.432140:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.432141:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 5/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 310 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432145:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 4/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 310 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432151:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432154:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 4/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432158:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.432162:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41278:x1731746396446336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.432164:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12426 00000100:00100000:0.0:1651529349.432168:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12427 00000100:00100000:0.0:1651529349.432169:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+309:41278:x1731746396446464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.432171:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.432173:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 309 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432176:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 3/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 309 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432180:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc71d0b0/0xa29a79078f3bac2b lrc: 0/0,0 mode: --/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f6b expref: 309 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432200:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432200:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432202:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432205:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 4/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432212:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966696192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.432218:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432224:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.432234:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41278:x1731746396446464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.432237:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12427 00010000:00010000:1.0:1651529349.432238:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432241:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432244:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432247:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432252:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12428 00000100:00100000:0.0:1651529349.432254:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396446528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.432257:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.432259:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 4/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 307 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432263:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 3/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 307 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432278:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8562096/0xa29a79078f3b9605 lrc: 0/0,0 mode: --/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd655 expref: 307 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.432281:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432283:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432286:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 4/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432288:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1756:39030:x1731745946565248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1127us (1180us total) trans 30064894326 rc 0/0 00000100:00100000:1.0:1651529349.432291:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153464 00010000:00010000:1.0:1651529349.432299:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432303:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.432309:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.432310:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432310:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396446528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.432313:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 3/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432318:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 1/0,0 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432321:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c0086 lrc: 0/0,0 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432322:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12428 00010000:00010000:1.0:1651529349.432328:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432331:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432333:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df2dd95/0xa29a79078f3bbbe4 lrc: 0/0,0 mode: --/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d68 expref: 305 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.432334:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432337:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432337:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966696000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.432341:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432344:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432347:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432350:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432352:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432371:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1756:39030:x1731745946565376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1003us (1132us total) trans 30064894327 rc 0/0 00000100:00100000:1.0:1651529349.432374:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153466 00010000:00010000:1.0:1651529349.432381:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432386:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.432387:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432390:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 3/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432392:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1756:39029:x1731745946565184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1277us (1308us total) trans 30064894328 rc 0/0 00010000:00010000:1.0:1651529349.432394:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 1/0,0 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432397:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0094 lrc: 0/0,0 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432397:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153463 00010000:00010000:1.0:1651529349.432401:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432403:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000528fa145 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.432404:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432405:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432407:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 3/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432408:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432410:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 1/0,0 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432411:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432414:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 2/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432415:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c007f lrc: 0/0,0 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432419:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432429:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.432430:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 2/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432433:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 3/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432436:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 1/0,0 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432439:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c008d lrc: 0/0,0 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432453:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1756:39029:x1731745946565312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1239us (1326us total) trans 30064894329 rc 0/0 00000100:00100000:0.0:1651529349.432456:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153465 00000100:00100000:1.0:1651529349.432485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.432506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.432513:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565440 00000100:00100000:0.0:1651529349.432524:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565504 00000100:00100000:0.0:1651529349.432531:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153467 00000100:00100000:0.0:1651529349.432533:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1757:39029:x1731745946565440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.432538:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178259 count 1 00010000:00010000:0.0:1651529349.432542:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432553:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 2/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.432576:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153468 00000100:00100000:1.0:1651529349.432579:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1757:39030:x1731745946565504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.432579:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432580:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432581:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 4/0,1 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.432585:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178260 count 1 00010000:00010000:1.0:1651529349.432589:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432589:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 3/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.432594:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 4/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 304 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.432597:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 2/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.432600:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432600:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432601:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 4/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432608:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 3/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.432609:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966696256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.432612:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 4/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 304 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.432616:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966696320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.432625:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.432634:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.432639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.432649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.432668:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565632 00000100:00100000:0.0:1651529349.432675:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565568 00000100:00100000:0.0:1651529349.432683:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153469 00000100:00100000:0.0:1651529349.432685:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1759:39030:x1731745946565632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.432690:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178262 count 1 00000100:00100000:1.0:1651529349.432694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.432694:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432705:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 2/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.432706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.432714:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565760 00010000:00010000:0.0:1651529349.432718:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432718:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432719:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 4/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432721:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565696 00000100:00100000:1.0:1651529349.432725:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153470 00000100:00100000:1.0:1651529349.432727:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1761:39029:x1731745946565568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.432732:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178261 count 1 00010000:00010000:1.0:1651529349.432746:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432751:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 2/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.432758:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 3/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.432763:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 4/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 304 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.432767:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966696384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.432775:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432775:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432776:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 4/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432776:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.432783:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153471 00010000:00010000:1.0:1651529349.432784:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 3/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 304 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.432785:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1761:39030:x1731745946565760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.432788:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 4/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 304 pid: 161133 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.432790:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178264 count 1 00000100:00100000:1.0:1651529349.432792:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.432794:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432799:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 2/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.432830:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.432832:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432833:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.432834:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 4/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.432841:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153472 00000100:00100000:1.0:1651529349.432844:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1761:39029:x1731745946565696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.432852:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178263 count 1 00010000:00010000:1.0:1651529349.432856:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432861:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 2/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.432861:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 3/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.432864:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432864:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432865:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 4/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.432865:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 304 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.432869:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966696512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.432877:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.432889:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 3/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.432894:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 304 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.432899:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966696576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.432904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.432909:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.432916:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565888 00000100:00100000:1.0:1651529349.432924:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153473 00000100:00100000:1.0:1651529349.432926:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1762:39030:x1731745946565888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.432944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.432951:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178266 count 1 00010000:00010000:1.0:1651529349.432956:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.432961:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 2/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.432964:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432965:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.432965:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 4/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.432971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.432980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.432990:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565824 00010000:00010000:1.0:1651529349.432991:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.432996:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153474 00000100:00100000:0.0:1651529349.432998:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1763:39029:x1731745946565824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.433003:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178265 count 1 00010000:00010000:1.0:1651529349.433011:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 304 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.433016:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966696640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.433021:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433027:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 2/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 304 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.433032:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.433036:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433037:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433037:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 4/0,1 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433042:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966696320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.433047:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433054:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446592 00010000:00010000:0.0:1651529349.433055:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 3/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 305 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.433059:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 4/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 305 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433059:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 4/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 305 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433063:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966696704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.433066:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446656 00010000:00010000:1.0:1651529349.433068:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 5/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433072:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.433078:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12429 00000100:00100000:1.0:1651529349.433080:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396446592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.433083:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.433084:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 4/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 306 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433087:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12430 00010000:00010000:1.0:1651529349.433088:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 3/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 306 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433088:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396446656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.433092:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.433094:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 5/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433098:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 4/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433101:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae571b2/0xa29a79078f3ba571 lrc: 0/0,0 mode: --/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1498 expref: 306 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433104:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433104:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433105:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433105:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433105:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433106:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433108:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 4/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433110:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 4/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433115:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.433116:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.433121:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396446656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.433124:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396446592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.433124:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12430 00000100:00100000:1.0:1651529349.433127:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12429 00010000:00010000:1.0:1651529349.433134:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433135:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094606748/0xa29a79078f3b967c lrc: 0/0,0 mode: --/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7eb expref: 303 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433138:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433139:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966696256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.433141:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433142:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433143:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433145:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433148:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433151:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433161:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433204:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1765:39030:x1731745946565504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 624us (698us total) trans 30064894330 rc 0/0 00000100:00100000:1.0:1651529349.433209:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153468 00010000:00010000:1.0:1651529349.433218:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433221:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1764:39029:x1731745946565440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 688us (736us total) trans 30064894331 rc 0/0 00010000:00010000:1.0:1651529349.433222:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.433223:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433226:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 3/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433226:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153467 00010000:00010000:1.0:1651529349.433231:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 1/0,0 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433234:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c00a2 lrc: 0/0,0 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433234:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433238:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.433239:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433242:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 3/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433247:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 1/0,0 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433250:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c009b lrc: 0/0,0 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433313:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966696384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.433317:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.433364:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966696512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.433365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.433368:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.433375:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446784 00000100:00100000:1.0:1651529349.433378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.433380:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 5/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 303 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.433390:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.433392:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446720 00010000:00010000:1.0:1651529349.433395:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433402:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966696576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.433405:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433409:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 4/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 304 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.433412:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446912 00000100:00100000:0.0:1651529349.433415:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446848 00010000:00010000:1.0:1651529349.433419:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 306 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433419:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 306 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433424:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12431 00000100:00100000:0.0:1651529349.433425:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41278:x1731746396446784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.433429:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12432 00000100:00100000:1.0:1651529349.433432:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396446720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.433436:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.433437:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 4/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433443:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.433444:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 4/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433448:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 3/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433450:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 3/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433454:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fd78179/0xa29a79078f3b951e lrc: 0/0,0 mode: --/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd218 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433456:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091975b1b/0xa29a79078f3b9708 lrc: 0/0,0 mode: --/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9c7 expref: 306 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433458:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433458:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433459:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433460:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433461:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433461:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433465:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 4/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433467:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 4/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433473:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.433481:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.433487:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006662bd4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41278:x1731746396446784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.433489:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41279:x1731746396446720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.433490:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12431 00000100:00100000:1.0:1651529349.433492:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12432 00000100:00100000:1.0:1651529349.433499:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12433 00000100:00100000:1.0:1651529349.433502:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41279:x1731746396446848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.433502:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12434 00000100:00100000:0.0:1651529349.433503:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41278:x1731746396446912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.433506:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.433507:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.433507:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 302 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433509:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 302 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433511:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 3/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 302 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433516:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 3/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 302 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433522:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539698af/0xa29a79078f3b9ab9 lrc: 0/0,0 mode: --/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce964 expref: 302 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433527:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433529:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433530:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f450cf39/0xa29a79078f3bba16 lrc: 0/0,0 mode: --/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d665a expref: 301 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433534:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 4/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433534:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433534:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433535:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433546:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 4/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433547:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.433554:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41279:x1731746396446848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.433557:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12433 00010000:00010000:1.0:1651529349.433564:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433564:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.433568:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433571:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433572:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746396446912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.433574:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433575:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12434 00010000:00010000:0.0:1651529349.433583:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433586:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433589:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433592:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433624:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1765:39029:x1731745946565696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 779us (917us total) trans 30064894332 rc 0/0 00000100:00100000:1.0:1651529349.433627:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153472 00010000:00010000:1.0:1651529349.433635:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433636:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1764:39030:x1731745946565632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 950us (997us total) trans 30064894333 rc 0/0 00010000:00010000:1.0:1651529349.433638:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.433639:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433639:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153469 00010000:00010000:1.0:1651529349.433645:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 3/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433647:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433650:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 1/0,0 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433650:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433652:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c00be lrc: 0/0,0 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433653:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433656:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433656:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433659:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.433660:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433663:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 3/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433666:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 1/0,0 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433668:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c00a9 lrc: 0/0,0 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433672:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433675:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.433676:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433678:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 3/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433681:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 1/0,0 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433684:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c00b7 lrc: 0/0,0 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433689:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433692:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433695:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433697:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1764:39030:x1731745946565760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 911us (1003us total) trans 30064894334 rc 0/0 00010000:00010000:1.0:1651529349.433698:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433700:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153471 00010000:00010000:0.0:1651529349.433707:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433710:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.433712:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433715:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 3/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433720:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 1/0,0 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433722:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c00b0 lrc: 0/0,0 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433744:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1764:39029:x1731745946565568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1006us (1083us total) trans 30064894335 rc 0/0 00000100:00100000:0.0:1651529349.433746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.433748:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153470 00000100:00100000:1.0:1651529349.433753:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946565952 00000100:00100000:1.0:1651529349.433763:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153475 00000100:00100000:1.0:1651529349.433764:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1764:39029:x1731745946565952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.433770:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178267 count 1 00010000:00010000:1.0:1651529349.433774:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.433819:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 2/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 298 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.433822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.433823:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433823:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433824:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 4/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.433832:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 3/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 298 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.433835:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 298 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.433840:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.433849:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.433856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.433868:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966696640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.433872:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433891:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396446976 00000100:00100000:1.0:1651529349.433895:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566016 00010000:00010000:0.0:1651529349.433897:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 299 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.433908:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447040 00000100:00100000:1.0:1651529349.433913:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153476 00000100:00100000:1.0:1651529349.433915:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1765:39030:x1731745946566016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.433920:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178268 count 1 00010000:00010000:1.0:1651529349.433925:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433926:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 5/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 300 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433932:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 2/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 300 pid: 144528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.433937:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12435 00010000:00010000:1.0:1651529349.433945:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433946:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.433947:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 4/0,1 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.433948:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41278:x1731746396446976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.433951:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.433953:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 300 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433955:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 3/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 300 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.433957:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 300 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.433959:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 4/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 300 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.433963:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966696832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.433963:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a0dea71/0xa29a79078f3bbe6f lrc: 0/0,0 mode: --/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76fa expref: 300 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.433967:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433967:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.433968:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.433971:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 4/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.433979:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.433987:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12436 00010000:00010000:0.0:1651529349.433989:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.433994:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746396447040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.433997:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746396446976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (176us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.433999:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.434001:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 5/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 299 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.434001:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12435 00010000:00010000:1.0:1651529349.434005:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 4/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 298 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434010:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434011:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434012:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434012:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17f4380/0xa29a79078f3bbdf8 lrc: 0/0,0 mode: --/PR res: [0x2b859:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74bc expref: 298 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434015:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 4/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434019:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.434026:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41278:x1731746396447040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.434029:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12436 00000100:00100000:0.0:1651529349.434030:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966696704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.434036:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434040:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434042:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434043:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434046:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434049:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434049:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434052:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434055:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434106:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1767:39030:x1731745946565888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1179us (1202us total) trans 30064894336 rc 0/0 00000100:00100000:0.0:1651529349.434108:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1767:39029:x1731745946565824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1108us (1164us total) trans 30064894337 rc 0/0 00000100:00100000:1.0:1651529349.434110:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153473 00010000:00010000:1.0:1651529349.434117:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434121:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.434122:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434122:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153474 00010000:00010000:1.0:1651529349.434125:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 3/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434129:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 1/0,0 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434131:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434132:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c00c5 lrc: 0/0,0 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434134:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.434136:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434138:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 3/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434143:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 1/0,0 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434146:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c00cc lrc: 0/0,0 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.434188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.434194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.434214:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966696768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.434222:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566080 00000100:00100000:0.0:1651529349.434230:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566144 00000100:00100000:0.0:1651529349.434237:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153477 00000100:00100000:0.0:1651529349.434238:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043e13e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1767:39029:x1731745946566080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.434244:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178269 count 1 00010000:00010000:1.0:1651529349.434245:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434248:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434253:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 2/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.434254:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153478 00000100:00100000:1.0:1651529349.434256:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1767:39030:x1731745946566144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.434262:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178270 count 1 00010000:00010000:0.0:1651529349.434263:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434264:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434265:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 4/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434266:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434270:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 2/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.434272:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 3/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.434273:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434274:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434275:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 4/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434276:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.434280:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966696896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.434281:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 3/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.434285:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434289:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966696960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.434292:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.434298:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.434298:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447104 00010000:00010000:0.0:1651529349.434302:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 297 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.434313:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12437 00000100:00100000:0.0:1651529349.434315:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41278:x1731746396447104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.434318:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.434329:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.434331:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 297 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434335:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 3/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 297 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.434354:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059537163/0xa29a79078f3b7c35 lrc: 0/0,0 mode: --/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbacc expref: 297 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434358:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434358:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434359:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434362:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 4/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434372:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.434380:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396447104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.434382:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12437 00000100:00100000:1.0:1651529349.434387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.434403:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566272 00000100:00100000:0.0:1651529349.434412:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566208 00000100:00100000:0.0:1651529349.434416:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566336 00000100:00100000:0.0:1651529349.434419:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153479 00000100:00100000:0.0:1651529349.434420:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1770:39030:x1731745946566272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.434425:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178272 count 1 00010000:00010000:0.0:1651529349.434429:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434434:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 2/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 295 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.434441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.434446:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434447:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434448:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 4/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.434455:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 3/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 295 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.434465:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 295 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434467:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566400 00000100:00100000:0.0:1651529349.434470:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.434476:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153480 00000100:00100000:1.0:1651529349.434478:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1771:39029:x1731745946566208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.434484:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00002000:00080000:1.0:1651529349.434494:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178271 count 1 00010000:00010000:1.0:1651529349.434501:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434509:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 2/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 295 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.434512:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434512:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434513:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 4/0,1 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434521:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 3/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 295 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.434523:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153481 00000100:00100000:0.0:1651529349.434525:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1771:39029:x1731745946566336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.434530:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178273 count 1 00010000:00010000:0.0:1651529349.434534:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434538:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 4/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 295 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434539:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 2/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 295 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.434545:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966697088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.434553:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434553:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434554:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 4/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434556:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.434563:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153482 00010000:00010000:0.0:1651529349.434564:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 3/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 295 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.434565:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1771:39030:x1731745946566400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.434568:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 295 pid: 161133 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.434570:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178274 count 1 00000100:00100000:0.0:1651529349.434572:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.434574:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434578:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 2/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 295 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.434580:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.434582:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434582:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434583:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 4/0,1 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434588:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447168 00010000:00010000:1.0:1651529349.434589:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 3/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 296 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.434592:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 5/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 296 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434593:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 4/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434597:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966697216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.434605:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12438 00000100:00100000:0.0:1651529349.434607:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396447168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.434609:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.434611:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 5/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 296 pid: 144528 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434612:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.434615:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 4/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 296 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434620:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434621:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434621:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434624:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000670fb9ea/0xa29a79078f3b77dc lrc: 0/0,0 mode: --/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb500 expref: 296 pid: 144528 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434627:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 4/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434628:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966696832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.434631:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.434632:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434636:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434638:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b7eb03a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746396447168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.434640:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12438 00010000:00010000:1.0:1651529349.434641:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434644:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434646:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.434693:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.434707:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1772:39030:x1731745946566016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 791us (914us total) trans 30064894338 rc 0/0 00000100:00100000:1.0:1651529349.434710:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153476 00010000:00010000:1.0:1651529349.434717:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434728:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.434730:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434746:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 3/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434757:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966696896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.434761:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 1/0,0 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434761:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434765:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c00da lrc: 0/0,0 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434768:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447232 00010000:00010000:0.0:1651529349.434773:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 295 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434778:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966696960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.434783:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447296 00010000:00010000:0.0:1651529349.434786:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434790:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434792:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12439 00000100:00100000:0.0:1651529349.434794:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41279:x1731746396447232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.434796:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.434828:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12440 00010000:00010000:0.0:1651529349.434828:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.434830:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41279:x1731746396447296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.434833:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 3/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434834:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.434836:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434839:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000121845fd/0xa29a79078f3bbcc4 lrc: 0/0,0 mode: --/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7078 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.434841:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 3/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434842:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434843:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.434844:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434846:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d519fb71/0xa29a79078f3baf11 lrc: 0/0,0 mode: --/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aaf expref: 295 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.434847:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 4/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434850:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434851:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.434852:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434853:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.434855:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 4/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434862:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.434876:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396447232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.434877:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396447296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.434879:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12439 00000100:00100000:1.0:1651529349.434881:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12440 00010000:00010000:0.0:1651529349.434887:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434890:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434890:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434893:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434894:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434896:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434899:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434899:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.434940:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1773:39030:x1731745946566144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 682us (745us total) trans 30064894339 rc 0/0 00000100:00100000:0.0:1651529349.434942:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043e13e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1773:39029:x1731745946566080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 703us (767us total) trans 30064894340 rc 0/0 00000100:00100000:1.0:1651529349.434943:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153478 00000100:00100000:0.0:1651529349.434945:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153477 00010000:00010000:1.0:1651529349.434950:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434952:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434953:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.434954:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434956:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009eb6c22f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.434957:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 3/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434957:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434960:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 3/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434964:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 1/0,0 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434964:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 1/0,0 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434967:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c00e8 lrc: 0/0,0 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.434967:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c00e1 lrc: 0/0,0 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434975:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434979:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.434982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.434984:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.434989:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435061:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1772:39029:x1731745946565952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1295us (1315us total) trans 30064894341 rc 0/0 00000100:00100000:1.0:1651529349.435071:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153475 00000100:00100000:0.0:1651529349.435072:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.435094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.435108:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566464 00000100:00100000:1.0:1651529349.435128:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153483 00000100:00100000:1.0:1651529349.435129:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1772:39030:x1731745946566464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.435133:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697024:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.435135:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178275 count 1 00010000:00010000:0.0:1651529349.435138:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435140:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435145:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 2/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 292 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435148:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435149:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435149:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 4/0,1 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435156:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 3/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 292 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.435159:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.435160:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 4/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 292 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.435162:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435164:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966697280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.435173:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.435175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.435180:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447360 00010000:00010000:1.0:1651529349.435184:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 293 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.435210:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447424 00000100:00100000:0.0:1651529349.435214:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447488 00010000:00010000:1.0:1651529349.435215:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 5/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 294 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435220:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447552 00010000:00010000:1.0:1651529349.435223:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 5/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435230:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12441 00000100:00100000:1.0:1651529349.435232:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396447360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.435234:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.435234:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 296 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435236:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435239:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 3/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435241:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12442 00000100:00100000:0.0:1651529349.435243:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396447424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.435245:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000565a6d52/0xa29a79078f3bbcd9 lrc: 0/0,0 mode: --/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70cc expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.435246:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.435248:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 5/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 296 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435250:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435252:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 4/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 295 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435253:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 4/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435257:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435258:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435259:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435264:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.435271:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746396447360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.435271:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 4/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435274:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12441 00010000:00010000:0.0:1651529349.435277:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.435279:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12443 00000100:00100000:1.0:1651529349.435281:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396447552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.435283:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.435284:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 5/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 294 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435284:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746396447424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.435287:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12442 00010000:00010000:1.0:1651529349.435288:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 4/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 294 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435292:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12444 00010000:00010000:1.0:1651529349.435293:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435293:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435294:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435294:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396447488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.435296:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.435297:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 4/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435298:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 293 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435301:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.435301:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 3/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 293 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435306:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396447552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.435306:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d8deb68/0xa29a79078f3b9866 lrc: 0/0,0 mode: --/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfa1 expref: 293 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435308:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12443 00010000:00010000:0.0:1651529349.435310:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435310:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435311:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435314:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 4/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435315:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435319:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.435320:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435322:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.435323:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 3/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435327:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 1/0,0 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435327:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41279:x1731746396447488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.435329:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12444 00010000:00010000:1.0:1651529349.435330:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c00d3 lrc: 0/0,0 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435336:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435340:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435343:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e6cba3/0xa29a79078f3bbd11 lrc: 0/0,0 mode: --/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7174 expref: 290 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.435343:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435345:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435350:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966697216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.435355:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435359:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435362:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435365:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435367:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435400:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1774:39030:x1731745946566272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 979us (1082us total) trans 30064894342 rc 0/0 00000100:00100000:0.0:1651529349.435403:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153479 00010000:00010000:0.0:1651529349.435410:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435413:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435416:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435418:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1773:39030:x1731745946566400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 852us (977us total) trans 30064894343 rc 0/0 00010000:00010000:0.0:1651529349.435419:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435421:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153482 00010000:00010000:1.0:1651529349.435437:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435441:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.435442:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435445:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 3/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435450:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 1/0,0 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435453:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c00ef lrc: 0/0,0 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435457:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435460:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.435460:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1773:39029:x1731745946566336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 935us (1074us total) trans 30064894344 rc 0/0 00010000:00010000:1.0:1651529349.435461:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435463:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153481 00010000:00010000:1.0:1651529349.435464:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 3/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435469:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 1/0,0 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435470:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435472:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0104 lrc: 0/0,0 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435474:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.435475:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435478:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 3/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435482:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 1/0,0 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435483:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cca1d258/0xa29a79078f3ba25a lrc: 0/0,0 mode: --/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d078d expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.435485:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c00fd lrc: 0/0,0 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435487:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966697088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.435490:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435493:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435496:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435499:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435501:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.435537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.435550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.435562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.435563:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1773:39029:x1731745946566208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1085us (1226us total) trans 30064894345 rc 0/0 00000100:00100000:1.0:1651529349.435567:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153480 00000100:00100000:1.0:1651529349.435573:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566592 00000100:00100000:1.0:1651529349.435583:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566528 00000100:00100000:1.0:1651529349.435594:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566656 00000100:00100000:1.0:1651529349.435599:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153484 00000100:00100000:0.0:1651529349.435608:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153485 00000100:00100000:1.0:1651529349.435610:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1775:39029:x1731745946566592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.435611:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1775:39030:x1731745946566528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.435617:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178276 count 1 00002000:00080000:1.0:1651529349.435619:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178277 count 1 00010000:00010000:0.0:1651529349.435621:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435624:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435626:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 2/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435629:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 2/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.435629:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435630:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435631:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 4/0,1 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435632:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435632:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435633:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 4/0,1 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435638:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 3/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435640:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 3/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435644:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 4/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435648:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966697408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.435657:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 4/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435664:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.435668:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966697344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.435671:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153486 00000100:00100000:1.0:1651529349.435673:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1775:39030:x1731745946566656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.435678:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178278 count 1 00000100:00100000:0.0:1651529349.435678:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.435682:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435686:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 2/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 288 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435689:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435689:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435690:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 4/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435696:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 3/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 288 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435700:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 4/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 288 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435704:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966697472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.435731:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.435747:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447616 00010000:00010000:1.0:1651529349.435754:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 5/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435771:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12445 00000100:00100000:1.0:1651529349.435773:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396447616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.435784:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.435786:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 5/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435790:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 4/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.435796:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435796:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435797:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435800:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 4/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435821:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.435832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.435839:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a632526e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396447616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.435841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.435842:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12445 00000100:00100000:0.0:1651529349.435867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.435872:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566720 00000100:00100000:0.0:1651529349.435876:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566784 00000100:00100000:1.0:1651529349.435879:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566848 00000100:00100000:1.0:1651529349.435882:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566912 00000100:00100000:0.0:1651529349.435883:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153487 00000100:00100000:0.0:1651529349.435885:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946566720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.435886:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153488 00000100:00100000:1.0:1651529349.435888:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1779:39030:x1731745946566784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.435890:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178279 count 1 00002000:00080000:1.0:1651529349.435893:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178280 count 1 00010000:00010000:0.0:1651529349.435895:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435898:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435900:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 2/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.435903:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435903:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435904:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 2/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.435904:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 4/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435907:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435908:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.435909:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 4/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435911:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 3/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.435914:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.435915:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 3/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.435918:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.435919:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.435924:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966697600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.435929:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.435937:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.435937:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153489 00010000:00010000:1.0:1651529349.435945:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435950:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.435952:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.435954:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946566848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.435957:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 3/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.435967:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 1/0,0 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.435969:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178281 count 1 00010000:00010000:1.0:1651529349.435970:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c00f6 lrc: 0/0,0 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435973:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.435980:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153490 00010000:00010000:0.0:1651529349.435980:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 2/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.435982:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1779:39030:x1731745946566912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.435983:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435984:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.435985:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 4/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.435987:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178282 count 1 00010000:00010000:1.0:1651529349.435990:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.435991:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 3/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.435995:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 2/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.435995:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.435999:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.436000:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436000:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436001:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 4/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436006:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.436013:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 288 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.436017:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.436024:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966697728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.436034:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.436059:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd943427/0xa29a79078f3b9c10 lrc: 0/0,0 mode: --/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee42 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.436071:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966697280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.436075:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436078:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436081:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436084:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.436087:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.436124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.436133:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966697344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.436138:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436144:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447680 00010000:00010000:0.0:1651529349.436149:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 5/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436162:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447744 00000100:00100000:1.0:1651529349.436179:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1780:39030:x1731745946566464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1048us (1197us total) trans 30064894346 rc 0/0 00000100:00100000:1.0:1651529349.436183:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153483 00010000:00010000:0.0:1651529349.436185:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 4/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436192:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447808 00000100:00100000:1.0:1651529349.436195:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966697472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.436195:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 4/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 290 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436199:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436200:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12446 00000100:00100000:0.0:1651529349.436201:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396447680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.436204:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.436205:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436205:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 5/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 290 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436208:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.436209:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436209:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 4/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 290 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436212:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 3/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436215:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436216:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436216:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436217:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 1/0,0 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436219:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 4/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436220:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c010b lrc: 0/0,0 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436224:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.436227:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12447 00000100:00100000:1.0:1651529349.436229:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41279:x1731746396447744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.436231:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396447680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.436232:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.436234:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 4/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 290 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436234:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12446 00010000:00010000:1.0:1651529349.436238:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 3/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436239:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12448 00000100:00100000:0.0:1651529349.436240:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41279:x1731746396447808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.436243:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.436244:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 4/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 289 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436245:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e14a429/0xa29a79078f3ba770 lrc: 0/0,0 mode: --/PR res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d74 expref: 289 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.436248:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 3/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 289 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436249:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436250:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436252:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f867e1/0xa29a79078f3b81de lrc: 0/0,0 mode: --/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdb2 expref: 288 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436253:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 4/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436256:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436257:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436257:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436262:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.436267:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 4/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.436269:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41279:x1731746396447744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.436272:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12447 00010000:00010000:0.0:1651529349.436277:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.436283:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41279:x1731746396447808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.436286:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12448 00010000:00010000:1.0:1651529349.436287:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436293:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436293:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436298:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436302:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436309:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436318:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436321:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436363:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1781:39030:x1731745946566528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 752us (826us total) trans 30064894347 rc 0/0 00000100:00100000:0.0:1651529349.436366:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153485 00000100:00100000:1.0:1651529349.436371:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1780:39030:x1731745946566656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 696us (808us total) trans 30064894348 rc 0/0 00000100:00100000:1.0:1651529349.436374:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153486 00010000:00010000:0.0:1651529349.436374:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436377:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.436378:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436381:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 3/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436382:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436386:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.436386:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 1/0,0 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436387:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436390:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 3/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436391:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0120 lrc: 0/0,0 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436395:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 1/0,0 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436397:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c0112 lrc: 0/0,0 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436410:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009219ee82/0xa29a79078f3b9d8a lrc: 0/0,0 mode: --/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf42a expref: 285 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.436413:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966697408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.436417:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436418:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.436429:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436433:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436436:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436441:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.436528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.436532:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1780:39029:x1731745946566592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1020us total) trans 30064894349 rc 0/0 00000100:00100000:1.0:1651529349.436535:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153484 00000100:00100000:0.0:1651529349.436535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.436552:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966697600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.436556:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436563:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.436567:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436570:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436573:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.436574:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436574:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.436577:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436579:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 3/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436583:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447872 00010000:00010000:1.0:1651529349.436584:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 1/0,0 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436587:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c0119 lrc: 0/0,0 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436588:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 285 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436593:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448000 00000100:00100000:1.0:1651529349.436596:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966697728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.436599:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.436605:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396447936 00010000:00010000:1.0:1651529349.436613:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 287 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.436613:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 287 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.436618:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448064 00010000:00010000:1.0:1651529349.436620:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.436620:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12449 00000100:00100000:0.0:1651529349.436621:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41278:x1731746396447872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.436624:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.436625:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12450 00010000:00010000:0.0:1651529349.436626:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.436627:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41279:x1731746396447936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.436630:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.436630:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 3/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436631:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436635:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 3/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.436635:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3bb022 lrc: 0/0,0 mode: --/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f47 expref: 288 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.436638:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436639:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436640:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02d05ed/0xa29a79078f3bb6a4 lrc: 0/0,0 mode: --/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58d8 expref: 287 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.436640:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436643:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436643:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 4/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436644:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436645:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436648:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 4/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436649:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.436654:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.436656:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396447872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.436659:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12449 00000100:00100000:1.0:1651529349.436661:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41279:x1731746396447936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.436664:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12450 00000100:00100000:0.0:1651529349.436665:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12451 00000100:00100000:0.0:1651529349.436667:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396448000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.436668:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12452 00010000:00010000:0.0:1651529349.436669:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.436670:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396448064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.436672:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.436673:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436677:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436682:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583dbc4a/0xa29a79078f3bb706 lrc: 0/0,0 mode: --/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a67 expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436685:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436685:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436685:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 283 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436686:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436689:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 4/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436694:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.436699:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e79f7569 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396448064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.436701:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12452 00010000:00010000:0.0:1651529349.436701:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 3/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 283 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436706:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436707:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff067124/0xa29a79078f3ba6f9 lrc: 0/0,0 mode: --/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b60 expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.436709:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436711:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.436711:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.436712:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436712:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436715:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436715:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 4/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436722:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.436743:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41279:x1731746396448000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.436746:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12451 00010000:00010000:0.0:1651529349.436758:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436762:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.436763:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436766:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 3/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436778:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 1/0,0 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.436779:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1780:39030:x1731745946566784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 890us (946us total) trans 30064894350 rc 0/0 00010000:00010000:0.0:1651529349.436781:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c012e lrc: 0/0,0 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.436782:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153488 00010000:00010000:0.0:1651529349.436787:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436790:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436790:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436793:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436793:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436796:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436796:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436799:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436856:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1781:39029:x1731745946566848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (1015us total) trans 30064894351 rc 0/0 00000100:00100000:0.0:1651529349.436859:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153489 00000100:00100000:1.0:1651529349.436864:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1780:39030:x1731745946566912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 881us (997us total) trans 30064894352 rc 0/0 00000100:00100000:1.0:1651529349.436867:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153490 00010000:00010000:0.0:1651529349.436867:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436870:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436874:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436878:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.436879:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436882:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 3/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436883:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.436886:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436887:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 1/0,0 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436890:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c0135 lrc: 0/0,0 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436894:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436896:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.436897:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436900:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 3/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436903:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 1/0,0 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436906:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c013c lrc: 0/0,0 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436909:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436912:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.436913:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436915:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 3/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436919:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 1/0,0 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.436921:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c0127 lrc: 0/0,0 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.436923:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1780:39029:x1731745946566720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1037us (1131us total) trans 30064894353 rc 0/0 00000100:00100000:0.0:1651529349.436926:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153487 00000100:00100000:1.0:1651529349.436982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.436999:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567040 00000100:00100000:0.0:1651529349.437011:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153491 00000100:00100000:0.0:1651529349.437013:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1780:39030:x1731745946567040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.437015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.437018:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178284 count 1 00000100:00100000:1.0:1651529349.437032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.437044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.437045:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437050:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 2/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.437052:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946566976 00010000:00010000:0.0:1651529349.437053:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437054:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437054:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 4/0,1 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.437059:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567104 00010000:00010000:0.0:1651529349.437062:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 3/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.437066:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567168 00000100:00100000:1.0:1651529349.437070:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153492 00000100:00100000:1.0:1651529349.437072:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1783:39029:x1731745946566976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.437077:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178283 count 1 00010000:00010000:1.0:1651529349.437081:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437082:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 4/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437086:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 2/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.437087:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.437090:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437090:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437091:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 4/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437098:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 3/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.437099:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.437102:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 4/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.437105:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153493 00000100:00100000:1.0:1651529349.437107:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966697856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.437107:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1783:39029:x1731745946567104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.437112:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178285 count 1 00000100:00100000:1.0:1651529349.437116:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.437116:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437120:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 2/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.437122:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153494 00010000:00010000:0.0:1651529349.437123:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.437124:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1783:39030:x1731745946567168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.437124:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437125:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 4/0,1 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.437129:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178286 count 1 00010000:00010000:1.0:1651529349.437132:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437136:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 2/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437139:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437140:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437140:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 4/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437151:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 3/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437153:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 3/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.437155:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 4/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437160:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437164:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966697984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.437171:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.437181:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.437190:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.437194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.437206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.437212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.437219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.437224:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567232 00000100:00100000:0.0:1651529349.437231:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567296 00000100:00100000:0.0:1651529349.437246:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567424 00000100:00100000:1.0:1651529349.437250:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567360 00000100:00100000:0.0:1651529349.437251:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153495 00000100:00100000:0.0:1651529349.437252:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946567232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.437256:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153496 00000100:00100000:1.0:1651529349.437257:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1787:39030:x1731745946567296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.437257:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178287 count 1 00010000:00010000:0.0:1651529349.437262:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.437263:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178288 count 1 00010000:00010000:0.0:1651529349.437266:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 2/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437267:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437269:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437270:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437271:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 4/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437273:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 2/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.437277:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 3/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437278:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437279:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437280:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 4/0,1 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437281:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 4/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437291:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 3/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437296:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 4/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437300:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966698112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.437300:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966698048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.437313:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.437313:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.437319:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153497 00000100:00100000:1.0:1651529349.437320:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1787:39030:x1731745946567424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.437321:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153498 00000100:00100000:0.0:1651529349.437322:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946567360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.437325:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178290 count 1 00002000:00080000:0.0:1651529349.437327:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178289 count 1 00010000:00010000:1.0:1651529349.437329:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437331:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437333:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 2/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.437335:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 2/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437336:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437336:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437337:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 4/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437338:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437338:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437339:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 4/0,1 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437343:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 3/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.437346:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437346:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 3/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 280 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.437350:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 4/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437353:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966698176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.437354:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966698240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.437360:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.437361:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.437598:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966697856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.437605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.437608:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.437620:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.437621:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966697984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.437624:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437626:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.437641:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448128 00000100:00100000:0.0:1651529349.437642:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448256 00010000:00010000:1.0:1651529349.437646:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 5/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437648:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 5/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437652:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448192 00000100:00100000:0.0:1651529349.437654:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448320 00010000:00010000:1.0:1651529349.437655:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 4/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 283 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437657:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437660:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12453 00000100:00100000:1.0:1651529349.437661:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396448128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.437663:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12454 00010000:00010000:1.0:1651529349.437664:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.437664:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396448256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.437666:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 5/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437667:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.437668:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 5/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437672:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 4/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437673:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 4/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 284 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437678:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437678:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437679:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437679:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437679:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437680:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437682:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 4/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437683:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 4/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437687:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.437688:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.437699:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396448256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.437703:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12454 00000100:00100000:1.0:1651529349.437706:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396448128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.437708:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12455 00000100:00100000:0.0:1651529349.437710:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396448192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.437711:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12453 00010000:00010000:0.0:1651529349.437712:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.437714:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 4/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 283 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437717:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 3/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437719:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12456 00000100:00100000:1.0:1651529349.437722:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396448320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.437726:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.437728:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437732:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 3/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437754:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b958ba7/0xa29a79078f3bc021 lrc: 0/0,0 mode: --/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d3d expref: 282 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437758:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.437759:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437760:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c31cac8/0xa29a79078f3ba165 lrc: 0/0,0 mode: --/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0350 expref: 281 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.437760:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437763:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 4/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437770:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437771:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.437772:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437775:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 4/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437782:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.437790:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.437790:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+280:41279:x1731746396448192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.437793:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12455 00000100:00100000:1.0:1651529349.437799:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396448320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 77us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.437816:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fbfb03/0xa29a79078f3b995b lrc: 0/0,0 mode: --/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce34b expref: 279 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.437820:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12456 00000100:00100000:0.0:1651529349.437826:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966697920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.437833:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437839:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437841:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437844:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437847:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437850:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437852:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437857:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437862:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437911:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1789:39029:x1731745946567104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 803us (880us total) trans 30064894354 rc 0/0 00000100:00100000:0.0:1651529349.437914:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153493 00000100:00100000:1.0:1651529349.437915:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1789:39030:x1731745946567168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 790us (871us total) trans 30064894355 rc 0/0 00000100:00100000:1.0:1651529349.437919:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153494 00010000:00010000:1.0:1651529349.437927:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437929:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022c60ce/0xa29a79078f3ba93e lrc: 0/0,0 mode: --/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d242e expref: 277 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.437931:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.437932:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437933:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966697792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.437935:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 3/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437936:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437940:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 1/0,0 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437940:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437943:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c0158 lrc: 0/0,0 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437943:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437946:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437948:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.437948:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437951:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.437952:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437955:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 3/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437958:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 1/0,0 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437963:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0151 lrc: 0/0,0 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437966:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437969:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.437970:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437972:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 3/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437975:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 1/0,0 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437978:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0143 lrc: 0/0,0 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437984:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437984:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1788:39030:x1731745946567040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 970us (1002us total) trans 30064894356 rc 0/0 00010000:00010000:1.0:1651529349.437986:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.437987:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153491 00010000:00010000:1.0:1651529349.437989:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.437992:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438034:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.438044:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1788:39029:x1731745946566976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 965us (1029us total) trans 30064894357 rc 0/0 00000100:00100000:1.0:1651529349.438047:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153492 00000100:00100000:0.0:1651529349.438047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.438059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.438062:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966698176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.438066:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438073:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448448 00010000:00010000:1.0:1651529349.438077:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 5/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 277 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.438097:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448576 00010000:00010000:1.0:1651529349.438101:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 5/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 278 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.438105:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448384 00010000:00010000:1.0:1651529349.438107:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 5/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 279 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.438112:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448512 00000100:00100000:0.0:1651529349.438127:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966698048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.438131:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438131:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438138:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966698240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.438141:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12457 00010000:00010000:0.0:1651529349.438141:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438143:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+280:41278:x1731746396448448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.438146:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.438147:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 4/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438148:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12458 00000100:00100000:0.0:1651529349.438150:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+280:41278:x1731746396448576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.438151:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 3/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438153:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.438155:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 4/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438157:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be088193/0xa29a79078f3ba333 lrc: 0/0,0 mode: --/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b1b expref: 280 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438161:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438162:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438163:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438166:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 4/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438176:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.438181:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 3/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 279 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.438187:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746396448448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.438189:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12457 00010000:00010000:0.0:1651529349.438192:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007972fc59/0xa29a79078f3ba0af lrc: 0/0,0 mode: --/PR res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d004e expref: 279 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.438194:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12459 00000100:00100000:1.0:1651529349.438196:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41279:x1731746396448384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.438196:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438197:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438197:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438199:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.438200:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 5/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 277 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438201:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 4/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438204:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 4/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 277 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438206:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.438209:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438209:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438210:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438213:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 4/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438214:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746396448576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.438217:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.438217:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12458 00000100:00100000:1.0:1651529349.438222:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044411cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396448384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.438223:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12460 00000100:00100000:1.0:1651529349.438225:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12459 00000100:00100000:0.0:1651529349.438225:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396448512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.438228:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.438229:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 275 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438233:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 3/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 275 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438238:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3ba9a7 lrc: 0/0,0 mode: --/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2569 expref: 275 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438239:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabec496/0xa29a79078f3b9cfe lrc: 0/0,0 mode: --/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf26a expref: 275 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.438241:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438241:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438242:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438244:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966698112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.438245:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 4/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438247:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438255:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.438259:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438261:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41279:x1731746396448512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (177us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.438263:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438264:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12460 00010000:00010000:1.0:1651529349.438266:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438268:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438283:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438287:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438308:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1788:39030:x1731745946567296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1049us (1101us total) trans 30064894358 rc 0/0 00010000:00010000:0.0:1651529349.438309:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438311:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153496 00010000:00010000:0.0:1651529349.438312:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 2/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438319:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438322:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.438323:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438326:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 3/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438331:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 1/0,0 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438334:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c014a lrc: 0/0,0 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438338:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438340:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.438341:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438344:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 3/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438347:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 1/0,0 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438350:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c0166 lrc: 0/0,0 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438353:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 2/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438354:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1788:39029:x1731745946567360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1031us (1141us total) trans 30064894359 rc 0/0 00010000:00010000:1.0:1651529349.438356:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.438356:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 2/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438357:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153498 00010000:00010000:1.0:1651529349.438361:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 3/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438365:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 1/0,0 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438366:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438367:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c0174 lrc: 0/0,0 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438369:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438372:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438372:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438375:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438375:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438378:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438381:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438406:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1789:39029:x1731745946567232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1152us (1211us total) trans 30064894360 rc 0/0 00000100:00100000:0.0:1651529349.438409:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153495 00010000:00010000:0.0:1651529349.438414:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438428:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1788:39030:x1731745946567424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1107us (1209us total) trans 30064894361 rc 0/0 00010000:00010000:0.0:1651529349.438429:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ead11881 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.438430:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438432:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153497 00010000:00010000:0.0:1651529349.438433:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 3/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438438:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 1/0,0 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438439:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438441:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c015f lrc: 0/0,0 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438445:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.438446:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438449:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 3/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438453:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 1/0,0 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438456:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c016d lrc: 0/0,0 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.438499:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567552 00000100:00100000:1.0:1651529349.438515:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567680 00000100:00100000:1.0:1651529349.438521:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153499 00000100:00100000:1.0:1651529349.438522:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1789:39030:x1731745946567552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.438528:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178292 count 1 00010000:00010000:1.0:1651529349.438537:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.438540:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153500 00000100:00100000:0.0:1651529349.438543:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1789:39030:x1731745946567680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.438549:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178294 count 1 00010000:00010000:1.0:1651529349.438553:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 2/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438553:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438558:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438558:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 2/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438559:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438559:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 4/0,1 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438561:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438562:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438568:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 3/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438573:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 4/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.438580:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966698304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.438582:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 4/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438600:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.438606:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 3/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438610:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 4/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438614:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966698368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.438616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438623:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.438630:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567488 00000100:00100000:1.0:1651529349.438635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438649:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567616 00000100:00100000:0.0:1651529349.438658:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153501 00000100:00100000:0.0:1651529349.438659:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1791:39029:x1731745946567488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.438664:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178291 count 1 00010000:00010000:0.0:1651529349.438668:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438673:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 2/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.438687:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153502 00010000:00010000:0.0:1651529349.438693:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438694:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438694:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 4/0,1 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438696:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1791:39029:x1731745946567616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.438702:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178293 count 1 00010000:00010000:1.0:1651529349.438706:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438711:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 2/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438714:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438715:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438716:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 4/0,1 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438721:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 3/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438730:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 3/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438732:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 4/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438744:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 4/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438744:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966698432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.438748:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966698496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.438753:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.438758:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.438767:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438791:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.438800:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.438832:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567808 00000100:00100000:1.0:1651529349.438846:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567744 00000100:00100000:1.0:1651529349.438856:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567936 00000100:00100000:1.0:1651529349.438861:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946567872 00000100:00100000:0.0:1651529349.438863:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153503 00000100:00100000:0.0:1651529349.438865:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1795:39030:x1731745946567808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.438867:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153504 00000100:00100000:1.0:1651529349.438868:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1795:39029:x1731745946567744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.438871:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178296 count 1 00002000:00080000:1.0:1651529349.438873:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178295 count 1 00010000:00010000:0.0:1651529349.438875:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438877:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438880:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 2/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438882:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 2/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438883:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438884:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438884:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 4/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438885:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438886:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438887:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 4/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438891:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 3/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438893:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 3/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438898:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438900:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438902:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966698560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.438904:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966698624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.438912:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.438913:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.438917:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153505 00000100:00100000:1.0:1651529349.438919:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153506 00000100:00100000:0.0:1651529349.438919:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1795:39030:x1731745946567936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.438921:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b0309f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1795:39029:x1731745946567872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.438923:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178298 count 1 00002000:00080000:1.0:1651529349.438925:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178297 count 1 00010000:00010000:0.0:1651529349.438927:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438929:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438931:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 2/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438933:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 2/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438934:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438934:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.438935:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 4/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.438936:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438936:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.438937:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 4/0,1 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.438941:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.438943:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 3/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 272 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.438945:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.438947:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 4/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.438951:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966698688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.438954:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966698752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.438958:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.438960:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.438965:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966698368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.438969:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.438970:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966698304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.438974:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.439077:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448704 00000100:00100000:0.0:1651529349.439078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.439083:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 4/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 273 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.439097:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448640 00000100:00100000:0.0:1651529349.439098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.439100:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 4/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 274 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.439105:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448768 00010000:00010000:1.0:1651529349.439107:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 4/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 275 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439107:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966698432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.439111:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448832 00010000:00010000:0.0:1651529349.439111:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439115:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 5/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439118:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12461 00000100:00100000:0.0:1651529349.439120:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746396448704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.439123:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12462 00010000:00010000:0.0:1651529349.439124:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.439125:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 4/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.439126:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746396448640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.439130:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.439133:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 4/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439139:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 3/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439144:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 3/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439148:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001241229d/0xa29a79078f3bc10f lrc: 0/0,0 mode: --/PR res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8173 expref: 276 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439153:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3ba984 lrc: 0/0,0 mode: --/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d250e expref: 275 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439154:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439155:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439156:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439160:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439161:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 4/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439161:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439162:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439167:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 4/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439170:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.439175:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.439180:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41278:x1731746396448640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.439183:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12462 00000100:00100000:0.0:1651529349.439183:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41278:x1731746396448704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.439186:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12461 00000100:00100000:1.0:1651529349.439188:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12463 00000100:00100000:1.0:1651529349.439190:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396448768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.439193:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.439193:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12464 00010000:00010000:1.0:1651529349.439194:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 4/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439195:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396448832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.439198:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 3/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439198:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.439199:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 5/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439203:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 4/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439204:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d9fcca/0xa29a79078f3b9835 lrc: 0/0,0 mode: --/PR res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf38 expref: 272 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439207:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439208:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439208:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439209:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439209:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439209:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439211:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 4/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439215:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 4/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439222:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.439227:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.439228:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396448768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.439231:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12463 00000100:00100000:0.0:1651529349.439233:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396448832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.439236:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12464 00010000:00010000:1.0:1651529349.439243:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a65e4037/0xa29a79078f3bc2f9 lrc: 0/0,0 mode: --/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8929 expref: 269 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439243:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439246:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439247:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966698496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.439250:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439252:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439252:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439257:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439262:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439268:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439273:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439317:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1797:39030:x1731745946567680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 773us (831us total) trans 30064894362 rc 0/0 00000100:00100000:0.0:1651529349.439320:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153500 00010000:00010000:0.0:1651529349.439327:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439331:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.439332:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439334:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1796:39029:x1731745946567616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 637us (699us total) trans 30064894363 rc 0/0 00010000:00010000:0.0:1651529349.439335:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 3/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439338:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153502 00010000:00010000:0.0:1651529349.439340:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 1/0,0 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439342:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0182 lrc: 0/0,0 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439346:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439348:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439349:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.439350:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439352:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439353:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 3/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439354:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439357:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439358:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 1/0,0 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439361:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0190 lrc: 0/0,0 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439373:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439376:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.439377:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439380:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 3/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439383:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 1/0,0 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439386:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0189 lrc: 0/0,0 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439393:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439396:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439399:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439399:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1796:39029:x1731745946567488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 739us (783us total) trans 30064894364 rc 0/0 00010000:00010000:1.0:1651529349.439401:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439402:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153501 00000100:00100000:1.0:1651529349.439462:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1796:39030:x1731745946567552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 938us (993us total) trans 30064894365 rc 0/0 00000100:00100000:1.0:1651529349.439465:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153499 00000100:00100000:1.0:1651529349.439481:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966698752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.439484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.439485:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439493:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966698624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.439495:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.439509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.439526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.439536:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439540:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.439541:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439544:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 3/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439549:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 1/0,0 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439552:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c017b lrc: 0/0,0 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439562:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966698560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.439563:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448960 00010000:00010000:0.0:1651529349.439565:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439569:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 269 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439572:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966698688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.439575:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449088 00010000:00010000:0.0:1651529349.439575:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439578:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 270 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439581:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396448896 00000100:00100000:1.0:1651529349.439582:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449024 00010000:00010000:1.0:1651529349.439584:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 4/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439586:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.439589:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12465 00000100:00100000:1.0:1651529349.439591:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396448960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.439592:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12466 00010000:00010000:1.0:1651529349.439593:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.439595:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439599:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 3/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439604:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d5688f0/0xa29a79078f3bb6c0 lrc: 0/0,0 mode: --/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5933 expref: 272 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439608:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439608:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439609:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439610:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396449088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.439612:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 4/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439614:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.439615:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 271 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439619:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.439619:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 271 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439624:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098dff87b/0xa29a79078f3ba0d2 lrc: 0/0,0 mode: --/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d012e expref: 271 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439628:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.439632:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746396448960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.439635:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12465 00010000:00010000:0.0:1651529349.439635:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439636:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439639:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 4/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439640:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12467 00000100:00100000:1.0:1651529349.439642:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41278:x1731746396449024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.439644:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.439645:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.439646:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 4/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 269 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.439650:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 3/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 269 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439653:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8367d20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41278:x1731746396449088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.439655:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3010511/0xa29a79078f3bc005 lrc: 0/0,0 mode: --/PR res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7cbf expref: 269 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.439656:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12466 00010000:00010000:1.0:1651529349.439658:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439659:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.439660:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439662:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 4/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439668:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.439674:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746396449024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.439677:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12467 00000100:00100000:0.0:1651529349.439683:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12468 00000100:00100000:0.0:1651529349.439685:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41278:x1731746396448896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.439688:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439688:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.439692:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439695:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439698:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439698:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439703:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 3/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439708:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f061c7c/0xa29a79078f3bc2cf lrc: 0/0,0 mode: --/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8888 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.439712:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439713:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.439714:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439716:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 4/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439723:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.439729:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746396448896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.439732:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12468 00010000:00010000:0.0:1651529349.439750:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439751:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b0309f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1796:39029:x1731745946567872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 829us (950us total) trans 30064894366 rc 0/0 00010000:00010000:0.0:1651529349.439753:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439754:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153506 00010000:00010000:0.0:1651529349.439759:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439761:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439762:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439766:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.439773:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439776:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 3/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439781:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 1/0,0 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439784:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c01ac lrc: 0/0,0 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439788:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439791:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009eb6c22f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.439792:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439797:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 3/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439800:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 1/0,0 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439818:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb6c22f/0xa29a79078f3c01a5 lrc: 0/0,0 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439821:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1796:39030:x1731745946567936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 896us (1024us total) trans 30064894367 rc 0/0 00000100:00100000:0.0:1651529349.439824:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153505 00010000:00010000:1.0:1651529349.439825:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439828:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439831:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439833:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439834:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439837:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439845:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439848:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439879:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1797:39029:x1731745946567744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1009us (1095us total) trans 30064894368 rc 0/0 00000100:00100000:1.0:1651529349.439882:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153504 00000100:00100000:0.0:1651529349.439887:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1796:39030:x1731745946567808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1021us (1119us total) trans 30064894369 rc 0/0 00010000:00010000:1.0:1651529349.439889:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.439890:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153503 00010000:00010000:1.0:1651529349.439894:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.439895:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439898:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 3/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439903:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 1/0,0 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.439905:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c019e lrc: 0/0,0 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439910:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439916:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094136445 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.439917:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439920:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 3/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439925:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 1/0,0 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.439927:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094136445/0xa29a79078f3c0197 lrc: 0/0,0 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.439943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.439960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.439980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.439988:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568000 00000100:00100000:0.0:1651529349.440002:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568064 00000100:00100000:0.0:1651529349.440008:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568192 00000100:00100000:0.0:1651529349.440013:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153507 00000100:00100000:0.0:1651529349.440015:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1798:39029:x1731745946568000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.440020:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178299 count 1 00000100:00100000:1.0:1651529349.440031:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153508 00000100:00100000:1.0:1651529349.440033:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1798:39030:x1731745946568064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.440039:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178300 count 1 00010000:00010000:0.0:1651529349.440039:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440043:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440049:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 2/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440052:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440052:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440053:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 4/0,1 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440054:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 2/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440058:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440059:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440059:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 4/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440061:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 3/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440065:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 4/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440068:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 3/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.440069:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966698816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.440072:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 4/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.440076:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966698880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.440080:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.440085:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.440086:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153509 00000100:00100000:1.0:1651529349.440088:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1798:39030:x1731745946568192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.440092:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178302 count 1 00010000:00010000:1.0:1651529349.440095:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440099:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 2/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.440100:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.440102:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440103:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440103:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 4/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440109:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 3/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440115:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.440119:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966698944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.440126:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.440131:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568128 00000100:00100000:0.0:1651529349.440131:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.440145:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153510 00000100:00100000:1.0:1651529349.440146:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1799:39030:x1731745946568128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.440150:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178301 count 1 00010000:00010000:1.0:1651529349.440154:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440158:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 2/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.440175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.440178:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440179:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440179:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 4/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440187:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 3/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440190:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.440196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.440208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.440217:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568256 00000100:00100000:1.0:1651529349.440220:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966699008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.440226:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568320 00000100:00100000:0.0:1651529349.440229:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568448 00000100:00100000:0.0:1651529349.440230:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568384 00000100:00100000:0.0:1651529349.440233:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153511 00000100:00100000:0.0:1651529349.440235:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1803:39029:x1731745946568256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.440239:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.440246:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153512 00002000:00080000:0.0:1651529349.440246:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178303 count 1 00000100:00100000:1.0:1651529349.440248:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1803:39030:x1731745946568320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.440250:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.440253:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178304 count 1 00010000:00010000:0.0:1651529349.440255:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 2/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 264 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440256:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440261:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 2/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440261:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440261:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440262:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 4/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440264:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440265:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440265:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 4/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440269:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 3/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 264 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440271:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 3/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440272:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 264 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440275:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.440276:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.440279:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966699136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.440285:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.440286:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.440291:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153513 00000100:00100000:0.0:1651529349.440293:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1803:39030:x1731745946568448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.440294:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153514 00000100:00100000:1.0:1651529349.440295:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1803:39030:x1731745946568384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.440298:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178306 count 1 00002000:00080000:1.0:1651529349.440300:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178305 count 1 00010000:00010000:0.0:1651529349.440301:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440303:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440305:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 2/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.440307:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 2/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440308:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440308:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440309:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 4/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440310:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440310:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440311:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 4/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440317:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 3/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440317:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 3/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 264 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.440321:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440323:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.440325:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.440329:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966699200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.440331:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.440341:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.440419:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966698880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.440423:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440448:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966698816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.440453:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440461:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966698944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.440464:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.440542:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449152 00000100:00100000:1.0:1651529349.440543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.440548:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 4/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 265 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.440550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.440565:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449280 00000100:00100000:1.0:1651529349.440567:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449216 00010000:00010000:0.0:1651529349.440569:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440573:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 4/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.440574:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12469 00000100:00100000:0.0:1651529349.440576:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41279:x1731746396449152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.440578:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.440580:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12470 00010000:00010000:0.0:1651529349.440580:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 4/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.440582:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746396449280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.440584:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.440584:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 3/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440586:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440589:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b9d130/0xa29a79078f3bbf9c lrc: 0/0,0 mode: --/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b61 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440590:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 3/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 267 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440593:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440593:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440594:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440596:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893f11c5/0xa29a79078f3baa56 lrc: 0/0,0 mode: --/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27b5 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440598:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 4/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440599:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440600:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440601:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440604:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 4/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440604:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.440612:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41279:x1731746396449152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (81us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.440614:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.440615:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12469 00000100:00100000:0.0:1651529349.440619:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12471 00000100:00100000:1.0:1651529349.440621:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396449280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.440621:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41279:x1731746396449216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.440623:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.440624:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12470 00010000:00010000:0.0:1651529349.440625:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 4/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440629:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 3/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 263 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440631:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440633:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000934279ac/0xa29a79078f3b9a88 lrc: 0/0,0 mode: --/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7dc expref: 263 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.440635:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440637:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.440637:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.440638:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440638:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440640:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440641:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 4/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440650:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.440656:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41279:x1731746396449216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.440659:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12471 00010000:00010000:0.0:1651529349.440666:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440669:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440673:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.440675:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440701:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1805:39030:x1731745946568192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 611us (720us total) trans 30064894370 rc 0/0 00000100:00100000:1.0:1651529349.440706:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153509 00010000:00010000:1.0:1651529349.440717:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440721:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.440723:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440729:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 3/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440752:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 1/0,0 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440756:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c01c1 lrc: 0/0,0 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440760:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440763:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000543b4363 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.440764:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440764:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1804:39029:x1731745946568000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 748us (820us total) trans 30064894371 rc 0/0 00010000:00010000:1.0:1651529349.440767:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 3/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440767:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153507 00010000:00010000:1.0:1651529349.440770:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 1/0,0 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440773:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543b4363/0xa29a79078f3c01b3 lrc: 0/0,0 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440780:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440783:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440786:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440788:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440890:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946568064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 856us (929us total) trans 30064894372 rc 0/0 00000100:00100000:0.0:1651529349.440895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.440902:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153508 00000100:00100000:0.0:1651529349.440916:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.440920:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440924:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.440924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.440925:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440933:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.440934:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 3/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.440944:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 1/0,0 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440947:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c01ba lrc: 0/0,0 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440958:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966699008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.440962:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440965:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.440969:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966699136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.440970:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.440972:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440978:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966699200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.440980:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.440980:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.440982:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.440987:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449344 00000100:00100000:0.0:1651529349.440989:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449472 00010000:00010000:1.0:1651529349.440991:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 263 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.440993:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 263 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.440997:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449600 00000100:00100000:0.0:1651529349.440999:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449408 00010000:00010000:1.0:1651529349.441000:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 264 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441001:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 265 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.441004:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449536 00010000:00010000:1.0:1651529349.441006:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441006:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12472 00000100:00100000:0.0:1651529349.441008:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41278:x1731746396449344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.441011:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12473 00010000:00010000:0.0:1651529349.441011:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.441013:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41278:x1731746396449472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.441013:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441016:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.441016:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 3/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441017:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441021:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 3/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441022:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003178994d/0xa29a79078f3bad66 lrc: 0/0,0 mode: --/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34c0 expref: 266 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441026:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81e78fb/0xa29a79078f3bb8cd lrc: 0/0,0 mode: --/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6167 expref: 265 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441026:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441027:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441028:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441029:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441030:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441031:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441031:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 4/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441034:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 4/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441041:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.441048:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.441051:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396449344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.441054:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12472 00000100:00100000:1.0:1651529349.441056:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008af82672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396449472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.441059:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12473 00000100:00100000:0.0:1651529349.441060:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12474 00000100:00100000:1.0:1651529349.441068:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12475 00000100:00100000:1.0:1651529349.441070:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41279:x1731746396449408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.441072:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.441074:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 262 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441075:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41278:x1731746396449600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.441078:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 3/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 262 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441079:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.441080:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 262 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441083:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04c8ef3/0xa29a79078f3b866f lrc: 0/0,0 mode: --/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbff7 expref: 262 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441085:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 3/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 262 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441086:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441087:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441087:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441090:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 4/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441090:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f41f3fe9/0xa29a79078f3bb93d lrc: 0/0,0 mode: --/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6312 expref: 261 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441093:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441094:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441095:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441100:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.441104:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 4/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441106:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41279:x1731746396449408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.441109:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12475 00010000:00010000:0.0:1651529349.441110:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.441113:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12476 00000100:00100000:1.0:1651529349.441114:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41279:x1731746396449536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.441117:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.441117:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396449600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.441118:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 259 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441119:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12474 00010000:00010000:1.0:1651529349.441122:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 3/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 259 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.441126:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b929290e/0xa29a79078f3bc1da lrc: 0/0,0 mode: --/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d846e expref: 258 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441126:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441129:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441130:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441130:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441131:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441133:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441134:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 4/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441138:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441140:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.441151:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746396449536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.441154:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12476 00010000:00010000:1.0:1651529349.441160:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441163:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441166:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441169:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.441219:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1805:39030:x1731745946568448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (1021us total) trans 30064894373 rc 0/0 00000100:00100000:0.0:1651529349.441224:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153513 00000100:00100000:1.0:1651529349.441233:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946568384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 937us (1025us total) trans 30064894374 rc 0/0 00010000:00010000:0.0:1651529349.441234:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441237:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153514 00010000:00010000:0.0:1651529349.441238:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441241:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441244:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441245:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441249:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441252:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441255:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.441282:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1805:39029:x1731745946568256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1046us (1150us total) trans 30064894375 rc 0/0 00000100:00100000:0.0:1651529349.441285:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153511 00000100:00100000:1.0:1651529349.441289:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946568320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1040us (1114us total) trans 30064894376 rc 0/0 00000100:00100000:1.0:1651529349.441292:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153512 00010000:00010000:0.0:1651529349.441292:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441295:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd02033b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.441297:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441299:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441300:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 3/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441302:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441305:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441305:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 1/0,0 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441308:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02033b/0xa29a79078f3c01dd lrc: 0/0,0 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441310:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441312:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441315:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.441316:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441318:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 3/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441321:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 1/0,0 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441324:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c01e4 lrc: 0/0,0 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441327:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441340:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946568128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1193us (1241us total) trans 30064894377 rc 0/0 00010000:00010000:0.0:1651529349.441340:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b877a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.441341:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441343:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153510 00010000:00010000:0.0:1651529349.441343:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 3/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441347:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 1/0,0 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441349:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441350:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b877a2/0xa29a79078f3c01cf lrc: 0/0,0 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441353:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.441353:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441354:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441356:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.441357:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 3/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441357:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441360:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 3/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441361:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 1/0,0 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441363:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 1/0,0 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441364:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c01d6 lrc: 0/0,0 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441373:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c01c8 lrc: 0/0,0 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.441415:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568576 00000100:00100000:1.0:1651529349.441433:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153515 00000100:00100000:1.0:1651529349.441434:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946568576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.441456:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178308 count 1 00010000:00010000:1.0:1651529349.441461:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441467:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 2/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 256 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441470:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441470:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441471:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 4/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441480:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 3/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 256 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441487:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 256 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.441494:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966699328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.441511:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.441525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.441550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.441560:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568512 00000100:00100000:1.0:1651529349.441562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.441568:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568640 00000100:00100000:1.0:1651529349.441570:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568704 00000100:00100000:1.0:1651529349.441589:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153516 00000100:00100000:1.0:1651529349.441591:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1807:39029:x1731745946568512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.441596:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178307 count 1 00010000:00010000:1.0:1651529349.441600:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.441606:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153517 00000100:00100000:0.0:1651529349.441608:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1807:39029:x1731745946568640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.441613:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 2/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.441614:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178309 count 1 00010000:00010000:1.0:1651529349.441616:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441617:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441617:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 4/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441618:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441625:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 3/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441628:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 4/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441634:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 2/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.441635:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966699392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.441638:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441639:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441639:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 4/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441650:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.441657:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153518 00000100:00100000:1.0:1651529349.441659:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1807:39030:x1731745946568704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.441665:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178310 count 1 00010000:00010000:0.0:1651529349.441666:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441670:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441670:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441674:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.441677:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 2/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441686:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441686:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441687:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 4/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441695:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 3/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441698:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 4/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441699:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.441702:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966699520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.441710:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.441727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.441752:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.441762:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568768 00000100:00100000:0.0:1651529349.441784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.441795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.441796:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568896 00000100:00100000:1.0:1651529349.441802:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568832 00000100:00100000:0.0:1651529349.441819:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946568960 00000100:00100000:1.0:1651529349.441822:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153519 00000100:00100000:1.0:1651529349.441823:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946568768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.441826:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153520 00000100:00100000:0.0:1651529349.441828:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1811:39029:x1731745946568896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.441829:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178311 count 1 00010000:00010000:1.0:1651529349.441833:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.441833:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178313 count 1 00010000:00010000:1.0:1651529349.441838:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 2/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.441838:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441841:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441842:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441842:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 4/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441843:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 2/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.441846:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441847:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441847:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 4/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441849:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 3/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441853:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441854:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 3/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.441857:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966699584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.441858:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441862:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966699648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.441870:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.441877:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153521 00000100:00100000:1.0:1651529349.441878:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946568832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.441883:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178312 count 1 00000100:00100000:0.0:1651529349.441884:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.441886:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.441891:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 2/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.441891:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153522 00000100:00100000:0.0:1651529349.441893:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946568960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.441894:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441894:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.441895:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 4/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.441898:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178314 count 1 00010000:00010000:1.0:1651529349.441901:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 3/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.441901:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.441906:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 2/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.441907:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.441909:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441909:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.441910:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 4/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441911:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966699712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.441916:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 3/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 256 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.441918:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.441920:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.441924:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.441927:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8c32785 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966699328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.441930:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.441931:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.441943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.442003:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449664 00010000:00010000:0.0:1651529349.442018:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 257 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442042:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12477 00000100:00100000:0.0:1651529349.442044:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746396449664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.442047:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.442048:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 257 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442052:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 3/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 257 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442058:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0864b3c/0xa29a79078f3b958e lrc: 0/0,0 mode: --/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd425 expref: 257 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442062:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442062:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442063:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442066:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 4/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442074:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.442077:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442081:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442085:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41279:x1731746396449664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.442088:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12477 00010000:00010000:1.0:1651529349.442089:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442092:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.442153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.442162:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.442173:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.442177:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442184:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449792 00000100:00100000:1.0:1651529349.442191:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1812:39030:x1731745946568576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 755us (789us total) trans 30064894378 rc 0/0 00000100:00100000:1.0:1651529349.442195:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153515 00010000:00010000:0.0:1651529349.442195:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442202:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449728 00010000:00010000:1.0:1651529349.442203:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442205:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 5/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 257 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442206:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.442207:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442209:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449856 00010000:00010000:1.0:1651529349.442211:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 3/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442211:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 5/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 258 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442215:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12478 00010000:00010000:1.0:1651529349.442216:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 1/0,0 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442217:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41279:x1731746396449792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.442218:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c01eb lrc: 0/0,0 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442219:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.442220:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 258 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442224:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 258 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.442229:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966699392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.442232:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9394aec/0xa29a79078f3bb928 lrc: 0/0,0 mode: --/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62e8 expref: 258 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442235:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442236:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442237:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442237:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442240:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 4/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442248:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966699520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.442252:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442263:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12479 00000100:00100000:1.0:1651529349.442265:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746396449728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.442266:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.442270:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.442272:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 4/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 257 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442274:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746396449792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.442276:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 3/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 257 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442277:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12478 00010000:00010000:1.0:1651529349.442281:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f37b676d/0xa29a79078f3bb47b lrc: 0/0,0 mode: --/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50dc expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442282:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12480 00000100:00100000:0.0:1651529349.442284:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746396449856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.442285:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.442286:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442286:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.442287:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442288:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 4/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 255 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442290:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 4/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442292:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 3/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 255 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442296:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.442297:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c585fbe/0xa29a79078f3bb490 lrc: 0/0,0 mode: --/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5130 expref: 255 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.442303:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41278:x1731746396449728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.442303:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442304:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442304:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442306:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12479 00010000:00010000:0.0:1651529349.442307:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 4/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442314:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442318:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.442324:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+253:41278:x1731746396449856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.442325:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442327:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12480 00010000:00010000:1.0:1651529349.442331:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442333:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442339:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442342:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442345:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442348:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442371:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1813:39029:x1731745946568512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 780us (846us total) trans 30064894379 rc 0/0 00000100:00100000:1.0:1651529349.442374:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153516 00010000:00010000:1.0:1651529349.442381:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442384:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.442385:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442388:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 3/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442389:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1812:39029:x1731745946568640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 780us (839us total) trans 30064894380 rc 0/0 00000100:00100000:0.0:1651529349.442392:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153517 00010000:00010000:1.0:1651529349.442393:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 1/0,0 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442395:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c01f2 lrc: 0/0,0 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442400:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442401:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442403:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc6f7bd9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.442404:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442404:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442407:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442407:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 3/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442410:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442412:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 1/0,0 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442414:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6f7bd9/0xa29a79078f3c01f9 lrc: 0/0,0 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442419:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442422:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.442422:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442425:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 3/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442429:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 1/0,0 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442434:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0200 lrc: 0/0,0 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442445:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1812:39030:x1731745946568704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 785us (883us total) trans 30064894381 rc 0/0 00000100:00100000:1.0:1651529349.442448:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153518 00000100:00100000:1.0:1651529349.442517:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966699712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.442522:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442530:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966699584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.442537:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966699648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.442542:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442560:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.442585:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.442593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.442601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.442608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.442614:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449920 00010000:00010000:0.0:1651529349.442614:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442620:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 253 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442623:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450048 00000100:00100000:1.0:1651529349.442626:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396449984 00010000:00010000:1.0:1651529349.442628:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 255 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442628:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 255 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.442632:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450112 00010000:00010000:1.0:1651529349.442634:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442634:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12481 00000100:00100000:0.0:1651529349.442636:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41279:x1731746396449920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.442639:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12482 00010000:00010000:0.0:1651529349.442639:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.442640:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.442641:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41279:x1731746396449984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.442644:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.442644:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 3/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442645:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442649:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 3/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442652:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e63c5ff/0xa29a79078f3bb8f0 lrc: 0/0,0 mode: --/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6208 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442654:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e148be80/0xa29a79078f3baa2c lrc: 0/0,0 mode: --/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2730 expref: 256 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442656:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442656:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442657:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442658:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.442658:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.442659:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442661:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 4/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442665:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 4/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442671:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.442677:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.442681:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396449920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.442684:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12481 00000100:00100000:1.0:1651529349.442685:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396449984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.442688:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12482 00000100:00100000:0.0:1651529349.442690:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12483 00000100:00100000:1.0:1651529349.442693:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12484 00000100:00100000:1.0:1651529349.442694:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41279:x1731746396450112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.442697:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.442698:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 252 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442701:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 3/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 252 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.442709:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41279:x1731746396450048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.442713:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086584bb2/0xa29a79078f3bb593 lrc: 0/0,0 mode: --/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5527 expref: 252 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442713:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.442714:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 252 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442716:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.442717:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.442718:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442721:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 4/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442727:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 3/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.442741:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fec323b/0xa29a79078f3bb936 lrc: 0/0,0 mode: --/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6304 expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.442749:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.442753:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442754:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.442754:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442756:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396450112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.442758:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 4/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442759:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12484 00010000:00010000:0.0:1651529349.442764:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.442767:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442771:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442771:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41279:x1731746396450048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.442773:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12483 00010000:00010000:1.0:1651529349.442774:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442777:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442780:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442784:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442787:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442790:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442842:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1813:39030:x1731745946568768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1017us (1114us total) trans 30064894382 rc 0/0 00000100:00100000:1.0:1651529349.442845:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153519 00000100:00100000:0.0:1651529349.442850:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1812:39029:x1731745946568896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1020us (1097us total) trans 30064894383 rc 0/0 00010000:00010000:1.0:1651529349.442852:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.442853:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153520 00010000:00010000:1.0:1651529349.442855:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442859:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442861:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442864:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.442865:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442868:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 3/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.442870:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442873:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 1/0,0 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442875:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0207 lrc: 0/0,0 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442880:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442883:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005805a892 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.442883:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442886:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 3/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442889:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 1/0,0 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442894:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005805a892/0xa29a79078f3c020e lrc: 0/0,0 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442898:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442900:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.442901:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442903:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 3/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442906:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 1/0,0 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442907:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1812:39030:x1731745946568832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1123us total) trans 30064894384 rc 0/0 00000100:00100000:1.0:1651529349.442909:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153521 00010000:00010000:0.0:1651529349.442909:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0215 lrc: 0/0,0 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442914:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442917:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442920:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.442923:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.442947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.442958:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1812:39030:x1731745946568960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1064us (1162us total) trans 30064894385 rc 0/0 00000100:00100000:0.0:1651529349.442961:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153522 00000100:00100000:1.0:1651529349.442962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.442976:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569024 00000100:00100000:1.0:1651529349.442977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.442986:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569152 00000100:00100000:0.0:1651529349.442990:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569088 00000100:00100000:0.0:1651529349.442997:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153523 00000100:00100000:1.0:1651529349.442998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.442998:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1814:39029:x1731745946569024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.443003:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178315 count 1 00010000:00010000:0.0:1651529349.443007:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443012:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 2/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 248 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443015:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443016:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443016:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 4/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443023:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 3/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 248 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443027:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 248 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.443031:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.443040:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.443046:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569216 00000100:00100000:0.0:1651529349.443053:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153524 00000100:00100000:0.0:1651529349.443055:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1815:39029:x1731745946569152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.443059:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178317 count 1 00010000:00010000:0.0:1651529349.443063:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443067:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 2/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443070:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443070:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443071:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 4/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443077:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 3/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443080:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443100:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153525 00000100:00100000:1.0:1651529349.443102:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1815:39030:x1731745946569088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.443108:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178316 count 1 00000100:00100000:0.0:1651529349.443110:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.443112:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443118:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 2/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443121:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443121:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.443124:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a910662 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.443129:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 4/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443132:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153526 00000100:00100000:0.0:1651529349.443134:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1815:39030:x1731745946569216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.443137:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 3/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.443139:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178318 count 1 00010000:00010000:0.0:1651529349.443142:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443147:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 2/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443150:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443150:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443151:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 4/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443152:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443156:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966699968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.443166:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.443171:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 3/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443175:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.443179:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966700032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.443183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.443187:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.443192:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443195:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000494f2e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.443196:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443218:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 3/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443223:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 1/0,0 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443226:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494f2e69/0xa29a79078f3c021c lrc: 0/0,0 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443237:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569280 00000100:00100000:0.0:1651529349.443247:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153527 00000100:00100000:0.0:1651529349.443248:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1816:39029:x1731745946569280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.443253:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178319 count 1 00010000:00010000:0.0:1651529349.443257:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443261:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 2/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.443264:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443265:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443265:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 4/0,1 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443272:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 3/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 248 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.443278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.443278:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 4/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.443282:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.443296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.443298:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.443307:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966699840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.443310:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.443341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.443352:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450176 00000100:00100000:1.0:1651529349.443358:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569344 00000100:00100000:1.0:1651529349.443366:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569472 00000100:00100000:1.0:1651529349.443370:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569408 00010000:00010000:0.0:1651529349.443371:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 249 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443374:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153528 00000100:00100000:1.0:1651529349.443376:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1819:39030:x1731745946569344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.443380:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12485 00002000:00080000:1.0:1651529349.443381:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178320 count 1 00000100:00100000:0.0:1651529349.443382:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396450176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.443385:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.443386:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,1 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443386:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 249 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443390:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 3/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 249 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.443391:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 2/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 249 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443394:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443394:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443395:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 4/0,1 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443395:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3b92a1 lrc: 0/0,0 mode: --/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc839 expref: 249 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443399:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443400:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443401:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443404:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 4/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443410:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.443413:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 3/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 248 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443417:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 4/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 248 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.443418:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41278:x1731746396450176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.443421:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.443421:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12485 00010000:00010000:0.0:1651529349.443427:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443430:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443434:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.443434:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443436:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443444:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153529 00000100:00100000:1.0:1651529349.443446:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1819:39030:x1731745946569472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.443452:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178322 count 1 00010000:00010000:1.0:1651529349.443464:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443470:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 2/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 247 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443475:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443476:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443477:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 4/0,1 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443487:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 3/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 247 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443491:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 4/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 247 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443496:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966700224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.443505:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.443505:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1820:39029:x1731745946569024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 505us (558us total) trans 30064894386 rc 0/0 00000100:00100000:0.0:1651529349.443508:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153523 00000100:00100000:1.0:1651529349.443512:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153530 00000100:00100000:1.0:1651529349.443515:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1819:39029:x1731745946569408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.443522:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178321 count 1 00010000:00010000:1.0:1651529349.443527:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443533:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 2/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 247 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443550:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443551:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443551:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 4/0,1 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443559:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 3/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 247 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443570:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 4/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 247 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443575:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966700288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.443590:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.443592:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.443598:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443601:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000710bab5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.443602:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.443605:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 3/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443610:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 1/0,0 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443613:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000710bab5/0xa29a79078f3c0223 lrc: 0/0,0 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.443639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.443647:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966699968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.443650:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966699904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.443652:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443655:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443661:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450240 00000100:00100000:0.0:1651529349.443662:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966700032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.443665:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443668:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443678:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450368 00010000:00010000:1.0:1651529349.443681:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 249 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443685:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450432 00000100:00100000:0.0:1651529349.443686:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450304 00010000:00010000:1.0:1651529349.443688:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 5/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443692:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443693:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12486 00000100:00100000:1.0:1651529349.443694:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41279:x1731746396450240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.443697:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.443698:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.443698:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12487 00010000:00010000:1.0:1651529349.443702:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 3/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.443707:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3b9fc8 lrc: 0/0,0 mode: --/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcea expref: 251 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.443711:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443712:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443712:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443713:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396450368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.443716:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 4/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443717:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.443719:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 250 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443723:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 3/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 250 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.443727:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.443742:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985d26d0/0xa29a79078f3ba8ab lrc: 0/0,0 mode: --/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d222f expref: 250 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443743:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396450240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.443746:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12486 00010000:00010000:0.0:1651529349.443747:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443747:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443748:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443751:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12488 00010000:00010000:0.0:1651529349.443751:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 4/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443753:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41278:x1731746396450432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.443756:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.443757:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 5/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443758:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.443761:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 4/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 248 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.443766:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.443766:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41279:x1731746396450368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (141us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.443767:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443767:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443768:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12487 00010000:00010000:1.0:1651529349.443770:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 4/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.443774:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12489 00010000:00010000:1.0:1651529349.443775:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.443775:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746396450304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.443778:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.443780:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41278:x1731746396450432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.443780:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 247 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443782:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12488 00010000:00010000:0.0:1651529349.443784:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 3/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 247 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443788:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006001e54/0xa29a79078f3bb15d lrc: 0/0,0 mode: --/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43f4 expref: 246 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.443792:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443793:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.443793:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443796:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 4/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.443816:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.443828:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087fbabe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396450304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.443831:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12489 00010000:00010000:0.0:1651529349.443845:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443849:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443852:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443855:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443871:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569536 00000100:00100000:1.0:1651529349.443894:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153531 00000100:00100000:1.0:1651529349.443895:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1820:39030:x1731745946569536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.443901:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178323 count 1 00010000:00010000:1.0:1651529349.443905:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443912:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 2/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443915:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443916:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.443916:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 4/0,1 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443923:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 3/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 244 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.443927:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 4/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 244 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.443931:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966700352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.443932:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1821:39030:x1731745946569216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 797us (938us total) trans 30064894387 rc 0/0 00000100:00100000:0.0:1651529349.443935:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153526 00010000:00010000:0.0:1651529349.443943:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.443944:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.443951:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443955:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443958:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.443961:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443964:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443968:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.443977:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444015:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1822:39030:x1731745946569088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 912us (1037us total) trans 30064894388 rc 0/0 00000100:00100000:1.0:1651529349.444018:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153525 00010000:00010000:1.0:1651529349.444026:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444026:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1821:39029:x1731745946569152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 969us (1063us total) trans 30064894389 rc 0/0 00000100:00100000:0.0:1651529349.444029:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153524 00010000:00010000:1.0:1651529349.444030:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5b1f4e3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.444031:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444034:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 3/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444037:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444039:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 1/0,0 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444040:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.444041:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444042:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1f4e3/0xa29a79078f3c0238 lrc: 0/0,0 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444045:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 3/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444046:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444049:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ead11881 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.444049:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 1/0,0 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444050:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444052:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0231 lrc: 0/0,0 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444055:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 3/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444058:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 1/0,0 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444061:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead11881/0xa29a79078f3c022a lrc: 0/0,0 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444063:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d07efc1/0xa29a79078f3bb9d7 lrc: 0/0,0 mode: --/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d657a expref: 244 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.444066:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.444069:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444073:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444075:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444078:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444081:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444126:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1821:39029:x1731745946569280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 876us (942us total) trans 30064894390 rc 0/0 00000100:00100000:0.0:1651529349.444129:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153527 00010000:00010000:0.0:1651529349.444136:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444141:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eed32ca3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.444142:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444145:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 3/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444150:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 1/0,0 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.444153:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed32ca3/0xa29a79078f3c023f lrc: 0/0,0 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.444167:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450560 00010000:00010000:0.0:1651529349.444173:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 5/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 244 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.444183:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450496 00010000:00010000:0.0:1651529349.444186:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 5/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 245 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.444190:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12490 00000100:00100000:0.0:1651529349.444192:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396450560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.444195:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.444196:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 5/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 245 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444202:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 4/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 245 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444207:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444208:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444208:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444211:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 4/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444216:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.444225:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396450560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.444226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.444227:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12490 00000100:00100000:0.0:1651529349.444231:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450624 00010000:00010000:0.0:1651529349.444234:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 5/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 245 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.444239:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12491 00000100:00100000:0.0:1651529349.444240:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41278:x1731746396450496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.444243:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.444244:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 5/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 245 pid: 127523 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444247:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 4/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 245 pid: 127523 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444252:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444252:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444253:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444263:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386163d7/0xa29a79078f3b7d00 lrc: 0/0,0 mode: --/PR res: [0x2b890:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb2e expref: 245 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444271:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.444280:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 4/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444285:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 4/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444286:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.444291:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444293:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746396450496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.444296:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444300:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444303:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444307:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12491 00000100:00100000:0.0:1651529349.444312:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12492 00000100:00100000:0.0:1651529349.444314:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396450624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.444317:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.444318:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 5/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444322:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 4/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444327:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444328:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444329:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444334:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 4/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444338:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.444345:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1821:39030:x1731745946569344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 968us (1068us total) trans 30064894391 rc 0/0 00000100:00100000:0.0:1651529349.444345:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396450624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.444347:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12492 00000100:00100000:1.0:1651529349.444348:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153528 00010000:00010000:1.0:1651529349.444360:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a86c57df/0xa29a79078f3b9732 lrc: 0/0,0 mode: --/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdae6 expref: 242 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444364:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966700224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.444367:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444371:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444373:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444376:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444387:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.444444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.444464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.444471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.444486:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1821:39030:x1731745946569472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1039us (1189us total) trans 30064894392 rc 0/0 00000100:00100000:0.0:1651529349.444489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.444490:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153529 00000100:00100000:1.0:1651529349.444495:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569600 00000100:00100000:1.0:1651529349.444502:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569664 00000100:00100000:1.0:1651529349.444515:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569728 00000100:00100000:0.0:1651529349.444516:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569792 00000100:00100000:1.0:1651529349.444521:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153532 00000100:00100000:1.0:1651529349.444522:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1824:39030:x1731745946569600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.444525:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153533 00002000:00080000:1.0:1651529349.444527:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178324 count 1 00000100:00100000:0.0:1651529349.444527:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1824:39029:x1731745946569664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.444532:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.444533:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178325 count 1 00010000:00010000:1.0:1651529349.444537:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 2/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 241 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444537:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444540:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444540:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444541:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 4/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444548:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 3/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 241 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.444551:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 241 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444555:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 2/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 241 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.444558:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966700416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.444560:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444560:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444561:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 4/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444573:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.444580:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450688 00010000:00010000:1.0:1651529349.444584:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 5/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 242 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444585:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 242 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444589:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 242 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444594:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12493 00000100:00100000:1.0:1651529349.444596:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41278:x1731746396450688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.444599:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.444599:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.444600:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 5/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 242 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.444604:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 4/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 242 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.444608:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.444609:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444610:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444611:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444614:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 4/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444615:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153534 00000100:00100000:0.0:1651529349.444616:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1824:39030:x1731745946569728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.444619:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.444625:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41278:x1731746396450688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.444628:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12493 00002000:00080000:0.0:1651529349.444634:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178326 count 1 00010000:00010000:0.0:1651529349.444638:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444639:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd56a43/0xa29a79078f3bb2f3 lrc: 0/0,0 mode: --/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b10 expref: 241 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444642:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966700288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.444642:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 2/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.444646:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444646:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444646:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444647:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 4/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444649:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444652:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444653:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 3/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.444655:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444656:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 4/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 240 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.444657:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444661:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966700544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.444676:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.444682:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153535 00000100:00100000:0.0:1651529349.444684:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000544c90e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1825:39029:x1731745946569792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.444688:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178327 count 1 00010000:00010000:0.0:1651529349.444692:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444696:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 2/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444699:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444699:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.444700:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1825:39029:x1731745946569408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1184us (1374us total) trans 30064894393 rc 0/0 00010000:00010000:0.0:1651529349.444700:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 4/0,1 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444703:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153530 00010000:00010000:0.0:1651529349.444706:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 3/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 240 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444709:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 4/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 240 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.444710:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444713:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966700608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.444715:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.444717:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444719:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 3/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444720:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.444724:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 1/0,0 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444726:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444727:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0246 lrc: 0/0,0 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444729:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.444730:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444731:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444742:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 3/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444743:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049a58713 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.444744:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444747:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 3/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444748:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 1/0,0 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444750:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 1/0,0 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444750:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c024d lrc: 0/0,0 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444756:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a58713/0xa29a79078f3c0254 lrc: 0/0,0 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444766:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d9d0c2/0xa29a79078f3bc0d7 lrc: 0/0,0 mode: --/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8070 expref: 240 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444770:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966700352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.444773:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.444785:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444788:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444791:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.444794:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.444860:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569856 00000100:00100000:0.0:1651529349.444866:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569920 00000100:00100000:0.0:1651529349.444870:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153536 00000100:00100000:0.0:1651529349.444871:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1827:39030:x1731745946569856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.444876:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178328 count 1 00010000:00010000:0.0:1651529349.444881:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444885:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 2/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444899:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444900:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.444900:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 4/0,1 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444908:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 3/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444912:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 4/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.444920:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1827:39030:x1731745946569536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1120us total) trans 30064894394 rc 0/0 00000100:00100000:1.0:1651529349.444924:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153531 00000100:00100000:1.0:1651529349.444931:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153537 00000100:00100000:1.0:1651529349.444932:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1826:39030:x1731745946569920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.444937:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178329 count 1 00000100:00100000:0.0:1651529349.444938:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966700672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.444942:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444947:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 2/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 239 pid: 127526 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.444947:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.444950:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444951:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.444951:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 4/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444952:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.444956:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f72021b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.444957:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444958:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 239 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.444960:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 3/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.444962:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 239 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.444964:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 1/0,0 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.444966:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966700736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.444975:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.444990:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f72021b/0xa29a79078f3c025b lrc: 0/0,0 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445019:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.445052:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946569984 00000100:00100000:1.0:1651529349.445062:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153538 00000100:00100000:1.0:1651529349.445064:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1827:39030:x1731745946569984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.445069:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178330 count 1 00010000:00010000:1.0:1651529349.445074:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445078:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 2/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 239 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.445081:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445082:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445083:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 4/0,1 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445089:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 3/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 239 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.445092:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 4/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 239 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.445096:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.445112:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.445127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.445175:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570048 00000100:00100000:1.0:1651529349.445185:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153539 00000100:00100000:1.0:1651529349.445188:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1828:39030:x1731745946570048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.445195:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178331 count 1 00010000:00010000:1.0:1651529349.445209:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445217:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 2/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 239 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.445223:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445224:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445225:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 4/0,1 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445233:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 3/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 239 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.445233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.445236:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 4/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 239 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445239:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.445240:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966700864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.445245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.445256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.445262:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.445271:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966700416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.445275:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445296:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.445300:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445301:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450752 00010000:00010000:1.0:1651529349.445306:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 240 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445308:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966700544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.445311:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445312:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450944 00010000:00010000:1.0:1651529349.445314:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 5/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 241 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445317:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966700608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.445318:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450816 00010000:00010000:0.0:1651529349.445319:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445320:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 242 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.445324:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396450880 00010000:00010000:1.0:1651529349.445326:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 4/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445327:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12494 00000100:00100000:0.0:1651529349.445328:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396450752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.445331:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12495 00000100:00100000:1.0:1651529349.445332:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396450944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.445332:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.445335:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.445336:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 4/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445340:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 3/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445341:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445345:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 3/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445346:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3ba97d lrc: 0/0,0 mode: --/PR res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2500 expref: 243 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445350:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445350:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445351:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445351:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082927820/0xa29a79078f3b99f5 lrc: 0/0,0 mode: --/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce589 expref: 242 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445354:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 4/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445355:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445356:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445357:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445360:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 4/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445369:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.445392:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396450944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.445398:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12495 00010000:00010000:0.0:1651529349.445405:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.445413:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c11cc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41278:x1731746396450752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.445417:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12496 00000100:00100000:0.0:1651529349.445418:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12494 00000100:00100000:1.0:1651529349.445419:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746396450816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.445422:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.445424:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 239 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445428:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 239 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445429:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12497 00000100:00100000:0.0:1651529349.445431:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41279:x1731746396450880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.445434:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000050861d/0xa29a79078f3b970f lrc: 0/0,0 mode: --/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9e3 expref: 239 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445434:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.445435:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 4/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 239 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445438:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445439:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445439:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 3/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 238 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445440:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445445:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 4/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445460:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.445468:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41279:x1731746396450816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.445471:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12496 00010000:00010000:0.0:1651529349.445473:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d903a6/0xa29a79078f3bab59 lrc: 0/0,0 mode: --/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c38 expref: 238 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445478:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445478:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445479:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445482:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 4/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445484:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966700736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.445488:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445489:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.445494:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445496:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41279:x1731746396450880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (240us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.445497:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445498:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12497 00010000:00010000:1.0:1651529349.445500:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445503:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445510:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0a6e736 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966700672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.445514:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445519:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445522:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445525:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445537:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445543:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1829:39030:x1731745946569600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1020us (1130us total) trans 30064894395 rc 0/0 00000100:00100000:1.0:1651529349.445554:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153532 00010000:00010000:1.0:1651529349.445561:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445565:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f8bd8f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.445565:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445568:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 3/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445574:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 1/0,0 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445577:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8bd8f3/0xa29a79078f3c0262 lrc: 0/0,0 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445581:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445583:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000544c90e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1829:39029:x1731745946569792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 898us (1093us total) trans 30064894396 rc 0/0 00010000:00010000:1.0:1651529349.445584:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.445585:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445586:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153535 00010000:00010000:1.0:1651529349.445587:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 3/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445591:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 1/0,0 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445593:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0277 lrc: 0/0,0 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445594:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445597:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445600:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445603:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.445636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.445649:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1829:39030:x1731745946569728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1031us (1177us total) trans 30064894397 rc 0/0 00000100:00100000:1.0:1651529349.445652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.445652:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153534 00010000:00010000:0.0:1651529349.445658:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445661:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a685879 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.445662:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445673:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 3/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445678:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 1/0,0 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445681:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a685879/0xa29a79078f3c0270 lrc: 0/0,0 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.445689:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451008 00010000:00010000:0.0:1651529349.445694:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 4/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 236 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445700:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451072 00010000:00010000:0.0:1651529349.445702:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 237 pid: 127526 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445706:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451136 00010000:00010000:0.0:1651529349.445708:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 5/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 238 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445712:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451200 00010000:00010000:0.0:1651529349.445715:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 5/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 239 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.445719:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12498 00000100:00100000:0.0:1651529349.445721:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746396451008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.445730:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.445731:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 4/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445742:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 3/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445747:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4373e47/0xa29a79078f3b85ab lrc: 0/0,0 mode: --/PR res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf87 expref: 239 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445751:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445751:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445752:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445755:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12499 00010000:00010000:0.0:1651529349.445755:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 4/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445757:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41278:x1731746396451072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.445761:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.445762:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.445763:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 238 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445767:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 238 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445780:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e0afdb/0xa29a79078f3b87f7 lrc: 0/0,0 mode: --/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0d0 expref: 238 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445784:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445784:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445785:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445788:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 4/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445790:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396451008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.445793:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12498 00010000:00010000:1.0:1651529349.445795:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.445799:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12500 00000100:00100000:0.0:1651529349.445801:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41278:x1731746396451136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.445802:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41278:x1731746396451072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.445815:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.445820:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12499 00010000:00010000:0.0:1651529349.445822:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 5/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 236 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.445827:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12501 00000100:00100000:1.0:1651529349.445828:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746396451200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.445831:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.445833:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 5/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 235 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.445836:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 4/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 235 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445837:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 4/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 235 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.445842:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445842:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445843:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.445843:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.445844:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445844:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445846:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 4/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445847:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 4/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445851:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.445851:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.445857:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf8dc83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746396451200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.445859:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12501 00000100:00100000:0.0:1651529349.445859:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746396451136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.445861:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12500 00010000:00010000:1.0:1651529349.445865:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445869:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445872:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445875:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445889:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445893:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445896:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445899:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.445933:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1830:39030:x1731745946569920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1139us total) trans 30064894398 rc 0/0 00000100:00100000:1.0:1651529349.445936:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153537 00010000:00010000:1.0:1651529349.445944:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445946:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1829:39030:x1731745946569856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1168us total) trans 30064894399 rc 0/0 00010000:00010000:1.0:1651529349.445947:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f9ca756 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.445948:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445949:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153536 00010000:00010000:1.0:1651529349.445951:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 3/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445956:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 1/0,0 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445957:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445959:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9ca756/0xa29a79078f3c0285 lrc: 0/0,0 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445960:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445963:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.445963:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445966:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.445966:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445967:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445972:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 3/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445975:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 1/0,0 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445978:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c027e lrc: 0/0,0 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445981:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445984:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000685a06e4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.445985:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445987:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 3/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445991:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 1/0,0 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.445993:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685a06e4/0xa29a79078f3c0269 lrc: 0/0,0 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.445998:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1829:39029:x1731745946569664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1470us (1534us total) trans 30064894400 rc 0/0 00000100:00100000:0.0:1651529349.446001:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153533 00010000:00010000:1.0:1651529349.446004:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a8506ad/0xa29a79078f3bb5d9 lrc: 0/0,0 mode: --/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5615 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446007:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.446011:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446014:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446017:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446020:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446022:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.446056:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.446066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.446089:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1829:39030:x1731745946569984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1024us (1069us total) trans 30064894401 rc 0/0 00000100:00100000:1.0:1651529349.446092:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153538 00000100:00100000:1.0:1651529349.446109:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570112 00000100:00100000:0.0:1651529349.446115:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570176 00000100:00100000:1.0:1651529349.446130:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570240 00000100:00100000:0.0:1651529349.446138:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153540 00000100:00100000:0.0:1651529349.446139:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946570112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.446141:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153541 00000100:00100000:1.0:1651529349.446143:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1831:39029:x1731745946570176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.446151:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178333 count 1 00010000:00010000:1.0:1651529349.446157:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.446161:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178332 count 1 00010000:00010000:1.0:1651529349.446163:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 2/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446166:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446166:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446166:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446167:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 4/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446171:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 2/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446174:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 3/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446174:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446175:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446175:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 4/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446178:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446182:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.446183:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 3/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446186:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.446190:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.446197:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.446203:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446206:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ae8a38f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.446207:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446207:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.446210:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 3/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446214:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153542 00000100:00100000:0.0:1651529349.446216:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946570240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.446217:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 1/0,0 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446220:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae8a38f/0xa29a79078f3c028c lrc: 0/0,0 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.446220:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178334 count 1 00010000:00010000:0.0:1651529349.446224:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446228:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 2/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 232 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446231:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f99b0ef/0xa29a79078f3bbe61 lrc: 0/0,0 mode: --/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76d0 expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446234:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966700864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.446234:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446234:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446235:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 4/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446238:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446241:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446241:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446244:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446244:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446247:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446248:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966701056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.446249:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446254:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.446288:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1832:39030:x1731745946570048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1099us (1161us total) trans 30064894402 rc 0/0 00000100:00100000:1.0:1651529349.446291:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153539 00010000:00010000:1.0:1651529349.446298:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446302:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000817e8576 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.446303:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.446322:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 3/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.446327:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 1/0,0 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446330:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817e8576/0xa29a79078f3c0293 lrc: 0/0,0 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446338:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570368 00000100:00100000:0.0:1651529349.446344:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.446351:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570304 00000100:00100000:1.0:1651529349.446355:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570496 00000100:00100000:0.0:1651529349.446355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.446367:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570432 00000100:00100000:1.0:1651529349.446371:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153543 00000100:00100000:1.0:1651529349.446373:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946570368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.446377:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153544 00000100:00100000:0.0:1651529349.446379:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1835:39029:x1731745946570304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.446385:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178335 count 1 00002000:00080000:1.0:1651529349.446389:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178336 count 1 00010000:00010000:0.0:1651529349.446389:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446393:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 2/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446394:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446399:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 2/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446399:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446399:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446400:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 4/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446402:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446403:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446404:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 4/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446407:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 3/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446410:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446411:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 3/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.446414:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966701120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.446415:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446419:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966701184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.446424:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.446427:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.446430:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153545 00000100:00100000:0.0:1651529349.446432:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946570496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.446435:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153546 00000100:00100000:1.0:1651529349.446436:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1835:39029:x1731745946570432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.446441:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178337 count 1 00010000:00010000:1.0:1651529349.446444:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446448:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 2/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446451:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446452:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529349.446452:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178338 count 1 00010000:00010000:1.0:1651529349.446453:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 4/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446456:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446460:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 2/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446461:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 3/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446463:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446464:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.446464:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446465:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 4/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446468:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966701248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.446474:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.446474:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 3/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 231 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446478:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.446482:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.446489:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.446491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.446499:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570560 00000100:00100000:1.0:1651529349.446510:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153547 00000100:00100000:1.0:1651529349.446513:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1836:39030:x1731745946570560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.446531:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178339 count 1 00010000:00010000:1.0:1651529349.446542:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446552:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 2/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 231 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.446555:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446555:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446556:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 4/0,1 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446561:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc905c76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966700992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.446563:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 3/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 231 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.446566:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446570:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 4/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 231 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.446573:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966701056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.446574:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966701376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.446575:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446588:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.446601:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966700928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.446607:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.446674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.446678:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451328 00000100:00100000:0.0:1651529349.446681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.446686:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446696:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12502 00000100:00100000:1.0:1651529349.446706:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41279:x1731746396451328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.446710:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451264 00010000:00010000:1.0:1651529349.446711:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.446714:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.446716:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446728:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 3/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.446742:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451392 00010000:00010000:1.0:1651529349.446744:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096b67e63/0xa29a79078f3bbf5d lrc: 0/0,0 mode: --/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a49 expref: 234 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.446746:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 234 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446751:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446751:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.446751:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12503 00010000:00010000:1.0:1651529349.446752:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.446753:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396451264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.446755:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 4/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446755:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.446757:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.446761:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 3/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446765:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.446773:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa9091c/0xa29a79078f3bb37f lrc: 0/0,0 mode: --/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cc2 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.446776:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396451328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 77us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.446779:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12502 00010000:00010000:0.0:1651529349.446781:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446782:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446783:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446785:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12504 00010000:00010000:0.0:1651529349.446786:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 4/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446787:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41279:x1731746396451392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.446790:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.446791:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.446795:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.446802:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.446820:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41279:x1731746396451264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.446822:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12503 00010000:00010000:1.0:1651529349.446826:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013b51f05/0xa29a79078f3b9e78 lrc: 0/0,0 mode: --/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf821 expref: 230 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.446830:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.446830:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446831:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.446831:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446834:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 4/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446834:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446837:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446840:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446842:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.446849:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41279:x1731746396451392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.446852:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12504 00000100:00100000:0.0:1651529349.446886:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1837:39030:x1731745946570112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 745us (844us total) trans 30064894403 rc 0/0 00000100:00100000:0.0:1651529349.446889:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153540 00010000:00010000:1.0:1651529349.446892:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446895:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446896:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446899:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446900:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446903:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446903:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446905:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.446964:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1838:39029:x1731745946570176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 820us (908us total) trans 30064894404 rc 0/0 00000100:00100000:1.0:1651529349.446968:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153541 00000100:00100000:0.0:1651529349.446969:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1838:39030:x1731745946570240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 752us (903us total) trans 30064894405 rc 0/0 00000100:00100000:0.0:1651529349.446974:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153542 00010000:00010000:1.0:1651529349.446976:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446981:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.446982:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446982:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446985:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 3/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446986:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.446987:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446990:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 1/0,0 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446990:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 3/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446993:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c02a1 lrc: 0/0,0 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446994:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 1/0,0 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.446997:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.446997:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c02a8 lrc: 0/0,0 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447000:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044bb7b14 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.447001:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447004:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 3/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447007:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 1/0,0 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447012:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bb7b14/0xa29a79078f3c029a lrc: 0/0,0 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447061:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966701120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.447066:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447108:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.447112:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447116:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966701184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.447121:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447131:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966701248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.447134:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.447158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.447163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.447174:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451520 00000100:00100000:1.0:1651529349.447175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.447184:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.447185:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 229 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.447190:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451648 00000100:00100000:0.0:1651529349.447191:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451456 00010000:00010000:0.0:1651529349.447194:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447196:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 231 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447198:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451584 00010000:00010000:0.0:1651529349.447200:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.447202:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451712 00010000:00010000:1.0:1651529349.447204:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 5/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 233 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447205:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12505 00000100:00100000:0.0:1651529349.447207:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41278:x1731746396451520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.447209:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12506 00010000:00010000:0.0:1651529349.447209:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.447211:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41278:x1731746396451456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.447211:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447214:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.447214:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 3/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447216:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447219:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 3/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.447220:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d9b5b7d/0xa29a79078f3b9ac0 lrc: 0/0,0 mode: --/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce972 expref: 233 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447225:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8182644/0xa29a79078f3bab60 lrc: 0/0,0 mode: --/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c46 expref: 232 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447229:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447230:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447230:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447234:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 4/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447238:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447239:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447240:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447243:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.447251:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 4/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447252:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41278:x1731746396451456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.447255:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12506 00010000:00010000:0.0:1651529349.447261:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.447267:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12507 00000100:00100000:1.0:1651529349.447269:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+230:41278:x1731746396451648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.447269:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+230:41278:x1731746396451520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.447272:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.447272:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12505 00010000:00010000:1.0:1651529349.447274:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 230 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447277:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12508 00010000:00010000:1.0:1651529349.447278:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 3/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 229 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447279:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41278:x1731746396451584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.447281:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.447283:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030c70df5/0xa29a79078f3bbf1e lrc: 0/0,0 mode: --/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7946 expref: 229 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.447283:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 229 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447286:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447287:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447287:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 3/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 228 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447288:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447291:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 4/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447292:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002542571c/0xa29a79078f3bbb74 lrc: 0/0,0 mode: --/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b8c expref: 228 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.447296:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447296:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447297:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447299:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.447306:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41278:x1731746396451648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.447306:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 4/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447308:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12507 00000100:00100000:1.0:1651529349.447313:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12509 00000100:00100000:1.0:1651529349.447314:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41278:x1731746396451712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.447318:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.447323:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.447324:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d541ed2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41278:x1731746396451584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.447325:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 5/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 226 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447327:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12508 00010000:00010000:1.0:1651529349.447329:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 4/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 226 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.447334:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447334:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447335:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447337:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447338:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 4/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447341:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447342:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.447344:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447346:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447347:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41278:x1731746396451712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.447350:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12509 00010000:00010000:1.0:1651529349.447356:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447359:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447362:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447365:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447384:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1838:39029:x1731745946570304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1004us (1061us total) trans 30064894406 rc 0/0 00000100:00100000:0.0:1651529349.447387:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153544 00010000:00010000:0.0:1651529349.447394:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447397:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.447398:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447403:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 3/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447404:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1837:39029:x1731745946570432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1049us total) trans 30064894407 rc 0/0 00000100:00100000:1.0:1651529349.447407:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153546 00010000:00010000:0.0:1651529349.447408:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 1/0,0 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447411:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c02af lrc: 0/0,0 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447415:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447417:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447418:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001acf1de1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.447419:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447420:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447422:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 3/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447423:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447425:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447426:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 1/0,0 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447429:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acf1de1/0xa29a79078f3c02bd lrc: 0/0,0 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447442:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447445:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.447445:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447448:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 3/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447452:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 1/0,0 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447457:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c02c4 lrc: 0/0,0 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447463:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447466:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447469:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447469:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1837:39030:x1731745946570496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1036us (1124us total) trans 30064894408 rc 0/0 00010000:00010000:1.0:1651529349.447472:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447472:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153545 00010000:00010000:0.0:1651529349.447488:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447494:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b29cda82 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.447496:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447498:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 3/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447503:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 1/0,0 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447506:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29cda82/0xa29a79078f3c02b6 lrc: 0/0,0 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447510:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1837:39030:x1731745946570368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1137us (1205us total) trans 30064894409 rc 0/0 00000100:00100000:1.0:1651529349.447513:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153543 00010000:00010000:1.0:1651529349.447524:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051febf17/0xa29a79078f3b9517 lrc: 0/0,0 mode: --/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1fc expref: 224 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.447528:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966701376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.447533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.447546:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.447552:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447555:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447558:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447561:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.447606:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570624 00000100:00100000:0.0:1651529349.447613:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570688 00000100:00100000:0.0:1651529349.447616:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570752 00000100:00100000:0.0:1651529349.447628:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153548 00000100:00100000:1.0:1651529349.447630:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1840:39030:x1731745946570560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1116us (1138us total) trans 30064894410 rc 0/0 00000100:00100000:0.0:1651529349.447630:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1840:39030:x1731745946570624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.447634:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153547 00002000:00080000:0.0:1651529349.447636:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178340 count 1 00000100:00100000:1.0:1651529349.447639:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153549 00010000:00010000:0.0:1651529349.447640:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447641:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1839:39029:x1731745946570688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.447649:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178341 count 1 00010000:00010000:1.0:1651529349.447655:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447663:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 2/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 223 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.447666:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447667:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447667:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 4/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447671:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 2/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.447675:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 3/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 223 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447677:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447678:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447679:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 223 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.447679:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 4/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447683:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966701440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.447686:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447690:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.447692:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.447695:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.447697:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447701:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f57d720 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.447702:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447704:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.447705:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 3/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447709:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 1/0,0 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447711:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153550 00010000:00010000:1.0:1651529349.447712:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f57d720/0xa29a79078f3c02cb lrc: 0/0,0 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.447713:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1839:39030:x1731745946570752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.447717:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178342 count 1 00010000:00010000:0.0:1651529349.447721:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447726:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 2/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447729:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447729:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447730:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 4/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447758:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 3/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447762:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 4/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447766:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966701568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.447771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.447785:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.447792:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570816 00000100:00100000:0.0:1651529349.447813:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153551 00000100:00100000:0.0:1651529349.447815:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1840:39029:x1731745946570816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.447819:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178343 count 1 00000100:00100000:1.0:1651529349.447827:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.447829:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447833:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 2/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447836:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447837:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447838:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 4/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.447840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.447849:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 3/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447856:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 4/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.447859:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966701632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.447868:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.447878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.447890:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570880 00000100:00100000:0.0:1651529349.447901:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571008 00000100:00100000:0.0:1651529349.447904:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946570944 00000100:00100000:0.0:1651529349.447908:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153552 00000100:00100000:0.0:1651529349.447909:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1843:39030:x1731745946570880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.447914:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178344 count 1 00010000:00010000:0.0:1651529349.447918:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447922:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 2/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 223 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447925:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.447926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.447926:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.447926:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 4/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.447933:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 3/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 223 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.447936:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 223 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.447937:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571072 00000100:00100000:1.0:1651529349.447946:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153553 00000100:00100000:1.0:1651529349.447948:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1844:39030:x1731745946571008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.447954:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178346 count 1 00000100:00100000:0.0:1651529349.447954:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966701696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.447958:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447963:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 2/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.447969:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.447979:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447980:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.447981:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 4/0,1 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.447991:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 3/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.447995:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 4/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448021:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966701760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.448036:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.448043:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153554 00000100:00100000:1.0:1651529349.448045:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1844:39029:x1731745946570944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.448050:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178345 count 1 00010000:00010000:1.0:1651529349.448063:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448070:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 2/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.448073:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448073:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448074:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 4/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448081:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 3/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.448085:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 4/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448089:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966701824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.448103:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.448110:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153555 00000100:00100000:1.0:1651529349.448112:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1844:39030:x1731745946571072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.448117:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178347 count 1 00010000:00010000:1.0:1651529349.448140:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448145:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 2/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.448148:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448149:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448150:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 4/0,1 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448157:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 3/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 223 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.448160:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 4/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448166:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966701888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.448184:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.448201:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966701440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448207:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.448266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.448269:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451904 00000100:00100000:0.0:1651529349.448272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.448281:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 5/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 224 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.448288:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451776 00000100:00100000:0.0:1651529349.448290:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d32c1c69 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448291:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 225 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448295:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451968 00010000:00010000:0.0:1651529349.448295:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448297:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 5/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 226 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448301:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396451840 00010000:00010000:1.0:1651529349.448302:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 227 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448302:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966701568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.448305:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448307:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12510 00000100:00100000:1.0:1651529349.448308:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41279:x1731746396451904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.448311:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.448311:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966701632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448312:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 4/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 227 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448313:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448316:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 3/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 227 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448320:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12511 00010000:00010000:1.0:1651529349.448322:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1fce529/0xa29a79078f3bc1f6 lrc: 0/0,0 mode: --/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8508 expref: 227 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448322:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41278:x1731746396451776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.448325:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.448326:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448326:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448327:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448327:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 226 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448330:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 4/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448333:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 3/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 226 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448341:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.448346:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab9018d/0xa29a79078f3b7a44 lrc: 0/0,0 mode: --/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9bb expref: 226 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448350:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.448351:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41279:x1731746396451904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.448351:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448352:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448355:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12510 00010000:00010000:0.0:1651529349.448355:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 4/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448364:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.448370:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12512 00000100:00100000:1.0:1651529349.448373:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41279:x1731746396451968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.448377:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.448379:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 4/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 224 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448384:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 3/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 224 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448387:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41278:x1731746396451776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.448390:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12511 00010000:00010000:1.0:1651529349.448393:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eca3806/0xa29a79078f3ba3bf lrc: 0/0,0 mode: --/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d13 expref: 223 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448399:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448399:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448400:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448408:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 4/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448416:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12513 00010000:00010000:1.0:1651529349.448430:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.448432:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746396451840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.448436:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.448437:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448438:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41279:x1731746396451968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.448441:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448442:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12512 00010000:00010000:0.0:1651529349.448447:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000225fa492/0xa29a79078f3ba8b9 lrc: 0/0,0 mode: --/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2260 expref: 221 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448450:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448451:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448451:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448452:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448454:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448455:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 4/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448457:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448460:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448462:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.448469:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41278:x1731746396451840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.448471:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12513 00010000:00010000:0.0:1651529349.448491:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448495:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448498:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448501:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448507:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946570688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 865us (957us total) trans 30064894411 rc 0/0 00000100:00100000:1.0:1651529349.448510:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153549 00010000:00010000:1.0:1651529349.448518:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448521:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.448522:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448525:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 3/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448530:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 1/0,0 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448533:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c02d9 lrc: 0/0,0 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448537:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448540:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.448541:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448543:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 3/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448547:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 1/0,0 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448549:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c02e7 lrc: 0/0,0 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448561:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946570816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 746us (790us total) trans 30064894412 rc 0/0 00000100:00100000:0.0:1651529349.448565:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153551 00000100:00100000:0.0:1651529349.448585:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966701696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.448589:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448595:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448598:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.448598:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448606:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448609:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.448653:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.448656:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1845:39030:x1731745946570752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 942us (1094us total) trans 30064894413 rc 0/0 00000100:00100000:0.0:1651529349.448659:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153550 00000100:00100000:0.0:1651529349.448667:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452096 00010000:00010000:0.0:1651529349.448672:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 5/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 220 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448693:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452032 00010000:00010000:0.0:1651529349.448696:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 221 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448700:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452160 00010000:00010000:0.0:1651529349.448703:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 5/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448707:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12514 00000100:00100000:0.0:1651529349.448709:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41279:x1731746396452096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.448711:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.448713:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 5/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448716:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 4/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448722:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.448723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.448723:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448724:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448727:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 4/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448732:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.448744:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3bb029 lrc: 0/0,0 mode: --/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f55 expref: 222 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448749:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966701760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448753:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448756:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448759:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448762:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448765:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448771:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41279:x1731746396452096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.448774:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12514 00000100:00100000:0.0:1651529349.448780:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452224 00010000:00010000:0.0:1651529349.448784:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 5/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 221 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.448789:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12515 00000100:00100000:0.0:1651529349.448791:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746396452032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.448793:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.448795:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 221 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448828:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 3/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 221 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448833:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf864c9/0xa29a79078f3b9660 lrc: 0/0,0 mode: --/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd76d expref: 221 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448837:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448838:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.448839:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448842:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1845:39030:x1731745946571008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 893us (1001us total) trans 30064894414 rc 0/0 00010000:00010000:0.0:1651529349.448842:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 4/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448847:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153553 00010000:00010000:0.0:1651529349.448848:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.448859:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966701824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448862:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448869:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448872:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.448873:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448874:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d5770f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41278:x1731746396452032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 82us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.448876:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 3/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448877:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12515 00010000:00010000:1.0:1651529349.448881:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 1/0,0 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448883:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c02e0 lrc: 0/0,0 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448887:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448887:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12516 00000100:00100000:0.0:1651529349.448889:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+219:41278:x1731746396452160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.448890:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.448891:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448892:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.448894:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 3/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448894:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 4/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 219 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448897:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 1/0,0 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448897:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 3/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 219 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448900:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c02f5 lrc: 0/0,0 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448903:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3ba7ee lrc: 0/0,0 mode: --/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f7a expref: 219 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448906:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.448907:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12517 00010000:00010000:0.0:1651529349.448907:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.448908:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41279:x1731746396452224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.448908:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448911:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 4/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448912:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.448913:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 5/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 218 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.448917:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 4/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 218 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.448920:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.448926:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41278:x1731746396452160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.448929:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12516 00010000:00010000:1.0:1651529349.448930:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448931:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.448931:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448935:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 4/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448942:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.448942:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448946:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448949:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41279:x1731746396452224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.448949:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.448951:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.448952:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12517 00010000:00010000:1.0:1651529349.448962:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008959c56b/0xa29a79078f3bac7f lrc: 0/0,0 mode: --/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3059 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.448966:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966701888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.448969:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448972:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448975:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448978:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.448981:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.448991:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1845:39030:x1731745946570880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1080us (1191us total) trans 30064894415 rc 0/0 00000100:00100000:0.0:1651529349.448994:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153552 00010000:00010000:0.0:1651529349.449001:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449004:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.449005:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449008:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 3/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 1/0,0 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449018:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c02ee lrc: 0/0,0 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449022:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449025:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.449026:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449029:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 3/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449030:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1845:39030:x1731745946571072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 917us (1104us total) trans 30064894416 rc 0/0 00010000:00010000:0.0:1651529349.449032:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 1/0,0 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449035:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153555 00010000:00010000:0.0:1651529349.449035:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0303 lrc: 0/0,0 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449040:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449042:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449043:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449045:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449047:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449048:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449050:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449052:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.449081:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1846:39030:x1731745946570624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1451us (1549us total) trans 30064894417 rc 0/0 00000100:00100000:0.0:1651529349.449084:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153548 00000100:00100000:1.0:1651529349.449088:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946570944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1042us (1210us total) trans 30064894418 rc 0/0 00000100:00100000:1.0:1651529349.449091:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153554 00010000:00010000:0.0:1651529349.449091:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449094:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.449095:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449098:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449098:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 3/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449101:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.449102:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449102:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 1/0,0 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449105:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 3/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449105:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c02d2 lrc: 0/0,0 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449110:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 1/0,0 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449113:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c02fc lrc: 0/0,0 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.449153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.449183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.449197:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571136 00000100:00100000:0.0:1651529349.449206:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571200 00000100:00100000:0.0:1651529349.449211:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153556 00000100:00100000:0.0:1651529349.449213:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1846:39030:x1731745946571136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.449219:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178348 count 1 00010000:00010000:0.0:1651529349.449223:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449225:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153557 00010000:00010000:0.0:1651529349.449228:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 2/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.449229:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1846:39029:x1731745946571200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.449237:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178349 count 1 00010000:00010000:1.0:1651529349.449241:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449246:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 2/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449248:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449249:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449249:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449249:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 4/0,1 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449250:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449251:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 4/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449257:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 3/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449258:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 3/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449262:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 4/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449262:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 4/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449266:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.449267:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966702016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.449282:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.449288:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.449293:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.449336:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571264 00000100:00100000:1.0:1651529349.449350:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153558 00000100:00100000:1.0:1651529349.449352:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1847:39030:x1731745946571264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.449357:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178350 count 1 00010000:00010000:1.0:1651529349.449361:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449366:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 2/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 215 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449369:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449370:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449370:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 4/0,1 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449377:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 3/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 215 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449380:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 4/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 215 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.449384:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966702080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.449395:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.449405:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.449417:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571328 00000100:00100000:0.0:1651529349.449428:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153559 00000100:00100000:0.0:1651529349.449430:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1848:39029:x1731745946571328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.449436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.449436:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178351 count 1 00010000:00010000:0.0:1651529349.449446:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.449456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.449456:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 2/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449459:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449460:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449460:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 4/0,1 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.449467:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 3/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449471:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 4/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.449472:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571392 00000100:00100000:0.0:1651529349.449475:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.449478:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571456 00000100:00100000:1.0:1651529349.449482:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571520 00000100:00100000:1.0:1651529349.449484:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571584 00000100:00100000:0.0:1651529349.449485:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060762202 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.449487:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153560 00000100:00100000:1.0:1651529349.449488:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1852:39030:x1731745946571392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.449491:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153561 00002000:00080000:1.0:1651529349.449493:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178352 count 1 00000100:00100000:0.0:1651529349.449493:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1852:39029:x1731745946571456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.449497:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.449498:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178353 count 1 00010000:00010000:0.0:1651529349.449501:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449502:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 2/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449505:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449505:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449505:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 2/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449506:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 4/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449509:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449509:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449510:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 4/0,1 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449512:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 3/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449516:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 4/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449516:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 3/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449520:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.449521:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966702208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.449524:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966702272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.449533:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.449534:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.449544:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153562 00000100:00100000:1.0:1651529349.449546:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1852:39030:x1731745946571520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.449552:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178354 count 1 00000100:00100000:0.0:1651529349.449556:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153563 00010000:00010000:1.0:1651529349.449557:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.449558:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1852:39029:x1731745946571584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.449565:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 2/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449568:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449569:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449570:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 4/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.449577:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178355 count 1 00010000:00010000:0.0:1651529349.449581:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449586:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 2/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.449588:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 3/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449589:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449595:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449597:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.449599:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966702336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.449599:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 4/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449608:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.449609:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 3/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 215 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.449613:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 4/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449617:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966702400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.449625:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.449722:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966701952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.449726:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.449752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.449767:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452288 00000100:00100000:1.0:1651529349.449773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.449773:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 4/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449780:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452352 00010000:00010000:0.0:1651529349.449783:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 5/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449788:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452416 00010000:00010000:0.0:1651529349.449790:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 5/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 218 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449794:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12518 00000100:00100000:0.0:1651529349.449838:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41278:x1731746396452288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.449842:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.449843:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 4/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 218 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449847:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 3/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 218 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449853:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4ff5bc6/0xa29a79078f3baadb lrc: 0/0,0 mode: --/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a78 expref: 218 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449873:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449874:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449875:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449876:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966702016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.449878:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 4/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449881:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449884:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.449890:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12519 00000100:00100000:1.0:1651529349.449892:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746396452352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.449897:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746396452288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 100us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.449900:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12518 00010000:00010000:1.0:1651529349.449902:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.449904:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 4/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449906:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12520 00010000:00010000:1.0:1651529349.449908:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 3/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.449908:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+216:41279:x1731746396452416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.449910:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.449912:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 5/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 216 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.449913:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5cbb64f/0xa29a79078f3bc25f lrc: 0/0,0 mode: --/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86c8 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449916:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 4/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 216 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.449917:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449918:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449919:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449921:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.449921:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.449922:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 4/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449922:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449925:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 4/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449928:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.449929:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.449936:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41278:x1731746396452352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.449936:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41279:x1731746396452416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.449938:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12520 00000100:00100000:1.0:1651529349.449940:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12519 00000100:00100000:0.0:1651529349.449950:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966702272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.449951:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c62f75a/0xa29a79078f3b969f lrc: 0/0,0 mode: --/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd869 expref: 213 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.449954:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.449955:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966702080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.449959:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449959:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449962:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449962:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449965:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449966:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449968:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.449969:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.449971:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.450027:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1854:39030:x1731745946571264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 673us (733us total) trans 30064894420 rc 0/0 00000100:00100000:1.0:1651529349.450030:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153558 00000100:00100000:0.0:1651529349.450035:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1853:39030:x1731745946571136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 821us (882us total) trans 30064894419 rc 0/0 00000100:00100000:0.0:1651529349.450038:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153556 00000100:00100000:1.0:1651529349.450042:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966702208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.450046:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450046:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450050:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.450051:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450052:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450054:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 3/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450055:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.450056:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450059:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 1/0,0 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450061:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 3/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450062:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c030a lrc: 0/0,0 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450066:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 1/0,0 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450069:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0318 lrc: 0/0,0 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450072:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.450075:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450075:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450078:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450081:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450084:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.450140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.450154:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1853:39029:x1731745946571200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 925us (970us total) trans 30064894421 rc 0/0 00000100:00100000:1.0:1651529349.450157:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153557 00000100:00100000:0.0:1651529349.450159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.450171:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.450185:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.450188:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450193:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 3/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.450205:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 1/0,0 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450209:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0311 lrc: 0/0,0 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450209:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966702400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.450213:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450220:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452480 00000100:00100000:1.0:1651529349.450221:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966702336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.450224:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450224:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 4/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 213 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450230:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452608 00000100:00100000:1.0:1651529349.450232:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452736 00010000:00010000:0.0:1651529349.450232:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 214 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450236:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 4/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 215 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450236:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452544 00010000:00010000:0.0:1651529349.450238:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 4/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.450242:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452672 00000100:00100000:0.0:1651529349.450243:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12521 00010000:00010000:1.0:1651529349.450245:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450245:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41279:x1731746396452480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.450248:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.450249:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 4/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.450250:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12522 00000100:00100000:1.0:1651529349.450251:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41279:x1731746396452608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.450254:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.450256:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450259:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 3/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450264:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005451f73a/0xa29a79078f3bb8a3 lrc: 0/0,0 mode: --/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6095 expref: 217 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450268:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450268:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450269:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450269:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 3/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450272:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 4/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450274:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a5eb6b/0xa29a79078f3ba43d lrc: 0/0,0 mode: --/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f12 expref: 216 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.450278:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450279:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450280:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450283:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.450289:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 4/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.450293:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000446a925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41279:x1731746396452608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.450296:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12522 00010000:00010000:0.0:1651529349.450300:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.450301:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12523 00000100:00100000:1.0:1651529349.450303:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+214:41279:x1731746396452736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.450305:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.450306:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 4/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 214 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450308:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+214:41279:x1731746396452480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (179us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.450310:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 3/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 214 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450311:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12521 00010000:00010000:1.0:1651529349.450315:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a588bbd/0xa29a79078f3ba02a lrc: 0/0,0 mode: --/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe80 expref: 213 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450318:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450319:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450320:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450320:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12524 00000100:00100000:0.0:1651529349.450322:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41278:x1731746396452544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.450323:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 4/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450325:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.450326:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 4/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 212 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450330:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.450336:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396452736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.450339:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12523 00000100:00100000:1.0:1651529349.450343:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12525 00000100:00100000:1.0:1651529349.450345:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41278:x1731746396452672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.450347:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.450348:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 211 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.450350:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 3/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 211 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450352:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 3/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 211 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.450356:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003511c631/0xa29a79078f3b9b5a lrc: 0/0,0 mode: --/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb6a expref: 211 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.450357:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc1d7619/0xa29a79078f3b9c9c lrc: 0/0,0 mode: --/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf08e expref: 211 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.450359:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450360:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450360:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450361:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450361:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450361:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450364:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 4/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450364:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 4/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450370:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.450374:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.450381:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41278:x1731746396452544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.450382:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41278:x1731746396452672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.450384:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12524 00000100:00100000:1.0:1651529349.450385:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12525 00010000:00010000:0.0:1651529349.450391:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450392:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450395:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450395:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450398:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450398:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450400:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450401:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.450450:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1854:39030:x1731745946571392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1015us total) trans 30064894422 rc 0/0 00000100:00100000:1.0:1651529349.450454:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153560 00000100:00100000:0.0:1651529349.450455:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1854:39029:x1731745946571456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1007us total) trans 30064894423 rc 0/0 00000100:00100000:0.0:1651529349.450458:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153561 00010000:00010000:1.0:1651529349.450460:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450464:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450466:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450467:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450470:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450470:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450473:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450475:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450505:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1854:39029:x1731745946571328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1075us (1111us total) trans 30064894424 rc 0/0 00000100:00100000:0.0:1651529349.450508:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153559 00010000:00010000:0.0:1651529349.450514:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.450517:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1853:39030:x1731745946571520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 970us (1060us total) trans 30064894425 rc 0/0 00010000:00010000:0.0:1651529349.450518:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.450519:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.450520:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153562 00010000:00010000:0.0:1651529349.450521:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 3/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450527:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450527:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 1/0,0 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450530:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002cfccf71 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.450530:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0326 lrc: 0/0,0 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450531:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450534:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 3/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450534:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450536:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.450537:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450539:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 1/0,0 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450540:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 3/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450543:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c032d lrc: 0/0,0 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450543:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 1/0,0 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450546:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0334 lrc: 0/0,0 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450548:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450550:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.450551:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450551:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450554:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 3/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450554:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450557:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 1/0,0 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450557:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450560:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c031f lrc: 0/0,0 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450560:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 2/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450563:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450566:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.450567:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 2/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450570:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 3/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450573:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 1/0,0 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450575:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c033b lrc: 0/0,0 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.450593:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1853:39029:x1731745946571584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1034us (1128us total) trans 30064894426 rc 0/0 00000100:00100000:0.0:1651529349.450596:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153563 00000100:00100000:1.0:1651529349.450613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.450631:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571712 00000100:00100000:0.0:1651529349.450646:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153564 00000100:00100000:0.0:1651529349.450648:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096d08cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1853:39029:x1731745946571712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.450654:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178357 count 1 00010000:00010000:0.0:1651529349.450658:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450663:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 2/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.450666:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450667:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450667:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 4/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450674:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 3/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.450681:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 4/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450685:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966702464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.450701:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.450713:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.450751:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571648 00000100:00100000:0.0:1651529349.450754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.450763:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571776 00000100:00100000:1.0:1651529349.450769:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153565 00000100:00100000:1.0:1651529349.450770:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1855:39030:x1731745946571648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.450771:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153566 00000100:00100000:0.0:1651529349.450773:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1855:39030:x1731745946571776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.450776:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178356 count 1 00002000:00080000:0.0:1651529349.450779:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178358 count 1 00010000:00010000:1.0:1651529349.450780:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450783:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450785:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 2/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.450788:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450788:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 2/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.450789:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450790:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 4/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450791:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450791:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450792:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 4/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450799:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 3/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 207 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.450829:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 207 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.450834:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966702528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.450835:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.450839:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450844:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.450849:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.450859:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.450864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.450875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.450882:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571904 00000100:00100000:1.0:1651529349.450891:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571840 00000100:00100000:0.0:1651529349.450927:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153567 00000100:00100000:0.0:1651529349.450929:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1857:39030:x1731745946571904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.450937:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153568 00000100:00100000:1.0:1651529349.450939:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1857:39029:x1731745946571840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.450940:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178360 count 1 00002000:00080000:1.0:1651529349.450944:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178359 count 1 00010000:00010000:0.0:1651529349.450944:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450949:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450949:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 2/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.450952:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450952:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.450953:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 4/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.450954:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 2/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.450957:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450957:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.450958:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 4/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.450960:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 3/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.450963:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 4/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450967:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966702656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.450968:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 3/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.450972:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 4/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.450975:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.450976:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966702720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.450985:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.450989:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.451021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.451030:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572032 00000100:00100000:0.0:1651529349.451039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.451041:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946571968 00000100:00100000:1.0:1651529349.451046:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153569 00000100:00100000:1.0:1651529349.451047:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1859:39030:x1731745946572032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.451048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529349.451058:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178362 count 1 00000100:00100000:0.0:1651529349.451060:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966702464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.451063:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451065:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451069:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 2/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.451071:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572096 00010000:00010000:1.0:1651529349.451074:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451075:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451076:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 4/0,1 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451094:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 3/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.451098:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 4/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451102:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966702784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.451111:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153570 00000100:00100000:0.0:1651529349.451113:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1860:39029:x1731745946571968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.451118:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178361 count 1 00010000:00010000:0.0:1651529349.451122:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451123:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.451127:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 2/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.451130:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.451131:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153571 00010000:00010000:0.0:1651529349.451131:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451131:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 4/0,1 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451133:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1860:39029:x1731745946572096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.451138:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178363 count 1 00010000:00010000:0.0:1651529349.451138:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 3/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.451142:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451142:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 4/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451146:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 2/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.451146:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966702848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.451149:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451150:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451150:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 4/0,1 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451154:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.451157:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 3/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 207 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.451160:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 4/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 207 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.451160:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452800 00010000:00010000:0.0:1651529349.451165:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 4/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 208 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451167:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966702912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.451176:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12526 00000100:00100000:0.0:1651529349.451178:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396452800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.451181:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.451182:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 4/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 208 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451183:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.451186:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 3/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 208 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451191:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003606fca9/0xa29a79078f3bb776 lrc: 0/0,0 mode: --/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bc5 expref: 208 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451195:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451195:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451196:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451199:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 4/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451206:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.451212:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41278:x1731746396452800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.451247:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12526 00010000:00010000:0.0:1651529349.451264:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.451268:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451282:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.451285:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451335:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096d08cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1861:39029:x1731745946571712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 685us (722us total) trans 30064894427 rc 0/0 00000100:00100000:0.0:1651529349.451338:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153564 00000100:00100000:1.0:1651529349.451369:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.451374:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.451378:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451380:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966702528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.451385:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451385:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966702656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.451388:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451392:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452928 00000100:00100000:0.0:1651529349.451395:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452864 00010000:00010000:1.0:1651529349.451397:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 208 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451399:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 208 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451409:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396452992 00010000:00010000:1.0:1651529349.451413:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 4/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 209 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.451416:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12527 00000100:00100000:0.0:1651529349.451418:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41278:x1731746396452928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.451420:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12528 00000100:00100000:1.0:1651529349.451421:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41279:x1731746396452864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.451421:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.451423:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 209 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451424:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.451426:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 209 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451427:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 209 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451430:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 3/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 209 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451433:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001521684b/0xa29a79078f3bb148 lrc: 0/0,0 mode: --/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ae expref: 209 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451436:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b406444/0xa29a79078f3b94a7 lrc: 0/0,0 mode: --/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd020 expref: 208 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451436:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451437:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451438:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451440:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451440:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.451441:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451441:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 4/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451444:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 4/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451447:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.451451:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.451460:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41278:x1731746396452928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.451463:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12527 00000100:00100000:1.0:1651529349.451466:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+206:41279:x1731746396452864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.451468:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12529 00000100:00100000:0.0:1651529349.451470:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+206:41279:x1731746396452992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.451471:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12528 00010000:00010000:0.0:1651529349.451473:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.451474:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 4/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 206 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451478:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 3/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451481:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451486:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.451487:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451491:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 3/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451498:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 1/0,0 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451500:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a33f618c/0xa29a79078f3b9e5c lrc: 0/0,0 mode: --/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7bf expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451507:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c0342 lrc: 0/0,0 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451516:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451519:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451524:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451525:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451526:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451527:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451530:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 4/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451541:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451545:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.451553:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e814b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41279:x1731746396452992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.451555:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12529 00010000:00010000:0.0:1651529349.451567:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451571:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451576:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451579:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451588:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1861:39030:x1731745946571648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 816us (874us total) trans 30064894428 rc 0/0 00000100:00100000:1.0:1651529349.451594:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153565 00010000:00010000:1.0:1651529349.451602:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451605:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.451606:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451609:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 3/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451614:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 1/0,0 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451617:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0349 lrc: 0/0,0 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451622:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451624:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.451625:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451628:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 3/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451631:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 1/0,0 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451633:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1861:39030:x1731745946571904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 703us (769us total) trans 30064894429 rc 0/0 00010000:00010000:1.0:1651529349.451634:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0357 lrc: 0/0,0 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451636:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153567 00010000:00010000:0.0:1651529349.451645:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.451648:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451652:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451662:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451699:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1861:39030:x1731745946571776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 926us (946us total) trans 30064894430 rc 0/0 00000100:00100000:0.0:1651529349.451702:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153566 00000100:00100000:0.0:1651529349.451707:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572160 00000100:00100000:0.0:1651529349.451717:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153572 00000100:00100000:0.0:1651529349.451719:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1861:39030:x1731745946572160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.451730:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178364 count 1 00010000:00010000:0.0:1651529349.451742:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451747:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 2/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 203 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.451750:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451751:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451751:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 4/0,1 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451758:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 3/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 203 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.451762:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 4/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 203 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.451766:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.451781:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b37f1aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.451787:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453120 00010000:00010000:0.0:1651529349.451792:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 5/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 204 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.451799:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12530 00000100:00100000:0.0:1651529349.451801:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41279:x1731746396453120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.451842:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.451844:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 5/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 204 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451848:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 4/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 204 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.451854:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451855:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451856:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451859:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 4/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.451884:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966702720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.451888:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.451889:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451895:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41279:x1731746396453120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 93us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.451896:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451899:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c5c3f32 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.451899:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12530 00010000:00010000:1.0:1651529349.451900:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451903:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 3/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451904:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453056 00010000:00010000:1.0:1651529349.451908:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 1/0,0 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451908:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 4/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 204 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451910:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0350 lrc: 0/0,0 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451913:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453184 00010000:00010000:0.0:1651529349.451915:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 5/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.451919:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a644f95/0xa29a79078f3b9b76 lrc: 0/0,0 mode: --/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceba2 expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.451923:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966702784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.451925:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451931:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.451932:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453248 00010000:00010000:1.0:1651529349.451934:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451937:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.451939:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451943:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 5/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.451949:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12531 00000100:00100000:0.0:1651529349.451950:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41278:x1731746396453056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.451953:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.451955:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 4/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451958:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 3/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451964:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df9fa7b/0xa29a79078f3ba47c lrc: 0/0,0 mode: --/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d101c expref: 205 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.451967:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451968:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.451969:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.451983:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 4/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.451990:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1862:39030:x1731745946572032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (1000us total) trans 30064894431 rc 0/0 00010000:00010000:0.0:1651529349.451993:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.452001:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41278:x1731746396453056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.452002:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153569 00000100:00100000:0.0:1651529349.452003:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12531 00000100:00100000:0.0:1651529349.452008:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12532 00000100:00100000:1.0:1651529349.452017:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12533 00000100:00100000:0.0:1651529349.452017:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41278:x1731746396453184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.452019:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41279:x1731746396453248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.452020:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.452022:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.452022:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 5/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 203 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452024:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 5/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 203 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452026:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 4/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 203 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452028:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 4/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 203 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452031:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452032:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452034:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452035:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452035:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 4/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452036:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452039:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 4/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452039:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.452044:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.452044:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41278:x1731746396453184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.452047:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12532 00000100:00100000:1.0:1651529349.452050:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41279:x1731746396453248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.452052:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12533 00010000:00010000:0.0:1651529349.452060:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ede73c8/0xa29a79078f3bb195 lrc: 0/0,0 mode: --/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44bf expref: 201 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452064:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069912cb1/0xa29a79078f3b9d1a lrc: 0/0,0 mode: --/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2be expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.452064:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966702848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.452067:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452068:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966702912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.452071:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452075:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452077:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452080:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452080:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452083:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452083:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452086:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452088:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452133:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1863:39029:x1731745946572096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1084us total) trans 30064894432 rc 0/0 00000100:00100000:1.0:1651529349.452136:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153571 00000100:00100000:0.0:1651529349.452138:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1863:39029:x1731745946571968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1024us (1117us total) trans 30064894433 rc 0/0 00000100:00100000:0.0:1651529349.452141:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153570 00010000:00010000:1.0:1651529349.452144:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452147:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.452148:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452149:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452151:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 3/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452153:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.452154:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452155:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 1/0,0 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452157:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 3/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452158:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0365 lrc: 0/0,0 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452161:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 1/0,0 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452163:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452164:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0373 lrc: 0/0,0 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452165:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.452166:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452171:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 3/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452175:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 1/0,0 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452177:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c036c lrc: 0/0,0 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452183:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452186:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452189:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.452201:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.452234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.452241:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1862:39029:x1731745946571840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1302us (1366us total) trans 30064894434 rc 0/0 00000100:00100000:1.0:1651529349.452244:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153568 00000100:00100000:0.0:1651529349.452244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.452257:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572288 00000100:00100000:1.0:1651529349.452263:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572224 00000100:00100000:1.0:1651529349.452267:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572352 00000100:00100000:1.0:1651529349.452288:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153573 00000100:00100000:1.0:1651529349.452291:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946572288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.452296:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452300:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.452301:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452304:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 3/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.452306:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178366 count 1 00010000:00010000:0.0:1651529349.452308:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 1/0,0 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452310:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452311:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c035e lrc: 0/0,0 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452316:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 2/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 199 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452319:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452319:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.452319:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153574 00010000:00010000:1.0:1651529349.452320:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 4/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452321:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1864:39029:x1731745946572224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.452327:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 3/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 199 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.452327:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178365 count 1 00010000:00010000:1.0:1651529349.452330:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 199 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.452334:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966703040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.452346:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452350:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.452357:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153575 00010000:00010000:0.0:1651529349.452357:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 2/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 199 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.452359:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946572352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.452360:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452361:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452361:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 4/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.452364:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178367 count 1 00010000:00010000:1.0:1651529349.452367:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452369:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 3/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 199 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452372:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 2/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 199 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.452372:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 199 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452375:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452376:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.452376:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966703104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.452377:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 4/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452383:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 3/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 199 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452386:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 199 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.452386:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.452391:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966703168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.452395:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966702976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.452398:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.452399:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452406:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453312 00010000:00010000:0.0:1651529349.452411:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 4/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.452423:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12534 00000100:00100000:0.0:1651529349.452440:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+200:41278:x1731746396453312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.452444:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.452445:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 4/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452449:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 3/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.452450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.452458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.452464:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003df3c045/0xa29a79078f3bb2fa lrc: 0/0,0 mode: --/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b1e expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452469:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452469:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452470:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452473:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 4/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.452492:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.452505:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396453312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.452506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.452508:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12534 00000100:00100000:0.0:1651529349.452520:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572480 00000100:00100000:0.0:1651529349.452529:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572544 00000100:00100000:0.0:1651529349.452533:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572416 00000100:00100000:0.0:1651529349.452538:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572608 00000100:00100000:0.0:1651529349.452541:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153576 00000100:00100000:0.0:1651529349.452543:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1868:39029:x1731745946572480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.452548:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178369 count 1 00010000:00010000:0.0:1651529349.452552:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452556:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153577 00010000:00010000:0.0:1651529349.452557:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 2/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 198 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.452559:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1868:39030:x1731745946572544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.452560:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452561:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452561:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 4/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.452564:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178370 count 1 00010000:00010000:0.0:1651529349.452567:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 3/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 198 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452569:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452571:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 198 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.452575:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966703232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.452576:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 2/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 198 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452579:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452580:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452581:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 4/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452588:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.452595:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 198 pid: 127526 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.452595:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153578 00000100:00100000:0.0:1651529349.452597:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1868:39029:x1731745946572416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.452599:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 198 pid: 127526 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.452601:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178368 count 1 00000100:00100000:1.0:1651529349.452603:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966703296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.452605:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452612:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.452612:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 2/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 198 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.452615:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452615:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452616:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 4/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452618:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153579 00000100:00100000:1.0:1651529349.452620:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1868:39029:x1731745946572608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.452622:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 198 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.452625:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178371 count 1 00010000:00010000:0.0:1651529349.452626:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 198 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452628:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452629:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966703360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.452632:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 2/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 198 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.452635:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452636:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.452636:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.452637:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 4/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452641:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452644:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452645:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 3/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 198 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.452647:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452650:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452651:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 198 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.452667:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966703424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.452677:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.452689:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452694:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.452695:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452698:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 3/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452703:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 1/0,0 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452706:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c037a lrc: 0/0,0 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452720:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946572160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1000us (1071us total) trans 30064894435 rc 0/0 00000100:00100000:0.0:1651529349.452723:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153572 00000100:00100000:1.0:1651529349.452792:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966703040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.452799:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452856:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d201c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966703104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.452857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.452861:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.452875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.452879:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453440 00000100:00100000:1.0:1651529349.452884:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966703168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.452884:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 199 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452888:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.452891:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453376 00010000:00010000:0.0:1651529349.452894:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 200 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.452895:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453504 00010000:00010000:1.0:1651529349.452900:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 201 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.452907:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12535 00000100:00100000:1.0:1651529349.452908:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41278:x1731746396453440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.452911:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.452913:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 201 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452916:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 3/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 201 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.452916:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12536 00000100:00100000:0.0:1651529349.452918:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41278:x1731746396453504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.452921:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.452923:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 201 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452924:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea6b245/0xa29a79078f3bc2eb lrc: 0/0,0 mode: --/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88f1 expref: 201 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452927:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 3/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 201 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452928:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452929:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452930:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452933:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 4/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452933:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087403add/0xa29a79078f3b92bd lrc: 0/0,0 mode: --/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8a9 expref: 200 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452937:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452937:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.452938:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452942:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.452948:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 4/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.452952:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396453440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.452955:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12535 00010000:00010000:0.0:1651529349.452958:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.452966:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12537 00000100:00100000:0.0:1651529349.452966:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+198:41278:x1731746396453504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.452968:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+198:41278:x1731746396453376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.452969:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12536 00010000:00010000:1.0:1651529349.452971:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.452972:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 197 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.452976:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 3/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 197 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452977:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452981:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004368762d/0xa29a79078f3b9c64 lrc: 0/0,0 mode: --/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefae expref: 197 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.452981:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452984:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.452987:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452988:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452988:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.452989:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.452992:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 4/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453007:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.453018:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085929330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41278:x1731746396453376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.453021:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12537 00010000:00010000:1.0:1651529349.453035:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453040:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.453042:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453043:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1869:39029:x1731745946572224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 721us (819us total) trans 30064894436 rc 0/0 00000100:00100000:0.0:1651529349.453046:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153574 00010000:00010000:1.0:1651529349.453047:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 3/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453055:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 1/0,0 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453058:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c0388 lrc: 0/0,0 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453067:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453070:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.453087:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453090:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453167:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946572288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 866us (964us total) trans 30064894437 rc 0/0 00000100:00100000:1.0:1651529349.453172:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153573 00000100:00100000:0.0:1651529349.453179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.453189:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.453190:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572672 00000100:00100000:0.0:1651529349.453197:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.453205:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153580 00000100:00100000:1.0:1651529349.453207:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946572672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.453217:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178372 count 1 00010000:00010000:1.0:1651529349.453221:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453226:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 2/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 195 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.453229:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453230:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.453230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.453231:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 4/0,1 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453237:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453238:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 3/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 195 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.453241:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.453242:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 4/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 195 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.453242:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453245:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 3/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453246:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966703488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.453250:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 1/0,0 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453253:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0381 lrc: 0/0,0 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453260:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.453269:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966703296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.453272:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453272:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966703232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.453276:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453280:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966703424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.453282:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453289:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453568 00010000:00010000:1.0:1651529349.453293:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 196 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.453297:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002245d7d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966703360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.453298:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453632 00010000:00010000:1.0:1651529349.453300:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 197 pid: 127526 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.453307:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453696 00010000:00010000:1.0:1651529349.453309:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 198 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.453309:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453313:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453760 00010000:00010000:1.0:1651529349.453314:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 199 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.453319:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12538 00000100:00100000:1.0:1651529349.453320:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396453568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.453323:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.453324:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 199 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.453327:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12539 00010000:00010000:1.0:1651529349.453328:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 3/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 199 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.453329:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41279:x1731746396453632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.453333:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008381aece/0xa29a79078f3b938f lrc: 0/0,0 mode: --/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc0d expref: 199 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.453333:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.453334:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 199 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.453337:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453337:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453338:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453338:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 198 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.453341:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 4/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453343:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000332e4754/0xa29a79078f3b85c0 lrc: 0/0,0 mode: --/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfb1 expref: 198 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.453347:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453348:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453348:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453351:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.453358:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+197:41278:x1731746396453568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.453358:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 4/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453361:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12538 00010000:00010000:0.0:1651529349.453367:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.453372:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12540 00000100:00100000:1.0:1651529349.453374:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41278:x1731746396453696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.453375:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41279:x1731746396453632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.453377:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.453377:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12539 00010000:00010000:1.0:1651529349.453378:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 196 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.453382:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 195 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.453383:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12541 00010000:00010000:1.0:1651529349.453387:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3ba9a0 lrc: 0/0,0 mode: --/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d255b expref: 195 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.453391:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453392:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453392:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453392:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+194:41278:x1731746396453760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.453395:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 4/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453395:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.453396:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 194 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.453400:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 3/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 194 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.453404:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.453410:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+194:41278:x1731746396453696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.453412:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b518fe6/0xa29a79078f3bc434 lrc: 0/0,0 mode: --/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8df2 expref: 194 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.453413:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12540 00010000:00010000:0.0:1651529349.453416:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453417:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453417:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453419:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453420:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 4/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453422:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453426:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453428:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.453434:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453435:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396453760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.453438:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12541 00010000:00010000:0.0:1651529349.453445:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453448:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453461:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453464:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453481:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1870:39030:x1731745946572352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1236us total) trans 30064894438 rc 0/0 00000100:00100000:1.0:1651529349.453484:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153575 00010000:00010000:1.0:1651529349.453491:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453494:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.453495:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453498:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 3/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453503:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 1/0,0 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453506:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c038f lrc: 0/0,0 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453507:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1870:39029:x1731745946572480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 963us (1057us total) trans 30064894439 rc 0/0 00010000:00010000:1.0:1651529349.453510:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453510:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153576 00010000:00010000:1.0:1651529349.453513:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.453513:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453516:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 3/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453518:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453519:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 1/0,0 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453521:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453522:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0396 lrc: 0/0,0 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453524:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453527:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453527:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453530:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453533:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453536:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453558:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1871:39029:x1731745946572416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 961us (1068us total) trans 30064894440 rc 0/0 00000100:00100000:0.0:1651529349.453561:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153578 00010000:00010000:0.0:1651529349.453568:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453572:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1870:39029:x1731745946572608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 951us (1065us total) trans 30064894441 rc 0/0 00000100:00100000:1.0:1651529349.453575:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153579 00010000:00010000:0.0:1651529349.453581:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.453582:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453582:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453585:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453585:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 3/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453588:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453590:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 1/0,0 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453591:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453593:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c03a4 lrc: 0/0,0 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453597:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453600:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.453601:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453604:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 3/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453607:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 1/0,0 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453612:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c03ab lrc: 0/0,0 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453616:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453618:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529349.453619:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1870:39030:x1731745946572544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1060us (1161us total) trans 30064894442 rc 0/0 00010000:00010000:0.0:1651529349.453619:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453622:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153577 00010000:00010000:0.0:1651529349.453622:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 3/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453625:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 1/0,0 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453627:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c039d lrc: 0/0,0 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.453667:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.453712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.453722:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572736 00000100:00100000:0.0:1651529349.453732:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572800 00000100:00100000:0.0:1651529349.453745:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153581 00000100:00100000:0.0:1651529349.453747:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1871:39029:x1731745946572736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.453749:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153582 00000100:00100000:1.0:1651529349.453751:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1871:39030:x1731745946572800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.453752:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178373 count 1 00010000:00010000:0.0:1651529349.453756:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.453758:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178374 count 1 00010000:00010000:1.0:1651529349.453763:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453763:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 2/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 191 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.453768:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 2/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.453773:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453774:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.453775:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 4/0,1 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.453782:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453783:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.453784:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 4/0,1 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.453786:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 3/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.453791:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 4/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.453796:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966703552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.453801:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 3/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 191 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.453815:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 4/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 191 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.453827:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.453829:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966703616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.453839:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.453909:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966703488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.453914:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.453921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.453929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.453938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.453942:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572928 00000100:00100000:0.0:1651529349.453944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.453953:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572864 00000100:00100000:1.0:1651529349.453959:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573056 00000100:00100000:0.0:1651529349.453968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.453969:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946572992 00000100:00100000:1.0:1651529349.453977:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573120 00000100:00100000:1.0:1651529349.453981:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153583 00000100:00100000:1.0:1651529349.453982:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1876:39030:x1731745946572928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.453986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.453987:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178376 count 1 00000100:00100000:0.0:1651529349.453995:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153584 00000100:00100000:0.0:1651529349.453997:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946572864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.454002:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.454003:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178375 count 1 00010000:00010000:0.0:1651529349.454007:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454008:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 2/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.454011:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454011:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454012:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 4/0,1 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454012:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 2/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.454015:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454016:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454016:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 4/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454019:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 3/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.454023:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 4/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454023:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 3/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.454027:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966703680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.454027:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454031:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966703744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.454043:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.454048:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.454050:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153585 00000100:00100000:1.0:1651529349.454052:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1876:39030:x1731745946573056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.454055:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153586 00000100:00100000:0.0:1651529349.454056:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946572992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.454057:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178378 count 1 00010000:00010000:1.0:1651529349.454061:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.454061:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178377 count 1 00010000:00010000:0.0:1651529349.454064:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454065:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 2/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.454068:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454069:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454069:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 2/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 191 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.454070:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 4/0,1 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454072:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454072:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454073:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 4/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454079:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 3/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 191 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.454080:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 3/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 191 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.454083:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 4/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 191 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454087:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 4/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454094:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966703872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.454100:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966703808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.454103:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.454108:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.454110:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153587 00000100:00100000:1.0:1651529349.454112:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946573120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.454115:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453824 00002000:00080000:1.0:1651529349.454117:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178379 count 1 00010000:00010000:1.0:1651529349.454120:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454121:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 4/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454125:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 2/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 192 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.454133:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12542 00000100:00100000:0.0:1651529349.454135:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41279:x1731746396453824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.454138:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454138:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.454139:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454140:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 4/0,1 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454140:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 4/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454143:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 3/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454147:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 3/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 192 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.454149:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2d8a447/0xa29a79078f3bb3c5 lrc: 0/0,0 mode: --/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dda expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454150:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 4/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 192 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454154:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966703936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.454155:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454156:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454157:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454160:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 4/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.454161:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.454168:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.454174:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454175:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41279:x1731746396453824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.454178:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454178:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12542 00010000:00010000:1.0:1651529349.454181:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454184:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.454235:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.454255:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1877:39030:x1731745946572672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1047us (1169us total) trans 30064894443 rc 0/0 00000100:00100000:1.0:1651529349.454267:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153580 00000100:00100000:0.0:1651529349.454284:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966703616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.454288:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454292:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454295:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453888 00010000:00010000:1.0:1651529349.454296:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.454297:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454300:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 3/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454300:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 5/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454306:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 1/0,0 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454307:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396453952 00010000:00010000:1.0:1651529349.454309:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c03b2 lrc: 0/0,0 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454309:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 4/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 192 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454321:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12543 00000100:00100000:0.0:1651529349.454323:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396453888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.454326:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.454327:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 5/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454330:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12544 00010000:00010000:0.0:1651529349.454330:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 4/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 192 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454334:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396453952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.454339:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.454342:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 4/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 192 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454346:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 3/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 192 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454350:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454351:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454352:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454354:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033d43ad6/0xa29a79078f3b9739 lrc: 0/0,0 mode: --/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaf4 expref: 192 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454355:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 4/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454358:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454359:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454359:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454360:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.454363:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 4/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454374:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.454384:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396453952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.454386:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12544 00000100:00100000:0.0:1651529349.454391:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000802a3b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41278:x1731746396453888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.454394:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12543 00010000:00010000:1.0:1651529349.454399:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000703c0165/0xa29a79078f3bac24 lrc: 0/0,0 mode: --/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f09 expref: 189 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454403:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966703552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.454407:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454407:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454410:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454411:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454413:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454416:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454417:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454419:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454419:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.454459:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1878:39030:x1731745946572800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 707us (753us total) trans 30064894444 rc 0/0 00000100:00100000:1.0:1651529349.454462:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153582 00000100:00100000:0.0:1651529349.454462:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1878:39029:x1731745946572736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 715us (795us total) trans 30064894445 rc 0/0 00000100:00100000:0.0:1651529349.454465:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153581 00010000:00010000:1.0:1651529349.454469:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454472:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.454472:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454473:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454476:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 3/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454476:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.454477:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454480:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 3/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454481:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 1/0,0 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454484:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c03c0 lrc: 0/0,0 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454484:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 1/0,0 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454487:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c03b9 lrc: 0/0,0 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.454499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.454527:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573184 00000100:00100000:0.0:1651529349.454538:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153588 00000100:00100000:0.0:1651529349.454540:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1877:39030:x1731745946573184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.454564:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178380 count 1 00010000:00010000:0.0:1651529349.454578:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454584:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 2/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 188 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.454587:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454587:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454588:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 4/0,1 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454606:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 3/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 188 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.454625:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 4/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 188 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454630:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.454631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.454641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.454649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.454652:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.454659:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966703744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.454663:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454670:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454080 00010000:00010000:0.0:1651529349.454704:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 189 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.454719:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454016 00010000:00010000:0.0:1651529349.454722:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 5/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 190 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.454727:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454144 00010000:00010000:0.0:1651529349.454729:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 5/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 191 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454741:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454272 00000100:00100000:1.0:1651529349.454743:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454208 00010000:00010000:0.0:1651529349.454744:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 5/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 192 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454749:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 5/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 193 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454749:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12545 00000100:00100000:0.0:1651529349.454750:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396454080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.454753:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.454755:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 193 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454756:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12546 00000100:00100000:1.0:1651529349.454758:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396454016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.454758:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 3/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 193 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454761:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.454762:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 5/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 193 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454764:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074249e81/0xa29a79078f3bbd96 lrc: 0/0,0 mode: --/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7350 expref: 193 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454766:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 4/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 193 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454767:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454773:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454774:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454775:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454775:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454776:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454779:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 4/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454780:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 4/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454786:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.454788:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.454800:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396454016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.454826:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396454080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.454849:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12545 00000100:00100000:1.0:1651529349.454862:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12546 00000100:00100000:0.0:1651529349.454864:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12547 00000100:00100000:0.0:1651529349.454866:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41278:x1731746396454144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.454870:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12548 00010000:00010000:0.0:1651529349.454870:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.454871:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 5/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 190 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454872:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41279:x1731746396454272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.454875:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.454875:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 4/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 190 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454877:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 5/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 190 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454881:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 4/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 190 pid: 127525 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454881:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454881:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.454882:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454885:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 4/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454887:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454888:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454889:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454890:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.454892:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 4/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454897:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.454904:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41279:x1731746396454272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.454906:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12548 00000100:00100000:0.0:1651529349.454906:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41278:x1731746396454144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.454909:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12547 00000100:00100000:1.0:1651529349.454911:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12549 00000100:00100000:1.0:1651529349.454912:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+188:41278:x1731746396454208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.454915:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.454916:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 5/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 188 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.454920:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 3/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 188 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.454920:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966703808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.454925:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b025352/0xa29a79078f3b9303 lrc: 0/0,0 mode: --/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9d6 expref: 188 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.454925:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454928:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454929:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.454930:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454932:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 4/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454939:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454943:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.454948:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.454949:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+187:41278:x1731746396454208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.454952:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12549 00010000:00010000:0.0:1651529349.454952:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.454955:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454969:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425a8e80/0xa29a79078f3b8271 lrc: 0/0,0 mode: --/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdf8 expref: 186 pid: 127525 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.454974:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966703936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.454978:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454984:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454986:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454989:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.454992:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.454998:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1878:39029:x1731745946572864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1000us (1068us total) trans 30064894446 rc 0/0 00000100:00100000:0.0:1651529349.455001:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153584 00010000:00010000:0.0:1651529349.455009:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455012:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455025:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455028:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455033:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1878:39029:x1731745946573120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 921us (1065us total) trans 30064894447 rc 0/0 00000100:00100000:1.0:1651529349.455036:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153587 00010000:00010000:1.0:1651529349.455043:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455047:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.455048:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455050:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 3/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455055:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 1/0,0 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455058:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c03ce lrc: 0/0,0 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455063:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455065:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.455065:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1878:39029:x1731745946572992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1008us (1120us total) trans 30064894448 rc 0/0 00010000:00010000:1.0:1651529349.455066:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455068:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153586 00010000:00010000:1.0:1651529349.455069:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 3/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455072:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 1/0,0 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455074:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c03e3 lrc: 0/0,0 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455075:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455079:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.455080:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455083:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 3/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455084:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009261becd/0xa29a79078f3b9b14 lrc: 0/0,0 mode: --/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea8a expref: 185 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455087:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966703872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.455087:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 1/0,0 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455090:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455090:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c03dc lrc: 0/0,0 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455096:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455099:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455101:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455104:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.455127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.455142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.455153:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1878:39030:x1731745946573056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1100us (1214us total) trans 30064894449 rc 0/0 00000100:00100000:1.0:1651529349.455156:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153585 00000100:00100000:1.0:1651529349.455161:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573248 00000100:00100000:1.0:1651529349.455171:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573312 00000100:00100000:1.0:1651529349.455190:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153589 00000100:00100000:1.0:1651529349.455192:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1879:39030:x1731745946573248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.455198:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153590 00000100:00100000:0.0:1651529349.455200:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1879:39030:x1731745946573312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.455206:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178382 count 1 00002000:00080000:1.0:1651529349.455207:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178381 count 1 00010000:00010000:0.0:1651529349.455210:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455213:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455215:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 2/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.455218:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 2/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 184 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.455218:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455219:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455219:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 4/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455224:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455225:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455226:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 4/0,1 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455226:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 3/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.455229:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 4/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455234:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 3/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 184 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.455234:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966704064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455240:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 4/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455247:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966704128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.455265:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.455269:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd5a6b35 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.455271:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455275:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.455276:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455279:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 3/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455279:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455283:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 1/0,0 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455283:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455289:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c03d5 lrc: 0/0,0 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455297:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454336 00010000:00010000:1.0:1651529349.455302:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 4/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 185 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455311:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12550 00000100:00100000:1.0:1651529349.455324:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+185:41279:x1731746396454336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.455329:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.455331:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 4/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 185 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455335:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 3/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 185 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455341:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ceb6e3/0xa29a79078f3b94f4 lrc: 0/0,0 mode: --/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd138 expref: 185 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455345:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455345:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455346:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455349:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 4/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455362:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.455379:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000623e9fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+184:41279:x1731746396454336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.455382:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12550 00000100:00100000:0.0:1651529349.455384:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.455399:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a0b1b97/0xa29a79078f3bb30f lrc: 0/0,0 mode: --/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b56 expref: 183 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455403:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966703680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.455410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.455420:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.455429:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.455433:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455435:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455435:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455438:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455439:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455441:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455443:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455445:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455500:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1881:39030:x1731745946572928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1515us (1578us total) trans 30064894450 rc 0/0 00000100:00100000:1.0:1651529349.455506:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153583 00000100:00100000:1.0:1651529349.455512:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573376 00000100:00100000:0.0:1651529349.455514:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1881:39030:x1731745946573184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 973us (1015us total) trans 30064894451 rc 0/0 00000100:00100000:1.0:1651529349.455516:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573440 00000100:00100000:0.0:1651529349.455517:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153588 00000100:00100000:1.0:1651529349.455519:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573504 00000100:00100000:1.0:1651529349.455521:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573568 00000100:00100000:0.0:1651529349.455523:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153591 00000100:00100000:0.0:1651529349.455525:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1883:39029:x1731745946573376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.455526:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153592 00000100:00100000:1.0:1651529349.455527:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946573440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.455529:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178383 count 1 00002000:00080000:1.0:1651529349.455532:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178384 count 1 00010000:00010000:0.0:1651529349.455534:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455539:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 2/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.455542:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455543:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455543:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 4/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455545:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455550:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 2/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.455550:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 3/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.455553:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455554:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455554:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 4/0,1 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455554:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.455558:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455561:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 3/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.455565:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 4/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.455566:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.455569:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.455573:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153593 00000100:00100000:0.0:1651529349.455574:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016c8fffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1883:39029:x1731745946573504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.455579:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.455579:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178385 count 1 00010000:00010000:0.0:1651529349.455582:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455586:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 2/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.455587:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153594 00000100:00100000:1.0:1651529349.455589:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946573568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.455589:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455589:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455590:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 4/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.455593:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178386 count 1 00010000:00010000:1.0:1651529349.455597:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455598:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 3/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.455601:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 2/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.455602:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 4/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455604:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455604:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455605:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 4/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455606:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966704320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455611:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 3/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.455612:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.455615:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.455617:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455619:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966704384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.455620:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.455621:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455624:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 3/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455625:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.455629:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 1/0,0 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455631:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455632:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c03c7 lrc: 0/0,0 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455634:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.455635:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455649:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 3/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455654:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 1/0,0 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455680:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c03ea lrc: 0/0,0 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.455699:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454400 00000100:00100000:0.0:1651529349.455707:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.455712:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 5/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 183 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455723:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454464 00010000:00010000:1.0:1651529349.455726:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 5/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.455731:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12551 00000100:00100000:1.0:1651529349.455732:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+184:41278:x1731746396454400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.455748:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966704064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455753:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.455753:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455755:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 5/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455759:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 4/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.455761:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12552 00000100:00100000:0.0:1651529349.455763:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+184:41278:x1731746396454464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.455766:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.455767:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455767:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 4/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455768:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.455769:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455771:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 3/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.455772:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 4/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455777:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.455777:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c415af0/0xa29a79078f3ba945 lrc: 0/0,0 mode: --/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d243c expref: 184 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.455781:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455781:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.455782:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455785:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 4/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455795:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41278:x1731746396454400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.455800:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12551 00010000:00010000:1.0:1651529349.455828:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729a158c/0xa29a79078f3bbdc7 lrc: 0/0,0 mode: --/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7406 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.455829:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.455832:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966704128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.455836:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455839:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455842:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455845:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455848:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455850:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41278:x1731746396454464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.455855:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12552 00010000:00010000:0.0:1651529349.455866:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455869:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455873:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.455876:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.455888:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1884:39030:x1731745946573248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 695us (783us total) trans 30064894452 rc 0/0 00000100:00100000:1.0:1651529349.455891:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153589 00010000:00010000:1.0:1651529349.455898:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455902:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.455903:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455906:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 3/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455910:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 1/0,0 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455913:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c03f8 lrc: 0/0,0 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455917:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455920:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.455921:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455924:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 3/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.455927:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 1/0,0 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455928:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1884:39030:x1731745946573312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 727us (801us total) trans 30064894453 rc 0/0 00010000:00010000:1.0:1651529349.455930:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c03f1 lrc: 0/0,0 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.455931:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153590 00000100:00100000:1.0:1651529349.455945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.455990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.456009:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573632 00000100:00100000:1.0:1651529349.456022:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573696 00000100:00100000:0.0:1651529349.456025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.456032:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153595 00000100:00100000:1.0:1651529349.456034:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1885:39029:x1731745946573632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.456034:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.456039:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178387 count 1 00010000:00010000:1.0:1651529349.456044:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456054:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 2/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 180 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.456054:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f71c0be7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.456057:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456058:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456058:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456059:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 4/0,1 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456065:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454528 00010000:00010000:0.0:1651529349.456070:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 181 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456072:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 3/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 181 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.456078:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 4/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 181 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.456084:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966704448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.456097:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.456103:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153596 00000100:00100000:1.0:1651529349.456106:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1885:39030:x1731745946573696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.456108:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454592 00002000:00080000:1.0:1651529349.456122:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178388 count 1 00010000:00010000:0.0:1651529349.456123:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 5/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456126:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456134:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12553 00000100:00100000:0.0:1651529349.456136:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+182:41279:x1731746396454528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.456137:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 2/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456139:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.456141:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456141:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456142:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456142:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 4/0,1 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456145:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 3/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456149:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 3/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 182 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456151:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae3a0967/0xa29a79078f3bbad3 lrc: 0/0,0 mode: --/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6898 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456153:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 4/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 182 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456155:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456155:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456156:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456157:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966704512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.456159:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 4/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456165:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.456166:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.456173:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12554 00000100:00100000:0.0:1651529349.456173:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41279:x1731746396454528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.456174:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41279:x1731746396454592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.456176:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12553 00010000:00010000:1.0:1651529349.456177:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.456179:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 5/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456183:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 4/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456186:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c3625c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966704320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.456189:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456189:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456190:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456190:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456193:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 4/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456197:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456198:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.456200:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456203:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41279:x1731746396454592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.456203:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456205:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456206:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12554 00000100:00100000:1.0:1651529349.456225:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966704384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.456230:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456236:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456239:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.456240:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456243:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 3/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456247:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 1/0,0 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456247:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1886:39029:x1731745946573376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 721us (863us total) trans 30064894454 rc 0/0 00010000:00010000:1.0:1651529349.456250:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c03ff lrc: 0/0,0 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456250:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153591 00010000:00010000:1.0:1651529349.456258:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006002e45c/0xa29a79078f3bbe14 lrc: 0/0,0 mode: --/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d752c expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.456262:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.456264:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456265:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.456267:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456278:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456281:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.456284:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.456320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.456333:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1886:39030:x1731745946573440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 805us (923us total) trans 30064894455 rc 0/0 00000100:00100000:1.0:1651529349.456336:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153592 00000100:00100000:0.0:1651529349.456352:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573760 00000100:00100000:0.0:1651529349.456362:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153597 00000100:00100000:0.0:1651529349.456364:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1886:39029:x1731745946573760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.456365:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573824 00002000:00080000:0.0:1651529349.456370:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178389 count 1 00000100:00100000:1.0:1651529349.456374:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153598 00010000:00010000:0.0:1651529349.456374:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456376:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1887:39030:x1731745946573824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.456379:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 2/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 178 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.456382:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178390 count 1 00010000:00010000:0.0:1651529349.456382:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456382:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456383:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 4/0,1 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456388:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456390:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 3/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 178 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.456396:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 2/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 178 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.456399:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456400:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456401:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 4/0,1 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456411:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 3/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 178 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456411:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 4/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456415:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 4/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 178 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456416:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.456419:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.456428:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.456428:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.456433:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456433:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454656 00010000:00010000:1.0:1651529349.456437:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.456438:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456438:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 4/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456441:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 3/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456445:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 1/0,0 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456445:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454720 00010000:00010000:0.0:1651529349.456447:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456448:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0406 lrc: 0/0,0 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456457:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12555 00000100:00100000:1.0:1651529349.456459:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41279:x1731746396454656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.456462:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.456464:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 4/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456467:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 3/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456469:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12556 00000100:00100000:0.0:1651529349.456471:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41279:x1731746396454720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.456472:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e19a1ff/0xa29a79078f3baf03 lrc: 0/0,0 mode: --/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a70 expref: 180 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456474:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.456475:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456475:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456476:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456477:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456480:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 4/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456491:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.456494:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 3/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.456497:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41279:x1731746396454656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.456500:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12555 00010000:00010000:0.0:1651529349.456500:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b983f25/0xa29a79078f3bbe4c lrc: 0/0,0 mode: --/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7698 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456504:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456505:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456506:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456509:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 4/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456518:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.456526:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396454720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.456528:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12556 00010000:00010000:0.0:1651529349.456537:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456541:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456548:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.456562:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456565:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456604:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016c8fffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1888:39029:x1731745946573504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1029us (1184us total) trans 30064894456 rc 0/0 00000100:00100000:1.0:1651529349.456605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.456607:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153593 00000100:00100000:0.0:1651529349.456626:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573888 00000100:00100000:0.0:1651529349.456636:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946573952 00000100:00100000:0.0:1651529349.456643:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153599 00000100:00100000:0.0:1651529349.456644:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1889:39029:x1731745946573888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.456649:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178391 count 1 00010000:00010000:0.0:1651529349.456654:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456658:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 2/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 176 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456661:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456662:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456663:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 4/0,1 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456669:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 3/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 176 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456673:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 4/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 176 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456677:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966704704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.456679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.456693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.456693:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.456704:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456707:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.456708:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456725:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 3/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456730:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 1/0,0 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456741:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c040d lrc: 0/0,0 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456742:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456749:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456751:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454848 00010000:00010000:1.0:1651529349.456753:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456755:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456756:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 5/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 177 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456784:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454784 00010000:00010000:0.0:1651529349.456788:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 5/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.456796:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12557 00000100:00100000:0.0:1651529349.456798:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+178:41278:x1731746396454848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.456801:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.456820:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 5/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456824:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 4/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456829:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456830:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456831:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456834:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1890:39030:x1731745946573568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1244us (1404us total) trans 30064894457 rc 0/0 00010000:00010000:0.0:1651529349.456834:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 4/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456837:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153594 00010000:00010000:0.0:1651529349.456839:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.456843:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153600 00000100:00100000:1.0:1651529349.456845:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1889:39029:x1731745946573952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.456847:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b20ee91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+178:41278:x1731746396454848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (169us total) trans 0 rc 0/0 00002000:00080000:1.0:1651529349.456850:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178392 count 1 00000100:00100000:0.0:1651529349.456850:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12557 00010000:00010000:1.0:1651529349.456854:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456859:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 2/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 177 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.456859:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12558 00000100:00100000:0.0:1651529349.456861:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396454784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.456862:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456862:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456863:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 4/0,1 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.456864:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.456865:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 5/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 177 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456869:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 4/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 177 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.456873:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 3/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 177 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.456874:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456874:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.456875:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456877:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 4/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 177 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.456878:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 4/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456881:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966704768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.456882:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.456886:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396454784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.456889:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.456889:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12558 00010000:00010000:1.0:1651529349.456897:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456902:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002cfccf71 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.456903:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.456906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.456908:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 3/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456926:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 1/0,0 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456929:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c0414 lrc: 0/0,0 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.456939:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574016 00000100:00100000:1.0:1651529349.456961:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153601 00000100:00100000:1.0:1651529349.456963:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1890:39030:x1731745946574016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.456968:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178393 count 1 00010000:00010000:1.0:1651529349.456972:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.456995:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 2/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 176 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.456998:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456999:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.456999:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 4/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457009:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.457016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.457017:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 176 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457021:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 176 pid: 127526 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.457022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.457025:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966704832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.457030:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.457034:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457040:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.457048:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454912 00000100:00100000:0.0:1651529349.457051:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455040 00010000:00010000:1.0:1651529349.457053:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 4/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.457055:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 5/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 178 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457059:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396454976 00010000:00010000:1.0:1651529349.457062:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 5/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 179 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.457062:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12559 00000100:00100000:0.0:1651529349.457063:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41279:x1731746396454912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.457066:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.457068:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 4/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457069:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12560 00000100:00100000:1.0:1651529349.457071:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41279:x1731746396455040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.457074:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.457075:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 5/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457079:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 4/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457084:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457085:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457086:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457087:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 3/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457089:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 4/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457093:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.457093:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe475ad9/0xa29a79078f3bbf02 lrc: 0/0,0 mode: --/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d78e4 expref: 179 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.457097:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457097:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457098:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457099:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+178:41279:x1731746396455040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (83us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.457101:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 4/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457102:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12560 00000100:00100000:1.0:1651529349.457106:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12561 00000100:00100000:1.0:1651529349.457108:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41278:x1731746396454976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.457108:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.457111:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.457112:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 5/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 177 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457116:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 4/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 177 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.457116:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396454912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.457119:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12559 00010000:00010000:1.0:1651529349.457120:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457121:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457121:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457124:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 4/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457128:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.457130:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd4fae22/0xa29a79078f3bc140 lrc: 0/0,0 mode: --/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d825a expref: 176 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457133:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+176:41278:x1731746396454976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.457134:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966704704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.457137:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12561 00010000:00010000:0.0:1651529349.457137:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457141:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457143:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457146:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457151:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f619248b/0xa29a79078f3bbb97 lrc: 0/0,0 mode: --/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c18 expref: 174 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457157:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966704512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.457162:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457164:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457165:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457168:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457179:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457182:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457217:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1892:39029:x1731745946573888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 571us (670us total) trans 30064894458 rc 0/0 00000100:00100000:0.0:1651529349.457220:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153599 00010000:00010000:0.0:1651529349.457227:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457228:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1891:39030:x1731745946573696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1121us (1239us total) trans 30064894459 rc 0/0 00000100:00100000:1.0:1651529349.457231:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153596 00010000:00010000:0.0:1651529349.457233:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.457234:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457237:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 3/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457238:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457242:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.457242:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 1/0,0 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457243:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457245:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0437 lrc: 0/0,0 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457246:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 3/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457250:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 1/0,0 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457251:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457253:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0422 lrc: 0/0,0 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457254:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457257:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457259:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457264:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000880f0c3/0xa29a79078f3bb546 lrc: 0/0,0 mode: --/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d541d expref: 173 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457275:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966704448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.457279:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457282:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457285:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457288:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457290:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457307:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946573760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (986us total) trans 30064894460 rc 0/0 00000100:00100000:0.0:1651529349.457310:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153597 00010000:00010000:0.0:1651529349.457317:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457320:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb28b6d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.457321:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457324:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 3/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457328:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 1/0,0 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457331:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946573632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1296us (1386us total) trans 30064894461 rc 0/0 00010000:00010000:0.0:1651529349.457331:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c0429 lrc: 0/0,0 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457334:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153595 00010000:00010000:0.0:1651529349.457335:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457338:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.457339:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457342:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 3/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457346:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef341f5/0xa29a79078f3b92fc lrc: 0/0,0 mode: --/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc989 expref: 172 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.457347:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 1/0,0 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457350:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.457350:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c041b lrc: 0/0,0 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457353:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457356:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457359:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457362:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.457365:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.457419:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1891:39030:x1731745946573824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1043us (1136us total) trans 30064894462 rc 0/0 00000100:00100000:1.0:1651529349.457428:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153598 00000100:00100000:1.0:1651529349.457442:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574080 00000100:00100000:1.0:1651529349.457462:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153602 00000100:00100000:1.0:1651529349.457464:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1891:39030:x1731745946574080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.457471:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178394 count 1 00010000:00010000:1.0:1651529349.457477:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457484:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 2/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457489:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457490:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457491:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 4/0,1 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457502:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 3/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457509:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 4/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457515:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.457532:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.457538:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457541:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.457543:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457545:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 3/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457550:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 1/0,0 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457553:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0430 lrc: 0/0,0 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.457578:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455104 00010000:00010000:1.0:1651529349.457585:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 5/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 172 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457598:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12562 00000100:00100000:1.0:1651529349.457600:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396455104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.457604:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.457605:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 5/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 172 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457609:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 4/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 172 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457615:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457615:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457616:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457619:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 4/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457624:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.457631:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396455104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.457633:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12562 00000100:00100000:0.0:1651529349.457649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.457658:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7fbd3e3/0xa29a79078f3ba818 lrc: 0/0,0 mode: --/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2006 expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457663:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966704768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.457667:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457670:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457673:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457676:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.457703:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457707:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.457718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.457733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.457749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.457756:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574144 00000100:00100000:0.0:1651529349.457766:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574208 00000100:00100000:1.0:1651529349.457788:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1894:39029:x1731745946573952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (1182us total) trans 30064894463 rc 0/0 00000100:00100000:0.0:1651529349.457791:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574272 00000100:00100000:1.0:1651529349.457792:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153600 00000100:00100000:0.0:1651529349.457795:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574400 00000100:00100000:0.0:1651529349.457797:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574336 00000100:00100000:0.0:1651529349.457800:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153603 00000100:00100000:1.0:1651529349.457836:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153604 00000100:00100000:0.0:1651529349.457836:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946574144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.457839:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1896:39030:x1731745946574208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.457843:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178395 count 1 00002000:00080000:1.0:1651529349.457845:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178396 count 1 00010000:00010000:0.0:1651529349.457848:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457850:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457853:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 2/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457857:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 2/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.457858:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457859:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457860:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457860:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 4/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457861:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457861:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 4/0,1 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457867:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 3/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457869:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 3/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.457871:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 4/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 170 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457873:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 4/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 170 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.457875:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.457877:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966705024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.457885:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.457887:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.457892:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153605 00000100:00100000:1.0:1651529349.457894:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153606 00000100:00100000:0.0:1651529349.457894:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946574272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.457896:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946574400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.457898:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178397 count 1 00002000:00080000:1.0:1651529349.457900:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178399 count 1 00010000:00010000:0.0:1651529349.457901:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457904:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457906:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 2/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457908:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 2/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.457908:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457909:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457909:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 4/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457911:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457912:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.457912:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 4/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457918:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 3/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457919:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 3/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 170 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.457922:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 170 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.457923:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 4/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 170 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.457926:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966705088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.457927:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966705152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.457934:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.457935:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.457939:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153607 00000100:00100000:0.0:1651529349.457941:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946574336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.457944:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.457945:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178398 count 1 00010000:00010000:1.0:1651529349.457947:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.457948:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457948:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457951:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 3/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457952:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 2/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.457955:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 1/0,0 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457955:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457956:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.457956:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 4/0,1 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.457958:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c043e lrc: 0/0,0 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.457962:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 3/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 170 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.457965:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 4/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 170 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457970:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966704832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.457970:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966705216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.457974:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.457976:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.457980:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455168 00010000:00010000:1.0:1651529349.457985:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 171 pid: 127526 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.457992:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12563 00000100:00100000:1.0:1651529349.457994:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41278:x1731746396455168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.457997:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.457998:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 171 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458002:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 171 pid: 127526 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458007:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d08ce7a/0xa29a79078f3b8fd0 lrc: 0/0,0 mode: --/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4dc expref: 171 pid: 127526 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.458028:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458028:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458036:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458042:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 4/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458050:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455232 00010000:00010000:0.0:1651529349.458056:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 5/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458064:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12564 00000100:00100000:0.0:1651529349.458066:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41279:x1731746396455232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.458069:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.458070:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 5/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458074:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 4/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458080:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458080:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458081:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458082:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.458084:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 4/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458089:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.458098:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41278:x1731746396455168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.458103:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12563 00000100:00100000:0.0:1651529349.458104:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de556638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41279:x1731746396455232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.458107:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12564 00010000:00010000:1.0:1651529349.458114:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458118:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458121:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458124:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458140:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458144:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.458145:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458148:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 3/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458164:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 1/0,0 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458167:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1897:39030:x1731745946574016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1204us (1262us total) trans 30064894464 rc 0/0 00010000:00010000:0.0:1651529349.458167:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c0445 lrc: 0/0,0 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458171:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153601 00000100:00100000:0.0:1651529349.458183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.458184:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ade9a22/0xa29a79078f3baa4f lrc: 0/0,0 mode: --/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27a7 expref: 169 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.458196:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966704896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.458200:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458203:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458206:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458209:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458211:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458272:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1897:39030:x1731745946574080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 807us (907us total) trans 30064894465 rc 0/0 00000100:00100000:1.0:1651529349.458275:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153602 00000100:00100000:1.0:1651529349.458280:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574464 00000100:00100000:1.0:1651529349.458287:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153608 00000100:00100000:1.0:1651529349.458297:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1897:39030:x1731745946574464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.458302:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178400 count 1 00010000:00010000:1.0:1651529349.458306:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458310:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 2/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.458316:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458317:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458318:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 4/0,1 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458329:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 3/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.458335:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 4/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 168 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.458342:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966705280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.458354:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.458359:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458363:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.458364:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458367:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 3/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458372:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 1/0,0 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458394:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c044c lrc: 0/0,0 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458400:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.458442:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574528 00000100:00100000:0.0:1651529349.458448:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.458461:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574592 00000100:00100000:1.0:1651529349.458465:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153609 00000100:00100000:1.0:1651529349.458467:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1899:39030:x1731745946574528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.458477:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178401 count 1 00000100:00100000:0.0:1651529349.458477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.458485:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.458492:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.458493:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 2/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.458497:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458498:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.458498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.458499:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 4/0,1 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458516:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 3/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.458520:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 4/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 168 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.458524:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966705344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.458535:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.458560:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153610 00000100:00100000:1.0:1651529349.458563:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1899:39030:x1731745946574592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.458571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.458577:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178402 count 1 00010000:00010000:1.0:1651529349.458581:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458581:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966704960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.458585:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458586:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 2/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.458589:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458590:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458590:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 4/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458594:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966705088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.458597:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 3/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 168 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.458597:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458601:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 168 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458603:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455360 00000100:00100000:1.0:1651529349.458605:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966705408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.458607:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 5/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 169 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458613:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455488 00010000:00010000:0.0:1651529349.458615:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 5/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 170 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.458619:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.458627:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455296 00000100:00100000:1.0:1651529349.458628:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966705152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.458630:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 4/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 171 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458632:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458633:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455424 00010000:00010000:0.0:1651529349.458635:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 172 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458639:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455552 00000100:00100000:1.0:1651529349.458641:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455616 00010000:00010000:0.0:1651529349.458641:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 5/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 173 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458646:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 5/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 174 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.458648:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12565 00000100:00100000:0.0:1651529349.458650:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+174:41278:x1731746396455360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.458653:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12566 00010000:00010000:0.0:1651529349.458653:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.458654:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+174:41278:x1731746396455488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.458654:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 5/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 174 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458657:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.458657:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 4/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 174 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458658:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 4/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 174 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458662:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 3/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 174 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458663:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458664:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458664:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458667:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17e5e2c/0xa29a79078f3b98c1 lrc: 0/0,0 mode: --/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0f1 expref: 174 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458667:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 4/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458672:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458672:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458672:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.458673:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458678:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 4/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458679:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+173:41278:x1731746396455360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.458682:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12565 00010000:00010000:1.0:1651529349.458689:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.458700:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396455488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.458703:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12567 00000100:00100000:1.0:1651529349.458705:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12566 00000100:00100000:0.0:1651529349.458705:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396455296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.458709:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.458710:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 4/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 171 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.458711:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12568 00000100:00100000:1.0:1651529349.458713:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41278:x1731746396455424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.458714:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 3/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 171 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458715:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.458717:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458719:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ceb174d/0xa29a79078f3b956b lrc: 0/0,0 mode: --/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd34c expref: 171 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458721:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 3/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 171 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458723:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458723:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458724:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458726:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f4150a/0xa29a79078f3ba888 lrc: 0/0,0 mode: --/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d218e expref: 170 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458727:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 4/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458730:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458731:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458732:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458743:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.458744:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 4/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458750:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+169:41278:x1731746396455296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.458753:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.458758:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12567 00000100:00100000:1.0:1651529349.458761:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+169:41278:x1731746396455424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.458763:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12568 00000100:00100000:0.0:1651529349.458765:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12569 00000100:00100000:0.0:1651529349.458767:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41278:x1731746396455552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.458769:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12570 00010000:00010000:0.0:1651529349.458770:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.458771:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41279:x1731746396455616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.458771:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 5/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458773:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.458774:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 5/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458775:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 4/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458778:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 4/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458780:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458781:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.458782:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458783:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458783:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.458784:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458785:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 4/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458787:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 4/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458789:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.458791:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.458794:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41278:x1731746396455552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.458796:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41279:x1731746396455616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.458797:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12569 00000100:00100000:1.0:1651529349.458798:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12570 00010000:00010000:1.0:1651529349.458827:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458827:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3b99af lrc: 0/0,0 mode: --/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4a9 expref: 165 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.458831:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458831:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966705216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.458834:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458835:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458838:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458840:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458841:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458844:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458847:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458881:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1901:39029:x1731745946574400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 984us (1148us total) trans 30064894466 rc 0/0 00000100:00100000:1.0:1651529349.458884:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153606 00000100:00100000:0.0:1651529349.458890:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1900:39029:x1731745946574336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 948us (1141us total) trans 30064894467 rc 0/0 00010000:00010000:1.0:1651529349.458891:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.458893:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153607 00010000:00010000:1.0:1651529349.458895:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.458896:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458899:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 3/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458901:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458903:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 1/0,0 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458905:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.458906:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0468 lrc: 0/0,0 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458906:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458909:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 3/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458913:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 1/0,0 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458916:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c046f lrc: 0/0,0 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458919:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3ba96f lrc: 0/0,0 mode: --/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24e4 expref: 164 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.458922:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458923:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966705024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.458925:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458927:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458930:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458933:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458935:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458938:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458938:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458941:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.458983:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1901:39030:x1731745946574208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1143us (1291us total) trans 30064894468 rc 0/0 00000100:00100000:0.0:1651529349.458985:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1901:39029:x1731745946574272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1090us (1267us total) trans 30064894469 rc 0/0 00000100:00100000:1.0:1651529349.458986:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153604 00000100:00100000:0.0:1651529349.458988:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153605 00010000:00010000:1.0:1651529349.458992:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458996:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.458996:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458997:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.458999:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 3/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.458999:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459002:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459005:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459006:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 1/0,0 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459009:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c045a lrc: 0/0,0 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459014:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459016:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.459017:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459020:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 3/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459023:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 1/0,0 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459026:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0461 lrc: 0/0,0 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459029:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459032:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.459033:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459036:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 3/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459036:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1900:39029:x1731745946574144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1200us (1398us total) trans 30064894470 rc 0/0 00010000:00010000:1.0:1651529349.459039:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 1/0,0 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459039:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153603 00010000:00010000:1.0:1651529349.459041:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0453 lrc: 0/0,0 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459051:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f4d520/0xa29a79078f3bb9ad lrc: 0/0,0 mode: --/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d649a expref: 163 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.459054:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966705280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.459065:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459068:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459071:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459074:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459079:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.459135:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459147:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.459148:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459151:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 3/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459156:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 1/0,0 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459159:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0476 lrc: 0/0,0 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.459208:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946574464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (1023us total) trans 30064894471 rc 0/0 00000100:00100000:1.0:1651529349.459212:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153608 00000100:00100000:1.0:1651529349.459222:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455680 00010000:00010000:1.0:1651529349.459227:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 5/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 163 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.459244:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12571 00000100:00100000:1.0:1651529349.459246:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+163:41278:x1731746396455680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.459250:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.459251:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 5/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 163 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.459255:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 4/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 163 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.459261:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459261:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459262:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459265:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 4/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459272:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.459285:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043a26293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+163:41278:x1731746396455680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.459288:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12571 00010000:00010000:1.0:1651529349.459312:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002235c0ad/0xa29a79078f3ba27d lrc: 0/0,0 mode: --/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d085f expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.459320:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966705344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.459325:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459330:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459332:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459335:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459338:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.459366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.459374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.459394:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.459401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.459415:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946574528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 947us (1014us total) trans 30064894472 rc 0/0 00000100:00100000:0.0:1651529349.459417:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.459424:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153609 00000100:00100000:1.0:1651529349.459430:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574720 00000100:00100000:1.0:1651529349.459436:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574656 00000100:00100000:0.0:1651529349.459442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.459448:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574848 00000100:00100000:0.0:1651529349.459450:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574784 00000100:00100000:1.0:1651529349.459456:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574912 00000100:00100000:1.0:1651529349.459459:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946574976 00000100:00100000:1.0:1651529349.459462:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153611 00000100:00100000:1.0:1651529349.459464:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1905:39030:x1731745946574720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.459465:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153612 00000100:00100000:0.0:1651529349.459466:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1905:39029:x1731745946574656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.459469:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178404 count 1 00002000:00080000:0.0:1651529349.459472:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178403 count 1 00010000:00010000:1.0:1651529349.459473:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459477:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459478:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 2/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.459481:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459482:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459482:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 4/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459489:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 3/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.459493:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.459493:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 2/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 161 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.459496:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.459496:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.459497:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966705472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.459497:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 4/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459505:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 3/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 161 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.459509:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 161 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.459511:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.459519:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966705536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.459520:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966705408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.459524:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459529:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.459531:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153613 00000100:00100000:1.0:1651529349.459533:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1905:39030:x1731745946574848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.459536:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153614 00002000:00080000:1.0:1651529349.459537:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178406 count 1 00000100:00100000:0.0:1651529349.459538:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1905:39029:x1731745946574912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.459540:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459545:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 2/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 161 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.459548:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459548:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459549:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 4/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459555:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 3/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 161 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.459558:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178407 count 1 00010000:00010000:1.0:1651529349.459559:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 161 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.459562:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.459563:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966705600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.459567:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 2/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.459570:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.459570:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459575:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459578:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.459578:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459579:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459579:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 4/0,1 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459582:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 3/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459586:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 1/0,0 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459586:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 3/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.459589:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c047d lrc: 0/0,0 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459590:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 4/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.459594:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966705664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.459596:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153615 00000100:00100000:1.0:1651529349.459598:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1905:39029:x1731745946574784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.459602:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178405 count 1 00000100:00100000:0.0:1651529349.459603:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.459605:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459609:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 2/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.459610:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153616 00010000:00010000:1.0:1651529349.459612:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459612:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.459612:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1905:39030:x1731745946574976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.459613:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 4/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.459616:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178408 count 1 00010000:00010000:1.0:1651529349.459619:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 3/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.459619:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459623:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 4/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.459624:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 2/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.459627:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966705728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.459627:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.459627:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.459628:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 4/0,1 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.459633:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.459634:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 3/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 161 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.459640:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455744 00010000:00010000:0.0:1651529349.459640:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 4/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.459644:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.459644:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966705792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.459650:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.459656:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12572 00000100:00100000:1.0:1651529349.459657:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+162:41278:x1731746396455744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.459660:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.459661:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.459665:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 3/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.459670:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506b7043/0xa29a79078f3b9d3d lrc: 0/0,0 mode: --/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf312 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.459672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.459673:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459674:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459675:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459678:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 4/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459684:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.459691:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+161:41278:x1731746396455744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.459693:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12572 00010000:00010000:1.0:1651529349.459699:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459711:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575040 00000100:00100000:0.0:1651529349.459722:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153617 00000100:00100000:0.0:1651529349.459724:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1906:39030:x1731745946575040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.459729:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178409 count 1 00010000:00010000:0.0:1651529349.459740:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459745:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 2/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 160 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.459748:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.459749:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459749:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.459750:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 4/0,1 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459755:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459760:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.459772:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 3/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 160 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.459776:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 4/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 160 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.459783:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966705856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.459794:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.459802:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1907:39030:x1731745946574592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1238us (1353us total) trans 30064894473 rc 0/0 00000100:00100000:1.0:1651529349.459822:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153610 00010000:00010000:1.0:1651529349.459840:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459859:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c5c3f32 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.459860:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459863:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 3/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459869:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 1/0,0 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459873:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c0484 lrc: 0/0,0 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.459970:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966705472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.459970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.459979:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.459989:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966705536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.459992:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966705600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.459994:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.459995:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.460001:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575104 00000100:00100000:1.0:1651529349.460009:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153618 00000100:00100000:1.0:1651529349.460011:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1907:39030:x1731745946575104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.460016:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178410 count 1 00010000:00010000:1.0:1651529349.460020:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460024:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 2/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 160 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.460027:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460028:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460028:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 4/0,1 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460035:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 3/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 160 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.460038:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 4/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 160 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460042:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966705920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.460058:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.460222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.460231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.460242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.460242:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455872 00010000:00010000:0.0:1651529349.460248:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.460268:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455808 00010000:00010000:0.0:1651529349.460271:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 162 pid: 127523 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.460275:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396455936 00010000:00010000:0.0:1651529349.460277:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 163 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.460281:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456000 00010000:00010000:0.0:1651529349.460284:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 5/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 164 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460287:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456064 00010000:00010000:0.0:1651529349.460289:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 5/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 165 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.460303:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966705728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.460308:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460322:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456128 00010000:00010000:0.0:1651529349.460326:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 5/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 166 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460328:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456192 00000100:00100000:0.0:1651529349.460331:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12573 00000100:00100000:0.0:1651529349.460332:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41278:x1731746396455872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.460334:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 5/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460335:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.460337:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460341:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12574 00010000:00010000:0.0:1651529349.460341:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 3/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460343:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41278:x1731746396455808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.460346:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.460347:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 167 pid: 127523 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460347:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cec33907/0xa29a79078f3bc32a lrc: 0/0,0 mode: --/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a10 expref: 167 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460350:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460351:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 3/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 166 pid: 127523 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460351:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460352:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460355:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 4/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460357:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdf9e140/0xa29a79078f3b8764 lrc: 0/0,0 mode: --/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc075 expref: 166 pid: 127523 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.460361:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460361:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460364:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.460369:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460375:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+165:41278:x1731746396455872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.460377:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 4/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460378:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12573 00000100:00100000:0.0:1651529349.460384:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12575 00010000:00010000:1.0:1651529349.460387:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.460393:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+164:41278:x1731746396455936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.460396:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+164:41278:x1731746396455808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.460396:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.460398:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 164 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460402:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 3/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 164 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460407:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12574 00010000:00010000:0.0:1651529349.460407:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b5b20d6/0xa29a79078f3b9365 lrc: 0/0,0 mode: --/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb65 expref: 164 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460410:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460411:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.460412:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12576 00010000:00010000:0.0:1651529349.460412:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.460414:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+162:41278:x1731746396456000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.460414:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 4/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460417:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.460419:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 5/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.460423:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.460429:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 4/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 162 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460429:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+162:41278:x1731746396455936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.460432:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12575 00010000:00010000:1.0:1651529349.460435:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460435:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.460436:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460436:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12577 00000100:00100000:0.0:1651529349.460438:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+161:41279:x1731746396456064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.460439:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 4/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460441:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.460442:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 4/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.460444:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.460445:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 3/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460450:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+161:41278:x1731746396456000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.460450:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0f1e6dd/0xa29a79078f3bb998 lrc: 0/0,0 mode: --/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d643f expref: 161 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460452:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12576 00010000:00010000:0.0:1651529349.460454:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460454:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460455:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.460457:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12578 00000100:00100000:1.0:1651529349.460458:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+159:41278:x1731746396456128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.460458:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 4/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460461:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.460465:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.460471:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+159:41279:x1731746396456064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.460473:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 5/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 159 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460473:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12577 00010000:00010000:1.0:1651529349.460477:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 4/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 158 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460478:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12579 00000100:00100000:0.0:1651529349.460479:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41279:x1731746396456192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.460482:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460482:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.460483:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460483:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 5/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 158 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.460484:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460487:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 4/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460491:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.460495:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 4/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 158 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.460497:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76fa668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41278:x1731746396456128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.460500:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12578 00010000:00010000:0.0:1651529349.460500:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460501:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.460502:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460505:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 4/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460509:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.460510:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460514:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460515:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+157:41279:x1731746396456192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.460517:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460518:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12579 00010000:00010000:1.0:1651529349.460519:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460528:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f79d5d25/0xa29a79078f3b9fb3 lrc: 0/0,0 mode: --/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfca4 expref: 156 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460532:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966705664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.460542:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460546:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460549:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460559:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460562:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.460587:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1909:39030:x1731745946574848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1053us (1193us total) trans 30064894474 rc 0/0 00000100:00100000:1.0:1651529349.460590:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153613 00010000:00010000:1.0:1651529349.460598:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460601:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.460602:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460605:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 3/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460607:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1908:39029:x1731745946574912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1068us (1190us total) trans 30064894475 rc 0/0 00010000:00010000:1.0:1651529349.460610:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 1/0,0 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460610:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153614 00010000:00010000:1.0:1651529349.460613:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c0499 lrc: 0/0,0 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460617:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460620:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.460621:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460623:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008851572f/0xa29a79078f3b9d67 lrc: 0/0,0 mode: --/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3ba expref: 155 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.460627:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966705856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.460630:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460634:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 3/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460634:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460636:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460638:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 1/0,0 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460639:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460640:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c04a0 lrc: 0/0,0 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460646:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460650:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460652:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460653:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460655:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460693:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1909:39030:x1731745946575040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 968us (1021us total) trans 30064894476 rc 0/0 00000100:00100000:0.0:1651529349.460696:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153617 00000100:00100000:1.0:1651529349.460700:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1908:39029:x1731745946574784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1101us (1298us total) trans 30064894477 rc 0/0 00000100:00100000:1.0:1651529349.460703:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153615 00010000:00010000:0.0:1651529349.460707:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065deecaa/0xa29a79078f3bb180 lrc: 0/0,0 mode: --/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d446b expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.460710:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460711:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966705792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.460714:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460716:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.460717:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460717:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460720:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 3/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460720:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460723:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460724:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 1/0,0 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460726:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460727:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c04b5 lrc: 0/0,0 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460731:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460745:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.460746:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460749:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 3/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460752:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 1/0,0 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460758:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c04a7 lrc: 0/0,0 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460761:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460764:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.460765:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460768:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 3/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460771:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 1/0,0 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460773:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c04ae lrc: 0/0,0 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460776:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1908:39030:x1731745946574976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1164us (1334us total) trans 30064894478 rc 0/0 00010000:00010000:1.0:1651529349.460780:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460780:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153616 00010000:00010000:1.0:1651529349.460783:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460786:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460787:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460789:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460791:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460794:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460796:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.460855:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1909:39030:x1731745946574720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1389us (1506us total) trans 30064894479 rc 0/0 00000100:00100000:1.0:1651529349.460858:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153611 00000100:00100000:0.0:1651529349.460858:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1909:39029:x1731745946574656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1390us (1491us total) trans 30064894480 rc 0/0 00000100:00100000:0.0:1651529349.460861:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153612 00010000:00010000:1.0:1651529349.460865:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460869:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.460869:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460870:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460872:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 3/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460872:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.460873:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460876:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 3/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460877:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 1/0,0 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.460880:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c048b lrc: 0/0,0 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460882:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 1/0,0 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.460885:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0492 lrc: 0/0,0 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.460929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.461038:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456256 00010000:00010000:1.0:1651529349.461045:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 5/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461059:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12580 00000100:00100000:1.0:1651529349.461061:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396456256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.461064:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.461066:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 5/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.461070:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 4/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.461075:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461076:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461077:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461080:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 4/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461085:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.461090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.461094:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396456256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.461097:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12580 00010000:00010000:1.0:1651529349.461107:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5b129a/0xa29a79078f3ba01c lrc: 0/0,0 mode: --/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe3a expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461111:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000405f9b91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966705920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.461126:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.461144:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575168 00010000:00010000:1.0:1651529349.461147:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461150:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461153:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461156:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461163:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575232 00000100:00100000:0.0:1651529349.461171:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153619 00000100:00100000:0.0:1651529349.461173:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1909:39029:x1731745946575168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.461178:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178411 count 1 00010000:00010000:0.0:1651529349.461183:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461188:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 2/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461191:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461191:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461192:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 4/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461199:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 3/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.461205:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1910:39030:x1731745946575104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1193us (1235us total) trans 30064894481 rc 0/0 00000100:00100000:1.0:1651529349.461208:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153618 00000100:00100000:1.0:1651529349.461213:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153620 00000100:00100000:1.0:1651529349.461215:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1909:39030:x1731745946575232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.461219:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 4/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 152 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.461220:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178412 count 1 00010000:00010000:1.0:1651529349.461224:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461224:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966705984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.461228:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 2/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.461233:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.461243:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461244:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461245:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 4/0,1 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461252:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 3/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.461259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.461264:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 4/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 152 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461269:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966706048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.461278:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.461291:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461294:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.461294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.461295:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461298:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 3/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461303:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 1/0,0 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.461315:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c04bc lrc: 0/0,0 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461324:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575296 00000100:00100000:0.0:1651529349.461331:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.461349:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575360 00000100:00100000:1.0:1651529349.461354:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575488 00000100:00100000:1.0:1651529349.461357:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575424 00000100:00100000:1.0:1651529349.461360:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153621 00000100:00100000:1.0:1651529349.461362:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1913:39029:x1731745946575296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.461366:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153622 00000100:00100000:0.0:1651529349.461368:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f98687fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1913:39030:x1731745946575360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.461373:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178414 count 1 00002000:00080000:1.0:1651529349.461375:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178413 count 1 00010000:00010000:0.0:1651529349.461378:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461381:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461382:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 2/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461385:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461386:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461387:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 4/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461388:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 2/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.461394:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461394:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461396:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 4/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461403:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.461407:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 152 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461418:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 3/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.461423:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966706112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461425:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 152 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.461429:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966706176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.461433:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.461438:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.461440:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153623 00000100:00100000:1.0:1651529349.461442:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1913:39030:x1731745946575488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.461445:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153624 00002000:00080000:1.0:1651529349.461447:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178416 count 1 00000100:00100000:0.0:1651529349.461447:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1913:39029:x1731745946575424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.461450:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.461451:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178415 count 1 00010000:00010000:1.0:1651529349.461455:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 2/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461455:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461458:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461458:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461459:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 4/0,1 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461459:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 2/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461462:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461463:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461464:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 4/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461465:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 3/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.461469:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 4/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 152 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461470:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 3/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.461473:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966706240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461473:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 152 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461479:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.461480:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966706304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.461486:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.461498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.461520:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.461528:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575552 00000100:00100000:1.0:1651529349.461535:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575616 00000100:00100000:0.0:1651529349.461567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.461576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.461578:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153625 00000100:00100000:1.0:1651529349.461581:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1915:39030:x1731745946575552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.461584:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153626 00000100:00100000:0.0:1651529349.461586:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1915:39030:x1731745946575616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.461589:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178417 count 1 00010000:00010000:1.0:1651529349.461594:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461601:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 2/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.461604:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461604:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461605:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 4/0,1 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.461606:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178418 count 1 00010000:00010000:0.0:1651529349.461610:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461612:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 3/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 152 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461615:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 2/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.461616:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 4/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 152 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461618:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461619:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461619:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 4/0,1 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461620:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966706368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461626:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 3/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 152 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.461630:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 4/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 152 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461635:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.461641:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966706432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.461642:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456320 00010000:00010000:1.0:1651529349.461647:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 5/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.461650:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.461659:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456384 00010000:00010000:1.0:1651529349.461662:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 5/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 154 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.461663:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966705984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461667:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461668:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12581 00000100:00100000:1.0:1651529349.461670:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396456320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.461673:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.461674:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 4/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.461675:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12582 00000100:00100000:0.0:1651529349.461677:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396456384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.461678:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 3/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461680:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.461682:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 5/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 154 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.461684:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005f4af80/0xa29a79078f3ba57f lrc: 0/0,0 mode: --/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14b4 expref: 154 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461686:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 4/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 154 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.461687:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461688:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461689:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461691:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.461692:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 4/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461692:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.461693:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461696:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 4/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461700:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.461706:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.461707:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+153:41279:x1731746396456320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.461710:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12581 00000100:00100000:0.0:1651529349.461713:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+152:41278:x1731746396456384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.461716:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12582 00010000:00010000:1.0:1651529349.461723:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3a81c5/0xa29a79078f3b97b0 lrc: 0/0,0 mode: --/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdca6 expref: 151 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.461724:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461727:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966706048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461727:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461730:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461731:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461742:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461744:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461747:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461757:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461760:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461791:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1917:39029:x1731745946575168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 617us (701us total) trans 30064894482 rc 0/0 00000100:00100000:0.0:1651529349.461794:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153619 00010000:00010000:0.0:1651529349.461802:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461817:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.461818:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461821:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 3/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461829:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1916:39030:x1731745946575232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 612us (695us total) trans 30064894483 rc 0/0 00000100:00100000:1.0:1651529349.461834:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153620 00010000:00010000:1.0:1651529349.461844:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461846:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 1/0,0 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.461849:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c04c3 lrc: 0/0,0 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461850:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.461851:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461854:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 3/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461859:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 1/0,0 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.461862:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c04ca lrc: 0/0,0 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.461905:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966706112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.461909:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.461931:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966706240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.461932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.461934:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.461950:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966706176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461960:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461968:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966706304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.461970:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.461977:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456512 00010000:00010000:0.0:1651529349.461981:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 151 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.461992:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456640 00010000:00010000:0.0:1651529349.461995:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 152 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.461999:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456448 00000100:00100000:0.0:1651529349.462000:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12583 00000100:00100000:0.0:1651529349.462001:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+153:41278:x1731746396456512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.462004:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.462005:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462007:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462012:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 3/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.462022:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12584 00000100:00100000:1.0:1651529349.462024:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+153:41278:x1731746396456640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.462028:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.462030:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 153 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462031:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db48a8fa/0xa29a79078f3ba40c lrc: 0/0,0 mode: --/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e47 expref: 153 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462034:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 3/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 153 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462036:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462037:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462040:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087aef6b3/0xa29a79078f3b93ab lrc: 0/0,0 mode: --/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc8b expref: 152 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462040:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 4/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462044:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462044:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462045:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462047:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.462049:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 4/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462064:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.462064:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+151:41278:x1731746396456512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.462067:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12583 00000100:00100000:1.0:1651529349.462071:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+151:41278:x1731746396456640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.462081:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12584 00000100:00100000:0.0:1651529349.462085:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12585 00000100:00100000:0.0:1651529349.462086:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396456448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.462089:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.462091:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 149 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462095:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 149 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.462098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.462101:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c5115d/0xa29a79078f3ba380 lrc: 0/0,0 mode: --/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bfb expref: 149 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462104:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462105:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462106:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462109:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 4/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462118:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.462129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.462161:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce664ab1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+148:41279:x1731746396456448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.462165:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12585 00000100:00100000:0.0:1651529349.462179:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575744 00000100:00100000:0.0:1651529349.462188:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575680 00000100:00100000:0.0:1651529349.462192:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153627 00000100:00100000:0.0:1651529349.462194:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1917:39030:x1731745946575744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.462199:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178420 count 1 00010000:00010000:1.0:1651529349.462202:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462203:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462207:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462208:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 2/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 147 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.462210:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462211:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462212:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462212:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 4/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462213:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462219:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 3/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 147 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.462223:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 147 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.462226:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966706496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.462256:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.462262:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462265:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.462268:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1918:39029:x1731745946575296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 906us (1009us total) trans 30064894484 rc 0/0 00010000:00010000:0.0:1651529349.462268:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462271:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.462272:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153621 00000100:00100000:1.0:1651529349.462277:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153628 00000100:00100000:1.0:1651529349.462279:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1917:39029:x1731745946575680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.462284:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178419 count 1 00010000:00010000:1.0:1651529349.462297:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462302:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 2/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 147 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.462305:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462306:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462306:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 4/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462314:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 147 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.462318:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 147 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.462321:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1918:39029:x1731745946575424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 874us (990us total) trans 30064894485 rc 0/0 00000100:00100000:1.0:1651529349.462322:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966706560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.462324:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153624 00000100:00100000:1.0:1651529349.462331:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.462332:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462335:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.462337:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462339:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462339:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 3/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462342:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.462343:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462344:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 1/0,0 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462346:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 3/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462347:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c04d8 lrc: 0/0,0 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462351:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 1/0,0 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462353:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462354:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c04e6 lrc: 0/0,0 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462356:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462359:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462361:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462400:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f98687fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1918:39030:x1731745946575360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1031us (1106us total) trans 30064894486 rc 0/0 00000100:00100000:0.0:1651529349.462403:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153622 00000100:00100000:0.0:1651529349.462431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.462451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.462454:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.462465:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.462466:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462467:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456576 00010000:00010000:1.0:1651529349.462470:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 3/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462472:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 4/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 148 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462474:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 1/0,0 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462477:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c04d1 lrc: 0/0,0 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462481:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456704 00000100:00100000:1.0:1651529349.462490:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456768 00010000:00010000:1.0:1651529349.462495:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 5/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462499:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 5/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 150 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.462501:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12586 00000100:00100000:1.0:1651529349.462503:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+150:41279:x1731746396456576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.462505:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12587 00010000:00010000:1.0:1651529349.462506:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.462507:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 4/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.462507:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+150:41279:x1731746396456768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.462510:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.462511:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 3/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462512:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 5/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462516:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 4/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462519:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3babe5 lrc: 0/0,0 mode: --/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e1b expref: 150 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.462521:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462522:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462523:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462523:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462524:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462524:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462526:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 4/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462527:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 4/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462531:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.462534:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.462545:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396456768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.462548:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12587 00000100:00100000:1.0:1651529349.462550:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396456576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.462553:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12586 00000100:00100000:0.0:1651529349.462554:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12588 00000100:00100000:0.0:1651529349.462556:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+147:41279:x1731746396456704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.462559:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.462560:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462560:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 5/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 147 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462564:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462564:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 4/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 147 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462567:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462569:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462569:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462569:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462570:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462573:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 4/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462577:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.462602:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+147:41279:x1731746396456704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.462615:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12588 00000100:00100000:1.0:1651529349.462618:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1918:39030:x1731745946575488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1309us total) trans 30064894487 rc 0/0 00000100:00100000:1.0:1651529349.462623:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153623 00010000:00010000:0.0:1651529349.462626:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de29bf60/0xa29a79078f3bab4b lrc: 0/0,0 mode: --/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c07 expref: 146 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462638:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000745d4b92/0xa29a79078f3b9636 lrc: 0/0,0 mode: --/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd70b expref: 146 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.462642:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b95db0aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966706368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.462646:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462649:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462654:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966706432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.462658:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462662:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462664:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462665:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462667:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462669:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462670:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462672:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462712:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1919:39030:x1731745946575616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1126us (1192us total) trans 30064894488 rc 0/0 00000100:00100000:0.0:1651529349.462715:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153626 00000100:00100000:1.0:1651529349.462720:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1918:39030:x1731745946575552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1138us (1222us total) trans 30064894489 rc 0/0 00000100:00100000:1.0:1651529349.462722:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153625 00010000:00010000:0.0:1651529349.462723:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462726:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb28b6d6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.462727:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462730:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462733:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 3/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462745:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.462746:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462746:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 1/0,0 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462749:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 3/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462749:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c04df lrc: 0/0,0 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462753:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462755:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 1/0,0 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462756:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.462757:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c04f4 lrc: 0/0,0 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462757:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462760:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 3/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462763:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 1/0,0 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462766:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c04ed lrc: 0/0,0 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.462792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.462852:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966706496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.462857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.462859:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.462873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.462874:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575872 00000100:00100000:0.0:1651529349.462881:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575808 00000100:00100000:0.0:1651529349.462888:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946575936 00000100:00100000:0.0:1651529349.462895:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153629 00000100:00100000:0.0:1651529349.462896:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1920:39030:x1731745946575872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.462902:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178422 count 1 00010000:00010000:0.0:1651529349.462906:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462911:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 2/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 144 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.462914:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462914:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462915:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 4/0,1 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462922:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 3/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 144 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.462925:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 4/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 144 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.462929:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966706624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.462944:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.462946:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966706560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.462950:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153630 00010000:00010000:1.0:1651529349.462951:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462952:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1920:39029:x1731745946575808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.462957:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178421 count 1 00000100:00100000:1.0:1651529349.462960:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153631 00010000:00010000:0.0:1651529349.462961:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.462962:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1920:39029:x1731745946575936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.462965:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 2/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 144 pid: 161133 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.462967:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178423 count 1 00010000:00010000:0.0:1651529349.462968:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462969:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.462969:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 4/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.462971:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.462975:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 3/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 144 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.462976:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 2/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 144 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.462978:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 144 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.462979:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462980:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.462980:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 4/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.462982:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966706688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.462987:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 3/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 144 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.462989:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.462991:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 144 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.462995:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966706752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.462998:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.463004:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.463030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.463037:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456832 00010000:00010000:0.0:1651529349.463043:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 145 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463061:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456896 00010000:00010000:0.0:1651529349.463064:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 146 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463072:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12589 00000100:00100000:0.0:1651529349.463074:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+146:41278:x1731746396456832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.463077:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.463079:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 146 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463082:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12590 00010000:00010000:0.0:1651529349.463082:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 3/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 146 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463085:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+146:41278:x1731746396456896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.463090:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.463093:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 146 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463098:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 146 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463110:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3b97e1 lrc: 0/0,0 mode: --/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdde8 expref: 146 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463114:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463114:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463115:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463118:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 4/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463119:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39f5a3b/0xa29a79078f3baf18 lrc: 0/0,0 mode: --/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3abd expref: 145 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463123:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463124:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463125:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463125:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.463128:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 4/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463133:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+144:41278:x1731746396456832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.463135:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.463136:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12589 00000100:00100000:1.0:1651529349.463143:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+143:41278:x1731746396456896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.463143:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463145:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12590 00010000:00010000:0.0:1651529349.463146:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463149:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463152:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463154:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463164:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463168:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463171:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463195:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1921:39030:x1731745946575744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 999us (1096us total) trans 30064894490 rc 0/0 00000100:00100000:0.0:1651529349.463197:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153627 00000100:00100000:1.0:1651529349.463221:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1921:39029:x1731745946575680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 941us (1093us total) trans 30064894491 rc 0/0 00000100:00100000:1.0:1651529349.463224:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153628 00000100:00100000:0.0:1651529349.463231:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.463242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.463243:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463249:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.463250:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463256:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 3/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463262:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 1/0,0 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463265:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c04fb lrc: 0/0,0 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.463292:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463295:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.463296:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463313:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 3/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463332:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 1/0,0 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463335:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c0502 lrc: 0/0,0 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.463342:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.463351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.463362:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966706752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.463366:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463366:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966706688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.463370:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463373:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396456960 00010000:00010000:1.0:1651529349.463378:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 5/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 143 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463380:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457088 00010000:00010000:0.0:1651529349.463385:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 144 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463389:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457024 00010000:00010000:1.0:1651529349.463392:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 145 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463397:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12591 00000100:00100000:1.0:1651529349.463399:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+145:41279:x1731746396456960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.463399:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12592 00000100:00100000:0.0:1651529349.463401:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+145:41279:x1731746396457088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.463402:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.463403:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 5/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 145 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463404:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.463405:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 145 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463409:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 3/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 145 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463414:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 4/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 145 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463414:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f0f18f/0xa29a79078f3b931f lrc: 0/0,0 mode: --/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca2a expref: 145 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.463418:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463419:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463419:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463420:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463421:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463422:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463425:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 4/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463429:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.463437:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+144:41279:x1731746396456960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.463439:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12591 00010000:00010000:0.0:1651529349.463439:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 4/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463444:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12593 00010000:00010000:0.0:1651529349.463445:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.463446:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+143:41278:x1731746396457024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.463448:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.463449:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 143 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463453:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 3/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 143 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463453:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+143:41279:x1731746396457088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.463456:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12592 00010000:00010000:1.0:1651529349.463457:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f2a42d/0xa29a79078f3bb729 lrc: 0/0,0 mode: --/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b08 expref: 143 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463463:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463464:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463465:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463467:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 4/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463469:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576000 00010000:00010000:1.0:1651529349.463474:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.463479:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576064 00000100:00100000:0.0:1651529349.463485:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576128 00000100:00100000:0.0:1651529349.463491:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153632 00000100:00100000:0.0:1651529349.463492:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1923:39030:x1731745946576000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.463494:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396457024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.463497:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12593 00002000:00080000:0.0:1651529349.463497:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178424 count 1 00010000:00010000:0.0:1651529349.463501:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463505:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153633 00010000:00010000:0.0:1651529349.463506:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 2/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 140 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.463507:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1923:39029:x1731745946576064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.463509:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463509:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463510:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 4/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.463512:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178425 count 1 00010000:00010000:1.0:1651529349.463516:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463517:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 140 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463520:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 2/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 140 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.463521:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 140 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463523:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463524:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463525:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 4/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463525:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966706816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.463531:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 3/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 140 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.463533:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.463535:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 140 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463539:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966706880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.463541:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c17a43/0xa29a79078f3bb70d lrc: 0/0,0 mode: --/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a8a expref: 140 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463545:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966706624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.463548:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.463549:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463552:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463554:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153634 00000100:00100000:1.0:1651529349.463555:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1923:39030:x1731745946576128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.463555:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463558:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.463559:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178426 count 1 00010000:00010000:0.0:1651529349.463560:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463562:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463567:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 2/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463569:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463570:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463570:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 4/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463577:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463580:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.463587:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966706944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.463592:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8874cbc going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.463598:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463601:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463601:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1924:39030:x1731745946575872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 703us (809us total) trans 30064894492 rc 0/0 00010000:00010000:1.0:1651529349.463604:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463604:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153629 00010000:00010000:1.0:1651529349.463607:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463613:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463616:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.463617:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463623:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 3/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463628:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 1/0,0 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463630:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0509 lrc: 0/0,0 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463635:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463637:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.463638:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463641:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 3/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463644:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 1/0,0 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463647:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1924:39029:x1731745946575936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 684us (774us total) trans 30064894493 rc 0/0 00010000:00010000:0.0:1651529349.463647:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c0517 lrc: 0/0,0 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463650:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153631 00010000:00010000:0.0:1651529349.463652:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463655:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463658:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463661:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.463678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.463692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.463701:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1924:39029:x1731745946575808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 747us (845us total) trans 30064894494 rc 0/0 00000100:00100000:0.0:1651529349.463704:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153630 00000100:00100000:0.0:1651529349.463708:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576192 00000100:00100000:0.0:1651529349.463717:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576256 00000100:00100000:0.0:1651529349.463722:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153635 00000100:00100000:0.0:1651529349.463723:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1925:39029:x1731745946576192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.463728:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178427 count 1 00010000:00010000:0.0:1651529349.463732:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463745:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 2/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.463749:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463749:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463750:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 4/0,1 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463766:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 3/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.463770:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 4/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.463774:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.463783:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.463791:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153636 00000100:00100000:0.0:1651529349.463820:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1925:39030:x1731745946576256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.463825:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178428 count 1 00010000:00010000:0.0:1651529349.463835:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463839:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 2/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463842:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463843:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463843:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463844:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 4/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463847:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.463848:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463850:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 3/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463853:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 3/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463854:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.463859:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 1/0,0 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463861:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0510 lrc: 0/0,0 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.463866:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966707072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.463880:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.463935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.463942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.463943:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576320 00000100:00100000:0.0:1651529349.463952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.463961:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576384 00000100:00100000:1.0:1651529349.463968:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576448 00000100:00100000:1.0:1651529349.463973:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153637 00000100:00100000:1.0:1651529349.463975:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1928:39029:x1731745946576320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.463975:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153638 00000100:00100000:0.0:1651529349.463977:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1928:39030:x1731745946576384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.463980:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178429 count 1 00002000:00080000:0.0:1651529349.463983:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178430 count 1 00010000:00010000:1.0:1651529349.463985:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463988:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.463990:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 2/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.463992:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 2/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.463993:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463993:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.463994:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 4/0,1 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.463995:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463996:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.463997:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 4/0,1 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464001:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 3/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.464004:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 3/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.464007:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464011:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464017:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 4/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464025:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966707136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.464040:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.464044:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aa96a15d going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.464047:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153639 00000100:00100000:1.0:1651529349.464050:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1928:39029:x1731745946576448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.464058:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178431 count 1 00010000:00010000:1.0:1651529349.464063:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464069:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 2/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.464072:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464072:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464073:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 4/0,1 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464094:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 3/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 139 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.464100:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 4/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464130:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966707264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.464141:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.464168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.464182:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.464191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.464211:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa867bc6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966706880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.464211:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966706816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464216:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464216:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464223:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457216 00000100:00100000:1.0:1651529349.464224:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966706944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464227:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464228:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 140 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464233:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457152 00000100:00100000:0.0:1651529349.464235:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457280 00010000:00010000:1.0:1651529349.464238:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464238:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464243:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12594 00000100:00100000:0.0:1651529349.464245:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41279:x1731746396457216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.464246:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12595 00010000:00010000:0.0:1651529349.464248:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.464249:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41279:x1731746396457280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.464249:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464253:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464254:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.464256:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464262:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464269:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012608d06/0xa29a79078f3bb90c lrc: 0/0,0 mode: --/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6294 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464277:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d92407/0xa29a79078f3b9f89 lrc: 0/0,0 mode: --/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc11 expref: 142 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464287:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464288:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464290:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464293:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 4/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464299:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464300:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464301:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.464301:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464304:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 4/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464309:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396457280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.464311:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.464312:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12595 00000100:00100000:1.0:1651529349.464318:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12596 00000100:00100000:0.0:1651529349.464319:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396457216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.464320:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396457152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.464322:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.464322:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12594 00010000:00010000:1.0:1651529349.464324:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464328:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 3/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 138 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464333:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b915b09/0xa29a79078f3bb0ed lrc: 0/0,0 mode: --/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4250 expref: 138 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464333:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966707072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464336:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464337:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464344:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.464344:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f51dad16 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464345:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464347:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464348:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 4/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464352:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464355:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.464355:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464361:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464362:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+137:41279:x1731746396457152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.464364:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12596 00010000:00010000:0.0:1651529349.464364:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464372:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464375:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464378:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464381:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464418:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1930:39030:x1731745946576000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 924us (1186us total) trans 30064894495 rc 0/0 00000100:00100000:0.0:1651529349.464421:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153632 00000100:00100000:1.0:1651529349.464435:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1929:39030:x1731745946576128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 879us (1158us total) trans 30064894496 rc 0/0 00010000:00010000:0.0:1651529349.464437:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464439:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153634 00010000:00010000:0.0:1651529349.464441:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.464442:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464445:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 3/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464447:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464450:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 1/0,0 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464453:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002cfccf71 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.464453:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c051e lrc: 0/0,0 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464454:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464457:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 3/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464462:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 1/0,0 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464465:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfccf71/0xa29a79078f3c052c lrc: 0/0,0 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464471:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464474:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464480:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.464497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.464498:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464506:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.464564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.464571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.464581:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1929:39029:x1731745946576064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1338us total) trans 30064894497 rc 0/0 00000100:00100000:1.0:1651529349.464584:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153633 00000100:00100000:0.0:1651529349.464585:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.464589:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464592:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464596:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000795ba8e5 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.464596:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457408 00010000:00010000:1.0:1651529349.464597:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464600:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 3/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464601:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 137 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464605:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 1/0,0 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464606:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457344 00010000:00010000:1.0:1651529349.464607:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795ba8e5/0xa29a79078f3c0525 lrc: 0/0,0 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464609:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 4/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 138 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464612:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457472 00000100:00100000:1.0:1651529349.464615:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457600 00010000:00010000:0.0:1651529349.464615:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 5/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 139 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464619:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457536 00010000:00010000:1.0:1651529349.464620:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 5/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464621:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464626:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12597 00000100:00100000:1.0:1651529349.464627:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396457408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.464628:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12598 00000100:00100000:0.0:1651529349.464629:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41279:x1731746396457344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.464630:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.464632:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464632:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.464634:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 4/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464637:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 3/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464638:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 3/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464642:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000656098f6/0xa29a79078f3bb9e5 lrc: 0/0,0 mode: --/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65a4 expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464643:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7a5ce6/0xa29a79078f3bb3e1 lrc: 0/0,0 mode: --/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eac expref: 141 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464646:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464646:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464647:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464647:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464648:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464648:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464651:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 4/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464651:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 4/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464657:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.464661:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.464668:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396457408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.464670:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12597 00000100:00100000:1.0:1651529349.464675:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12599 00000100:00100000:1.0:1651529349.464676:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+138:41279:x1731746396457472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.464679:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.464680:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 5/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 138 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464684:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 4/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 138 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464685:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+138:41279:x1731746396457344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.464688:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12598 00010000:00010000:1.0:1651529349.464689:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464689:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464690:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464693:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 4/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464693:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12600 00000100:00100000:0.0:1651529349.464695:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+137:41279:x1731746396457600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.464697:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.464697:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.464699:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 5/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 137 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464702:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098759fca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+137:41279:x1731746396457472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (146us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.464703:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 4/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 137 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464704:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12599 00010000:00010000:0.0:1651529349.464709:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464709:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.464710:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464713:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12601 00010000:00010000:0.0:1651529349.464713:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 4/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464714:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+136:41279:x1731746396457536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.464716:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.464717:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.464718:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 136 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464722:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 3/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 136 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.464723:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+136:41279:x1731746396457600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.464725:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12600 00010000:00010000:1.0:1651529349.464726:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f5d8ae/0xa29a79078f3b99e7 lrc: 0/0,0 mode: --/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce56d expref: 136 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.464730:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464730:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.464731:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464742:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464744:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 4/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464746:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464750:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464752:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.464757:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464759:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41279:x1731746396457536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.464762:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12601 00010000:00010000:1.0:1651529349.464773:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9902ca/0xa29a79078f3b9f04 lrc: 0/0,0 mode: --/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa27 expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.464777:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966707264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.464780:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464784:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464786:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464789:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464792:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 2/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464797:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1929:39029:x1731745946576192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1072us (1119us total) trans 30064894498 rc 0/0 00000100:00100000:0.0:1651529349.464800:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153635 00010000:00010000:0.0:1651529349.464829:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464833:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464836:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464839:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464865:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1930:39029:x1731745946576448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 815us (913us total) trans 30064894499 rc 0/0 00000100:00100000:1.0:1651529349.464869:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153639 00010000:00010000:1.0:1651529349.464876:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464879:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.464880:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464883:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 3/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464883:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1929:39030:x1731745946576256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1089us (1190us total) trans 30064894500 rc 0/0 00000100:00100000:0.0:1651529349.464886:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153636 00010000:00010000:1.0:1651529349.464888:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 1/0,0 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464891:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0533 lrc: 0/0,0 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464894:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 2/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464895:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464897:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036c420e9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.464898:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.464898:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 2/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464899:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464901:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 3/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464904:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 3/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464906:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 1/0,0 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464907:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 1/0,0 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464910:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c053a lrc: 0/0,0 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464911:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c420e9/0xa29a79078f3c054f lrc: 0/0,0 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464918:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464920:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000527e5e5e/0xa29a79078f3bb7c3 lrc: 0/0,0 mode: --/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d23 expref: 132 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.464921:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.464923:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966707136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.464924:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464926:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.464926:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464929:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464932:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464943:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.464945:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.464965:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1930:39030:x1731745946576384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 987us (1022us total) trans 30064894501 rc 0/0 00000100:00100000:0.0:1651529349.464968:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153638 00000100:00100000:1.0:1651529349.464983:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1929:39029:x1731745946576320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1007us (1048us total) trans 30064894502 rc 0/0 00000100:00100000:0.0:1651529349.464983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.464986:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153637 00000100:00100000:1.0:1651529349.464992:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576512 00000100:00100000:0.0:1651529349.464996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.465003:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153640 00000100:00100000:1.0:1651529349.465004:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1929:39030:x1731745946576512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.465016:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178432 count 1 00010000:00010000:1.0:1651529349.465020:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465025:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 2/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465028:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465029:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465029:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 4/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465036:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 3/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465052:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 4/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.465061:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576576 00000100:00100000:0.0:1651529349.465070:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153641 00000100:00100000:0.0:1651529349.465072:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1930:39029:x1731745946576576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.465077:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178433 count 1 00010000:00010000:0.0:1651529349.465081:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465086:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 2/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 131 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.465088:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966707328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.465089:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465090:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465091:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 4/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465097:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 3/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 131 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.465109:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.465117:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465121:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.465122:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465125:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 3/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465130:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 1/0,0 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465130:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 131 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465133:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0548 lrc: 0/0,0 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465135:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966707392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.465140:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465143:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcb5f316 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.465144:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465145:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.465146:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 3/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465150:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 1/0,0 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465153:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb5f316/0xa29a79078f3c0541 lrc: 0/0,0 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465269:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.465279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.465289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.465290:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576640 00000100:00100000:1.0:1651529349.465298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.465306:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576704 00000100:00100000:1.0:1651529349.465309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.465311:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576768 00000100:00100000:0.0:1651529349.465317:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576832 00000100:00100000:0.0:1651529349.465323:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576896 00000100:00100000:0.0:1651529349.465326:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153642 00000100:00100000:1.0:1651529349.465327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.465328:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1935:39029:x1731745946576640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.465333:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946576960 00002000:00080000:0.0:1651529349.465333:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178434 count 1 00010000:00010000:0.0:1651529349.465337:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465340:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153643 00000100:00100000:1.0:1651529349.465342:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1936:39029:x1731745946576704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.465344:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 2/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.465347:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178435 count 1 00010000:00010000:0.0:1651529349.465347:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465348:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465349:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 4/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465352:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465355:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 3/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465358:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 2/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.465359:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465363:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.465363:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.465364:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465365:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 4/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465376:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 3/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465383:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 4/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.465387:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966707520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.465394:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.465401:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153644 00000100:00100000:0.0:1651529349.465403:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1936:39030:x1731745946576768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.465406:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.465407:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178436 count 1 00010000:00010000:0.0:1651529349.465411:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465413:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153645 00000100:00100000:1.0:1651529349.465414:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1936:39029:x1731745946576832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.465416:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 2/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.465419:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529349.465420:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178437 count 1 00010000:00010000:1.0:1651529349.465423:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465427:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465428:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 2/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.465428:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 4/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465431:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465431:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465432:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 4/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465436:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 3/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465438:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 3/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.465439:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465442:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 4/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.465443:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.465449:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966707648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.465452:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.465456:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.465458:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153646 00000100:00100000:0.0:1651529349.465460:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1936:39030:x1731745946576896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.465462:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153647 00000100:00100000:1.0:1651529349.465463:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1936:39029:x1731745946576960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.465464:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178438 count 1 00002000:00080000:1.0:1651529349.465467:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178439 count 1 00010000:00010000:0.0:1651529349.465468:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465470:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465472:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 2/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465475:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 2/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.465475:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465476:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465476:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 4/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465477:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465478:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465478:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 4/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465482:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 3/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465484:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 3/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 131 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.465488:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.465492:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966707776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.465496:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.465498:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.465500:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966707712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.465508:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.465560:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966707328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.465565:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.465630:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966707392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.465634:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.465654:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457664 00010000:00010000:1.0:1651529349.465661:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 4/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 132 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.465676:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457728 00010000:00010000:1.0:1651529349.465680:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 133 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.465690:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12602 00000100:00100000:1.0:1651529349.465693:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41278:x1731746396457664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529349.465696:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12603 00010000:00010000:1.0:1651529349.465698:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.465698:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41278:x1731746396457728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.465701:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 4/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465707:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 3/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.465711:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.465713:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003062b4e3/0xa29a79078f3bb98a lrc: 0/0,0 mode: --/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d642a expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.465713:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 133 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465717:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 3/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 132 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465718:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.465719:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465723:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001260034d/0xa29a79078f3b93ff lrc: 0/0,0 mode: --/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdb8 expref: 132 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.465724:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 4/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465726:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465727:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.465728:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465745:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.465753:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 4/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465755:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41278:x1731746396457664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.465759:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12602 00010000:00010000:0.0:1651529349.465761:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.465766:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465769:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+130:41278:x1731746396457728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 70us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.465770:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465772:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12603 00010000:00010000:1.0:1651529349.465773:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465776:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465781:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465791:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465794:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465797:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.465842:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1938:39030:x1731745946576512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 836us (859us total) trans 30064894503 rc 0/0 00000100:00100000:1.0:1651529349.465845:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153640 00010000:00010000:1.0:1651529349.465853:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465857:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1937:39029:x1731745946576576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 785us (860us total) trans 30064894504 rc 0/0 00010000:00010000:1.0:1651529349.465859:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047605ede already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.465860:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465861:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153641 00010000:00010000:1.0:1651529349.465863:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 3/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465868:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 1/0,0 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465869:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.465870:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047605ede/0xa29a79078f3c0556 lrc: 0/0,0 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465872:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.465882:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465886:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 3/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465896:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 1/0,0 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.465899:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c055d lrc: 0/0,0 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465937:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.465947:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.465963:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.465966:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.466007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.466009:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966707520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.466013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.466014:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.466031:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.466034:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966707648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.466036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.466037:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466043:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966707712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.466044:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966707776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.466047:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466048:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466055:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457856 00000100:00100000:1.0:1651529349.466056:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457984 00010000:00010000:0.0:1651529349.466060:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 4/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466061:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 4/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466065:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458112 00000100:00100000:1.0:1651529349.466066:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457792 00010000:00010000:0.0:1651529349.466067:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466069:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 133 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466072:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396457920 00000100:00100000:1.0:1651529349.466073:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458048 00010000:00010000:0.0:1651529349.466074:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 134 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466076:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466079:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12604 00000100:00100000:0.0:1651529349.466081:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+135:41279:x1731746396457856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.466082:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12605 00000100:00100000:1.0:1651529349.466083:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+135:41279:x1731746396457984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.466084:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.466085:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 4/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466086:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.466088:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 4/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466089:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 3/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466091:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 3/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466094:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3ba9b5 lrc: 0/0,0 mode: --/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25a1 expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466097:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007347ed9d/0xa29a79078f3bbb19 lrc: 0/0,0 mode: --/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69da expref: 135 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466100:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466100:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466101:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466101:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466102:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466102:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466105:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 4/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466105:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 4/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466112:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.466115:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.466125:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41279:x1731746396457856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.466130:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41279:x1731746396457984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.466144:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12604 00000100:00100000:1.0:1651529349.466147:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12605 00000100:00100000:0.0:1651529349.466151:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12606 00000100:00100000:1.0:1651529349.466153:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12607 00000100:00100000:0.0:1651529349.466153:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41279:x1731746396458112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.466154:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41278:x1731746396457792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.466156:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.466157:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.466158:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466158:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466162:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 3/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466162:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 3/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466167:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed17adf/0xa29a79078f3ba849 lrc: 0/0,0 mode: --/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2092 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466167:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fb316af/0xa29a79078f3ba8b2 lrc: 0/0,0 mode: --/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2252 expref: 131 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466170:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466171:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466171:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466171:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466172:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466172:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466175:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 4/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466178:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 4/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466181:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.466186:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.466194:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+129:41279:x1731746396458112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.466195:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+129:41278:x1731746396457792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.466197:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12606 00000100:00100000:1.0:1651529349.466198:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12607 00000100:00100000:1.0:1651529349.466203:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12608 00000100:00100000:1.0:1651529349.466204:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+127:41278:x1731746396457920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.466206:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12609 00010000:00010000:1.0:1651529349.466207:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.466208:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 127 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466208:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+127:41278:x1731746396458048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.466211:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.466212:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 3/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 127 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466213:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 127 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466216:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc15/0xa29a79078f3bc139 lrc: 0/0,0 mode: --/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d824c expref: 127 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466217:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 3/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 127 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466220:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466220:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466221:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466223:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000518c3338/0xa29a79078f3ba501 lrc: 0/0,0 mode: --/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1310 expref: 126 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.466224:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 4/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466226:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466227:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466228:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466234:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.466239:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41278:x1731746396457920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.466240:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 4/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.466242:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12608 00010000:00010000:0.0:1651529349.466249:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.466255:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466255:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41278:x1731746396458048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.466258:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12609 00010000:00010000:1.0:1651529349.466259:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466262:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466265:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466265:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466269:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466272:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466274:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.466311:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1938:39029:x1731745946576832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 895us (1013us total) trans 30064894505 rc 0/0 00000100:00100000:1.0:1651529349.466314:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153645 00000100:00100000:0.0:1651529349.466317:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946576768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 913us (1027us total) trans 30064894506 rc 0/0 00000100:00100000:0.0:1651529349.466320:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153644 00010000:00010000:1.0:1651529349.466322:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466325:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e981073 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466326:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466327:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466330:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466332:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 3/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466333:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466336:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 1/0,0 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466336:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466339:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e981073/0xa29a79078f3c0579 lrc: 0/0,0 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466344:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466347:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052991396 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466348:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466351:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 3/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466354:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 1/0,0 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466356:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052991396/0xa29a79078f3c0572 lrc: 0/0,0 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466360:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466363:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000bdb246b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466364:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466367:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 3/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466369:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946576896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 909us (1060us total) trans 30064894507 rc 0/0 00010000:00010000:1.0:1651529349.466370:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 1/0,0 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466372:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb246b/0xa29a79078f3c0580 lrc: 0/0,0 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466372:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153646 00010000:00010000:1.0:1651529349.466378:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466379:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466381:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466382:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466384:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466385:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466387:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466388:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466425:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1938:39029:x1731745946576640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1096us (1162us total) trans 30064894508 rc 0/0 00000100:00100000:0.0:1651529349.466428:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153642 00000100:00100000:1.0:1651529349.466431:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1937:39029:x1731745946576960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 967us (1110us total) trans 30064894509 rc 0/0 00000100:00100000:1.0:1651529349.466435:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153647 00010000:00010000:1.0:1651529349.466442:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.466445:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087343e8a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466446:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466456:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 3/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466461:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 1/0,0 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.466464:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087343e8a/0xa29a79078f3c0587 lrc: 0/0,0 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466469:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466471:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1b8caf2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466472:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466475:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 3/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466481:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 1/0,0 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466483:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b8caf2/0xa29a79078f3c0564 lrc: 0/0,0 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466489:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466497:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466500:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466503:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466513:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577024 00000100:00100000:0.0:1651529349.466519:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577088 00000100:00100000:0.0:1651529349.466524:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153648 00000100:00100000:0.0:1651529349.466525:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1938:39030:x1731745946577024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.466531:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178440 count 1 00010000:00010000:0.0:1651529349.466535:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466540:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 2/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.466543:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466544:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466544:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 4/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466551:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.466555:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466585:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.466597:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.466599:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1939:39029:x1731745946576704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1255us (1319us total) trans 30064894510 rc 0/0 00000100:00100000:1.0:1651529349.466602:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153643 00000100:00100000:0.0:1651529349.466604:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153649 00000100:00100000:0.0:1651529349.466606:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1938:39029:x1731745946577088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.466610:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.466611:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178441 count 1 00010000:00010000:1.0:1651529349.466613:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d64879fe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.466614:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466614:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466617:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 3/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466619:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 2/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.466622:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 1/0,0 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466622:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466622:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466623:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 4/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466625:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64879fe/0xa29a79078f3c056b lrc: 0/0,0 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.466629:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 3/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.466633:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.466637:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966707904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.466643:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.466705:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.466728:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577216 00000100:00100000:0.0:1651529349.466747:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153650 00000100:00100000:0.0:1651529349.466749:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1939:39029:x1731745946577216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.466753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529349.466754:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178443 count 1 00010000:00010000:0.0:1651529349.466758:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.466762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.466763:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 2/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.466768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.466769:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466769:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466770:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 4/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.466779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.466783:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 3/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.466786:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577152 00010000:00010000:0.0:1651529349.466787:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.466793:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577344 00000100:00100000:1.0:1651529349.466797:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577280 00000100:00100000:1.0:1651529349.466800:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577408 00000100:00100000:1.0:1651529349.466823:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153651 00000100:00100000:1.0:1651529349.466825:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002276da14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1943:39030:x1731745946577152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.466828:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707968:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.466830:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178442 count 1 00010000:00010000:1.0:1651529349.466835:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466839:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 2/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.466842:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.466849:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153652 00000100:00100000:0.0:1651529349.466851:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946577344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.466852:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466853:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466853:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 4/0,1 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.466856:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178445 count 1 00010000:00010000:0.0:1651529349.466859:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466861:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 3/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.466864:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 4/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.466864:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 2/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 123 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.466867:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466868:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.466868:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 4/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.466869:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.466878:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 3/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 123 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.466879:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000002f12ad4b going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.466882:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 123 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.466886:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153653 00000100:00100000:0.0:1651529349.466886:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966708096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.466888:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1943:39030:x1731745946577280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.466892:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178444 count 1 00000100:00100000:0.0:1651529349.466893:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.466895:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.466900:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 2/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.466903:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466903:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.466904:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 4/0,1 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.466907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.466913:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 3/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.466919:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 4/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.466926:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966708160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.466949:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.466956:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577472 00000100:00100000:1.0:1651529349.466963:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153654 00000100:00100000:1.0:1651529349.466965:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1944:39030:x1731745946577408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.466982:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178446 count 1 00000100:00100000:0.0:1651529349.466994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.466995:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467005:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.467008:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 2/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.467013:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467014:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.467014:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966707840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.467015:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 4/0,1 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467018:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467026:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 3/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 123 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.467033:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 4/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467037:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966708224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.467041:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966707904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.467044:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467052:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.467058:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458176 00000100:00100000:1.0:1651529349.467060:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153655 00000100:00100000:1.0:1651529349.467062:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1944:39029:x1731745946577472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.467063:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 124 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.467066:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178447 count 1 00010000:00010000:1.0:1651529349.467070:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467070:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458240 00010000:00010000:0.0:1651529349.467073:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467074:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 2/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 125 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.467078:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467078:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467079:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 4/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467083:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12610 00000100:00100000:0.0:1651529349.467085:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41278:x1731746396458176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.467088:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.467089:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467093:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467099:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 3/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 125 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.467103:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 4/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467110:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a4f95d/0xa29a79078f3ba2a0 lrc: 0/0,0 mode: --/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08cf expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467111:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966708288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.467114:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467114:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467115:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467118:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 4/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467119:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.467125:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.467128:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12611 00000100:00100000:1.0:1651529349.467130:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41278:x1731746396458240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.467133:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41278:x1731746396458176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.467134:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.467135:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 124 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.467135:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12610 00010000:00010000:1.0:1651529349.467139:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 3/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467143:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467145:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002214104/0xa29a79078f3bc2dd lrc: 0/0,0 mode: --/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ce expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467146:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467149:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467149:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467149:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467150:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467152:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467154:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 4/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467178:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.467188:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+122:41278:x1731746396458240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.467195:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12611 00010000:00010000:1.0:1651529349.467207:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467211:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011bbe9d5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.467212:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467215:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 3/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467219:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 1/0,0 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467222:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bbe9d5/0xa29a79078f3c058e lrc: 0/0,0 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467225:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1945:39030:x1731745946577024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 698us (782us total) trans 30064894511 rc 0/0 00000100:00100000:0.0:1651529349.467228:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153648 00010000:00010000:0.0:1651529349.467235:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467238:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467241:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467244:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467302:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1945:39029:x1731745946577088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 695us (840us total) trans 30064894512 rc 0/0 00000100:00100000:0.0:1651529349.467306:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153649 00000100:00100000:0.0:1651529349.467317:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966707968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.467328:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.467335:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966708096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.467338:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.467391:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467396:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cb76419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.467397:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467400:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 3/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.467408:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 1/0,0 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467411:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb76419/0xa29a79078f3c0595 lrc: 0/0,0 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467420:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.467426:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458368 00000100:00100000:1.0:1651529349.467432:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458304 00010000:00010000:1.0:1651529349.467439:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467450:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 5/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 123 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467452:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458432 00010000:00010000:1.0:1651529349.467455:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 124 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.467457:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458496 00010000:00010000:0.0:1651529349.467460:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 5/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467461:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12612 00000100:00100000:1.0:1651529349.467462:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41278:x1731746396458304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.467465:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529349.467465:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12613 00000100:00100000:0.0:1651529349.467466:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41279:x1731746396458368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.467467:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467469:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.467470:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 3/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467471:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 5/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467476:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b25f567/0xa29a79078f3ba2f4 lrc: 0/0,0 mode: --/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09ee expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467477:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 4/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 125 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467482:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467483:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467483:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467484:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467484:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467485:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467487:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 4/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467488:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 4/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467492:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.467497:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.467508:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020880663 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41278:x1731746396458304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.467511:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12612 00000100:00100000:0.0:1651529349.467512:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41279:x1731746396458368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.467516:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12614 00000100:00100000:1.0:1651529349.467518:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+123:41278:x1731746396458432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.467521:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.467522:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 123 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467526:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 3/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 123 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.467526:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12613 00010000:00010000:1.0:1651529349.467531:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008728b231/0xa29a79078f3b9755 lrc: 0/0,0 mode: --/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb64 expref: 122 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467534:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467535:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467536:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467536:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12615 00000100:00100000:0.0:1651529349.467538:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+121:41278:x1731746396458496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.467539:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 4/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467541:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.467542:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 5/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 121 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467546:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.467552:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+121:41278:x1731746396458432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.467553:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 4/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 121 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467556:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12614 00010000:00010000:0.0:1651529349.467559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467559:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467560:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467563:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 4/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467567:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.467571:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b08b7fa2/0xa29a79078f3bad90 lrc: 0/0,0 mode: --/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d355a expref: 120 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467577:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966708160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.467581:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467584:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467587:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467590:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467593:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467596:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41278:x1731746396458496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.467599:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12615 00010000:00010000:0.0:1651529349.467607:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467610:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467619:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467622:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467659:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1946:39030:x1731745946577280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 770us (890us total) trans 30064894513 rc 0/0 00000100:00100000:1.0:1651529349.467662:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153653 00000100:00100000:0.0:1651529349.467666:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1945:39029:x1731745946577216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 916us (962us total) trans 30064894514 rc 0/0 00010000:00010000:1.0:1651529349.467669:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467669:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153650 00010000:00010000:1.0:1651529349.467673:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b309635e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.467674:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467676:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467677:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 3/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467680:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467682:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 1/0,0 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467683:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467685:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309635e/0xa29a79078f3c05b1 lrc: 0/0,0 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467686:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467690:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467700:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ab1f974 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.467701:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467706:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 3/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467710:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 1/0,0 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467712:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab1f974/0xa29a79078f3c059c lrc: 0/0,0 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467716:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467719:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5119c06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.467720:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467722:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 3/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467722:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1945:39029:x1731745946577344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 871us (959us total) trans 30064894515 rc 0/0 00010000:00010000:1.0:1651529349.467725:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 1/0,0 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467725:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153652 00010000:00010000:1.0:1651529349.467728:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5119c06/0xa29a79078f3c05aa lrc: 0/0,0 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467750:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7c5306/0xa29a79078f3ba6eb lrc: 0/0,0 mode: --/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b28 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467754:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.467758:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.467769:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467772:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467775:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467777:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.467795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.467834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.467850:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002276da14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1945:39030:x1731745946577152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1024us (1097us total) trans 30064894516 rc 0/0 00000100:00100000:1.0:1651529349.467853:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153651 00000100:00100000:0.0:1651529349.467858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.467889:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467893:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a929395f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.467894:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467895:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577536 00010000:00010000:0.0:1651529349.467897:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 3/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467902:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 1/0,0 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467904:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577600 00010000:00010000:0.0:1651529349.467907:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a929395f/0xa29a79078f3c05a3 lrc: 0/0,0 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.467913:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153656 00000100:00100000:1.0:1651529349.467915:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1946:39030:x1731745946577536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.467920:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178448 count 1 00010000:00010000:1.0:1651529349.467924:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467929:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 2/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 117 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.467932:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467933:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.467934:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 4/0,1 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.467940:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 3/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 117 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.467940:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458624 00010000:00010000:1.0:1651529349.467944:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 4/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467945:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 5/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467948:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.467952:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458560 00010000:00010000:0.0:1651529349.467955:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 5/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 119 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.467967:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.467969:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12616 00000100:00100000:0.0:1651529349.467971:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396458624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.467974:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.467976:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966708288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.467976:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 4/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 119 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467980:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 3/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 119 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.467983:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.467986:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061392791/0xa29a79078f3bbd0a lrc: 0/0,0 mode: --/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7166 expref: 119 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467989:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.467990:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.467991:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12617 00000100:00100000:1.0:1651529349.467993:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41278:x1731746396458560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.467996:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.467997:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 5/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.467999:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468003:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 4/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468004:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 4/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468009:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468011:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.468016:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468017:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468019:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396458624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.468021:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 4/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468022:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12616 00010000:00010000:1.0:1651529349.468025:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.468032:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41278:x1731746396458560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.468035:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12617 00010000:00010000:1.0:1651529349.468042:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468046:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468046:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153657 00000100:00100000:0.0:1651529349.468048:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1946:39030:x1731745946577600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.468049:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468051:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.468054:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178449 count 1 00010000:00010000:0.0:1651529349.468069:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468074:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 2/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468077:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468077:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468078:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 4/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468085:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 3/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468089:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.468093:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1947:39029:x1731745946577472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1186us total) trans 30064894517 rc 0/0 00000100:00100000:1.0:1651529349.468096:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153655 00000100:00100000:0.0:1651529349.468101:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966708416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.468103:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468106:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004806f5c4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.468107:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468110:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 3/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468111:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.468115:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 1/0,0 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468118:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004806f5c4/0xa29a79078f3c05bf lrc: 0/0,0 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468127:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b18bfd/0xa29a79078f3bc377 lrc: 0/0,0 mode: --/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8afe expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.468131:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966708224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.468134:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.468150:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468152:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.468153:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468156:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468158:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.468193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.468210:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1947:39030:x1731745946577408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1244us (1430us total) trans 30064894518 rc 0/0 00000100:00100000:1.0:1651529349.468222:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153654 00000100:00100000:0.0:1651529349.468226:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577728 00000100:00100000:0.0:1651529349.468236:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577664 00000100:00100000:0.0:1651529349.468242:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577856 00000100:00100000:0.0:1651529349.468247:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577792 00000100:00100000:0.0:1651529349.468251:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153658 00000100:00100000:0.0:1651529349.468252:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1950:39029:x1731745946577728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.468254:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153659 00000100:00100000:1.0:1651529349.468257:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1950:39030:x1731745946577664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.468257:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178451 count 1 00002000:00080000:1.0:1651529349.468264:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178450 count 1 00010000:00010000:1.0:1651529349.468270:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468276:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 2/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468278:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468279:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468280:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468280:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 4/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468283:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 2/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468286:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468287:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468288:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 3/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468288:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 4/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468292:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 4/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 115 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.468295:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.468296:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966708480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.468312:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.468319:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153660 00000100:00100000:1.0:1651529349.468321:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1950:39029:x1731745946577856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.468326:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178453 count 1 00010000:00010000:0.0:1651529349.468327:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 115 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468329:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468334:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 2/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 115 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.468337:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468337:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468338:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 4/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468339:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966708544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.468344:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 3/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 115 pid: 142996 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.468349:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.468350:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 4/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 115 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.468354:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966708608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.468356:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153661 00000100:00100000:0.0:1651529349.468358:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1950:39030:x1731745946577792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.468362:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.468363:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178452 count 1 00010000:00010000:0.0:1651529349.468367:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468368:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468371:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb4ce9d3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.468371:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 2/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.468372:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468374:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468374:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468375:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 3/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468375:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 4/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468380:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 1/0,0 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468381:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 3/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.468383:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4ce9d3/0xa29a79078f3c05b8 lrc: 0/0,0 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468385:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 115 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.468401:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966708672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.468409:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000cbcfdfc going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.468428:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.468434:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577920 00000100:00100000:0.0:1651529349.468446:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153662 00000100:00100000:0.0:1651529349.468448:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1951:39030:x1731745946577920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.468452:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178454 count 1 00010000:00010000:0.0:1651529349.468456:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468461:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 2/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 115 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468464:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468465:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468465:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 4/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468471:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 3/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 115 pid: 142993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.468475:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 115 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.468479:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966708736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.468487:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.468488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.468508:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946577984 00000100:00100000:0.0:1651529349.468513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.468521:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153663 00000100:00100000:1.0:1651529349.468523:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1952:39030:x1731745946577984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.468523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529349.468528:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178455 count 1 00010000:00010000:1.0:1651529349.468532:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468532:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966708416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.468535:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468537:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 2/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 115 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.468540:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468541:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468541:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 4/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468542:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458688 00010000:00010000:0.0:1651529349.468547:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 5/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468548:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 3/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 116 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.468552:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.468557:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12618 00000100:00100000:0.0:1651529349.468558:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+116:41278:x1731746396458688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.468561:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.468562:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966708800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.468563:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 5/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.468566:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 4/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.468571:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.468572:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468573:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.468573:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468576:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 4/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.468579:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458752 00010000:00010000:0.0:1651529349.468581:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.468584:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 117 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.468588:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41278:x1731746396458688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.468590:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12618 00000100:00100000:1.0:1651529349.468596:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12619 00000100:00100000:1.0:1651529349.468598:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41278:x1731746396458752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.468601:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.468603:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468607:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 3/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468613:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d142ef/0xa29a79078f3ba459 lrc: 0/0,0 mode: --/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f90 expref: 116 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.468616:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468617:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.468618:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468621:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 4/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468629:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.468632:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.468636:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+115:41278:x1731746396458752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.468636:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.468639:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12619 00010000:00010000:0.0:1651529349.468639:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.468641:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468656:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2b5890/0xa29a79078f3ba5da lrc: 0/0,0 mode: --/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16c8 expref: 114 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.468660:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.468664:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468669:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468672:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468675:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468678:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.468694:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1953:39030:x1731745946577600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 645us (905us total) trans 30064894519 rc 0/0 00000100:00100000:0.0:1651529349.468697:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153657 00000100:00100000:1.0:1651529349.468717:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1953:39030:x1731745946577536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 802us (956us total) trans 30064894520 rc 0/0 00000100:00100000:1.0:1651529349.468720:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153656 00010000:00010000:1.0:1651529349.468765:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468769:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb28b6d6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.468770:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468773:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 3/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468778:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 1/0,0 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468781:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb28b6d6/0xa29a79078f3c05cd lrc: 0/0,0 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468788:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468791:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e1ae08 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.468792:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468794:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 3/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468798:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 1/0,0 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.468800:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1ae08/0xa29a79078f3c05c6 lrc: 0/0,0 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.468946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.468957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.468967:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578048 00000100:00100000:1.0:1651529349.468968:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578112 00000100:00100000:0.0:1651529349.468979:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153664 00000100:00100000:0.0:1651529349.468980:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1954:39030:x1731745946578048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.468985:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153665 00002000:00080000:0.0:1651529349.468985:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178456 count 1 00000100:00100000:1.0:1651529349.468986:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1954:39029:x1731745946578112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.468990:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.468992:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178457 count 1 00010000:00010000:0.0:1651529349.468995:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 2/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 113 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.469000:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469001:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469001:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 4/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469004:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469008:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 3/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 113 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.469010:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 2/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 113 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.469012:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 113 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469013:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469014:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469014:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 4/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469016:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966708864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.469022:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 3/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 113 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.469025:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 113 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469027:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.469029:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.469039:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.469315:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966708544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.469320:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469344:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.469350:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966708672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.469352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.469353:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.469360:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966708736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.469366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.469368:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.469382:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458880 00010000:00010000:0.0:1651529349.469392:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 114 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469398:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458816 00010000:00010000:0.0:1651529349.469400:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 5/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 115 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469404:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459008 00010000:00010000:0.0:1651529349.469406:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 5/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 116 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469410:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396458944 00010000:00010000:0.0:1651529349.469424:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 117 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.469425:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966708480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.469430:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469430:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459072 00010000:00010000:0.0:1651529349.469433:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 118 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.469438:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966708608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.469438:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12620 00000100:00100000:0.0:1651529349.469440:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396458880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.469441:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469443:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469444:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.469449:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12621 00000100:00100000:1.0:1651529349.469450:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41278:x1731746396458816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.469451:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469454:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.469455:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 4/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469457:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b58a78/0xa29a79078f3b9b1b lrc: 0/0,0 mode: --/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaa6 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469460:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 3/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 118 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469461:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469461:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469462:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469465:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 4/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469466:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0884e9b/0xa29a79078f3ba578 lrc: 0/0,0 mode: --/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14a6 expref: 117 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469470:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469470:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469471:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469472:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.469474:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 4/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469481:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.469485:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ee8fba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+116:41279:x1731746396458880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469488:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12620 00000100:00100000:1.0:1651529349.469495:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+115:41278:x1731746396458816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469498:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12622 00000100:00100000:1.0:1651529349.469499:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12621 00000100:00100000:0.0:1651529349.469499:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+115:41279:x1731746396459008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.469502:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469504:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 4/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 114 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.469506:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12623 00000100:00100000:1.0:1651529349.469507:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+114:41278:x1731746396458944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.469508:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 3/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 114 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469510:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.469512:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 114 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469513:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a1f6fac/0xa29a79078f3b8c81 lrc: 0/0,0 mode: --/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc315 expref: 114 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469516:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 3/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 114 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469516:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469517:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469518:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469521:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c4cae87/0xa29a79078f3bb3da lrc: 0/0,0 mode: --/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e4a expref: 113 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469521:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 4/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469524:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469525:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.469526:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469529:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.469535:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 4/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469535:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+112:41279:x1731746396459008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469538:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12622 00010000:00010000:1.0:1651529349.469545:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.469549:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12624 00000100:00100000:1.0:1651529349.469551:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41278:x1731746396458944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469551:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41278:x1731746396459072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.469554:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12623 00010000:00010000:0.0:1651529349.469554:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469555:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 111 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469559:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 3/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 110 pid: 142993 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.469564:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966708800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.469564:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041baf301/0xa29a79078f3bc3e7 lrc: 0/0,0 mode: --/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ca2 expref: 110 pid: 142993 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.469568:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469570:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469570:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469571:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469574:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 4/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469576:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469579:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469579:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.469582:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469585:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469585:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+109:41278:x1731746396459072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469587:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12624 00010000:00010000:0.0:1651529349.469602:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469606:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.469607:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469610:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 3/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469614:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 1/0,0 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469617:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c05e2 lrc: 0/0,0 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469625:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469627:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1955:39029:x1731745946577856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1305us (1448us total) trans 30064894521 rc 0/0 00010000:00010000:0.0:1651529349.469628:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469630:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153660 00010000:00010000:0.0:1651529349.469632:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469634:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469637:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469647:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469651:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469654:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469677:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1956:39030:x1731745946577792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1318us (1484us total) trans 30064894522 rc 0/0 00000100:00100000:0.0:1651529349.469681:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153661 00010000:00010000:0.0:1651529349.469688:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469691:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1955:39030:x1731745946577664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1434us (1538us total) trans 30064894523 rc 0/0 00010000:00010000:0.0:1651529349.469691:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469694:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153659 00010000:00010000:0.0:1651529349.469694:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469697:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469702:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469705:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002df7edd6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.469706:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469709:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 3/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469714:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 1/0,0 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469717:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df7edd6/0xa29a79078f3c05e9 lrc: 0/0,0 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469721:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469724:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.469725:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469730:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 3/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469742:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1955:39030:x1731745946577920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1293us (1314us total) trans 30064894524 rc 0/0 00010000:00010000:1.0:1651529349.469744:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 1/0,0 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469745:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153662 00010000:00010000:1.0:1651529349.469748:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c05d4 lrc: 0/0,0 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469752:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469754:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469755:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c5c3f32 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.469756:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469757:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469759:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 3/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469760:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469762:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 1/0,0 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469763:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469765:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5c3f32/0xa29a79078f3c05f0 lrc: 0/0,0 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469768:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469771:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db4fedb1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.469772:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469775:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 3/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469778:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 1/0,0 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.469780:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4fedb1/0xa29a79078f3c05db lrc: 0/0,0 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469791:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.469794:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.469796:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1955:39029:x1731745946577728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1542us (1657us total) trans 30064894525 rc 0/0 00000100:00100000:0.0:1651529349.469799:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153658 00000100:00100000:1.0:1651529349.469826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.469835:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966708864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.469839:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.469842:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.469853:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459136 00000100:00100000:1.0:1651529349.469857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.469858:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469870:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459264 00010000:00010000:0.0:1651529349.469873:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 110 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469877:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459200 00010000:00010000:0.0:1651529349.469879:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 111 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.469884:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12625 00000100:00100000:0.0:1651529349.469885:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41279:x1731746396459136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.469888:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469889:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 111 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469893:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 3/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 111 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469898:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c982cc85/0xa29a79078f3ba8ce lrc: 0/0,0 mode: --/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22a6 expref: 111 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469902:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469903:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469903:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469906:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 4/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469915:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.469923:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+110:41279:x1731746396459136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469925:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12625 00000100:00100000:0.0:1651529349.469930:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12626 00000100:00100000:0.0:1651529349.469931:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+109:41279:x1731746396459264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.469933:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469935:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469938:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 3/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469943:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000108db45f/0xa29a79078f3bbbf9 lrc: 0/0,0 mode: --/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6dae expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469946:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469947:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.469947:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469950:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 4/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.469958:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.469963:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396459264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.469966:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12626 00000100:00100000:0.0:1651529349.469988:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12627 00000100:00100000:0.0:1651529349.469990:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396459200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.469993:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.469994:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 107 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.469998:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 3/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 107 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470003:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044466a07/0xa29a79078f3ba214 lrc: 0/0,0 mode: --/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05e9 expref: 107 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470006:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470007:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470008:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470011:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 4/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470013:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470017:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470017:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.470023:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470029:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058997088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41278:x1731746396459200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.470031:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470032:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12627 00010000:00010000:0.0:1651529349.470065:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470069:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470073:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470080:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1955:39030:x1731745946577984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1557us (1592us total) trans 30064894526 rc 0/0 00010000:00010000:0.0:1651529349.470083:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470084:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153663 00010000:00010000:1.0:1651529349.470100:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470104:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470107:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470110:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470151:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1956:39029:x1731745946578112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1163us (1193us total) trans 30064894528 rc 0/0 00000100:00100000:1.0:1651529349.470154:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153665 00000100:00100000:0.0:1651529349.470160:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1955:39030:x1731745946578048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1179us (1221us total) trans 30064894527 rc 0/0 00010000:00010000:1.0:1651529349.470161:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470164:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153664 00010000:00010000:1.0:1651529349.470166:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.470167:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470170:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 3/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470171:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470175:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 1/0,0 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470175:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000063d90e04 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.470176:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470177:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c05f7 lrc: 0/0,0 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470179:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 3/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470182:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470184:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 1/0,0 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470185:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.470186:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470187:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d90e04/0xa29a79078f3c05fe lrc: 0/0,0 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470189:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 3/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470192:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 1/0,0 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470197:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0605 lrc: 0/0,0 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470231:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470267:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578176 00000100:00100000:0.0:1651529349.470273:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578240 00000100:00100000:0.0:1651529349.470286:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578368 00000100:00100000:0.0:1651529349.470290:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578304 00000100:00100000:1.0:1651529349.470298:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153666 00000100:00100000:1.0:1651529349.470300:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1958:39030:x1731745946578176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.470300:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153667 00000100:00100000:0.0:1651529349.470302:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1958:39030:x1731745946578240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.470306:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178458 count 1 00002000:00080000:0.0:1651529349.470307:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178459 count 1 00010000:00010000:1.0:1651529349.470310:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470312:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470315:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 2/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.470317:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 2/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470318:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470319:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470319:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 4/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470327:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 3/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470331:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470334:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.470335:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.470335:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470336:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 4/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470344:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 3/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.470346:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.470348:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470352:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153668 00000100:00100000:1.0:1651529349.470354:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1958:39029:x1731745946578368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.470355:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966709056:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.470358:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178461 count 1 00010000:00010000:1.0:1651529349.470361:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470364:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.470365:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 2/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 105 pid: 142996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470368:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470369:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470370:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 4/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470371:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153669 00000100:00100000:0.0:1651529349.470373:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1958:39029:x1731745946578304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.470376:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 3/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 105 pid: 142996 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.470378:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178460 count 1 00010000:00010000:1.0:1651529349.470379:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 105 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470381:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470383:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966709120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.470386:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 2/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.470389:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470389:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.470390:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.470390:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 4/0,1 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470396:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 3/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.470399:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 4/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.470418:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966709184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.470432:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.470458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470480:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.470500:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578432 00000100:00100000:0.0:1651529349.470500:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.470509:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578496 00000100:00100000:1.0:1651529349.470513:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578560 00000100:00100000:0.0:1651529349.470518:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578624 00000100:00100000:0.0:1651529349.470523:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153670 00000100:00100000:1.0:1651529349.470525:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153671 00000100:00100000:0.0:1651529349.470525:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1962:39030:x1731745946578432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.470527:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1962:39029:x1731745946578496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.470530:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178462 count 1 00002000:00080000:1.0:1651529349.470533:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178463 count 1 00010000:00010000:0.0:1651529349.470534:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470537:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470539:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 2/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470542:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 2/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.470542:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470542:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470543:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 4/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470545:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470546:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470546:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 4/0,1 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470549:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470553:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 3/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.470553:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 4/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.470557:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 4/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.470557:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966709248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.470561:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966709312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.470570:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000027e82d48 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.470577:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.470577:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153672 00000100:00100000:0.0:1651529349.470579:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1962:39030:x1731745946578560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.470583:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153673 00002000:00080000:0.0:1651529349.470584:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178464 count 1 00000100:00100000:1.0:1651529349.470585:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1962:39029:x1731745946578624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.470587:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.470590:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178465 count 1 00010000:00010000:0.0:1651529349.470591:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 2/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470593:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470594:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470594:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470595:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 4/0,1 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470598:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 2/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470601:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470601:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470601:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 3/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.470602:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 4/0,1 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.470605:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 4/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.470608:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 3/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 105 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.470609:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966709376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.470612:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 4/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 105 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470616:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966709440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.470616:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000090978341 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.470623:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.470751:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966708992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.470762:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470766:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966709184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.470771:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470774:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966709120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.470778:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470779:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158e8cb5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966709056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.470798:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.470848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.470860:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459328 00000100:00100000:1.0:1651529349.470865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.470866:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 106 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.470883:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459392 00010000:00010000:0.0:1651529349.470886:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 107 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.470891:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459456 00010000:00010000:0.0:1651529349.470893:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 108 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470894:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459520 00000100:00100000:0.0:1651529349.470897:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12628 00000100:00100000:0.0:1651529349.470899:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+109:41278:x1731746396459328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.470900:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 4/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470902:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.470903:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470907:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 3/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470909:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12629 00000100:00100000:1.0:1651529349.470911:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+109:41279:x1731746396459392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.470913:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c6204a/0xa29a79078f3b9cd4 lrc: 0/0,0 mode: --/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1c2 expref: 109 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.470914:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.470916:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 108 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470916:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470917:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470918:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470920:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 3/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 108 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470921:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 4/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470926:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009412d110/0xa29a79078f3bc1a2 lrc: 0/0,0 mode: --/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8364 expref: 108 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470930:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.470937:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470938:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.470939:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470939:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396459328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.470942:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12628 00010000:00010000:1.0:1651529349.470944:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 4/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.470947:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12630 00000100:00100000:0.0:1651529349.470949:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41278:x1731746396459456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.470951:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.470959:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.470970:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396459392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.470973:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12629 00010000:00010000:0.0:1651529349.470979:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 106 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470984:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 3/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 105 pid: 142996 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.470987:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12631 00000100:00100000:1.0:1651529349.470988:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+105:41279:x1731746396459520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.470990:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbfcacae/0xa29a79078f3b81f3 lrc: 0/0,0 mode: --/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc7 expref: 105 pid: 142996 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.470991:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.470993:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 4/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.470994:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470994:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.470995:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.470997:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 3/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.471002:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049edae07/0xa29a79078f3bbedf lrc: 0/0,0 mode: --/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7890 expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.471006:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.471006:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.471007:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471009:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 4/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471010:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 4/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471017:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.471024:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.471030:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41278:x1731746396459456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.471031:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396459520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.471033:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12630 00000100:00100000:1.0:1651529349.471035:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12631 00010000:00010000:0.0:1651529349.471041:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471043:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471044:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471046:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471047:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471050:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471052:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471054:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471096:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1964:39030:x1731745946578176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 795us (880us total) trans 30064894529 rc 0/0 00000100:00100000:1.0:1651529349.471099:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153666 00010000:00010000:1.0:1651529349.471106:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471106:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946578304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 732us (844us total) trans 30064894530 rc 0/0 00010000:00010000:1.0:1651529349.471109:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471109:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153669 00010000:00010000:1.0:1651529349.471112:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471115:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471117:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471120:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce634fae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.471121:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471124:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 3/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471129:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 1/0,0 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471132:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce634fae/0xa29a79078f3c0621 lrc: 0/0,0 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471136:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471139:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.471140:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471142:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 3/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471145:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 1/0,0 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471147:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946578368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 793us (895us total) trans 30064894531 rc 0/0 00010000:00010000:0.0:1651529349.471148:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c060c lrc: 0/0,0 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471150:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153668 00010000:00010000:0.0:1651529349.471154:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471156:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.471157:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471160:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 3/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471163:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 1/0,0 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471165:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c061a lrc: 0/0,0 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471172:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471175:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471178:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471180:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471233:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1963:39030:x1731745946578240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 930us (1002us total) trans 30064894532 rc 0/0 00000100:00100000:0.0:1651529349.471237:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153667 00000100:00100000:1.0:1651529349.471246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.471247:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966709248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.471256:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.471264:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459648 00010000:00010000:0.0:1651529349.471268:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 5/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 102 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471279:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459776 00010000:00010000:0.0:1651529349.471282:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 5/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471288:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12632 00000100:00100000:0.0:1651529349.471290:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396459648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.471293:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.471294:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 5/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.471295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.471298:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 4/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471304:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471304:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471305:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471308:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 4/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471313:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.471319:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396459648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.471322:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12632 00000100:00100000:0.0:1651529349.471325:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459584 00000100:00100000:1.0:1651529349.471327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.471328:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 4/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471333:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459712 00010000:00010000:0.0:1651529349.471335:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 5/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471339:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12633 00000100:00100000:0.0:1651529349.471341:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396459776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.471343:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.471344:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 5/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471347:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 4/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 104 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471354:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471355:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471356:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471359:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 4/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471362:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.471372:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396459776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.471374:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12633 00000100:00100000:0.0:1651529349.471378:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12634 00000100:00100000:0.0:1651529349.471380:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41278:x1731746396459584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.471383:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471387:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007658cd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.471388:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471393:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 3/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471398:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.471399:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 4/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.471401:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 1/0,0 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471406:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007658cd1e/0xa29a79078f3c0613 lrc: 0/0,0 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471413:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.471421:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966709312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.471425:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471427:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000885af455/0xa29a79078f3bb649 lrc: 0/0,0 mode: --/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5765 expref: 103 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471431:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.471432:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0336c2b/0xa29a79078f3bace1 lrc: 0/0,0 mode: --/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d326d expref: 102 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471432:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471435:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 4/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471436:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966709440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.471438:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471441:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471442:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.471444:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471447:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471449:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e282a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396459584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.471450:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471451:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12634 00000100:00100000:0.0:1651529349.471460:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12635 00000100:00100000:0.0:1651529349.471462:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396459712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.471464:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.471466:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 4/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 100 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471469:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 3/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 100 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471474:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f453ed2b/0xa29a79078f3bba08 lrc: 0/0,0 mode: --/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6614 expref: 100 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471478:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471478:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471479:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471482:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 4/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471492:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.471498:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41278:x1731746396459712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.471501:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12635 00010000:00010000:0.0:1651529349.471507:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471510:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946578624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 923us (1009us total) trans 30064894533 rc 0/0 00000100:00100000:1.0:1651529349.471513:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153673 00010000:00010000:1.0:1651529349.471521:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471522:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471525:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.471526:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471526:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471528:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 3/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471529:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471533:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 1/0,0 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471536:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c063d lrc: 0/0,0 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471541:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471543:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.471544:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471547:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 3/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471550:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 1/0,0 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471553:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c0628 lrc: 0/0,0 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471558:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471561:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471564:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471567:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471569:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1963:39030:x1731745946578432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1043us (1111us total) trans 30064894534 rc 0/0 00000100:00100000:0.0:1651529349.471572:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153670 00010000:00010000:0.0:1651529349.471579:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471583:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.471584:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471589:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 3/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471594:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 1/0,0 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471597:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c062f lrc: 0/0,0 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471602:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946578496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1122us total) trans 30064894535 rc 0/0 00000100:00100000:1.0:1651529349.471605:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153671 00010000:00010000:0.0:1651529349.471607:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002034c24c/0xa29a79078f3bb23d lrc: 0/0,0 mode: --/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4743 expref: 98 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471611:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966709376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.471615:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471618:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471620:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471623:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471626:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.471664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.471667:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1963:39030:x1731745946578560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1178us total) trans 30064894536 rc 0/0 00000100:00100000:0.0:1651529349.471678:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153672 00000100:00100000:1.0:1651529349.471679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.471685:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578752 00000100:00100000:1.0:1651529349.471690:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.471691:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578688 00000100:00100000:0.0:1651529349.471695:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578816 00000100:00100000:0.0:1651529349.471702:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578880 00000100:00100000:0.0:1651529349.471708:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153674 00000100:00100000:0.0:1651529349.471709:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1966:39029:x1731745946578752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.471714:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178467 count 1 00010000:00010000:0.0:1651529349.471719:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471723:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 2/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471726:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471727:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471728:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 4/0,1 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471742:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 3/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471746:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 4/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 97 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471753:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966709504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.471762:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.471769:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153675 00000100:00100000:0.0:1651529349.471771:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1966:39029:x1731745946578688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.471775:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178466 count 1 00010000:00010000:0.0:1651529349.471778:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471783:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 2/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 97 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471786:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471786:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471787:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 4/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471793:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 3/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 97 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471796:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 97 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.471799:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471800:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966709568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.471817:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.471819:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471822:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 3/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471827:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 1/0,0 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471832:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c0636 lrc: 0/0,0 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.471854:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.471856:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153676 00000100:00100000:1.0:1651529349.471858:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1966:39030:x1731745946578816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.471864:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178468 count 1 00000100:00100000:0.0:1651529349.471864:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153677 00000100:00100000:0.0:1651529349.471866:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1966:39029:x1731745946578880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.471868:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.471871:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178469 count 1 00010000:00010000:1.0:1651529349.471872:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 2/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.471875:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471875:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471876:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.471877:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 4/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471880:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 2/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471883:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471883:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.471884:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 3/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471884:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 4/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.471888:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 97 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.471890:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 3/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 97 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.471892:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966709632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.471894:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 97 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471898:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966709696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.471902:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.471925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.471930:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.471937:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579008 00000100:00100000:0.0:1651529349.471959:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153678 00000100:00100000:0.0:1651529349.471961:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1967:39029:x1731745946579008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.471966:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178471 count 1 00010000:00010000:0.0:1651529349.471969:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.471973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.471976:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 2/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 97 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471979:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471980:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.471980:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 4/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.471987:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 97 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.471990:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 97 pid: 128009 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.471994:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966709760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.472002:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.472025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.472038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.472047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.472056:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459840 00010000:00010000:0.0:1651529349.472061:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 5/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 98 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472062:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946578944 00000100:00100000:0.0:1651529349.472071:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12636 00000100:00100000:1.0:1651529349.472080:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579136 00000100:00100000:1.0:1651529349.472084:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579072 00000100:00100000:1.0:1651529349.472087:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153679 00000100:00100000:0.0:1651529349.472087:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396459840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.472089:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1970:39030:x1731745946578944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.472090:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472092:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 5/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 98 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.472094:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178470 count 1 00010000:00010000:0.0:1651529349.472096:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 4/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 98 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472099:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472102:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472102:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472103:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 2/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 98 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.472103:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472107:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472107:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472107:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 4/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472108:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 4/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472111:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.472115:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 3/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 98 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.472118:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 4/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 98 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472124:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396459840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.472127:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12636 00000100:00100000:1.0:1651529349.472130:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966709824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.472138:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023c34e39/0xa29a79078f3bc315 lrc: 0/0,0 mode: --/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ae expref: 97 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472140:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.472143:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966709504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.472146:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472147:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153680 00000100:00100000:1.0:1651529349.472149:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d259f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1970:39029:x1731745946579136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.472149:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.472153:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178473 count 1 00010000:00010000:0.0:1651529349.472155:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472156:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472158:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472160:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472161:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 2/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 96 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.472164:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472164:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472165:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 4/0,1 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472171:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 3/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 96 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.472174:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 4/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 96 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472178:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966709888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.472184:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.472190:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153681 00000100:00100000:1.0:1651529349.472192:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1971:39030:x1731745946579072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.472196:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178472 count 1 00010000:00010000:1.0:1651529349.472199:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472203:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 2/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 96 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.472206:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472207:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472207:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 4/0,1 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472210:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946578752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 500us (561us total) trans 30064894537 rc 0/0 00010000:00010000:1.0:1651529349.472213:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 3/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 96 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.472213:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153674 00010000:00010000:1.0:1651529349.472216:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 4/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 96 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472220:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966709952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.472220:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472223:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000528fa145 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.472224:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472226:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023df4518 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.472227:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 3/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472232:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 1/0,0 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472234:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c0644 lrc: 0/0,0 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472348:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051b6a45c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966709568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.472353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.472353:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.472361:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd843992 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966709696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.472367:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.472369:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.472381:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966709760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.472384:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472385:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966709632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.472390:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472391:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459904 00010000:00010000:0.0:1651529349.472396:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 97 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472397:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396459968 00000100:00100000:0.0:1651529349.472401:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460032 00010000:00010000:1.0:1651529349.472402:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 99 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472408:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460096 00010000:00010000:1.0:1651529349.472410:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 100 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472418:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12637 00000100:00100000:1.0:1651529349.472419:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396459904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.472421:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 100 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472422:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.472424:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 100 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472427:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 3/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 100 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472428:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12638 00000100:00100000:0.0:1651529349.472430:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396459968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529349.472433:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e13b804/0xa29a79078f3b9794 lrc: 0/0,0 mode: --/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc52 expref: 100 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472433:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472435:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 100 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472437:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472438:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472439:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472439:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 3/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 99 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472442:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 4/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472444:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae4765e/0xa29a79078f3b9d2f lrc: 0/0,0 mode: --/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2f6 expref: 99 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472448:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472448:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472452:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.472455:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472459:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 4/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472461:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396459904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.472464:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12637 00010000:00010000:0.0:1651529349.472465:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.472470:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12639 00000100:00100000:1.0:1651529349.472472:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396460096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529349.472473:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396459968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.472475:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12638 00010000:00010000:1.0:1651529349.472477:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.472479:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 96 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472481:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12640 00000100:00100000:0.0:1651529349.472482:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41279:x1731746396460032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.472485:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 3/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 96 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472485:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472486:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 96 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472494:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7b3e66/0xa29a79078f3b9bdf lrc: 0/0,0 mode: --/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced62 expref: 96 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472498:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472498:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.472499:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472503:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 95 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472504:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 4/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472509:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f52946/0xa29a79078f3b8939 lrc: 0/0,0 mode: --/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc163 expref: 95 pid: 128009 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472515:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.472523:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396460096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.472526:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12639 00010000:00010000:0.0:1651529349.472531:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472532:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472533:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472536:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 4/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472543:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.472548:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472550:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41279:x1731746396460032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.472552:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472553:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12640 00010000:00010000:1.0:1651529349.472558:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472560:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472560:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472563:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472566:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472569:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472610:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1972:39030:x1731745946578816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 751us (930us total) trans 30064894538 rc 0/0 00000100:00100000:1.0:1651529349.472613:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153676 00000100:00100000:0.0:1651529349.472615:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1972:39029:x1731745946578880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 748us (925us total) trans 30064894539 rc 0/0 00000100:00100000:0.0:1651529349.472619:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153677 00010000:00010000:1.0:1651529349.472621:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472624:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.472625:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472626:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472628:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 3/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472630:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472633:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 1/0,0 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472633:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472635:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472636:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0652 lrc: 0/0,0 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472641:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472644:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000845529d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.472645:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472647:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 3/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472651:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 1/0,0 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472653:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c0659 lrc: 0/0,0 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472657:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472660:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1d8850a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.472660:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472663:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 3/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472666:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 1/0,0 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472668:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946578688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 897us (1004us total) trans 30064894540 rc 0/0 00010000:00010000:1.0:1651529349.472671:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c064b lrc: 0/0,0 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472671:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153675 00010000:00010000:0.0:1651529349.472678:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472682:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472685:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.472690:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472744:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946579008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 782us (819us total) trans 30064894541 rc 0/0 00000100:00100000:0.0:1651529349.472747:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153678 00000100:00100000:1.0:1651529349.472750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.472752:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579200 00000100:00100000:0.0:1651529349.472765:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153682 00000100:00100000:0.0:1651529349.472767:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1971:39030:x1731745946579200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.472772:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178474 count 1 00010000:00010000:0.0:1651529349.472776:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472781:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 2/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 92 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.472784:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472784:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.472785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.472785:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 4/0,1 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472792:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 3/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 92 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.472795:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 4/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 92 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472802:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.472828:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.472836:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460160 00010000:00010000:0.0:1651529349.472841:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 5/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 93 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.472845:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.472856:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460288 00010000:00010000:0.0:1651529349.472860:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 5/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 94 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472864:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460224 00010000:00010000:0.0:1651529349.472866:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 5/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 95 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.472870:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12641 00000100:00100000:0.0:1651529349.472872:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41279:x1731746396460160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.472874:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472876:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 5/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 95 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472879:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 4/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 95 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472885:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472885:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472887:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472900:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472906:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.472911:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 4/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472913:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472917:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 3/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472917:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.472923:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 1/0,0 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472924:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eccbebb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41279:x1731746396460160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.472927:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0660 lrc: 0/0,0 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472927:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12641 00000100:00100000:1.0:1651529349.472944:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966709824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.472949:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472950:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12642 00000100:00100000:0.0:1651529349.472952:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41279:x1731746396460288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.472956:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472957:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 5/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 94 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472961:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 4/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 94 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472966:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472967:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.472968:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472971:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd60359d/0xa29a79078f3bab6e lrc: 0/0,0 mode: --/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c93 expref: 94 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.472971:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 4/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.472975:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966709888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.472975:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.472978:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.472981:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472981:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41279:x1731746396460288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.472984:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472984:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12642 00000100:00100000:0.0:1651529349.472988:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12643 00010000:00010000:1.0:1651529349.472989:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.472990:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396460224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.472992:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.472993:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 4/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 92 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.472994:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.472997:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 3/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 92 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.473025:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004372bdd5/0xa29a79078f3bb22f lrc: 0/0,0 mode: --/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4727 expref: 92 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.473029:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473030:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473030:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473033:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 4/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473051:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.473058:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396460224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.473061:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12643 00000100:00100000:1.0:1651529349.473069:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d259f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1972:39029:x1731745946579136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 919us (1043us total) trans 30064894542 rc 0/0 00000100:00100000:1.0:1651529349.473072:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153680 00010000:00010000:1.0:1651529349.473084:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3b97c5 lrc: 0/0,0 mode: --/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd2b expref: 90 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.473091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.473112:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966709952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.473116:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473119:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473121:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473125:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.473129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.473133:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.473154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.473174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.473182:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.473191:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473195:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.473196:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473199:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 3/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473204:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 1/0,0 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473207:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c066e lrc: 0/0,0 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473212:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1972:39030:x1731745946579072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1019us (1164us total) trans 30064894543 rc 0/0 00000100:00100000:1.0:1651529349.473216:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153681 00010000:00010000:0.0:1651529349.473218:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473221:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579264 00010000:00010000:0.0:1651529349.473221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.473222:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473227:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 3/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473228:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579328 00000100:00100000:1.0:1651529349.473231:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579456 00010000:00010000:0.0:1651529349.473231:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 1/0,0 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473235:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579392 00000100:00100000:1.0:1651529349.473241:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153683 00000100:00100000:1.0:1651529349.473243:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1975:39029:x1731745946579264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.473249:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178475 count 1 00010000:00010000:0.0:1651529349.473252:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0675 lrc: 0/0,0 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473254:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473258:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 2/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.473261:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473262:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473263:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 4/0,1 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.473264:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153684 00000100:00100000:0.0:1651529349.473266:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1975:39030:x1731745946579328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.473269:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 3/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529349.473271:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178476 count 1 00010000:00010000:1.0:1651529349.473273:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 4/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.473275:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473277:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966710080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.473279:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 2/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 89 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473282:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473283:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473283:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 4/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473286:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.473291:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 3/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 89 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.473292:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460352 00010000:00010000:0.0:1651529349.473294:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.473296:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 5/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.473299:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.473307:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12644 00000100:00100000:1.0:1651529349.473309:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396460352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.473312:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.473313:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 5/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.473316:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.473317:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 4/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.473322:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153685 00000100:00100000:0.0:1651529349.473323:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1975:39030:x1731745946579456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.473324:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473324:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473325:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473328:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 4/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.473328:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178478 count 1 00010000:00010000:0.0:1651529349.473331:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473333:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.473336:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 2/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 90 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.473339:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396460352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.473339:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473340:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473340:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 4/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473342:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12644 00010000:00010000:0.0:1651529349.473346:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 3/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 89 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473349:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.473351:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153686 00000100:00100000:1.0:1651529349.473353:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1975:39029:x1731745946579392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.473353:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966710208:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.473357:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178477 count 1 00000100:00100000:0.0:1651529349.473360:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.473361:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473365:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 2/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 89 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473367:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016bfb8d0/0xa29a79078f3ba206 lrc: 0/0,0 mode: --/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05a3 expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.473368:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473369:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473370:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 4/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.473372:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.473375:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473376:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 88 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473378:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473380:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 88 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.473381:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473384:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966710272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.473384:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473386:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473391:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.473407:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473410:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473413:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473416:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.473438:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1977:39030:x1731745946579200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 670us (751us total) trans 30064894544 rc 0/0 00000100:00100000:0.0:1651529349.473441:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153682 00010000:00010000:0.0:1651529349.473448:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473452:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000626f6c4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.473453:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473458:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 3/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473459:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1976:39030:x1731745946578944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1369us (1486us total) trans 30064894545 rc 0/0 00000100:00100000:1.0:1651529349.473462:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153679 00010000:00010000:0.0:1651529349.473463:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 1/0,0 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473465:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c067c lrc: 0/0,0 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473471:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473473:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.473474:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473477:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 3/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473480:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 1/0,0 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473483:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0667 lrc: 0/0,0 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.473529:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579520 00000100:00100000:0.0:1651529349.473541:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153687 00000100:00100000:0.0:1651529349.473543:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1976:39030:x1731745946579520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.473548:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178479 count 1 00010000:00010000:0.0:1651529349.473552:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473557:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 2/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473560:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473560:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473561:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 4/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473568:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 3/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473571:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 88 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.473575:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966710336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.473605:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.473720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.473729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.473754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.473771:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579584 00000100:00100000:0.0:1651529349.473782:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579712 00000100:00100000:1.0:1651529349.473784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.473788:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579648 00000100:00100000:0.0:1651529349.473797:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153688 00000100:00100000:0.0:1651529349.473798:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1979:39030:x1731745946579584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.473800:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153689 00002000:00080000:0.0:1651529349.473814:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178480 count 1 00000100:00100000:1.0:1651529349.473817:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1979:39030:x1731745946579712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.473823:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178482 count 1 00010000:00010000:0.0:1651529349.473823:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473828:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473828:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 2/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473831:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473832:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473832:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 4/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473833:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 2/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.473836:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473837:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473837:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 4/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473839:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 3/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473843:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 4/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 88 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.473844:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 88 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.473847:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.473848:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 88 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.473852:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966710464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.473861:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c9fade13 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.473869:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.473870:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460416 00000100:00100000:1.0:1651529349.473875:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153690 00010000:00010000:0.0:1651529349.473875:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 5/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.473877:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1979:39029:x1731745946579648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.473882:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178481 count 1 00000100:00100000:0.0:1651529349.473883:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12645 00000100:00100000:0.0:1651529349.473884:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396460416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.473885:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473887:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.473888:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 5/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.473889:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 2/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 89 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.473892:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473893:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.473893:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 4/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.473895:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 4/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 89 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.473900:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 3/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 89 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.473900:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473901:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.473902:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473903:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 89 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.473905:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 4/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.473907:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966710528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.473909:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.473914:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.473916:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396460416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.473919:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12645 00010000:00010000:1.0:1651529349.473922:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003608c673/0xa29a79078f3bb3d3 lrc: 0/0,0 mode: --/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e2e expref: 88 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.473926:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966710080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.473930:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473936:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473940:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473946:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.473950:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.474038:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1980:39029:x1731745946579264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 794us (947us total) trans 30064894546 rc 0/0 00000100:00100000:0.0:1651529349.474040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.474041:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153683 00010000:00010000:1.0:1651529349.474051:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474055:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.474056:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.474073:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 3/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.474083:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 1/0,0 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474086:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0683 lrc: 0/0,0 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474089:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.474093:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474098:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966710272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.474100:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966710208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.474102:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474103:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474109:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460480 00000100:00100000:0.0:1651529349.474112:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966710336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.474114:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 88 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474114:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474119:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460608 00000100:00100000:0.0:1651529349.474120:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460544 00010000:00010000:1.0:1651529349.474122:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474125:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.474126:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460672 00010000:00010000:1.0:1651529349.474128:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 91 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.474131:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12646 00000100:00100000:0.0:1651529349.474133:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396460480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.474134:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12647 00000100:00100000:1.0:1651529349.474135:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396460608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.474135:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.474137:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 91 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474138:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.474140:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 91 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474140:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 3/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 91 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474146:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 3/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 91 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474146:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000072183d4/0xa29a79078f3baf0a lrc: 0/0,0 mode: --/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3aa1 expref: 91 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474149:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474151:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062da2213/0xa29a79078f3ba0b6 lrc: 0/0,0 mode: --/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0078 expref: 90 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474151:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474155:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474155:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474156:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474156:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 4/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474159:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 4/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474162:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.474170:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.474177:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396460480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.474180:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12646 00000100:00100000:1.0:1651529349.474181:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396460608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.474185:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12647 00000100:00100000:0.0:1651529349.474187:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12648 00000100:00100000:1.0:1651529349.474194:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12649 00000100:00100000:1.0:1651529349.474196:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396460672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.474199:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.474201:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 87 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.474205:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396460544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.474207:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 87 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474209:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.474210:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 87 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474214:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 3/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 87 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474215:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e22fb893/0xa29a79078f3b92f5 lrc: 0/0,0 mode: --/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc974 expref: 87 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474221:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474221:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474222:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474225:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 4/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474233:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.474239:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229f3caa/0xa29a79078f3bb603 lrc: 0/0,0 mode: --/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5669 expref: 86 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474243:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474244:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474245:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474248:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 4/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474253:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396460672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.474256:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12649 00010000:00010000:0.0:1651529349.474257:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.474264:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de1d2c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396460544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 75us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.474265:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474267:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12648 00010000:00010000:1.0:1651529349.474268:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474272:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474274:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474278:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474282:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474285:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474287:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474327:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1981:39029:x1731745946579392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 973us (1144us total) trans 30064894547 rc 0/0 00000100:00100000:1.0:1651529349.474330:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153686 00010000:00010000:1.0:1651529349.474337:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474341:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.474341:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1980:39030:x1731745946579456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1016us (1166us total) trans 30064894548 rc 0/0 00010000:00010000:1.0:1651529349.474342:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474344:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 3/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474344:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153685 00010000:00010000:1.0:1651529349.474349:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 1/0,0 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474352:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0698 lrc: 0/0,0 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474352:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474355:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.474356:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474361:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 3/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474366:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 1/0,0 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474367:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.474369:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c0691 lrc: 0/0,0 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474383:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474387:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474394:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474397:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474436:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1980:39030:x1731745946579328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1170us (1308us total) trans 30064894549 rc 0/0 00000100:00100000:0.0:1651529349.474440:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153684 00000100:00100000:1.0:1651529349.474442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.474445:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579776 00000100:00100000:0.0:1651529349.474462:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153691 00000100:00100000:0.0:1651529349.474463:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1980:39030:x1731745946579776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.474468:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178483 count 1 00010000:00010000:0.0:1651529349.474473:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.474477:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 2/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 83 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.474480:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474481:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474482:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 4/0,1 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474488:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 3/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 83 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.474492:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 4/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.474496:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.474512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.474520:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000000aa20722 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.474527:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474530:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474533:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474536:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474560:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966710464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.474565:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474589:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474593:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dce4d58 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.474594:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474597:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 3/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474602:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 1/0,0 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474605:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c068a lrc: 0/0,0 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474610:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474613:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a9df0d3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.474614:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474617:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 3/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474619:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1981:39030:x1731745946579520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1074us (1122us total) trans 30064894550 rc 0/0 00000100:00100000:0.0:1651529349.474622:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153687 00010000:00010000:1.0:1651529349.474631:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 1/0,0 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474633:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c069f lrc: 0/0,0 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474633:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000520a69d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.474636:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474644:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966710528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.474644:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460800 00010000:00010000:1.0:1651529349.474647:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474648:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 84 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.474653:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460736 00000100:00100000:1.0:1651529349.474655:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460864 00010000:00010000:0.0:1651529349.474655:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 4/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 85 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474660:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 86 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.474660:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12650 00000100:00100000:0.0:1651529349.474661:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396460800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.474664:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.474665:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 86 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.474666:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12651 00000100:00100000:1.0:1651529349.474668:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396460736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.474669:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 86 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474672:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.474675:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 4/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 86 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474675:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3b999a lrc: 0/0,0 mode: --/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce447 expref: 86 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474679:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474679:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474680:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474681:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 3/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 85 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474683:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 4/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474689:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3b99b6 lrc: 0/0,0 mode: --/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4b7 expref: 85 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474707:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.474711:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474712:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474713:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474715:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396460800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (273us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.474716:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 4/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474718:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12650 00000100:00100000:0.0:1651529349.474723:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12652 00010000:00010000:1.0:1651529349.474726:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.474731:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396460864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.474742:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.474744:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396460736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 75us (267us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.474744:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 83 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.474747:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12651 00010000:00010000:0.0:1651529349.474748:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 3/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 83 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.474753:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db352f1/0xa29a79078f3b9579 lrc: 0/0,0 mode: --/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3e6 expref: 82 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.474756:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474759:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.474760:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474760:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.474761:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474763:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474763:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 4/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474765:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474777:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.474783:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396460864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.474786:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12652 00010000:00010000:0.0:1651529349.474794:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474797:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.474798:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474801:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 3/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474826:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 1/0,0 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474829:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c06ad lrc: 0/0,0 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474834:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1981:39030:x1731745946579712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1030us (1104us total) trans 30064894551 rc 0/0 00000100:00100000:1.0:1651529349.474837:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153689 00010000:00010000:0.0:1651529349.474837:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474840:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474843:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474844:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.474846:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474848:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474851:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474860:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474887:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1982:39030:x1731745946579584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1087us (1167us total) trans 30064894552 rc 0/0 00000100:00100000:0.0:1651529349.474890:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153688 00000100:00100000:1.0:1651529349.474897:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1981:39029:x1731745946579648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1018us (1144us total) trans 30064894553 rc 0/0 00000100:00100000:1.0:1651529349.474900:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153690 00010000:00010000:1.0:1651529349.474907:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474911:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.474912:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474914:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 3/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.474934:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 1/0,0 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474939:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c06a6 lrc: 0/0,0 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474944:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.474947:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.474948:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474950:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 3/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.474954:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 1/0,0 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.474955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.474956:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c06b4 lrc: 0/0,0 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.474964:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460928 00000100:00100000:0.0:1651529349.474964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.474974:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 5/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 81 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.474991:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12653 00000100:00100000:1.0:1651529349.474993:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396460928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.474996:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.474998:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 5/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 81 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.475008:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 4/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 81 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.475016:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.475024:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d17ff7/0xa29a79078f3ba023 lrc: 0/0,0 mode: --/PR res: [0x2b933:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe5d expref: 81 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475024:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475028:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475029:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475030:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475032:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579840 00010000:00010000:1.0:1651529349.475033:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 4/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475048:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.475060:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396460928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.475063:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12653 00000100:00100000:0.0:1651529349.475066:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579968 00000100:00100000:0.0:1651529349.475071:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946579904 00000100:00100000:1.0:1651529349.475073:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153692 00000100:00100000:1.0:1651529349.475075:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1983:39030:x1731745946579840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.475077:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153693 00000100:00100000:0.0:1651529349.475078:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1983:39030:x1731745946579968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.475080:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178484 count 1 00010000:00010000:1.0:1651529349.475084:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.475084:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178486 count 1 00010000:00010000:1.0:1651529349.475088:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 2/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475088:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475092:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475092:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475092:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 2/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475093:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 4/0,1 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475095:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475096:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475097:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 4/0,1 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475100:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 3/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475103:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 4/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475103:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 3/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475107:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 4/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475108:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966710656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.475111:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.475116:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.475120:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.475123:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153694 00000100:00100000:1.0:1651529349.475125:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1983:39030:x1731745946579904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.475126:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.475129:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178485 count 1 00010000:00010000:0.0:1651529349.475130:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475132:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475135:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475137:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 2/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475138:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475140:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475140:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475141:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 4/0,1 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475149:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 3/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475153:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 4/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475157:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966710784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.475163:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.475177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.475205:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1984:39030:x1731745946579776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 740us (837us total) trans 30064894554 rc 0/0 00000100:00100000:0.0:1651529349.475208:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153691 00000100:00100000:0.0:1651529349.475213:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580096 00000100:00100000:1.0:1651529349.475214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.475232:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580032 00000100:00100000:1.0:1651529349.475236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.475240:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153695 00000100:00100000:0.0:1651529349.475242:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1985:39030:x1731745946580096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.475247:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178488 count 1 00010000:00010000:0.0:1651529349.475251:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475255:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 2/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 79 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475258:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475259:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475260:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 4/0,1 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475266:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 3/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 79 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475270:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 4/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 79 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475271:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.475274:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.475282:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.475288:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475291:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.475292:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475295:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 3/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475300:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 1/0,0 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475302:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c06bb lrc: 0/0,0 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475326:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580224 00000100:00100000:0.0:1651529349.475334:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580160 00000100:00100000:1.0:1651529349.475338:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153696 00000100:00100000:1.0:1651529349.475341:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1987:39029:x1731745946580032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.475343:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153697 00000100:00100000:0.0:1651529349.475345:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1987:39030:x1731745946580224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.475349:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178487 count 1 00002000:00080000:0.0:1651529349.475352:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178490 count 1 00010000:00010000:1.0:1651529349.475354:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475357:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475359:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 2/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475361:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 2/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475362:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475363:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475363:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 4/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475364:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475365:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475366:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 4/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475372:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 3/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475373:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 3/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475376:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 4/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.475380:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.475380:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966710912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.475387:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966710976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.475410:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.475414:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.475416:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153698 00000100:00100000:1.0:1651529349.475418:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1987:39029:x1731745946580160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.475423:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178489 count 1 00010000:00010000:1.0:1651529349.475427:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529349.475432:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 2/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475435:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475435:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475436:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 4/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475442:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 3/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.475446:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475450:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.475459:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580288 00000100:00100000:0.0:1651529349.475471:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153699 00000100:00100000:0.0:1651529349.475473:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1988:39030:x1731745946580288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.475476:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.475479:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178491 count 1 00010000:00010000:0.0:1651529349.475483:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475490:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 2/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475493:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475494:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475494:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 4/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475501:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 3/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 79 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.475504:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 4/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.475508:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.475523:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.475714:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966710656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.475719:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.475727:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000348e2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966710784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.475730:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475731:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.475745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.475750:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396460992 00000100:00100000:0.0:1651529349.475752:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.475761:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 4/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 80 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.475770:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461120 00000100:00100000:1.0:1651529349.475772:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461056 00010000:00010000:1.0:1651529349.475775:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 4/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 82 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475776:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 5/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 82 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475779:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461184 00010000:00010000:1.0:1651529349.475781:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 5/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 83 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.475783:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12654 00000100:00100000:0.0:1651529349.475784:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396460992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.475786:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12655 00010000:00010000:0.0:1651529349.475787:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.475788:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396461056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.475789:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 4/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.475792:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.475793:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 4/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475793:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 3/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.475797:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 3/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475799:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aee1013/0xa29a79078f3b9d44 lrc: 0/0,0 mode: --/PR res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf320 expref: 83 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475816:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475819:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c860d511/0xa29a79078f3bb0f4 lrc: 0/0,0 mode: --/PR res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4257 expref: 82 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475821:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475822:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475823:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475824:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475825:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475826:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 4/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475828:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 4/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475835:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.475840:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.475846:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396460992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.475849:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12654 00000100:00100000:0.0:1651529349.475855:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12656 00000100:00100000:1.0:1651529349.475856:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396461056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.475856:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396461120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529349.475859:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.475861:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12655 00010000:00010000:0.0:1651529349.475861:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 5/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 80 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475869:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12657 00000100:00100000:1.0:1651529349.475871:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396461184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.475875:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.475877:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 5/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 79 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475901:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 4/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.475904:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 4/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 79 pid: 142995 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.475907:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475908:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.475909:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475910:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475911:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.475912:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475912:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 4/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475915:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 4/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475916:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.475920:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.475923:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b13a56cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396461120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.475925:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12656 00000100:00100000:1.0:1651529349.475928:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396461184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.475931:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12657 00010000:00010000:0.0:1651529349.475943:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143165ea/0xa29a79078f3b8b69 lrc: 0/0,0 mode: --/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc289 expref: 77 pid: 142995 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.475944:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966710976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.475947:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.475947:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966710848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.475951:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475953:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475954:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475956:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475957:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475959:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475961:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.475963:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.475976:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476027:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946579904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 900us (1062us total) trans 30064894555 rc 0/0 00000100:00100000:1.0:1651529349.476030:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153694 00000100:00100000:0.0:1651529349.476032:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946580096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 789us (854us total) trans 30064894556 rc 0/0 00000100:00100000:0.0:1651529349.476035:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153695 00010000:00010000:1.0:1651529349.476038:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476041:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c46f175 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476042:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476045:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 3/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476047:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a587aeb/0xa29a79078f3bb745 lrc: 0/0,0 mode: --/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b39 expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476050:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 1/0,0 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476051:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015403a07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966710720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.476053:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c06d7 lrc: 0/0,0 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476054:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476057:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476058:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476060:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.476060:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476063:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476068:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476069:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476071:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 3/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476075:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 1/0,0 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476078:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c06d0 lrc: 0/0,0 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476082:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476085:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d159d212 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476086:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476089:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 3/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476092:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 1/0,0 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476094:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c06c9 lrc: 0/0,0 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476103:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1989:39030:x1731745946579968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1023us (1158us total) trans 30064894557 rc 0/0 00000100:00100000:0.0:1651529349.476105:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153693 00010000:00010000:1.0:1651529349.476108:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476111:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476114:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476117:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.476164:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1989:39030:x1731745946579840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1089us (1245us total) trans 30064894558 rc 0/0 00000100:00100000:0.0:1651529349.476164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.476176:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153692 00000100:00100000:0.0:1651529349.476176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.476190:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.476194:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.476211:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461312 00010000:00010000:1.0:1651529349.476216:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 5/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 76 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476233:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966710912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.476237:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461440 00010000:00010000:0.0:1651529349.476237:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476242:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 5/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 77 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476245:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.476247:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476250:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461248 00010000:00010000:1.0:1651529349.476252:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 78 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476254:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461376 00000100:00100000:1.0:1651529349.476257:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12658 00000100:00100000:1.0:1651529349.476258:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396461312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.476259:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 79 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476261:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.476262:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 4/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476264:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12659 00010000:00010000:1.0:1651529349.476266:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 3/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476272:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000181ea74b/0xa29a79078f3b94bc lrc: 0/0,0 mode: --/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd066 expref: 79 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476275:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476276:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476277:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476280:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 4/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476282:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396461440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.476287:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.476291:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.476295:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 4/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 78 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.476299:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 3/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 78 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.476302:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396461312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.476305:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12658 00000100:00100000:1.0:1651529349.476310:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12660 00010000:00010000:0.0:1651529349.476310:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaab7ee5/0xa29a79078f3b9f27 lrc: 0/0,0 mode: --/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaa5 expref: 77 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.476311:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396461248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529349.476314:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.476314:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476314:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476315:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.476315:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476318:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 4/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476319:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 3/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476324:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c38aa4/0xa29a79078f3bb275 lrc: 0/0,0 mode: --/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4831 expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.476324:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.476327:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476328:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476329:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476331:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 4/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476332:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41279:x1731746396461440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.476335:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12659 00010000:00010000:1.0:1651529349.476337:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.476340:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12661 00000100:00100000:0.0:1651529349.476342:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396461376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.476343:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396461248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.476344:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.476345:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12660 00010000:00010000:0.0:1651529349.476345:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 74 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476351:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476352:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 3/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 73 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476355:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476356:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007107eb79/0xa29a79078f3bacd3 lrc: 0/0,0 mode: --/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31d3 expref: 73 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.476358:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476359:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476360:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476360:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476360:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476363:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 4/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476373:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.476391:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41278:x1731746396461376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.476394:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12661 00000100:00100000:1.0:1651529349.476408:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1989:39029:x1731745946580032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1066us (1194us total) trans 30064894559 rc 0/0 00000100:00100000:1.0:1651529349.476411:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153696 00010000:00010000:0.0:1651529349.476415:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476418:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476419:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476421:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476422:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476422:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476425:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 3/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476427:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476429:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 1/0,0 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476432:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c06c2 lrc: 0/0,0 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476436:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476439:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476440:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476443:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 3/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476446:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 1/0,0 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476448:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c06de lrc: 0/0,0 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476453:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476455:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476456:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476459:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 3/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476464:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 1/0,0 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476467:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c06f3 lrc: 0/0,0 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.476467:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1989:39030:x1731745946580288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 992us (1036us total) trans 30064894560 rc 0/0 00000100:00100000:0.0:1651529349.476470:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153699 00010000:00010000:1.0:1651529349.476474:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476477:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476478:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476480:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476481:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476483:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476484:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476487:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476517:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1990:39029:x1731745946580160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1097us (1246us total) trans 30064894561 rc 0/0 00000100:00100000:1.0:1651529349.476520:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153698 00000100:00100000:0.0:1651529349.476520:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946580224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1174us (1283us total) trans 30064894562 rc 0/0 00000100:00100000:0.0:1651529349.476523:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153697 00010000:00010000:1.0:1651529349.476526:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476529:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476530:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476531:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476533:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.476534:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 3/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476534:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476537:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 3/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476538:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 1/0,0 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476541:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c06ec lrc: 0/0,0 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476542:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 1/0,0 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476544:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c06e5 lrc: 0/0,0 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.476611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.476623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.476636:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580352 00000100:00100000:0.0:1651529349.476636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.476644:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580416 00000100:00100000:1.0:1651529349.476654:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580480 00000100:00100000:0.0:1651529349.476654:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580544 00000100:00100000:1.0:1651529349.476667:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153700 00000100:00100000:1.0:1651529349.476669:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1991:39030:x1731745946580352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.476675:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178492 count 1 00000100:00100000:0.0:1651529349.476683:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153701 00000100:00100000:0.0:1651529349.476685:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1992:39029:x1731745946580416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.476686:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529349.476690:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178493 count 1 00010000:00010000:1.0:1651529349.476691:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 2/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.476694:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476694:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476695:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 4/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476702:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.476702:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476707:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 4/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.476707:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 2/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.476710:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.476711:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.476711:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476712:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 4/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476721:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 3/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.476726:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.476732:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.476742:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153702 00000100:00100000:1.0:1651529349.476744:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1992:39030:x1731745946580480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529349.476745:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966711232:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529349.476749:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178494 count 1 00010000:00010000:1.0:1651529349.476753:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476758:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 2/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.476761:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476761:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476762:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 4/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476768:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 3/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.476772:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 4/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476780:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011d24fd7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.476787:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966711296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.476788:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153703 00000100:00100000:0.0:1651529349.476790:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1992:39029:x1731745946580544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.476795:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178495 count 1 00000100:00100000:1.0:1651529349.476796:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.476799:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476824:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 2/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.476828:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476828:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476829:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 4/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.476836:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 3/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.476840:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.476844:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.476851:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.476856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.476868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.476911:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580608 00000100:00100000:0.0:1651529349.476935:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580672 00000100:00100000:0.0:1651529349.476942:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153704 00000100:00100000:0.0:1651529349.476944:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1994:39030:x1731745946580608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.476949:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178496 count 1 00000100:00100000:1.0:1651529349.476956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.476964:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476966:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580736 00010000:00010000:0.0:1651529349.476969:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 2/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.476972:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476973:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.476973:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 4/0,1 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.476974:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153705 00000100:00100000:1.0:1651529349.476976:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1995:39029:x1731745946580672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.476980:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 3/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.476981:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178497 count 1 00010000:00010000:1.0:1651529349.476986:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.476990:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 2/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.476993:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476994:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.476995:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 4/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477002:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 3/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.477006:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 4/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477011:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966711424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.477016:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477023:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966711488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.477026:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.477033:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153706 00000100:00100000:0.0:1651529349.477035:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1995:39029:x1731745946580736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529349.477038:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00002000:00080000:0.0:1651529349.477040:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178498 count 1 00010000:00010000:0.0:1651529349.477044:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477048:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 2/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 71 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.477051:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477052:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477052:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 4/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.477053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.477058:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 3/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 71 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.477062:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 71 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477066:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966711552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.477073:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529349.477120:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580800 00000100:00100000:1.0:1651529349.477128:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153707 00000100:00100000:1.0:1651529349.477130:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1996:39030:x1731745946580800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.477136:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178499 count 1 00010000:00010000:1.0:1651529349.477140:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477145:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 2/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.477148:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477148:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477149:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 4/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477158:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 3/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 71 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.477163:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477170:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966711616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.477192:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.477272:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966711232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.477277:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.477286:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.477316:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.477317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.477319:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477326:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461504 00000100:00100000:1.0:1651529349.477327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.477331:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 5/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 72 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477338:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.477343:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461632 00000100:00100000:1.0:1651529349.477352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.477352:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 73 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477358:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461568 00010000:00010000:0.0:1651529349.477360:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 74 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477361:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7be67e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.477364:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461696 00010000:00010000:1.0:1651529349.477365:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477366:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 5/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 75 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477370:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461760 00010000:00010000:0.0:1651529349.477372:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 5/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477373:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008278e0d9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966711296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.477375:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477376:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12662 00000100:00100000:0.0:1651529349.477378:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396461504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.477381:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.477382:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12663 00010000:00010000:0.0:1651529349.477382:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 4/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477384:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396461632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529349.477386:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477388:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.477390:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477392:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec8ad641/0xa29a79078f3bc1e8 lrc: 0/0,0 mode: --/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84de expref: 76 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477395:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477396:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 3/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 75 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477396:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477397:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477400:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 4/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477405:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083400a77/0xa29a79078f3bb045 lrc: 0/0,0 mode: --/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f9b expref: 75 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477427:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477428:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477429:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477432:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 4/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477435:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.477444:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d60d402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396461504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.477448:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12662 00000100:00100000:0.0:1651529349.477457:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12664 00010000:00010000:1.0:1651529349.477460:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.477466:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41278:x1731746396461568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529349.477469:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41278:x1731746396461632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 84us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.477469:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.477471:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 73 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477472:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12663 00010000:00010000:0.0:1651529349.477477:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 3/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 72 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477479:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12665 00000100:00100000:1.0:1651529349.477480:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41278:x1731746396461696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529349.477483:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.477483:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca11dc1d/0xa29a79078f3ba379 lrc: 0/0,0 mode: --/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bed expref: 72 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477485:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 4/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 72 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477486:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477487:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477488:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477489:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 3/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477491:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 4/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477494:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3629caf/0xa29a79078f3bbcee lrc: 0/0,0 mode: --/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7112 expref: 71 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477496:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.477497:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477498:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477499:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477502:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 4/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477502:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396461568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.477505:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12664 00010000:00010000:1.0:1651529349.477508:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.477510:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12666 00000100:00100000:0.0:1651529349.477511:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396461760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529349.477513:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396461696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.477513:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.477515:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 5/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 69 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477516:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12665 00010000:00010000:0.0:1651529349.477518:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 4/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 68 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477522:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477523:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477523:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477524:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477526:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477527:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 4/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477529:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477531:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477531:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.477535:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396461760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.477538:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12666 00010000:00010000:0.0:1651529349.477544:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477547:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477551:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477553:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.477580:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1998:39030:x1731745946580480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 835us (957us total) trans 30064894563 rc 0/0 00000100:00100000:1.0:1651529349.477583:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153702 00010000:00010000:1.0:1651529349.477591:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477596:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.477597:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477599:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1997:39029:x1731745946580544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 808us (962us total) trans 30064894564 rc 0/0 00010000:00010000:1.0:1651529349.477600:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 3/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477602:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153703 00010000:00010000:1.0:1651529349.477605:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 1/0,0 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477608:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0708 lrc: 0/0,0 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477609:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477612:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477613:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477615:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.477616:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477616:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477618:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 3/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477618:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477622:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 1/0,0 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477627:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c070f lrc: 0/0,0 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477630:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477633:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.477633:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477636:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 3/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477639:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 1/0,0 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477642:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0701 lrc: 0/0,0 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477648:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477650:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1997:39029:x1731745946580416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 964us (1039us total) trans 30064894565 rc 0/0 00010000:00010000:1.0:1651529349.477651:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477652:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153701 00010000:00010000:1.0:1651529349.477654:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477657:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477663:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd42e8c1/0xa29a79078f3bb053 lrc: 0/0,0 mode: --/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fef expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477667:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029da7859 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966711424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.477671:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477674:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477677:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477682:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477685:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.477700:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1997:39030:x1731745946580352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1022us (1106us total) trans 30064894566 rc 0/0 00000100:00100000:1.0:1651529349.477703:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153700 00010000:00010000:1.0:1651529349.477710:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477713:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.477714:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477717:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 3/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477721:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 1/0,0 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477724:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c06fa lrc: 0/0,0 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477724:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1997:39030:x1731745946580608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 779us (868us total) trans 30064894567 rc 0/0 00000100:00100000:0.0:1651529349.477727:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153704 00010000:00010000:1.0:1651529349.477729:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477731:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.477732:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477745:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 3/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477749:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 1/0,0 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477752:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0716 lrc: 0/0,0 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477794:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966711552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.477831:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.477879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529349.477886:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461888 00010000:00010000:0.0:1651529349.477891:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 67 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.477910:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461824 00000100:00100000:1.0:1651529349.477926:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966711488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.477931:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 68 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477932:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.477943:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12667 00000100:00100000:0.0:1651529349.477944:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396461888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.477949:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.477950:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 68 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477952:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12668 00010000:00010000:0.0:1651529349.477954:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 3/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 68 pid: 142994 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.477956:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396461824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.477961:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.477963:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 68 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477968:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 3/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 68 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477971:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217123ea/0xa29a79078f3b7884 lrc: 0/0,0 mode: --/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7a0 expref: 68 pid: 142994 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.477974:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3ba999 lrc: 0/0,0 mode: --/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2554 expref: 68 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.477975:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477976:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.477977:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477980:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 4/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477981:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477981:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.477982:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.477985:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 4/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.477987:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.477992:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.478001:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396461824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.478004:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12668 00000100:00100000:0.0:1651529349.478005:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396461888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.478008:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12667 00010000:00010000:1.0:1651529349.478012:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478015:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478015:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478018:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478018:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478021:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478024:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478027:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478071:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1998:39029:x1731745946580672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1094us (1202us total) trans 30064894568 rc 0/0 00000100:00100000:1.0:1651529349.478074:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153705 00010000:00010000:1.0:1651529349.478081:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478085:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.478086:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478089:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 3/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478093:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 1/0,0 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478096:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c071d lrc: 0/0,0 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478101:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478104:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.478105:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478108:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 3/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478109:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1997:39029:x1731745946580736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1073us (1154us total) trans 30064894569 rc 0/0 00010000:00010000:1.0:1651529349.478111:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 1/0,0 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478112:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153706 00010000:00010000:1.0:1651529349.478116:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0724 lrc: 0/0,0 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.478173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.478194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529349.478243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.478251:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580864 00000100:00100000:0.0:1651529349.478259:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580928 00000100:00100000:0.0:1651529349.478263:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946580992 00000100:00100000:0.0:1651529349.478272:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581056 00000100:00100000:0.0:1651529349.478278:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153708 00000100:00100000:0.0:1651529349.478280:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2000:39030:x1731745946580864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.478286:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178500 count 1 00000100:00100000:1.0:1651529349.478287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.478290:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478295:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581120 00010000:00010000:0.0:1651529349.478295:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 2/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.478299:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478299:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478300:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 4/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478303:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153709 00000100:00100000:1.0:1651529349.478305:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f2dbe31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2001:39029:x1731745946580928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.478309:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 3/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529349.478311:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178501 count 1 00010000:00010000:0.0:1651529349.478313:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.478315:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478317:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966711680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.478320:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 2/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 64 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.478323:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.478324:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.478324:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 4/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478332:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.478339:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 3/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 64 pid: 161133 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.478339:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153710 00000100:00100000:0.0:1651529349.478341:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2001:39030:x1731745946580992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529349.478343:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 64 pid: 161133 timeout: 13099 lvb_type: 1 00002000:00080000:0.0:1651529349.478346:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178502 count 1 00000100:00100000:1.0:1651529349.478348:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966711744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.478349:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478353:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 2/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.478356:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529349.478357:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e35b8c0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529349.478357:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478358:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 4/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478364:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153711 00010000:00010000:0.0:1651529349.478364:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 3/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529349.478366:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2001:39029:x1731745946581056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.478367:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00002000:00080000:1.0:1651529349.478370:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178503 count 1 00010000:00010000:1.0:1651529349.478373:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478378:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 2/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.478381:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.478381:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529349.478381:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.478382:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 4/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478388:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.478389:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.478392:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.478395:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153712 00000100:00100000:1.0:1651529349.478396:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.478402:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.478413:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2001:39030:x1731745946581120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.478419:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178504 count 1 00010000:00010000:0.0:1651529349.478423:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.478427:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 2/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.478430:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478431:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478431:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 4/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529349.478438:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 3/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.478441:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.478445:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966711936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.478453:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.478460:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581248 00000100:00100000:0.0:1651529349.478478:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581184 00000100:00100000:0.0:1651529349.478484:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153713 00000100:00100000:0.0:1651529349.478486:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2003:39030:x1731745946581248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529349.478490:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178506 count 1 00010000:00010000:0.0:1651529349.478494:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478499:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 2/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.478502:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478502:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478503:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 4/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478515:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153714 00000100:00100000:1.0:1651529349.478517:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2003:39029:x1731745946581184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529349.478523:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178505 count 1 00010000:00010000:0.0:1651529349.478525:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 3/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.478528:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478529:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.478532:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 2/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.478533:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966712000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.478535:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.478536:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.478537:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 4/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478544:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 3/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 64 pid: 144527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529349.478547:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.478556:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.478560:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966712064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.478573:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529349.478590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.478596:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966711616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.478600:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478611:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396461952 00010000:00010000:0.0:1651529349.478617:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 65 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.478636:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12669 00000100:00100000:0.0:1651529349.478638:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41278:x1731746396461952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529349.478641:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.478642:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 65 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.478646:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 3/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 65 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.478652:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d96c11be/0xa29a79078f3bc171 lrc: 0/0,0 mode: --/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82f4 expref: 65 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.478655:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478656:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.478657:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478660:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 4/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.478669:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.478672:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478676:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478678:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a69771b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396461952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (89us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.478679:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478681:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478681:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12669 00000100:00100000:1.0:1651529349.478748:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2004:39030:x1731745946580800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1617us (1694us total) trans 30064894570 rc 0/0 00000100:00100000:1.0:1651529349.478751:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153707 00010000:00010000:1.0:1651529349.478759:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478762:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.478763:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478766:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 3/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478771:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 1/0,0 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478774:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c072b lrc: 0/0,0 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478889:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dbdce89 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966711680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.478903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529349.478906:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.478920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.478926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529349.478950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529349.478951:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac34838 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966711808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.478954:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478962:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966711936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.478963:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966711744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.478964:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.478969:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.478982:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966711872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529349.478985:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.478994:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462016 00010000:00010000:0.0:1651529349.479000:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 64 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479006:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462144 00010000:00010000:0.0:1651529349.479009:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 65 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.479010:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462080 00000100:00100000:0.0:1651529349.479013:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462208 00010000:00010000:0.0:1651529349.479015:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479016:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 67 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479019:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12670 00000100:00100000:0.0:1651529349.479021:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396462016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529349.479024:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12671 00010000:00010000:0.0:1651529349.479024:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529349.479026:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396462144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.479029:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.479030:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479033:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479034:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 3/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479037:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 3/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479040:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b2f5a64/0xa29a79078f3bbfb8 lrc: 0/0,0 mode: --/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bd8 expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479043:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005080f3fc/0xa29a79078f3bbca8 lrc: 0/0,0 mode: --/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d702b expref: 67 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479044:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479044:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479045:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479047:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479047:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479048:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 4/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479048:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479051:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 4/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479059:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.479065:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.479067:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41278:x1731746396462144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.479070:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12671 00000100:00100000:0.0:1651529349.479073:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396462016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.479075:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12672 00000100:00100000:1.0:1651529349.479076:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396462208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.479077:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12670 00010000:00010000:1.0:1651529349.479079:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.479081:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 63 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479082:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12673 00010000:00010000:1.0:1651529349.479084:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 63 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479084:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396462080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529349.479086:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.479088:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 63 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479089:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf9b671f/0xa29a79078f3ba000 lrc: 0/0,0 mode: --/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdca expref: 63 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479092:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 3/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 63 pid: 161133 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479093:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479094:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479094:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479097:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 4/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479103:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.479105:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38fae46/0xa29a79078f3b98f9 lrc: 0/0,0 mode: --/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1df expref: 62 pid: 161133 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.479108:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41279:x1731746396462208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529349.479109:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479109:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479110:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479111:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12672 00010000:00010000:0.0:1651529349.479113:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 4/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479118:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581312 00010000:00010000:0.0:1651529349.479121:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529349.479128:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396462080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.479131:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12673 00000100:00100000:1.0:1651529349.479133:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153715 00000100:00100000:1.0:1651529349.479134:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2004:39030:x1731745946581312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529349.479138:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529349.479139:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178507 count 1 00010000:00010000:0.0:1651529349.479142:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479143:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479145:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479148:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 2/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 59 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529349.479148:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479151:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479152:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479152:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 4/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479159:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 3/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 59 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529349.479169:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 4/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 59 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.479174:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529349.479182:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00010000:00010000:1.0:1651529349.479188:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479191:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.479192:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479195:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 3/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479200:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 1/0,0 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479202:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0740 lrc: 0/0,0 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479207:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946580992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 865us (1014us total) trans 30064894571 rc 0/0 00000100:00100000:0.0:1651529349.479210:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153710 00010000:00010000:1.0:1651529349.479211:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479214:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479217:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479220:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479221:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966712000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.479225:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479239:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479242:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.479243:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479246:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 3/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479251:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 1/0,0 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479253:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0747 lrc: 0/0,0 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479260:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479266:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946581056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 899us (1023us total) trans 30064894572 rc 0/0 00000100:00100000:1.0:1651529349.479269:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153711 00010000:00010000:0.0:1651529349.479273:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479276:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479276:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479279:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479279:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479282:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479292:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479319:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2006:39030:x1731745946580864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1038us (1167us total) trans 30064894573 rc 0/0 00000100:00100000:0.0:1651529349.479323:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153708 00000100:00100000:1.0:1651529349.479330:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f2dbe31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946580928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1024us (1158us total) trans 30064894574 rc 0/0 00000100:00100000:1.0:1651529349.479333:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153709 00000100:00100000:0.0:1651529349.479355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.479362:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479366:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529349.479366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.479367:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479370:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 3/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479375:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 1/0,0 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.479377:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0732 lrc: 0/0,0 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479388:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479391:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.479392:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479397:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 3/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479400:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 1/0,0 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479403:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0739 lrc: 0/0,0 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479422:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462336 00010000:00010000:0.0:1651529349.479428:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 60 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.479430:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966712064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529349.479438:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462272 00010000:00010000:0.0:1651529349.479441:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 61 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479443:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479445:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462400 00010000:00010000:0.0:1651529349.479447:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:1.0:1651529349.479451:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12674 00000100:00100000:1.0:1651529349.479453:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396462336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529349.479454:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12675 00000100:00100000:0.0:1651529349.479456:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396462272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529349.479458:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.479459:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.479460:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479461:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479467:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 3/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479476:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448023e3/0xa29a79078f3bb061 lrc: 0/0,0 mode: --/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4027 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479481:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 3/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 62 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479482:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479483:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479484:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479487:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 4/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479487:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000543c79a7/0xa29a79078f3bbe99 lrc: 0/0,0 mode: --/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7794 expref: 61 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479491:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479492:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479493:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479498:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529349.479502:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 4/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479509:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396462336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.479512:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12674 00010000:00010000:0.0:1651529349.479513:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.479518:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12676 00000100:00100000:1.0:1651529349.479520:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396462400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529349.479522:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396462272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529349.479523:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529349.479525:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 59 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479525:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12675 00010000:00010000:1.0:1651529349.479529:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 3/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 58 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479532:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479534:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004436de36/0xa29a79078f3b993f lrc: 0/0,0 mode: --/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce305 expref: 58 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479535:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479537:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529349.479538:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479538:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479539:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479541:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 4/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479541:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479547:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529349.479553:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1ba9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41279:x1731746396462400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529349.479555:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12676 00010000:00010000:1.0:1651529349.479565:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479568:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.479569:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479572:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 3/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479576:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 1/0,0 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479579:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c074e lrc: 0/0,0 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479580:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946581120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1181us (1292us total) trans 30064894575 rc 0/0 00000100:00100000:0.0:1651529349.479583:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153712 00010000:00010000:1.0:1651529349.479586:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479590:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479594:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479595:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479597:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479599:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479600:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479605:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479658:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2006:39029:x1731745946581184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1139us (1222us total) trans 30064894576 rc 0/0 00000100:00100000:0.0:1651529349.479659:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2006:39030:x1731745946581248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1172us (1235us total) trans 30064894577 rc 0/0 00000100:00100000:1.0:1651529349.479661:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153714 00000100:00100000:0.0:1651529349.479663:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153713 00010000:00010000:1.0:1651529349.479669:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479672:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.479673:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479676:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 3/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479681:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 1/0,0 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479691:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c075c lrc: 0/0,0 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479704:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479706:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529349.479707:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479708:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529349.479721:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 3/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479728:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 1/0,0 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479731:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0755 lrc: 0/0,0 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479752:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396462464 00010000:00010000:0.0:1651529349.479757:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 5/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 57 pid: 144527 timeout: 13099 lvb_type: 1 00000100:00100000:0.0:1651529349.479768:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12677 00000100:00100000:0.0:1651529349.479770:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396462464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529349.479772:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529349.479773:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529349.479774:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 4/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 57 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:1.0:1651529349.479776:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479778:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 3/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 57 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479784:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003386dd04/0xa29a79078f3bc370 lrc: 0/0,0 mode: --/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ae2 expref: 57 pid: 144527 timeout: 13099 lvb_type: 1 00010000:00010000:0.0:1651529349.479788:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479788:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529349.479789:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479792:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 4/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479831:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529349.479834:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479837:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529349.479841:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396462464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529349.479844:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12677 00010000:00010000:1.0:1651529349.479851:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529349.479854:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479878:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479882:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529349.479883:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479886:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 3/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479891:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 1/0,0 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529349.479894:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c0763 lrc: 0/0,0 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529349.479913:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946581312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 777us (962us total) trans 30064894578 rc 0/0 00000100:00100000:1.0:1651529349.479916:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153715 00000001:00080000:1.0:1651529349.567743:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894117 is committed 00000100:00100000:0.0:1651529354.464159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529354.464171:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581440 00000100:00100000:0.0:1651529354.464186:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 308 00000100:00100000:0.0:1651529354.464189:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+466:39029:x1731745946581440:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529354.464201:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578368 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529354.464225:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dbdce89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+466:39029:x1731745946581440:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529354.464229:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 308 00000001:00080000:1.0:1651529355.699413:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894578 is committed 00000100:00100000:0.0:1651529359.584066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529359.584076:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581568 00000100:00100000:0.0:1651529359.584089:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 309 00000100:00100000:0.0:1651529359.584091:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529359.584101:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578368 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529359.584123:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029da7859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 31us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529359.584126:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 309 00000400:00000080:0.0:1651529364.502360:0:166880:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529364.502362:0:166880:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 124d: cancel very aged locks if lru-resize diasbaled ========================================================== 22:09:24 (1651529364) 00000100:00100000:0.0:1651529364.622422:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529364.622442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529364.622457:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581824 00000100:00100000:0.0:1651529364.622457:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581760 00000100:00100000:0.0:1651529364.622483:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 310 00000100:00100000:1.0:1651529364.622484:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153716 00000100:00100000:0.0:1651529364.622485:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946581760:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1651529364.622488:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:137464:x1731745946581824:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00000024:0.0:1651529364.622504:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578368 pending 0 free 81229504512 avail 77058793472 00002000:00080000:1.0:1651529364.622506:0:161133:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x0 at 178626 00000100:00100000:0.0:1651529364.622533:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a23cab47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946581760:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.622536:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 310 00000100:00100000:1.0:1651529364.623719:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:137464:x1731745946581824:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 1231us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.623723:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153716 00000100:00100000:0.0:1651529364.634013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529364.634039:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581888 00000100:00100000:1.0:1651529364.634053:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153717 00000100:00100000:1.0:1651529364.634055:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946581888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529364.634062:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178508 count 1 00010000:00010000:1.0:1651529364.634074:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634095:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 2/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 55 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.634099:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.634100:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.634101:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 4/0,1 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634115:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 3/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 55 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.634121:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 4/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 55 pid: 128009 timeout: 13114 lvb_type: 1 00000100:00100000:1.0:1651529364.634127:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529364.634152:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529364.634501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.634511:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396504960 00000100:00100000:1.0:1651529364.634514:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529364.634520:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 4/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 56 pid: 128009 timeout: 13114 lvb_type: 1 00010000:00010000:1.0:1651529364.634522:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.634535:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12678 00000100:00100000:0.0:1651529364.634537:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41279:x1731746396504960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529364.634542:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529364.634544:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 4/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 56 pid: 128009 timeout: 13114 lvb_type: 1 00010000:00010000:0.0:1651529364.634549:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 3/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 56 pid: 128009 timeout: 13114 lvb_type: 1 00010000:00010000:0.0:1651529364.634559:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3bcf78 lrc: 0/0,0 mode: --/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91db expref: 56 pid: 128009 timeout: 13114 lvb_type: 1 00010000:00010000:0.0:1651529364.634563:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.634564:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.634565:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.634570:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 4/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.634581:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529364.634592:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.634592:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41279:x1731746396504960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.634595:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12678 00010000:00010000:1.0:1651529364.634597:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634610:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634614:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529364.634701:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946581888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 644us (688us total) trans 30064894579 rc 0/0 00000100:00100000:1.0:1651529364.634705:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153717 00010000:00010000:1.0:1651529364.634715:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634719:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c28435 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529364.634721:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634725:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 3/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634753:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 1/0,0 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634757:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c076a lrc: 0/0,0 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.655119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.655148:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396508800 00000100:00100000:1.0:1651529364.655164:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153718 00000100:00100000:1.0:1651529364.655167:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396508800:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:1.0:1651529364.655172:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.655178:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0771 lrc: 2/0,0 mode: --/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9c77 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.655187:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.655193:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.655193:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.655195:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0771 lrc: 3/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c77 expref: 56 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.655201:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0771 lrc: 3/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c77 expref: 56 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.655207:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d8c28435, rc 0) 00000100:00100000:1.0:1651529364.655229:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396508800:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.655232:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153718 00000100:00100000:0.0:1651529364.656638:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.656652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.656660:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396509696 00000100:00100000:1.0:1651529364.656663:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396509632 00000100:00100000:0.0:1651529364.656673:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153719 00000100:00100000:0.0:1651529364.656675:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396509696:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00000100:00100000:1.0:1651529364.656683:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153720 00000100:00100000:1.0:1651529364.656685:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396509632:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.656685:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.656688:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.656691:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0778 lrc: 2/0,0 mode: --/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9cc4 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.656693:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c077f lrc: 2/0,0 mode: --/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9cbd expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.656699:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529364.656699:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.656703:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.656704:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.656704:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.656705:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.656706:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c077f lrc: 3/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cbd expref: 59 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.656707:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0778 lrc: 3/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cc4 expref: 59 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.656710:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c077f lrc: 3/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cbd expref: 59 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.656712:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0778 lrc: 3/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cc4 expref: 59 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.656714:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d159d212, rc 0) 00010000:00010000:0.0:1651529364.656716:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d8e7f88a, rc 0) 00000100:00100000:1.0:1651529364.656729:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396509632:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.656732:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153720 00000100:00100000:0.0:1651529364.656734:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396509696:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.656737:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153719 00000100:00100000:0.0:1651529364.656956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.656970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.656978:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396509824 00000100:00100000:1.0:1651529364.656981:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396509760 00000100:00100000:0.0:1651529364.656988:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153721 00000100:00100000:0.0:1651529364.656990:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396509824:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.656994:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.656996:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153722 00000100:00100000:1.0:1651529364.656997:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396509760:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.656998:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 2/0,0 mode: --/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9cd2 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.657001:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.657005:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c078d lrc: 2/0,0 mode: --/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ccb expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.657007:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.657011:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529364.657012:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.657012:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657014:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 61 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.657016:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.657017:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657018:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 61 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.657019:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c078d lrc: 3/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ccb expref: 61 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.657022:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000432a99, rc 0) 00010000:00010000:1.0:1651529364.657023:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c078d lrc: 3/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ccb expref: 61 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.657030:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c46f175, rc 0) 00000100:00100000:0.0:1651529364.657032:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41278:x1731746396509824:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.657035:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153721 00000100:00100000:1.0:1651529364.657038:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396509760:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.657041:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153722 00000100:00100000:0.0:1651529364.659441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.659452:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.659457:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.659466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.659473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.659482:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510848 00000100:00100000:0.0:1651529364.659490:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510912 00000100:00100000:1.0:1651529364.659492:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396511040 00000100:00100000:0.0:1651529364.659496:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396511552 00000100:00100000:0.0:1651529364.659500:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396511744 00000100:00100000:0.0:1651529364.659512:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153723 00000100:00100000:0.0:1651529364.659513:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396510848:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:1.0:1651529364.659517:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153724 00010000:00010000:0.0:1651529364.659517:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.659520:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396510912:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.659521:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0794 lrc: 2/0,0 mode: --/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d2d expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.659524:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:0.0:1651529364.659527:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.659528:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c079b lrc: 2/0,0 mode: --/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d34 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.659531:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659532:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529364.659534:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.659534:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0794 lrc: 3/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d2d expref: 65 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.659538:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0794 lrc: 3/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d2d expref: 66 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659540:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659541:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659542:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b8457821, rc 0) 00010000:00010000:1.0:1651529364.659543:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c079b lrc: 3/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d34 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659550:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c079b lrc: 3/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d34 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529364.659553:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41279:x1731746396510848:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529364.659555:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a9df0d3, rc 0) 00000100:00100000:0.0:1651529364.659556:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153723 00000100:00100000:0.0:1651529364.659561:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153725 00000100:00100000:0.0:1651529364.659563:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396511552:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:1.0:1651529364.659564:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396510912:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 44us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529364.659565:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.659568:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153724 00010000:00010000:0.0:1651529364.659569:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c07a2 lrc: 2/0,0 mode: --/PR res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d73 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.659573:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b994:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529364.659576:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153726 00010000:00010000:0.0:1651529364.659577:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659577:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529364.659579:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396511040:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.659579:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c07a2 lrc: 3/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d73 expref: 65 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659583:0:128009:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.659583:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c07a2 lrc: 3/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d73 expref: 65 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659586:0:128009:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c07a9 lrc: 2/0,0 mode: --/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d42 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.659586:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003add3d75, rc 0) 00002000:00010000:1.0:1651529364.659591:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b982:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529364.659592:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396511552:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 29us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.659595:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153725 00010000:00010000:1.0:1651529364.659596:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659596:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659598:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c07a9 lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d42 expref: 65 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529364.659599:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153727 00000100:00100000:0.0:1651529364.659601:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396511744:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.659603:0:142995:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.659605:0:128009:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c07a9 lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d42 expref: 65 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.659606:0:142995:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c07b0 lrc: 2/0,0 mode: --/PR res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d88 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.659611:0:128009:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003dce4d58, rc 0) 00002000:00010000:0.0:1651529364.659611:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b984:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.659614:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659614:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659615:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c07b0 lrc: 3/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d88 expref: 66 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.659619:0:142995:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c07b0 lrc: 3/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d88 expref: 66 pid: 142995 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529364.659620:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41279:x1731746396511040:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 41us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529364.659622:0:142995:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000071a5e057, rc 0) 00000100:00100000:1.0:1651529364.659623:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153726 00000100:00100000:0.0:1651529364.659628:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396511744:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 26us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.659630:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153727 00000100:00100000:0.0:1651529364.661081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.661089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.661095:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.661107:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512512 00000100:00100000:0.0:1651529364.661114:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512640 00000100:00100000:0.0:1651529364.661116:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512704 00000100:00100000:0.0:1651529364.661123:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153728 00000100:00100000:0.0:1651529364.661125:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396512512:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.661128:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.661129:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153729 00000100:00100000:1.0:1651529364.661131:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396512640:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.661133:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c07b7 lrc: 2/0,0 mode: --/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9dce expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.661135:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:0.0:1651529364.661138:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.661140:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c07be lrc: 2/0,0 mode: --/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9de3 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.661142:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661142:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661144:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c07b7 lrc: 3/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dce expref: 68 pid: 127525 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1651529364.661146:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.661148:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c07b7 lrc: 3/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dce expref: 69 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661152:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661152:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000068fe190e, rc 0) 00010000:00010000:1.0:1651529364.661154:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661156:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c07be lrc: 3/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9de3 expref: 69 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661164:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c07be lrc: 3/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9de3 expref: 69 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661170:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1d8850a, rc 0) 00000100:00100000:1.0:1651529364.661181:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396512640:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.661184:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153729 00000100:00100000:0.0:1651529364.661187:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396512512:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.661190:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153728 00000100:00100000:0.0:1651529364.661196:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153730 00000100:00100000:0.0:1651529364.661198:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396512704:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.661201:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.661205:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c07c5 lrc: 2/0,0 mode: --/PR res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9dea expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.661210:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b983:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.661213:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661214:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661216:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c07c5 lrc: 3/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dea expref: 68 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661220:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c07c5 lrc: 3/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dea expref: 68 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661223:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c9cf9467, rc 0) 00000100:00100000:1.0:1651529364.661225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.661231:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396512704:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.661233:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153730 00000100:00100000:0.0:1651529364.661238:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512896 00000100:00100000:0.0:1651529364.661247:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153731 00000100:00100000:0.0:1651529364.661249:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396512896:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.661251:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.661255:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c07cc lrc: 2/0,0 mode: --/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9dff expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.661260:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.661263:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661263:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661265:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c07cc lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dff expref: 69 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661272:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c07cc lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dff expref: 69 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661275:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfcbc7ed, rc 0) 00000100:00100000:0.0:1651529364.661285:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396512896:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 36us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.661287:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153731 00000100:00100000:1.0:1651529364.662999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.663018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.663026:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513280 00000100:00100000:1.0:1651529364.663032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.663044:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513408 00000100:00100000:0.0:1651529364.663049:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513344 00000100:00100000:0.0:1651529364.663054:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153732 00000100:00100000:0.0:1651529364.663055:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396513280:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:1.0:1651529364.663058:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153733 00010000:00010000:0.0:1651529364.663059:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.663060:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396513408:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.663063:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c07d3 lrc: 2/0,0 mode: --/PR res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e1b expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.663064:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:0.0:1651529364.663068:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b987:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.663069:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c07da lrc: 2/0,0 mode: --/PR res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e29 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.663072:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663072:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663074:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c07d3 lrc: 3/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e1b expref: 72 pid: 127525 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1651529364.663075:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b993:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.663078:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c07d3 lrc: 3/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e1b expref: 73 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663080:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663080:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663082:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000230803cc, rc 0) 00010000:00010000:1.0:1651529364.663083:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c07da lrc: 3/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e29 expref: 73 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663090:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c07da lrc: 3/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e29 expref: 73 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529364.663093:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396513280:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.663095:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153732 00010000:00010000:1.0:1651529364.663097:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000626f6c4e, rc 0) 00000100:00100000:0.0:1651529364.663100:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153734 00000100:00100000:0.0:1651529364.663102:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513344:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.663104:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1651529364.663106:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513408:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 45us (89us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529364.663107:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c07e1 lrc: 2/0,0 mode: --/PR res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e22 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529364.663108:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153733 00002000:00010000:0.0:1651529364.663112:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b990:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.663115:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663115:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663116:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c07e1 lrc: 3/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e22 expref: 72 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.663120:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c07e1 lrc: 3/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e22 expref: 72 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.663124:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000068800f9f, rc 0) 00000100:00100000:0.0:1651529364.663130:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513344:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 27us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.663132:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153734 00000100:00100000:1.0:1651529364.664385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.664401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.664409:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514560 00000100:00100000:1.0:1651529364.664410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.664418:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514304 00000100:00100000:0.0:1651529364.664422:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514432 00000100:00100000:1.0:1651529364.664430:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153735 00000100:00100000:1.0:1651529364.664433:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396514560:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:0.0:1651529364.664433:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153736 00000100:00100000:0.0:1651529364.664435:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396514304:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.664437:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.664438:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.664441:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c07e8 lrc: 2/0,0 mode: --/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e92 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.664442:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c07ef lrc: 2/0,0 mode: --/PR res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e7d expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.664447:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529364.664448:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b992:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.664451:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664451:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664451:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664452:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664453:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c07e8 lrc: 3/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e92 expref: 76 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664453:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c07ef lrc: 3/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e7d expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.664457:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c07e8 lrc: 3/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e92 expref: 76 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664458:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c07ef lrc: 3/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e7d expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.664461:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000845529d3, rc 0) 00010000:00010000:0.0:1651529364.664461:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cb0ce92a, rc 0) 00000100:00100000:1.0:1651529364.664471:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396514560:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.664471:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396514304:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 36us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.664474:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153736 00000100:00100000:1.0:1651529364.664476:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153735 00000100:00100000:0.0:1651529364.664479:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153737 00000100:00100000:0.0:1651529364.664480:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396514432:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.664483:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.664486:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c07f6 lrc: 2/0,0 mode: --/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e8b expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.664490:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.664493:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664494:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664495:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c07f6 lrc: 3/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e8b expref: 75 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664499:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c07f6 lrc: 3/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e8b expref: 75 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664502:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009f3fd4d2, rc 0) 00000100:00100000:0.0:1651529364.664507:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41278:x1731746396514432:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 27us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.664510:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153737 00000100:00100000:1.0:1651529364.665345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.665367:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515072 00000100:00100000:0.0:1651529364.665375:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153738 00000100:00100000:0.0:1651529364.665376:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41279:x1731746396515072:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.665380:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.665384:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c07fd lrc: 2/0,0 mode: --/PR res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9eca expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.665389:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b999:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.665392:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665393:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665394:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c07fd lrc: 3/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eca expref: 76 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665399:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c07fd lrc: 3/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eca expref: 76 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665402:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004518a1dd, rc 0) 00000100:00100000:0.0:1651529364.665417:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41279:x1731746396515072:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.665420:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153738 00000100:00100000:1.0:1651529364.666847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.666869:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515584 00000100:00100000:0.0:1651529364.666878:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153739 00000100:00100000:0.0:1651529364.666879:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396515584:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.666883:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.666895:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0804 lrc: 2/0,0 mode: --/PR res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9eed expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.666901:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b997:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.666905:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.666906:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.666907:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0804 lrc: 3/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eed expref: 77 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.666912:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0804 lrc: 3/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eed expref: 77 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.666915:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80aa875, rc 0) 00000100:00100000:0.0:1651529364.666930:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396515584:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.666933:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153739 00000100:00100000:1.0:1651529364.667540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.667562:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515776 00000100:00100000:0.0:1651529364.667570:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153740 00000100:00100000:0.0:1651529364.667572:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41279:x1731746396515776:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.667575:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.667579:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c080b lrc: 2/0,0 mode: --/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9efb expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.667585:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.667588:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.667589:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.667590:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c080b lrc: 3/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9efb expref: 78 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.667594:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c080b lrc: 3/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9efb expref: 78 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.667598:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000044c25a68, rc 0) 00000100:00100000:0.0:1651529364.667613:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396515776:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.667616:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153740 00000100:00100000:1.0:1651529364.668142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.668164:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515968 00000100:00100000:0.0:1651529364.668172:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153741 00000100:00100000:0.0:1651529364.668173:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396515968:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.668177:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.668180:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0812 lrc: 2/0,0 mode: --/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f09 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.668186:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.668190:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.668190:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.668192:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0812 lrc: 3/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f09 expref: 79 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.668199:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0812 lrc: 3/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f09 expref: 79 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.668202:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079f5db30, rc 0) 00000100:00100000:0.0:1651529364.668217:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396515968:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.668219:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153741 00000100:00100000:1.0:1651529364.669386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.669408:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396516480 00000100:00100000:0.0:1651529364.669416:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153742 00000100:00100000:0.0:1651529364.669418:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396516480:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.669421:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.669425:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0819 lrc: 2/0,0 mode: --/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f2c expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.669430:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.669433:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.669434:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.669435:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0819 lrc: 3/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f2c expref: 80 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.669439:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0819 lrc: 3/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f2c expref: 80 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.669443:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f016294, rc 0) 00000100:00100000:0.0:1651529364.669457:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396516480:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.669460:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153742 00000100:00100000:1.0:1651529364.671600:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.671622:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396517120 00000100:00100000:0.0:1651529364.671630:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153743 00000100:00100000:0.0:1651529364.671632:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396517120:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.671635:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.671639:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0820 lrc: 2/0,0 mode: --/PR res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f5d expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.671644:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b985:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.671647:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.671648:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.671649:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0820 lrc: 3/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f5d expref: 81 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.671654:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0820 lrc: 3/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f5d expref: 81 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.671657:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000962f47d8, rc 0) 00000100:00100000:0.0:1651529364.671672:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396517120:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.671674:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153743 00000100:00100000:1.0:1651529364.672081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.672103:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396517312 00000100:00100000:0.0:1651529364.672111:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153744 00000100:00100000:0.0:1651529364.672112:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396517312:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.672116:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.672119:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0827 lrc: 2/0,0 mode: --/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f6b expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.672125:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.672128:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.672129:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.672130:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0827 lrc: 3/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f6b expref: 82 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.672134:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0827 lrc: 3/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f6b expref: 82 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.672138:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000580e7621, rc 0) 00000100:00100000:0.0:1651529364.672152:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396517312:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.672155:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153744 00000100:00100000:1.0:1651529364.674895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.674916:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396518272 00000100:00100000:0.0:1651529364.674925:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153745 00000100:00100000:0.0:1651529364.674927:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396518272:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.674930:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.674934:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c082e lrc: 2/0,0 mode: --/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9fb1 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.674939:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.674943:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.674943:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.674945:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c082e lrc: 3/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fb1 expref: 83 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.674952:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c082e lrc: 3/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fb1 expref: 83 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.674955:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdac3b1, rc 0) 00000100:00100000:0.0:1651529364.674969:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41279:x1731746396518272:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 42us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.674986:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153745 00000100:00100000:1.0:1651529364.675500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.675521:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396518592 00000100:00100000:0.0:1651529364.675529:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153746 00000100:00100000:0.0:1651529364.675531:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396518592:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.675534:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.675538:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0835 lrc: 2/0,0 mode: --/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9fc6 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.675543:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.675547:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.675547:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.675549:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0835 lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fc6 expref: 84 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.675553:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0835 lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fc6 expref: 84 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.675557:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003044d8ef, rc 0) 00000100:00100000:0.0:1651529364.675571:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396518592:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.675574:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153746 00000100:00100000:1.0:1651529364.676883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.676904:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396519040 00000100:00100000:0.0:1651529364.676912:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153747 00000100:00100000:0.0:1651529364.676914:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396519040:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.676917:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.676921:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c083c lrc: 2/0,0 mode: --/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9fe9 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.676927:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.676930:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.676931:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.676932:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c083c lrc: 3/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe9 expref: 85 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.676937:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c083c lrc: 3/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe9 expref: 85 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.676940:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e92e1902, rc 0) 00000100:00100000:0.0:1651529364.676954:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396519040:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.676957:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153747 00000100:00100000:1.0:1651529364.677526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.677548:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396519232 00000100:00100000:0.0:1651529364.677556:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153748 00000100:00100000:0.0:1651529364.677558:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396519232:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.677561:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.677565:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0843 lrc: 2/0,0 mode: --/PR res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ff7 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.677570:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b986:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.677573:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.677574:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.677575:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0843 lrc: 3/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ff7 expref: 86 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.677579:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0843 lrc: 3/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ff7 expref: 86 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.677583:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000255305c8, rc 0) 00000100:00100000:0.0:1651529364.677597:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396519232:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.677600:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153748 00000100:00100000:1.0:1651529364.678091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.678113:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396519552 00000100:00100000:0.0:1651529364.678121:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153749 00000100:00100000:0.0:1651529364.678123:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396519552:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.678126:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.678130:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c084a lrc: 2/0,0 mode: --/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da00c expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.678136:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.678139:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.678140:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.678141:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c084a lrc: 3/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da00c expref: 87 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.678148:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c084a lrc: 3/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da00c expref: 87 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.678152:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006e24de61, rc 0) 00000100:00100000:0.0:1651529364.678166:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41278:x1731746396519552:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 42us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.678169:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153749 00000100:00100000:1.0:1651529364.678560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.678581:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396519616 00000100:00100000:0.0:1651529364.678589:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153750 00000100:00100000:0.0:1651529364.678590:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41278:x1731746396519616:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.678594:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.678598:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0851 lrc: 2/0,0 mode: --/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da013 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.678603:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.678607:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.678607:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.678609:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0851 lrc: 3/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da013 expref: 88 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.678613:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0851 lrc: 3/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da013 expref: 88 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.678616:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dfa79ad3, rc 0) 00000100:00100000:0.0:1651529364.678630:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396519616:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.678633:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153750 00000100:00100000:1.0:1651529364.680695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.680717:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396520384 00000100:00100000:0.0:1651529364.680725:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153751 00000100:00100000:0.0:1651529364.680727:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396520384:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.680730:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.680734:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0858 lrc: 2/0,0 mode: --/PR res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da04b expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.680739:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b996:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.680750:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.680751:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.680752:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0858 lrc: 3/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da04b expref: 89 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.680757:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0858 lrc: 3/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da04b expref: 89 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.680761:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c3416be, rc 0) 00000100:00100000:0.0:1651529364.680775:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41279:x1731746396520384:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 47us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.680777:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153751 00000100:00100000:1.0:1651529364.681182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.681203:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396520576 00000100:00100000:0.0:1651529364.681211:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153752 00000100:00100000:0.0:1651529364.681213:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396520576:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.681216:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.681220:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c085f lrc: 2/0,0 mode: --/PR res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da059 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.681225:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b998:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.681229:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.681229:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.681231:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c085f lrc: 3/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da059 expref: 90 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.681235:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c085f lrc: 3/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da059 expref: 90 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.681239:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f6d9bc0, rc 0) 00000100:00100000:0.0:1651529364.681253:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41278:x1731746396520576:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.681256:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153752 00000100:00100000:1.0:1651529364.682538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.682560:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521088 00000100:00100000:0.0:1651529364.682568:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153753 00000100:00100000:0.0:1651529364.682570:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41278:x1731746396521088:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.682573:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.682577:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0866 lrc: 2/0,0 mode: --/PR res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da07c expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.682582:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b995:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.682585:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.682586:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.682587:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0866 lrc: 3/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da07c expref: 91 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.682594:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0866 lrc: 3/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da07c expref: 91 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.682598:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000382fc22, rc 0) 00000100:00100000:0.0:1651529364.682612:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396521088:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 42us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.682615:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153753 00000100:00100000:1.0:1651529364.682897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.682918:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521152 00000100:00100000:0.0:1651529364.682926:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153754 00000100:00100000:0.0:1651529364.682928:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41279:x1731746396521152:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.682931:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.682935:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c086d lrc: 2/0,0 mode: --/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da083 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.682941:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.682944:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.682945:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.682946:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c086d lrc: 3/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da083 expref: 92 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.682951:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c086d lrc: 3/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da083 expref: 92 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.682954:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003416f7b2, rc 0) 00000100:00100000:0.0:1651529364.682968:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41279:x1731746396521152:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.682972:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153754 00000100:00100000:1.0:1651529364.683499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.683521:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521344 00000100:00100000:0.0:1651529364.683529:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153755 00000100:00100000:0.0:1651529364.683531:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396521344:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.683534:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.683538:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0874 lrc: 2/0,0 mode: --/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da091 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.683543:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.683546:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.683547:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.683548:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0874 lrc: 3/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da091 expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.683552:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0874 lrc: 3/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da091 expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.683556:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000806805c0, rc 0) 00000100:00100000:0.0:1651529364.683570:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396521344:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.683573:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153755 00000100:00100000:1.0:1651529364.684066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.684090:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521536 00000100:00100000:0.0:1651529364.684098:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153756 00000100:00100000:0.0:1651529364.684099:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41279:x1731746396521536:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.684103:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.684106:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c087b lrc: 2/0,0 mode: --/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da09f expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.684112:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.684115:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.684116:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.684117:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c087b lrc: 3/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da09f expref: 94 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.684121:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c087b lrc: 3/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da09f expref: 94 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.684125:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000059b4498e, rc 0) 00000100:00100000:0.0:1651529364.684140:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41279:x1731746396521536:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.684142:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153756 00000100:00100000:1.0:1651529364.684616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.684639:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521728 00000100:00100000:0.0:1651529364.684647:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153757 00000100:00100000:0.0:1651529364.684649:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396521728:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.684652:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.684656:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0882 lrc: 2/0,0 mode: --/PR res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0ad expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.684661:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b989:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.684665:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.684665:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.684667:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0882 lrc: 3/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ad expref: 95 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.684673:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0882 lrc: 3/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ad expref: 95 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.684677:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000590e4cfe, rc 0) 00000100:00100000:0.0:1651529364.684691:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396521728:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.684694:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153757 00000100:00100000:1.0:1651529364.685182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.685203:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396521920 00000100:00100000:0.0:1651529364.685211:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153758 00000100:00100000:0.0:1651529364.685213:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41279:x1731746396521920:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.685216:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.685220:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0889 lrc: 2/0,0 mode: --/PR res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0bb expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.685225:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b981:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.685229:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.685229:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.685231:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0889 lrc: 3/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0bb expref: 96 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.685235:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0889 lrc: 3/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0bb expref: 96 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.685239:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aa865cce, rc 0) 00000100:00100000:0.0:1651529364.685253:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41279:x1731746396521920:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.685255:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153758 00000100:00100000:1.0:1651529364.686892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.686914:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396522624 00000100:00100000:0.0:1651529364.686923:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153759 00000100:00100000:0.0:1651529364.686924:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396522624:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.686928:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.686932:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0890 lrc: 2/0,0 mode: --/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0ec expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.686937:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.686940:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.686941:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.686942:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0890 lrc: 3/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ec expref: 97 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.686947:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0890 lrc: 3/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ec expref: 97 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.686950:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a4f97720, rc 0) 00000100:00100000:0.0:1651529364.686964:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396522624:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.686967:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153759 00000100:00100000:1.0:1651529364.687229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.687251:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396522688 00000100:00100000:0.0:1651529364.687259:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153760 00000100:00100000:0.0:1651529364.687260:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396522688:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.687263:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.687268:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0897 lrc: 2/0,0 mode: --/PR res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0f3 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.687273:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b988:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.687276:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.687277:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.687278:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0897 lrc: 3/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0f3 expref: 98 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.687282:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0897 lrc: 3/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0f3 expref: 98 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.687286:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000040c1504b, rc 0) 00000100:00100000:0.0:1651529364.687300:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396522688:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.687303:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153760 00000100:00100000:1.0:1651529364.689311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.689348:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523456 00000100:00100000:0.0:1651529364.689356:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153761 00000100:00100000:0.0:1651529364.689358:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396523456:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.689361:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.689365:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c089e lrc: 2/0,0 mode: --/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da12b expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.689370:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.689373:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.689374:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.689376:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c089e lrc: 3/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da12b expref: 99 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.689382:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c089e lrc: 3/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da12b expref: 99 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.689386:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095cff58f, rc 0) 00000100:00100000:0.0:1651529364.689400:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396523456:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.689403:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153761 00000100:00100000:1.0:1651529364.690095:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.690112:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523648 00000100:00100000:0.0:1651529364.690120:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153762 00000100:00100000:0.0:1651529364.690122:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41278:x1731746396523648:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.690125:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.690129:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c08a5 lrc: 2/0,0 mode: --/PR res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da139 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.690135:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b980:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.690138:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.690139:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.690140:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c08a5 lrc: 3/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da139 expref: 100 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.690144:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c08a5 lrc: 3/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da139 expref: 100 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.690148:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f25ba4b, rc 0) 00000100:00100000:0.0:1651529364.690164:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396523648:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 41us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.690167:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153762 00000100:00100000:1.0:1651529364.692848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.692866:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396524608 00000100:00100000:0.0:1651529364.692874:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153763 00000100:00100000:0.0:1651529364.692875:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396524608:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.692879:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.692882:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c08ac lrc: 2/0,0 mode: --/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da17f expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.692887:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b991:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.692891:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.692891:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.692893:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c08ac lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da17f expref: 101 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.692897:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c08ac lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da17f expref: 101 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.692901:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000015f46ac3, rc 0) 00000100:00100000:0.0:1651529364.692916:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396524608:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.692919:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153763 00000100:00100000:1.0:1651529364.693448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.693465:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396524800 00000100:00100000:0.0:1651529364.693473:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153764 00000100:00100000:0.0:1651529364.693474:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396524800:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.693477:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.693481:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c08b3 lrc: 2/0,0 mode: --/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da18d expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.693487:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.693490:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.693491:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.693492:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c08b3 lrc: 3/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da18d expref: 102 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.693496:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c08b3 lrc: 3/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da18d expref: 102 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.693500:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f782055, rc 0) 00000100:00100000:0.0:1651529364.693515:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396524800:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.693518:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153764 00000100:00100000:1.0:1651529364.694247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.694264:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396525184 00000100:00100000:0.0:1651529364.694272:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153765 00000100:00100000:0.0:1651529364.694274:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41279:x1731746396525184:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.694277:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.694281:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c08ba lrc: 2/0,0 mode: --/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da19b expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.694286:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.694290:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.694290:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.694292:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c08ba lrc: 3/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da19b expref: 103 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.694309:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c08ba lrc: 3/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da19b expref: 103 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.694313:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000566545e3, rc 0) 00000100:00100000:0.0:1651529364.694327:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396525184:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 52us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.694330:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153765 00000100:00100000:1.0:1651529364.695191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.695224:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396525504 00000100:00100000:0.0:1651529364.695232:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153766 00000100:00100000:0.0:1651529364.695234:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41278:x1731746396525504:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.695237:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.695241:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c08c1 lrc: 2/0,0 mode: --/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da1b7 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529364.695245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529364.695246:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.695249:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.695250:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.695252:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c08c1 lrc: 3/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1b7 expref: 104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.695256:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c08c1 lrc: 3/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1b7 expref: 104 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.695260:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a79ef65, rc 0) 00000100:00100000:1.0:1651529364.695268:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396525568 00000100:00100000:0.0:1651529364.695272:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396525504:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.695282:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153766 00000100:00100000:1.0:1651529364.695284:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153767 00000100:00100000:1.0:1651529364.695286:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396525568:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.695290:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.695295:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c08c8 lrc: 2/0,0 mode: --/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da1be expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.695302:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.695307:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.695307:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.695309:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c08c8 lrc: 3/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1be expref: 105 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.695314:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c08c8 lrc: 3/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1be expref: 105 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.695318:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000528fa145, rc 0) 00000100:00100000:1.0:1651529364.695327:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+105:41278:x1731746396525568:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.695330:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153767 00000100:00100000:1.0:1651529366.204909:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966712320:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529366.204926:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966712256:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529366.205196:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017e428e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966712320:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529366.205203:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080862d10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966712256:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529369.824118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.824145:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582208 00000100:00100000:0.0:1651529369.824161:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 311 00000100:00100000:0.0:1651529369.824164:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946582208:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529369.824177:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580672 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529369.824198:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e428e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946582208:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.824201:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 311 00000100:00100000:1.0:1651529369.854572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854616:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582272 00000100:00100000:1.0:1651529369.854618:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854628:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582400 00000100:00100000:0.0:1651529369.854642:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582528 00000100:00100000:1.0:1651529369.854644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854655:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582656 00000100:00100000:0.0:1651529369.854661:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582336 00000100:00100000:0.0:1651529369.854663:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582464 00000100:00100000:0.0:1651529369.854666:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582592 00000100:00100000:1.0:1651529369.854668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854669:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153768 00000100:00100000:0.0:1651529369.854671:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946582272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.854676:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582720 00002000:00080000:0.0:1651529369.854679:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178509 count 1 00000100:00100000:1.0:1651529369.854685:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153769 00000100:00100000:1.0:1651529369.854687:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946582400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.854689:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854695:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178511 count 1 00010000:00010000:0.0:1651529369.854697:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 2/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854701:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854708:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 2/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854712:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854713:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854713:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854714:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 4/0,1 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854714:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854715:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 4/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854725:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 3/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854725:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854730:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 4/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.854730:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.854735:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966712384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854735:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966712448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854763:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067254568 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.854772:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153770 00000100:00100000:0.0:1651529369.854774:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946582528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.854780:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.854780:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178513 count 1 00010000:00010000:0.0:1651529369.854786:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.854788:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153771 00000100:00100000:1.0:1651529369.854790:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946582656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.854791:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 2/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 104 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854794:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854795:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854795:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 4/0,1 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854796:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178515 count 1 00010000:00010000:1.0:1651529369.854801:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854820:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 2/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854823:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854823:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854824:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 4/0,1 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854826:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 3/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 104 pid: 144528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854830:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 4/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 104 pid: 144528 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.854833:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.854835:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966712512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854837:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 4/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.854841:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966712576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854843:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.854851:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b997aa9d going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.854851:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153772 00000100:00100000:0.0:1651529369.854852:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.854857:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178510 count 1 00000100:00100000:1.0:1651529369.854858:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153773 00000100:00100000:1.0:1651529369.854861:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.854861:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854866:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178512 count 1 00010000:00010000:0.0:1651529369.854866:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 2/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854870:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854870:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854870:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854871:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 4/0,1 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854875:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 2/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854877:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 3/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854878:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854878:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854879:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 4/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854881:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 4/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.854885:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966712640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854886:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 104 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854889:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.854892:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000952b295a going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.854894:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966712704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854898:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153774 00000100:00100000:0.0:1651529369.854900:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.854901:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.854905:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178514 count 1 00000100:00100000:1.0:1651529369.854907:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153775 00010000:00010000:0.0:1651529369.854908:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.854909:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.854913:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 2/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 104 pid: 128009 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529369.854914:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178516 count 1 00010000:00010000:0.0:1651529369.854916:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854916:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854917:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 4/0,1 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854923:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 3/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 104 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854927:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854927:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 4/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 104 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.854931:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854934:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 2/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 104 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854937:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.854937:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b01d87d3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.854938:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854939:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 4/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854946:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 104 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854950:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 4/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 104 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.854954:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966712832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.854962:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.855605:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966712448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.855606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.855616:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.855616:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.855623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.855625:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528256 00000100:00100000:1.0:1651529369.855630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.855632:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 5/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 105 pid: 144528 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.855640:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528064 00000100:00100000:0.0:1651529369.855645:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528192 00010000:00010000:1.0:1651529369.855647:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 107 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855648:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 5/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 107 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.855653:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528448 00000100:00100000:1.0:1651529369.855654:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12679 00000100:00100000:1.0:1651529369.855656:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396528256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.855656:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 5/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 108 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.855661:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.855661:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12680 00000100:00100000:0.0:1651529369.855662:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396528192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.855663:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 5/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 108 pid: 144528 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855666:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.855667:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 5/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 108 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.855668:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 4/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 108 pid: 144528 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855671:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 4/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 108 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.855677:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855677:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855678:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855679:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855679:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855679:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855682:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 4/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855683:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 4/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855687:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.855688:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.855700:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396528256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.855703:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12679 00000100:00100000:0.0:1651529369.855706:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396528192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.855709:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12680 00000100:00100000:1.0:1651529369.855711:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12681 00000100:00100000:1.0:1651529369.855713:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396528064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529369.855715:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12682 00010000:00010000:1.0:1651529369.855716:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.855717:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 106 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.855717:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396528448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.855719:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.855721:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 106 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855721:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 5/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 106 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855725:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 4/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 106 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.855729:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c301aeff/0xa29a79078f3bd089 lrc: 0/0,0 mode: --/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95fc expref: 106 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855730:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855731:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855731:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855733:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855733:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855734:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855734:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 4/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855737:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 4/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855738:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.855744:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.855758:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+105:41279:x1731746396528448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.855759:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+105:41279:x1731746396528064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.855762:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12681 00000100:00100000:0.0:1651529369.855763:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12682 00010000:00010000:0.0:1651529369.855772:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855775:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b3e5b9/0xa29a79078f3bd00b lrc: 0/0,0 mode: --/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9435 expref: 103 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.855775:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855779:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.855780:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966712576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.855782:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855784:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855787:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855798:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855801:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855819:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.855909:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946582272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1336us total) trans 30064894581 rc 0/0 00000100:00100000:1.0:1651529369.855910:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946582656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1119us (1301us total) trans 30064894580 rc 0/0 00000100:00100000:0.0:1651529369.855912:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153768 00000100:00100000:1.0:1651529369.855914:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153771 00010000:00010000:0.0:1651529369.855924:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001b528e9/0xa29a79078f3bcfa9 lrc: 0/0,0 mode: --/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92b4 expref: 102 pid: 144528 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.855928:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec734a72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966712512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.855932:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855936:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855951:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855954:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855957:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855999:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856003:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000386c4efa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.856004:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856008:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 3/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 1/0,0 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856016:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c08cf lrc: 0/0,0 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856021:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856031:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b26a1ec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.856033:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856035:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 3/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856039:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 1/0,0 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856041:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b26a1ec/0xa29a79078f3c08e4 lrc: 0/0,0 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856046:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856048:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e763957b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.856049:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856052:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 3/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856055:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 1/0,0 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856065:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c08dd lrc: 0/0,0 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856114:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966712704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.856119:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856135:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099cae647/0xa29a79078f3bd074 lrc: 0/0,0 mode: --/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d958c expref: 101 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.856139:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000682ee2c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966712384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.856142:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856145:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856148:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856162:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.856165:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856207:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528576 00010000:00010000:1.0:1651529369.856214:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 5/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 101 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856235:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528832 00010000:00010000:1.0:1651529369.856239:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 5/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 102 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856244:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528768 00010000:00010000:1.0:1651529369.856246:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 103 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856250:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528960 00000100:00100000:1.0:1651529369.856251:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12683 00000100:00100000:1.0:1651529369.856253:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396528576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.856255:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.856257:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 5/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.856257:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 5/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 104 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856261:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 4/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 104 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856264:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12684 00000100:00100000:0.0:1651529369.856266:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396528832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.856268:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856268:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856269:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856269:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.856271:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 5/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 104 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856272:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 4/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856275:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 4/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 104 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856277:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.856281:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856282:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856283:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856286:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 4/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856290:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004446743b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396528576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.856292:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12683 00000100:00100000:1.0:1651529369.856305:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12685 00000100:00100000:1.0:1651529369.856306:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396528768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.856309:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.856311:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 103 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856314:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 103 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856320:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc763531/0xa29a79078f3bcf8d lrc: 0/0,0 mode: --/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9252 expref: 103 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856324:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856324:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856325:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856325:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.856328:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 4/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856334:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.856334:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396528832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.856337:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12684 00000100:00100000:1.0:1651529369.856340:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396528768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.856343:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12685 00000100:00100000:0.0:1651529369.856345:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12686 00000100:00100000:0.0:1651529369.856346:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396528960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.856350:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.856351:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 5/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 100 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.856353:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4126e44 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966712832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.856355:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 100 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856359:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856361:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3bd02e lrc: 0/0,0 mode: --/PR res: [0x2b954:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94cf expref: 100 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.856365:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856365:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856366:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856366:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856368:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856369:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 4/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856371:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856374:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856380:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.856386:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41278:x1731746396528960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.856389:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12686 00010000:00010000:0.0:1651529369.856397:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856400:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b55cf186 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.856401:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856403:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856404:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 3/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856408:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 1/0,0 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856409:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b46e986f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.856411:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856411:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55cf186/0xa29a79078f3c08d6 lrc: 0/0,0 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856414:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 3/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856418:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 1/0,0 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856421:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46e986f/0xa29a79078f3c08f2 lrc: 0/0,0 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856422:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087066587/0xa29a79078f3bd090 lrc: 0/0,0 mode: --/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d960a expref: 98 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856426:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a51eb8b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966712640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.856427:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856429:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856430:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856433:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856434:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856436:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856438:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856441:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856444:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856461:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856464:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000785b243a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.856465:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856468:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 3/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856472:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 1/0,0 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856474:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785b243a/0xa29a79078f3c0900 lrc: 0/0,0 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856477:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856481:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5430163 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.856482:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856484:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 3/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856489:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 1/0,0 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529369.856492:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c08eb lrc: 0/0,0 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.856516:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583424 00000100:00100000:0.0:1651529369.856526:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583488 00000100:00100000:0.0:1651529369.856535:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153776 00000100:00100000:0.0:1651529369.856537:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946583424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.856538:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153777 00000100:00100000:1.0:1651529369.856540:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946583488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.856544:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178517 count 1 00002000:00080000:1.0:1651529369.856546:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178518 count 1 00010000:00010000:0.0:1651529369.856550:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856551:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856556:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 2/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 97 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.856558:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 2/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 97 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.856559:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856559:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856560:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 4/0,1 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856568:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 3/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 97 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.856572:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 4/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 97 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.856576:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966712896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.856588:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529369.856591:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.856599:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856601:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 4/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856615:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 97 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.856622:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 97 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.856636:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966712960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.856648:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.856659:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3767209/0xa29a79078f3bcf94 lrc: 0/0,0 mode: --/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9260 expref: 97 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.856669:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966712768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.856673:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856677:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856679:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856684:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946582528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1908us (2084us total) trans 30064894582 rc 0/0 00010000:00010000:1.0:1651529369.856687:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856687:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153770 00010000:00010000:1.0:1651529369.856690:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856760:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946582592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1859us (2116us total) trans 30064894586 rc 0/0 00000100:00100000:1.0:1651529369.856764:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153774 00010000:00010000:1.0:1651529369.856773:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856776:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046b29c31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.856777:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856780:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 3/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856785:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 1/0,0 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856788:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c08f9 lrc: 0/0,0 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856833:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946582464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1972us (2208us total) trans 30064894587 rc 0/0 00000100:00100000:1.0:1651529369.856837:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153773 00000100:00100000:1.0:1651529369.856891:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:39030:x1731745946582400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2203us (2303us total) trans 30064894583 rc 0/0 00000100:00100000:1.0:1651529369.856895:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153769 00000100:00100000:1.0:1651529369.856917:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946582720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2007us (2248us total) trans 30064894584 rc 0/0 00000100:00100000:1.0:1651529369.856920:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153775 00000100:00100000:1.0:1651529369.856935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.856948:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946582336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2094us (2330us total) trans 30064894585 rc 0/0 00000100:00100000:0.0:1651529369.856952:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153772 00000100:00100000:0.0:1651529369.856958:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583552 00000100:00100000:0.0:1651529369.856969:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153778 00000100:00100000:0.0:1651529369.856971:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946583552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.856977:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178519 count 1 00010000:00010000:0.0:1651529369.857004:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857010:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 2/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 96 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857023:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857024:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857024:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 4/0,1 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857033:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 3/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 96 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857037:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 4/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 96 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857041:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966713024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.857058:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.857071:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2acff34 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966712960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857076:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857084:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529152 00010000:00010000:0.0:1651529369.857088:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 5/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 97 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.857094:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529216 00000100:00100000:0.0:1651529369.857096:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12687 00000100:00100000:0.0:1651529369.857098:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396529152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.857100:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 98 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857101:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.857103:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 5/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 98 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857106:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 4/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 98 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.857109:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12688 00000100:00100000:1.0:1651529369.857111:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396529216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.857112:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857113:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857114:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.857114:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857115:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 98 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857116:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 4/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857119:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 98 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857121:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.857125:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79d5d88/0xa29a79078f3bcfbe lrc: 0/0,0 mode: --/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9301 expref: 98 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.857129:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857130:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.857134:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396529152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (81us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.857137:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857137:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12687 00010000:00010000:1.0:1651529369.857140:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 4/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857150:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.857158:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396529216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.857161:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12688 00010000:00010000:0.0:1651529369.857190:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857192:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033548aa6/0xa29a79078f3bd082 lrc: 0/0,0 mode: --/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95c4 expref: 95 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857194:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857201:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870c23d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966712896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857206:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857206:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857209:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857209:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857212:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857215:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857223:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857269:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946583488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 728us (760us total) trans 30064894588 rc 0/0 00000100:00100000:1.0:1651529369.857274:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153777 00010000:00010000:1.0:1651529369.857281:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857282:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946583424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 744us (791us total) trans 30064894589 rc 0/0 00010000:00010000:1.0:1651529369.857285:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c1ba0c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.857286:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857289:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 3/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857293:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 1/0,0 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857296:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0907 lrc: 0/0,0 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857301:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857301:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153776 00010000:00010000:1.0:1651529369.857303:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f49c1d7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.857304:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857307:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 3/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857312:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 1/0,0 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857315:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f49c1d7/0xa29a79078f3c090e lrc: 0/0,0 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857359:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583936 00000100:00100000:0.0:1651529369.857368:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153779 00000100:00100000:0.0:1651529369.857370:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946583936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.857376:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178520 count 1 00010000:00010000:0.0:1651529369.857381:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857386:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 2/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857389:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857389:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857390:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 4/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.857398:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857402:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857406:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966713088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857409:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529280 00010000:00010000:1.0:1651529369.857415:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 5/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 95 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857420:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857428:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12689 00000100:00100000:1.0:1651529369.857430:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396529280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529369.857430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.857439:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.857440:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 5/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 95 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.857444:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 4/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 95 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.857450:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857451:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857452:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.857466:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 4/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.857476:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.857478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857490:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396529280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.857493:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12689 00000100:00100000:1.0:1651529369.857500:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584000 00000100:00100000:1.0:1651529369.857515:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584064 00000100:00100000:1.0:1651529369.857522:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584128 00000100:00100000:1.0:1651529369.857526:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584192 00000100:00100000:1.0:1651529369.857533:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153780 00000100:00100000:1.0:1651529369.857535:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946584000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.857537:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc4fa7a/0xa29a79078f3bd06d lrc: 0/0,0 mode: --/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d957e expref: 94 pid: 127525 timeout: 13119 lvb_type: 1 00002000:00080000:1.0:1651529369.857540:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178521 count 1 00000100:00100000:0.0:1651529369.857542:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966713024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857545:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857546:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857550:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 2/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857550:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857552:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857553:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857554:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857554:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 4/0,1 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857559:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857561:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857561:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857565:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 4/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 93 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.857579:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966713152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857588:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.857593:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857597:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df94e3f2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.857598:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857600:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 3/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857605:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 1/0,0 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857608:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0915 lrc: 0/0,0 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857615:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153781 00000100:00100000:1.0:1651529369.857617:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946584064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.857623:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178522 count 1 00010000:00010000:1.0:1651529369.857627:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857629:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946583552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 657us (694us total) trans 30064894590 rc 0/0 00010000:00010000:1.0:1651529369.857631:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 2/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.857632:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153778 00010000:00010000:1.0:1651529369.857634:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857635:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857635:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 4/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857638:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153782 00000100:00100000:0.0:1651529369.857639:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946584128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529369.857641:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529369.857644:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178523 count 1 00010000:00010000:1.0:1651529369.857645:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 93 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857648:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857649:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966713216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857653:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 2/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.857656:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.857656:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857657:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857657:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 4/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857662:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153783 00000100:00100000:1.0:1651529369.857664:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946584192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.857664:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529369.857668:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178524 count 1 00010000:00010000:1.0:1651529369.857671:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857671:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 93 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857675:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966713280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857676:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 2/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857678:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857679:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857679:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 4/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857683:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b74709fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.857688:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857692:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 93 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.857696:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966713344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.857698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857701:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857707:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584448 00000100:00100000:1.0:1651529369.857719:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153784 00000100:00100000:1.0:1651529369.857721:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946584448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.857725:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178525 count 1 00010000:00010000:1.0:1651529369.857729:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857734:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 2/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857737:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857737:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857738:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 4/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.857762:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 93 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857768:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 93 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.857772:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966713408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.857778:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584512 00000100:00100000:0.0:1651529369.857785:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153785 00000100:00100000:0.0:1651529369.857786:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946584512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.857791:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.857797:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178526 count 1 00010000:00010000:0.0:1651529369.857802:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857825:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 2/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857828:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857828:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857829:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 4/0,1 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857836:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 93 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857840:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 4/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 93 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857844:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966713472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.857875:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.857886:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1dff28f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966713088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857890:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857951:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584576 00000100:00100000:0.0:1651529369.857960:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153786 00000100:00100000:0.0:1651529369.857961:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946584576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.857965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529369.857966:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178527 count 1 00010000:00010000:0.0:1651529369.857971:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857972:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529344 00010000:00010000:0.0:1651529369.857976:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 2/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 94 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857977:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.857979:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857979:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857980:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 4/0,1 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857985:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12690 00010000:00010000:0.0:1651529369.857986:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 3/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 94 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.857987:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396529344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.857990:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.857990:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 4/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 94 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.857992:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.857994:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966713536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857996:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858001:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3bd012 lrc: 0/0,0 mode: --/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9443 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858005:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.858005:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.858006:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858007:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858010:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 4/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858020:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858028:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdcce80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396529344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.858031:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12690 00010000:00010000:0.0:1651529369.858064:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858069:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966713152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858069:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858072:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858074:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858075:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858112:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858116:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096f8488a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.858117:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858119:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946583936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 748us (788us total) trans 30064894591 rc 0/0 00010000:00010000:1.0:1651529369.858120:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 3/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858122:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153779 00010000:00010000:1.0:1651529369.858125:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 1/0,0 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858131:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c091c lrc: 0/0,0 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.858341:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584640 00000100:00100000:0.0:1651529369.858349:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153787 00000100:00100000:0.0:1651529369.858351:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946584640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.858356:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178528 count 1 00010000:00010000:0.0:1651529369.858360:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858365:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 2/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 92 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.858368:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858369:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858370:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 4/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858392:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 92 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.858396:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 92 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858400:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966713600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.858412:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.858500:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966713280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858505:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858509:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966713216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858514:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858522:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966713408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858524:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858541:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f30a901 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966713344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858555:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858605:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529792 00000100:00100000:0.0:1651529369.858606:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.858615:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 4/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 93 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.858621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858630:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529920 00010000:00010000:1.0:1651529369.858633:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 94 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858637:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530112 00010000:00010000:1.0:1651529369.858640:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 95 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858644:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530048 00000100:00100000:0.0:1651529369.858645:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.858647:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 96 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.858651:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530240 00010000:00010000:1.0:1651529369.858653:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 5/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 97 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858655:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530176 00000100:00100000:1.0:1651529369.858657:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530304 00010000:00010000:1.0:1651529369.858659:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 5/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 99 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858661:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 99 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.858664:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12691 00000100:00100000:1.0:1651529369.858666:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396529792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529369.858668:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12692 00010000:00010000:1.0:1651529369.858669:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858670:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 4/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 99 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858670:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396529920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.858672:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858674:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 99 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858674:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 99 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858678:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 99 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858679:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ca975c/0xa29a79078f3bd03c lrc: 0/0,0 mode: --/PR res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94eb expref: 99 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858683:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858683:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858684:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858690:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 4/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858702:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.858702:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3bd020 lrc: 0/0,0 mode: --/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9497 expref: 98 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858706:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858706:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858707:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858711:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 4/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858714:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396529792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.858717:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12691 00010000:00010000:0.0:1651529369.858725:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858728:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12693 00000100:00100000:1.0:1651529369.858730:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396530112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.858733:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.858733:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41279:x1731746396529920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.858734:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 96 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858736:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12692 00010000:00010000:1.0:1651529369.858738:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 96 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858742:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12694 00010000:00010000:1.0:1651529369.858743:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1996d9/0xa29a79078f3bcf9b lrc: 0/0,0 mode: --/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d926e expref: 95 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858743:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41279:x1731746396530048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.858755:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858757:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858757:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 94 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858758:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858758:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858761:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 94 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858762:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 4/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858766:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c81810/0xa29a79078f3bd035 lrc: 0/0,0 mode: --/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94dd expref: 94 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858770:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858772:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.858776:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858777:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858779:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396530112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.858780:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 4/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858782:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12693 00010000:00010000:0.0:1651529369.858786:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858787:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12695 00000100:00100000:1.0:1651529369.858788:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396530240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.858791:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858792:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 5/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 92 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858792:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41279:x1731746396530048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.858795:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12694 00010000:00010000:1.0:1651529369.858796:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 4/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 92 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858800:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.858800:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12696 00010000:00010000:1.0:1651529369.858801:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.858802:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41279:x1731746396530304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.858816:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858818:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.858819:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 5/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 91 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858820:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 4/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858823:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 4/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 91 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858824:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.858829:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858829:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529369.858830:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396530240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.858830:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858833:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12695 00010000:00010000:0.0:1651529369.858833:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 4/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858837:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12697 00010000:00010000:0.0:1651529369.858837:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858839:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396530176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.858842:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858843:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858843:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060030e42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396530304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.858846:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12696 00010000:00010000:1.0:1651529369.858847:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.858852:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006631c7c4/0xa29a79078f3bd09e lrc: 0/0,0 mode: --/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d965e expref: 89 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.858853:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858855:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858856:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858857:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858857:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858860:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 4/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858860:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858863:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858866:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858877:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396530176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.858880:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12697 00010000:00010000:1.0:1651529369.858890:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858893:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.858894:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858897:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 3/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858902:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 1/0,0 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858904:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0938 lrc: 0/0,0 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858908:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:39030:x1731745946584192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1244us (1430us total) trans 30064894592 rc 0/0 00010000:00010000:1.0:1651529369.858910:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858911:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153783 00010000:00010000:1.0:1651529369.858913:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858916:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858919:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858922:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001037b04c/0xa29a79078f3bcfcc lrc: 0/0,0 mode: --/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d931d expref: 87 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.858926:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da50ea5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966713472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858930:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858933:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858936:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858939:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858942:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858971:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946584064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1353us (1513us total) trans 30064894593 rc 0/0 00000100:00100000:1.0:1651529369.858974:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153781 00010000:00010000:1.0:1651529369.858981:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858987:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.858988:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858988:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946584512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1201us (1245us total) trans 30064894594 rc 0/0 00010000:00010000:1.0:1651529369.858991:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 3/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858991:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153785 00010000:00010000:1.0:1651529369.858995:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 1/0,0 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858998:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c092a lrc: 0/0,0 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859002:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859002:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069469436/0xa29a79078f3bd097 lrc: 0/0,0 mode: --/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9650 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859005:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087766569 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.859006:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859007:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966713536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.859009:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 3/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859010:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859012:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 1/0,0 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859013:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859016:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859017:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0946 lrc: 0/0,0 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859019:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859021:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859023:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859025:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859035:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859038:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859060:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:39029:x1731745946584576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1098us (1167us total) trans 30064894595 rc 0/0 00000100:00100000:0.0:1651529369.859063:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153786 00000100:00100000:0.0:1651529369.859073:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966713600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859076:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946584000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1541us (1646us total) trans 30064894596 rc 0/0 00010000:00010000:0.0:1651529369.859076:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859080:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153780 00010000:00010000:0.0:1651529369.859082:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859085:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859086:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859088:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859090:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043da83ee already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.859090:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859091:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859093:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 3/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859105:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 1/0,0 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859109:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c094d lrc: 0/0,0 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859113:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859115:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.859116:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859119:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 3/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859122:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 1/0,0 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859125:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0923 lrc: 0/0,0 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859128:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859130:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005859f450 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529369.859130:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946584128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1490us (1662us total) trans 30064894597 rc 0/0 00010000:00010000:1.0:1651529369.859131:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859133:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153782 00010000:00010000:1.0:1651529369.859134:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 3/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859137:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 1/0,0 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859140:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0931 lrc: 0/0,0 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859147:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859150:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859153:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859155:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859160:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.859226:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:39030:x1731745946584448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1504us (1527us total) trans 30064894598 rc 0/0 00000100:00100000:1.0:1651529369.859253:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153784 00010000:00010000:1.0:1651529369.859284:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859288:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.859289:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859292:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 3/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859297:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 1/0,0 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859299:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c093f lrc: 0/0,0 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859307:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530368 00010000:00010000:1.0:1651529369.859312:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.859323:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12698 00000100:00100000:1.0:1651529369.859325:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396530368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.859328:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.859329:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859333:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859341:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459cdb3d/0xa29a79078f3bcfe1 lrc: 0/0,0 mode: --/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d936a expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859344:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859345:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859346:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859349:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 4/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859357:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.859359:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859363:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859367:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396530368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.859370:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12698 00010000:00010000:0.0:1651529369.859371:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859375:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859399:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859403:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d4befcc8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.859404:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859407:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 3/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859411:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 1/0,0 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859416:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0954 lrc: 0/0,0 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859434:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946584640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1082us (1104us total) trans 30064894599 rc 0/0 00000100:00100000:0.0:1651529369.859437:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153787 00000100:00100000:0.0:1651529369.859542:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.859571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.859580:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585088 00000100:00100000:1.0:1651529369.859589:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585152 00000100:00100000:0.0:1651529369.859595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.859609:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585216 00000100:00100000:0.0:1651529369.859611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.859623:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585472 00000100:00100000:1.0:1651529369.859631:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153788 00000100:00100000:1.0:1651529369.859632:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946585088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529369.859633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529369.859638:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178529 count 1 00000100:00100000:0.0:1651529369.859640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.859642:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859650:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.859657:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 2/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 84 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859660:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859661:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859661:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 4/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.859669:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 84 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859672:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 84 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.859675:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585344 00000100:00100000:1.0:1651529369.859680:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966713664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859680:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585408 00000100:00100000:0.0:1651529369.859682:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585536 00000100:00100000:0.0:1651529369.859684:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585728 00000100:00100000:0.0:1651529369.859687:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153789 00000100:00100000:0.0:1651529369.859689:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.859694:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f8bca3b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.859701:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153790 00002000:00080000:0.0:1651529369.859701:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178530 count 1 00000100:00100000:1.0:1651529369.859703:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946585216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.859706:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.859708:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178531 count 1 00010000:00010000:0.0:1651529369.859711:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 2/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859712:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859717:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 2/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859717:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859717:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859718:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 4/0,1 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859720:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859720:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859721:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 4/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859725:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859727:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859729:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 4/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859731:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.859733:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966713728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859735:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966713792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859743:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.859744:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d70c3fed going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.859760:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153791 00000100:00100000:0.0:1651529369.859762:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946585472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.859767:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178534 count 1 00000100:00100000:1.0:1651529369.859768:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153792 00000100:00100000:1.0:1651529369.859770:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.859771:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.859775:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178532 count 1 00010000:00010000:0.0:1651529369.859776:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 2/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859779:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859779:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859779:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859780:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 4/0,1 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859783:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 2/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859787:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859787:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859788:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 4/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859790:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 3/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859794:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859794:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 4/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859798:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.859798:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966713856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859802:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966713920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859823:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.859827:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.859830:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153793 00000100:00100000:0.0:1651529369.859831:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.859834:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153794 00000100:00100000:1.0:1651529369.859835:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.859836:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178533 count 1 00002000:00080000:1.0:1651529369.859840:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178535 count 1 00010000:00010000:0.0:1651529369.859840:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859844:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859844:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 2/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859847:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859848:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859849:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 4/0,1 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859850:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 2/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 84 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859853:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859854:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859855:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 4/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859855:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 3/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 84 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859859:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 4/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.859861:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 84 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.859863:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966713984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.859864:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 84 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.859869:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859871:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.859875:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f6617e25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.859877:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153795 00000100:00100000:0.0:1651529369.859878:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.859882:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178536 count 1 00010000:00010000:0.0:1651529369.859885:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859889:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 2/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 84 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859892:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859893:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859893:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 4/0,1 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859899:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 3/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 84 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859903:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 4/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 84 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.859907:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859912:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000594a80e9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.860161:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966713664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860166:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860180:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087880af3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966713728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.860185:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860593:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966713792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860597:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860604:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966713920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860607:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860647:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860650:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860660:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530816 00010000:00010000:1.0:1651529369.860665:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 85 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860671:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860682:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12699 00000100:00100000:1.0:1651529369.860684:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396530816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.860687:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860688:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 85 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860698:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 85 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.860704:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3014153/0xa29a79078f3bcfc5 lrc: 0/0,0 mode: --/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9324 expref: 85 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.860708:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860708:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860709:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860710:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.860712:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 4/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.860718:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.860721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860731:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396530816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860734:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12699 00000100:00100000:0.0:1651529369.860737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860739:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530880 00010000:00010000:1.0:1651529369.860742:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 4/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860756:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530944 00010000:00010000:1.0:1651529369.860759:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 85 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860763:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531008 00000100:00100000:0.0:1651529369.860768:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531072 00010000:00010000:1.0:1651529369.860773:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 5/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 87 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860774:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 87 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860778:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531136 00010000:00010000:1.0:1651529369.860781:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 5/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 88 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860781:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531200 00010000:00010000:0.0:1651529369.860783:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 89 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860785:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531264 00010000:00010000:1.0:1651529369.860788:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 5/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 90 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860788:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12700 00000100:00100000:0.0:1651529369.860790:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41278:x1731746396530880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.860793:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529369.860795:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12701 00010000:00010000:0.0:1651529369.860795:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 4/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860797:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396530944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.860799:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.860799:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860801:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860825:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860829:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3bcf7f lrc: 0/0,0 mode: --/PR res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9236 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860831:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b47d4b3/0xa29a79078f3bd051 lrc: 0/0,0 mode: --/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9546 expref: 90 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860833:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860833:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860834:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860834:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860835:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860836:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860837:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 4/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860839:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 4/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860844:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.860845:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.860853:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396530944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.860853:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396530880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860856:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12701 00000100:00100000:0.0:1651529369.860858:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12700 00000100:00100000:1.0:1651529369.860861:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12702 00000100:00100000:1.0:1651529369.860862:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396531008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529369.860863:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12703 00010000:00010000:1.0:1651529369.860865:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.860865:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396531072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.860866:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 5/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860868:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860870:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 4/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860870:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860874:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860875:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860875:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860876:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860878:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5513d3/0xa29a79078f3bd043 lrc: 0/0,0 mode: --/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9523 expref: 86 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860879:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 4/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860883:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.860885:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860885:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860886:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860887:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396531008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.860888:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 4/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860889:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12702 00000100:00100000:1.0:1651529369.860893:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12704 00000100:00100000:1.0:1651529369.860894:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396531136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529369.860897:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.860903:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396531072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.860904:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860906:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 5/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 84 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860906:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12703 00010000:00010000:1.0:1651529369.860910:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 4/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 83 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.860911:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12705 00000100:00100000:0.0:1651529369.860912:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41279:x1731746396531200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.860915:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860915:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860915:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860916:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860916:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 83 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860919:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 4/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860920:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 83 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.860923:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.860924:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed6d64d/0xa29a79078f3bcfe8 lrc: 0/0,0 mode: --/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d939b expref: 83 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.860928:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081ddfff7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396531136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.860928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860928:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860929:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860931:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12704 00010000:00010000:0.0:1651529369.860932:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 4/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860940:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.860945:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396531200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860946:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12706 00000100:00100000:1.0:1651529369.860948:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396531264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529369.860948:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12705 00010000:00010000:1.0:1651529369.860951:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860952:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 5/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 80 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860954:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860956:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 4/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 80 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.860958:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860961:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860961:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860961:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860962:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860964:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860965:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 4/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860975:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.860981:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396531264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860984:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12706 00010000:00010000:1.0:1651529369.860991:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860995:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe7aa555 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.860996:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860999:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 3/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861003:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 1/0,0 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861005:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0962 lrc: 0/0,0 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861008:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946585152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1319us (1437us total) trans 30064894600 rc 0/0 00010000:00010000:1.0:1651529369.861011:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861011:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153789 00010000:00010000:1.0:1651529369.861014:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861020:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861023:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861023:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2b771fe/0xa29a79078f3bd04a lrc: 0/0,0 mode: --/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9531 expref: 79 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861029:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966713856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.861033:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861036:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861039:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861042:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861045:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861075:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946585216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1371us (1479us total) trans 30064894601 rc 0/0 00000100:00100000:1.0:1651529369.861078:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153790 00010000:00010000:1.0:1651529369.861085:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861088:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529369.861088:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946585472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1325us (1477us total) trans 30064894602 rc 0/0 00010000:00010000:1.0:1651529369.861089:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861091:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153791 00010000:00010000:1.0:1651529369.861092:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 3/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861097:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 1/0,0 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861100:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0969 lrc: 0/0,0 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861101:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058da2d42/0xa29a79078f3bcfef lrc: 0/0,0 mode: --/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93c5 expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.861104:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861105:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a128203e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966713984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.861107:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003efc2cef already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.861108:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861108:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861110:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 3/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861112:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861113:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 1/0,0 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861114:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861116:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0970 lrc: 0/0,0 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861117:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861120:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861122:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861124:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861134:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861137:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861158:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946585408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1326us (1518us total) trans 30064894603 rc 0/0 00000100:00100000:0.0:1651529369.861161:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153793 00010000:00010000:0.0:1651529369.861171:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9826e6a/0xa29a79078f3bcfb0 lrc: 0/0,0 mode: --/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92ad expref: 77 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.861175:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946585344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1404us (1547us total) trans 30064894604 rc 0/0 00000100:00100000:0.0:1651529369.861175:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046c87d96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861178:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153792 00010000:00010000:0.0:1651529369.861178:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861181:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861185:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861186:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861189:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcf340a7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529369.861189:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861190:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861192:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 3/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861192:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861197:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 1/0,0 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861207:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c097e lrc: 0/0,0 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861212:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861214:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.861215:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861218:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 3/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861224:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 1/0,0 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861227:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0977 lrc: 0/0,0 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861230:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861231:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946585728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1352us (1563us total) trans 30064894605 rc 0/0 00010000:00010000:1.0:1651529369.861232:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d320122 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.861233:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861234:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153795 00010000:00010000:1.0:1651529369.861236:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 3/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861239:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 1/0,0 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861241:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c098c lrc: 0/0,0 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861248:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861251:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861254:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861256:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861341:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946585536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1504us (1690us total) trans 30064894606 rc 0/0 00000100:00100000:1.0:1651529369.861344:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153794 00010000:00010000:1.0:1651529369.861351:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861354:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.861355:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861358:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 3/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861363:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 1/0,0 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861366:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0985 lrc: 0/0,0 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861372:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861376:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861379:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861381:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861434:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946585088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1800us (1903us total) trans 30064894607 rc 0/0 00000100:00100000:1.0:1651529369.861437:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153788 00010000:00010000:1.0:1651529369.861443:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861446:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.861447:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861450:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 3/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861454:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 1/0,0 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861465:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c095b lrc: 0/0,0 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.861554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861565:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586304 00000100:00100000:1.0:1651529369.861575:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586368 00000100:00100000:1.0:1651529369.861580:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153796 00000100:00100000:1.0:1651529369.861582:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946586304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.861587:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178537 count 1 00010000:00010000:1.0:1651529369.861592:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861605:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 2/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.861607:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153797 00010000:00010000:1.0:1651529369.861608:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861609:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861609:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 4/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861610:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946586368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.861616:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178538 count 1 00010000:00010000:1.0:1651529369.861617:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861621:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 76 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.861621:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861625:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.861626:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 2/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 76 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861629:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861629:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861630:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 4/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861641:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.861646:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 76 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861650:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 76 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861654:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.861663:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000affe4a3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861692:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586432 00000100:00100000:0.0:1651529369.861695:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861709:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586496 00000100:00100000:1.0:1651529369.861730:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153798 00000100:00100000:0.0:1651529369.861730:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861732:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946586432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.861742:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178539 count 1 00010000:00010000:1.0:1651529369.861757:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861762:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 2/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 76 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861765:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861766:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861766:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 4/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861768:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.861778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.861780:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 76 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861784:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 76 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861788:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966714304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.861791:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586560 00000100:00100000:1.0:1651529369.861819:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861822:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586624 00000100:00100000:0.0:1651529369.861825:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586816 00000100:00100000:0.0:1651529369.861827:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587072 00000100:00100000:1.0:1651529369.861830:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153799 00000100:00100000:1.0:1651529369.861832:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946586496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529369.861834:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153800 00000100:00100000:0.0:1651529369.861836:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946586560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.861837:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178540 count 1 00010000:00010000:1.0:1651529369.861841:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.861841:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178541 count 1 00010000:00010000:0.0:1651529369.861846:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861850:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 2/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 76 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861856:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 2/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861856:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861857:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861857:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 4/0,1 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861859:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861860:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861861:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 4/0,1 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861865:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 3/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 76 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861868:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 3/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861868:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 4/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 76 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.861871:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 4/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 76 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861872:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966714368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861876:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966714432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.861881:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.861884:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3f5b04f going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861888:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153801 00000100:00100000:0.0:1651529369.861890:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946586624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.861892:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153802 00000100:00100000:1.0:1651529369.861894:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946586816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.861894:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178542 count 1 00010000:00010000:0.0:1651529369.861898:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.861899:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178543 count 1 00010000:00010000:1.0:1651529369.861902:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861902:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 2/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861905:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861906:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861906:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 4/0,1 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861907:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 2/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861910:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861915:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 3/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861917:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861918:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 4/0,1 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861919:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 4/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 76 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861922:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966714496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.861925:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 3/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.861928:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.861929:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 4/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 76 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.861933:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966714560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861940:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861951:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153803 00000100:00100000:0.0:1651529369.861953:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946587072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.861958:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178544 count 1 00010000:00010000:0.0:1651529369.861962:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861967:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 2/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861981:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861982:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861982:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 4/0,1 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861990:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 76 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861993:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 4/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 76 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.861998:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966714624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.862005:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed1ef8f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.862040:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862045:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862078:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032c68d7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862082:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.862229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862235:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532032 00000100:00100000:0.0:1651529369.862237:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532096 00010000:00010000:1.0:1651529369.862241:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862242:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 78 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.862250:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12707 00000100:00100000:1.0:1651529369.862252:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396532032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529369.862252:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12708 00000100:00100000:0.0:1651529369.862254:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396532096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.862255:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862256:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862257:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.862258:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 78 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862260:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862262:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 78 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862266:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b700f8/0xa29a79078f3bd0b3 lrc: 0/0,0 mode: --/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d968f expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862268:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f4e87e/0xa29a79078f3bcfa2 lrc: 0/0,0 mode: --/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92a6 expref: 78 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862270:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862271:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862272:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862275:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 4/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862275:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862275:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862276:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862279:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 4/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862281:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.862285:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862295:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396532032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.862297:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12707 00010000:00010000:1.0:1651529369.862305:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862308:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862311:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862314:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862314:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41279:x1731746396532096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.862317:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12708 00010000:00010000:0.0:1651529369.862325:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862329:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862332:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862335:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862365:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946586304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 782us (824us total) trans 30064894608 rc 0/0 00000100:00100000:1.0:1651529369.862368:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153796 00010000:00010000:1.0:1651529369.862375:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862378:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.862379:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862382:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 3/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862382:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946586368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 772us (828us total) trans 30064894609 rc 0/0 00000100:00100000:0.0:1651529369.862385:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153797 00010000:00010000:1.0:1651529369.862387:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 1/0,0 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862390:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0993 lrc: 0/0,0 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862394:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862397:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047613beb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.862398:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862403:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 3/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862406:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 1/0,0 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862409:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c099a lrc: 0/0,0 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862435:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966714304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862445:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862594:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.862601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.862611:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587264 00000100:00100000:0.0:1651529369.862612:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587200 00000100:00100000:1.0:1651529369.862621:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153804 00000100:00100000:1.0:1651529369.862623:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946587264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.862628:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178546 count 1 00000100:00100000:0.0:1651529369.862628:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153805 00000100:00100000:0.0:1651529369.862629:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946587200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529369.862632:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.862635:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178545 count 1 00010000:00010000:1.0:1651529369.862637:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 2/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 74 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.862640:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862640:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862640:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862641:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 4/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862645:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 2/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 74 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.862648:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 74 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.862648:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862648:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862649:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 4/0,1 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862652:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 74 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.862656:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862656:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 3/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 74 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.862660:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 4/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 74 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.862664:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.862670:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a21c8e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.862680:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.862779:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966714432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862788:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862801:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966714560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862823:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862834:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532352 00000100:00100000:0.0:1651529369.862836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.862839:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 5/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 75 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.862843:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862847:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532288 00010000:00010000:1.0:1651529369.862849:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 76 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.862849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862853:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532608 00000100:00100000:0.0:1651529369.862854:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.862860:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532736 00010000:00010000:1.0:1651529369.862864:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 5/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862866:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 4/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 78 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.862869:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532544 00010000:00010000:1.0:1651529369.862872:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 4/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 79 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.862876:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532800 00010000:00010000:1.0:1651529369.862878:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 5/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 80 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.862882:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12709 00000100:00100000:1.0:1651529369.862884:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396532352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.862887:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862888:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 5/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 80 pid: 142995 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862892:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 4/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 80 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.862900:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12710 00000100:00100000:0.0:1651529369.862902:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396532288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.862905:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862906:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862906:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862907:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862908:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 80 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862910:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 4/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862912:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 80 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862918:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f158e848/0xa29a79078f3bcff6 lrc: 0/0,0 mode: --/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93d3 expref: 80 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862921:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862922:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862923:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862924:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.862926:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 4/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862931:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396532352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.862936:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862941:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12709 00000100:00100000:0.0:1651529369.862943:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396532288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.862946:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12711 00000100:00100000:1.0:1651529369.862948:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396532608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529369.862948:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12710 00010000:00010000:1.0:1651529369.862951:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862953:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 5/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 77 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.862953:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12712 00000100:00100000:0.0:1651529369.862955:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41279:x1731746396532736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.862957:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 4/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 77 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.862958:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.862959:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 4/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 77 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862962:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862962:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862963:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862963:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 3/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 77 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862966:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 4/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862968:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba69b7ff/0xa29a79078f3bd05f lrc: 0/0,0 mode: --/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9562 expref: 77 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.862970:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.862971:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862972:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862973:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862975:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cdda3cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41279:x1731746396532608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.862975:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 4/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862977:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12711 00010000:00010000:0.0:1651529369.862984:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.862989:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41279:x1731746396532736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.862992:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12712 00000100:00100000:1.0:1651529369.862994:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12713 00000100:00100000:1.0:1651529369.862996:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396532544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529369.862997:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12714 00000100:00100000:0.0:1651529369.862998:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396532800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.862999:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.863000:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 4/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 74 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863004:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 3/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 74 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863009:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3bd019 lrc: 0/0,0 mode: --/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9489 expref: 74 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863012:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863013:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863014:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863014:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.863016:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 5/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 73 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863017:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 4/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863020:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 4/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 73 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863022:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.863025:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863025:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863026:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863028:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41278:x1731746396532544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.863029:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 4/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863031:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12713 00010000:00010000:0.0:1651529369.863033:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.863037:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863039:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41278:x1731746396532800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.863040:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863042:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12714 00010000:00010000:1.0:1651529369.863046:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863049:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863053:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001afdf7f/0xa29a79078f3bcfb7 lrc: 0/0,0 mode: --/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92de expref: 71 pid: 142995 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.863057:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6184e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966714368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863060:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863066:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863069:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863072:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863075:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863097:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946586496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1264us (1402us total) trans 30064894610 rc 0/0 00000100:00100000:1.0:1651529369.863100:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153799 00010000:00010000:1.0:1651529369.863107:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863110:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863111:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863114:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 3/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863119:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 1/0,0 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863120:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946586560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1283us (1390us total) trans 30064894611 rc 0/0 00010000:00010000:1.0:1651529369.863122:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c09a8 lrc: 0/0,0 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863123:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153800 00010000:00010000:1.0:1651529369.863126:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863134:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058733e19/0xa29a79078f3bd07b lrc: 0/0,0 mode: --/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95b6 expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863137:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c540a557 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863138:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863138:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a62f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966714496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.863141:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 3/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863141:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863144:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863145:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 1/0,0 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863147:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c09af lrc: 0/0,0 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863150:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863153:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863154:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863155:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863157:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863160:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863168:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863195:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946586624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1304us (1427us total) trans 30064894612 rc 0/0 00000100:00100000:0.0:1651529369.863198:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153801 00000100:00100000:1.0:1651529369.863207:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946586816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1312us (1429us total) trans 30064894613 rc 0/0 00010000:00010000:0.0:1651529369.863209:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056032d3d/0xa29a79078f3bcfd3 lrc: 0/0,0 mode: --/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9340 expref: 69 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.863210:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153802 00000100:00100000:0.0:1651529369.863213:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966714624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863216:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863218:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863219:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062d024ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863222:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863222:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863225:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 3/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863227:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863229:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 1/0,0 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863230:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863232:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c09b6 lrc: 0/0,0 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863236:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863246:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863247:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863250:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 3/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863263:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 1/0,0 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863266:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c09bd lrc: 0/0,0 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863269:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946587072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1315us (1484us total) trans 30064894614 rc 0/0 00010000:00010000:1.0:1651529369.863270:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863272:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153803 00010000:00010000:1.0:1651529369.863273:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9d270f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863273:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863276:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 3/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863279:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 1/0,0 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863282:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c09c4 lrc: 0/0,0 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863299:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.863303:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863311:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.863323:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532928 00000100:00100000:0.0:1651529369.863324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.863328:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 69 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.863339:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532992 00010000:00010000:1.0:1651529369.863341:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 5/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.863348:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12715 00000100:00100000:1.0:1651529369.863349:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396532928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.863352:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.863354:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863381:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.863388:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12716 00000100:00100000:0.0:1651529369.863390:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396532992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.863392:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038aa8668/0xa29a79078f3bd058 lrc: 0/0,0 mode: --/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9554 expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.863394:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.863396:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 5/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 70 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863397:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863398:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863400:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 4/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 69 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.863401:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 4/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863406:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863407:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863408:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863411:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 4/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863415:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.863416:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.863427:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396532928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 77us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.863430:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12715 00010000:00010000:1.0:1651529369.863437:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863440:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863444:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863446:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863454:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396532992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.863458:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12716 00010000:00010000:0.0:1651529369.863471:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b85b71d/0xa29a79078f3bd0a5 lrc: 0/0,0 mode: --/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d966c expref: 67 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.863475:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047b883b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966714752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863478:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863482:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863484:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863485:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946586432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1752us (1812us total) trans 30064894615 rc 0/0 00010000:00010000:0.0:1651529369.863487:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863488:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153798 00010000:00010000:0.0:1651529369.863490:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863506:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863510:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863511:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863516:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 3/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863521:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 1/0,0 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863524:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c09a1 lrc: 0/0,0 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863528:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863531:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004fc3b419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863532:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863533:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946587200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 902us (931us total) trans 30064894616 rc 0/0 00010000:00010000:1.0:1651529369.863534:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 3/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863537:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 1/0,0 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863537:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153805 00010000:00010000:1.0:1651529369.863540:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c09d2 lrc: 0/0,0 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863546:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863549:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863552:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863555:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863610:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946587264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 986us (1016us total) trans 30064894617 rc 0/0 00000100:00100000:1.0:1651529369.863613:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153804 00010000:00010000:1.0:1651529369.863620:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863623:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.863624:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863633:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 3/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863638:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 1/0,0 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863641:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c09cb lrc: 0/0,0 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.863783:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587776 00000100:00100000:0.0:1651529369.863785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.863799:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587840 00000100:00100000:1.0:1651529369.863824:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587968 00000100:00100000:0.0:1651529369.863828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.863839:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588032 00000100:00100000:0.0:1651529369.863842:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588096 00000100:00100000:1.0:1651529369.863847:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153806 00000100:00100000:1.0:1651529369.863849:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946587776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.863854:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178547 count 1 00010000:00010000:1.0:1651529369.863859:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863863:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 2/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 66 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863866:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863867:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863868:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 4/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863878:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153807 00000100:00100000:0.0:1651529369.863880:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946587840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529369.863882:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 66 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863886:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 66 pid: 142994 timeout: 13119 lvb_type: 1 00002000:00080000:0.0:1651529369.863886:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178548 count 1 00000100:00100000:1.0:1651529369.863891:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863891:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863896:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 2/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 66 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863899:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863900:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863900:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 4/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863906:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bbdf5886 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.863913:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153808 00010000:00010000:0.0:1651529369.863914:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 66 pid: 127523 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.863915:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946587968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.863918:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 66 pid: 127523 timeout: 13119 lvb_type: 1 00002000:00080000:1.0:1651529369.863920:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178549 count 1 00010000:00010000:1.0:1651529369.863924:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863925:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966714880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.863928:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 2/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863932:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 2/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863934:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863935:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863935:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 5/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863935:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000466a00f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863941:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153809 00010000:00010000:1.0:1651529369.863942:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.863943:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946588032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529369.863945:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 66 pid: 128009 timeout: 13119 lvb_type: 1 00002000:00080000:0.0:1651529369.863947:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178550 count 1 00000100:00100000:1.0:1651529369.863949:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966714944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863951:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863955:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 2/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863958:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863958:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863959:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863959:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 4/0,1 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863965:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 66 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.863965:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 3/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.863968:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966715008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863969:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 4/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 66 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.863972:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003f8b9380 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863973:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.863979:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153810 00000100:00100000:0.0:1651529369.863979:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.863980:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946588096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529369.863985:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178551 count 1 00010000:00010000:1.0:1651529369.863988:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863992:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 2/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 66 pid: 142994 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.863994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.863995:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863996:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863996:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 4/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864002:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 66 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.864006:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 66 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.864013:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966715136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.864019:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd17f60c going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.864027:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588224 00000100:00100000:1.0:1651529369.864037:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588160 00000100:00100000:0.0:1651529369.864050:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588288 00000100:00100000:0.0:1651529369.864057:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153811 00000100:00100000:0.0:1651529369.864059:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946588224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.864064:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178553 count 1 00000100:00100000:1.0:1651529369.864068:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153812 00010000:00010000:0.0:1651529369.864068:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864070:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946588160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.864073:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 2/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529369.864075:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178552 count 1 00010000:00010000:0.0:1651529369.864076:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864076:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864077:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 4/0,1 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864087:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864092:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 2/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.864095:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864095:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864096:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 4/0,1 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864100:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 3/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.864103:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 3/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 66 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.864104:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 4/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 66 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864107:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 4/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 66 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864108:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.864111:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966715264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864119:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 000000006319cb5f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.864121:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.864125:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153813 00000100:00100000:0.0:1651529369.864126:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946588288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529369.864132:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178554 count 1 00010000:00010000:0.0:1651529369.864136:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864140:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 2/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.864143:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864144:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864145:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 4/0,1 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864150:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 3/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 66 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.864154:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 4/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 66 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864174:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966715328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864183:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000893ae2b1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.864222:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966714816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.864226:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864258:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d486ca2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966714880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.864262:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864576:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966715136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.864580:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864588:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966714944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864591:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966715008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.864599:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.864604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864606:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533504 00010000:00010000:1.0:1651529369.864611:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 67 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864620:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533632 00000100:00100000:1.0:1651529369.864623:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533760 00010000:00010000:1.0:1651529369.864626:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 69 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.864626:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 69 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.864630:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533568 00010000:00010000:1.0:1651529369.864632:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 70 pid: 127523 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864632:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533696 00010000:00010000:0.0:1651529369.864635:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 5/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 71 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.864639:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533824 00000100:00100000:0.0:1651529369.864640:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12717 00010000:00010000:1.0:1651529369.864641:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 72 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864642:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396533504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.864645:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529369.864646:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12718 00010000:00010000:0.0:1651529369.864646:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 72 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.864648:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396533760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529369.864650:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 72 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864651:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864652:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 72 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864656:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 72 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.864656:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c71dcae/0xa29a79078f3bcfda lrc: 0/0,0 mode: --/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9355 expref: 72 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864660:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3bcf5c lrc: 0/0,0 mode: --/PR res: [0x2b975:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9180 expref: 71 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.864660:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864660:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864661:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864665:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.864667:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 4/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864681:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41279:x1731746396533760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.864681:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864684:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12718 00000100:00100000:0.0:1651529369.864688:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41279:x1731746396533504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.864689:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12719 00000100:00100000:1.0:1651529369.864691:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41279:x1731746396533632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529369.864691:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12717 00010000:00010000:1.0:1651529369.864694:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864695:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 68 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864696:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12720 00000100:00100000:0.0:1651529369.864698:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396533568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.864701:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864702:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 68 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.864703:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 68 pid: 127523 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864710:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3bcf6a lrc: 0/0,0 mode: --/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d918e expref: 68 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864717:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864718:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864719:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864720:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 67 pid: 127523 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864724:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 4/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864736:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864767:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e9297de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41279:x1731746396533632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (181us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.864767:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf161b6/0xa29a79078f3bcf86 lrc: 0/0,0 mode: --/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d922f expref: 67 pid: 127523 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.864771:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12719 00010000:00010000:0.0:1651529369.864771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864771:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864772:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864775:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 4/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864783:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12721 00010000:00010000:0.0:1651529369.864784:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864785:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41278:x1731746396533696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.864788:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864790:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 5/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 65 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864792:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41278:x1731746396533568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 93us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.864794:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 4/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 65 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864795:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12720 00010000:00010000:1.0:1651529369.864800:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864800:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.864800:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12722 00010000:00010000:1.0:1651529369.864801:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864802:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396533824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.864824:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 4/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864824:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.864826:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 64 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.864829:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.864830:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 64 pid: 142994 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.864835:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b2fd99a/0xa29a79078f3bd004 lrc: 0/0,0 mode: --/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93fd expref: 64 pid: 142994 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.864836:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396533696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.864839:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12721 00010000:00010000:0.0:1651529369.864839:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864839:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864840:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864843:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 4/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864846:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864849:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864852:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.864858:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41278:x1731746396533824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.864859:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864862:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864869:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12722 00010000:00010000:0.0:1651529369.864882:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d08924/0xa29a79078f3bd0ac lrc: 0/0,0 mode: --/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d967a expref: 61 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.864886:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.864889:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864893:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864895:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864899:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864901:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864903:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946587968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 987us (1118us total) trans 30064894618 rc 0/0 00000100:00100000:1.0:1651529369.864907:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153808 00010000:00010000:1.0:1651529369.864922:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864925:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.864926:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864930:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 3/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864934:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 1/0,0 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864937:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c09e7 lrc: 0/0,0 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864941:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864944:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006872a4bf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.864945:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864947:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1004us (1154us total) trans 30064894619 rc 0/0 00010000:00010000:1.0:1651529369.864948:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 3/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864950:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153809 00010000:00010000:1.0:1651529369.864951:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 1/0,0 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864956:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c09ee lrc: 0/0,0 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864958:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864962:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864965:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864968:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864971:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864972:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864975:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864978:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.865015:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946588096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1033us (1186us total) trans 30064894620 rc 0/0 00000100:00100000:1.0:1651529369.865018:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153810 00000100:00100000:0.0:1651529369.865018:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946587840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1137us (1240us total) trans 30064894621 rc 0/0 00000100:00100000:0.0:1651529369.865021:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153807 00010000:00010000:1.0:1651529369.865025:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865028:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865029:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865031:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.865032:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 3/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865035:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865047:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 1/0,0 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865050:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c09f5 lrc: 0/0,0 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865054:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865056:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c24392a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865057:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865060:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 3/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.865063:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 1/0,0 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865066:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c09e0 lrc: 0/0,0 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.865075:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533888 00010000:00010000:1.0:1651529369.865080:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 4/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 61 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.865094:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396534016 00010000:00010000:1.0:1651529369.865104:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 5/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 62 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.865109:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396534080 00010000:00010000:1.0:1651529369.865110:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 5/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 63 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.865138:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12723 00000100:00100000:0.0:1651529369.865141:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12724 00000100:00100000:0.0:1651529369.865143:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396534016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529369.865146:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396533888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529369.865147:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.865149:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.865149:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 5/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 63 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865151:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 4/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 63 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865155:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 3/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 63 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865160:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ee7ab0/0xa29a79078f3bd066 lrc: 0/0,0 mode: --/PR res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9570 expref: 63 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865163:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865163:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 4/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 63 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865164:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.865165:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865168:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 4/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865169:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865170:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865171:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865174:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 4/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865178:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.865195:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396533888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.865198:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12723 00000100:00100000:1.0:1651529369.865204:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12725 00000100:00100000:1.0:1651529369.865205:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41278:x1731746396534080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.865207:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.865208:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.865210:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 5/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 61 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865213:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 4/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 61 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865215:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41279:x1731746396534016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.865218:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12724 00010000:00010000:1.0:1651529369.865219:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.865219:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.865220:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865223:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 4/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865226:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865227:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.865229:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.865232:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e660fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396534080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.865232:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.865235:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12725 00010000:00010000:0.0:1651529369.865235:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865250:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063f87826/0xa29a79078f3bcffd lrc: 0/0,0 mode: --/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93e1 expref: 59 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.865261:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966715264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.865272:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865275:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865278:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865281:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865284:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865302:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1241us (1307us total) trans 30064894622 rc 0/0 00000100:00100000:0.0:1651529369.865305:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153811 00010000:00010000:0.0:1651529369.865317:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3bcf55 lrc: 0/0,0 mode: --/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9141 expref: 58 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865322:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966715328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.865325:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1254us (1316us total) trans 30064894623 rc 0/0 00010000:00010000:0.0:1651529369.865325:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.865328:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153812 00010000:00010000:0.0:1651529369.865329:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865331:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865334:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865335:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865337:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865338:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006bfcf3fb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865339:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865342:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 3/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865357:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 1/0,0 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865360:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c09fc lrc: 0/0,0 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865364:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865367:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5dfcad9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865367:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865370:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 3/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865373:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 1/0,0 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865376:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a03 lrc: 0/0,0 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865378:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1251us (1360us total) trans 30064894624 rc 0/0 00010000:00010000:1.0:1651529369.865379:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865381:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153813 00010000:00010000:1.0:1651529369.865382:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865383:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865386:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 3/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865389:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 1/0,0 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865391:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0a0a lrc: 0/0,0 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865399:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865402:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865405:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865408:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.865416:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.865438:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.865458:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946587776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1608us (1692us total) trans 30064894625 rc 0/0 00000100:00100000:1.0:1651529369.865467:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153806 00000100:00100000:0.0:1651529369.865474:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588416 00000100:00100000:0.0:1651529369.865481:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588352 00000100:00100000:0.0:1651529369.865488:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588480 00000100:00100000:0.0:1651529369.865492:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153814 00000100:00100000:0.0:1651529369.865494:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946588416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529369.865498:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153815 00002000:00080000:0.0:1651529369.865499:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178556 count 1 00000100:00100000:1.0:1651529369.865500:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946588352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529369.865504:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.865506:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178555 count 1 00010000:00010000:0.0:1651529369.865509:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 2/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 57 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.865510:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865512:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865513:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865513:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 4/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865515:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 2/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 57 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.865519:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.865519:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.865520:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 4/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865520:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 57 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.865524:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 57 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865527:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 57 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.865531:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 57 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.865535:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966715456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.865545:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.865550:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000011a5aed3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.865556:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865559:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.865560:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865561:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.865566:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 3/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865568:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153816 00000100:00100000:0.0:1651529369.865569:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946588480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529369.865570:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 1/0,0 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.865573:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c09d9 lrc: 0/0,0 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.865574:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178557 count 1 00010000:00010000:0.0:1651529369.865578:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865583:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 2/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 57 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.865586:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865586:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.865587:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 4/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.865593:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 57 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.865597:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 57 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865600:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.865607:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.865858:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966715456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.865863:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865867:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.865872:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865879:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.865882:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.865935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.865945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.865950:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396534208 00000100:00100000:0.0:1651529369.865952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.865961:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 58 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865961:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396534272 00010000:00010000:0.0:1651529369.865967:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 59 pid: 128009 timeout: 13119 lvb_type: 1 00000100:00100000:1.0:1651529369.865972:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396534144 00010000:00010000:1.0:1651529369.865975:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 60 pid: 127525 timeout: 13119 lvb_type: 1 00000100:00100000:0.0:1651529369.865980:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12726 00000100:00100000:1.0:1651529369.865982:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12727 00000100:00100000:0.0:1651529369.865982:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396534208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529369.865983:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396534272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.865985:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.865986:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.865986:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865988:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.865990:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865992:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.865996:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3bcf63 lrc: 0/0,0 mode: --/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9187 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.865998:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3bcf71 lrc: 0/0,0 mode: --/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91c6 expref: 60 pid: 128009 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.866000:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.866001:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.866001:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.866001:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866002:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.866003:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866006:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 4/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866007:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 4/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866014:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.866021:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.866026:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41279:x1731746396534272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.866028:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12727 00000100:00100000:1.0:1651529369.866033:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12728 00000100:00100000:0.0:1651529369.866033:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41279:x1731746396534208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.866035:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396534144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529369.866036:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12726 00010000:00010000:1.0:1651529369.866038:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.866039:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 56 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:1.0:1651529369.866043:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 56 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.866044:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866047:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866048:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3bd027 lrc: 0/0,0 mode: --/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94c1 expref: 56 pid: 127525 timeout: 13119 lvb_type: 1 00010000:00010000:0.0:1651529369.866050:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866051:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.866052:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.866052:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866053:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866055:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 4/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866068:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.866074:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396534144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.866077:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12728 00010000:00010000:1.0:1651529369.866083:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866087:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d320122 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.866088:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866091:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 3/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866095:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 1/0,0 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.866098:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946588480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 528us (660us total) trans 30064894626 rc 0/0 00010000:00010000:1.0:1651529369.866100:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a1f lrc: 0/0,0 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.866101:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153816 00010000:00010000:1.0:1651529369.866107:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866107:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866109:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866110:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866113:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866116:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866122:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.866125:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.866163:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946588352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 662us (740us total) trans 30064894627 rc 0/0 00000100:00100000:0.0:1651529369.866165:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946588416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 670us (757us total) trans 30064894628 rc 0/0 00000100:00100000:1.0:1651529369.866166:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153815 00000100:00100000:0.0:1651529369.866168:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153814 00010000:00010000:1.0:1651529369.866174:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866177:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.866178:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866181:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 3/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866186:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 1/0,0 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866189:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a18 lrc: 0/0,0 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866193:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866195:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc44840e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529369.866196:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866199:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 3/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866202:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 1/0,0 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.866205:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a11 lrc: 0/0,0 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1651529369.955376:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894581 is committed 00000100:00100000:0.0:1651529372.384122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529372.384159:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588544 00000100:00100000:1.0:1651529372.384173:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 37 00000100:00100000:1.0:1651529372.384175:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588544:12345-10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529372.384199:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588544:12345-10.240.43.61@tcp:400:kworker/u4:1.0 Request processed in 23us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529372.384202:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 37 00000100:00100000:0.0:1651529374.944113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529374.944123:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588736 00000100:00100000:0.0:1651529374.944133:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 312 00000100:00100000:0.0:1651529374.944135:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529374.944143:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580672 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529374.944156:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (44us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529374.944159:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 312 00000001:00080000:0.0:1651529375.550146:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894628 is committed 00000100:00100000:0.0:1651529380.064129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529380.064139:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588864 00000100:00100000:0.0:1651529380.064149:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 313 00000100:00100000:0.0:1651529380.064151:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946588864:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529380.064159:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580672 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529380.064182:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946588864:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529380.064186:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 313 00000100:00100000:0.0:1651529385.184164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529385.184180:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588992 00000100:00100000:0.0:1651529385.184199:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 314 00000100:00100000:0.0:1651529385.184201:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588992:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529385.184218:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580672 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529385.184241:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588992:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529385.184245:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 314 00000400:00000080:0.0:1651529386.087556:0:167098:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529386.087559:0:167098:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 125: don't return EPROTO when a dir has a non-default striping and ACLs ========================================================== 22:09:45 (1651529385) 00000100:00100000:0.0:1651529386.248904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529386.248936:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589120 00000100:00100000:1.0:1651529386.248977:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153817 00000100:00100000:1.0:1651529386.248981:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946589120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529386.248997:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178558 count 1 00010000:00010000:1.0:1651529386.249021:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249031:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 2/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 54 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529386.249036:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529386.249037:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529386.249038:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 4/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249053:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 54 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529386.249059:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 4/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 54 pid: 142995 timeout: 13135 lvb_type: 1 00000100:00100000:1.0:1651529386.249066:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966715584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529386.249107:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b230a3a5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529386.249449:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966715584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529386.249457:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529386.249496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529386.249525:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396555008 00010000:00010000:1.0:1651529386.249533:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 4/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 55 pid: 142995 timeout: 13135 lvb_type: 1 00000100:00100000:1.0:1651529386.249559:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12729 00000100:00100000:1.0:1651529386.249562:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41279:x1731746396555008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529386.249566:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529386.249568:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 4/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 55 pid: 142995 timeout: 13135 lvb_type: 1 00010000:00010000:1.0:1651529386.249573:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 55 pid: 142995 timeout: 13135 lvb_type: 1 00010000:00010000:1.0:1651529386.249591:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c0786 lrc: 0/0,0 mode: --/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cd2 expref: 55 pid: 142995 timeout: 13135 lvb_type: 1 00010000:00010000:1.0:1651529386.249596:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529386.249596:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529386.249598:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249601:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 4/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249609:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529386.249626:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41279:x1731746396555008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529386.249630:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12729 00010000:00010000:1.0:1651529386.249647:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249651:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249655:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249667:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529386.249783:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946589120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 802us (882us total) trans 30064894629 rc 0/0 00000100:00100000:1.0:1651529386.249787:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153817 00010000:00010000:1.0:1651529386.249796:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249800:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006aba5b52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529386.249801:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249818:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 3/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249831:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 1/0,0 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529386.249835:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a26 lrc: 0/0,0 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529388.690076:0:167316:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529388.690078:0:167316:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 126: check that the fsgid provided by the client is taken into account ========================================================== 22:09:47 (1651529387) 00000100:00100000:0.0:1651529390.304194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529390.304212:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589312 00000100:00100000:0.0:1651529390.304232:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 315 00000100:00100000:0.0:1651529390.304234:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946589312:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529390.304252:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580672 pending 0 free 81229504512 avail 77058793472 00000100:00100000:0.0:1651529390.304276:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946589312:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529390.304280:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 315 00000400:00000080:0.0:1651529391.158826:0:167534:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529391.158828:0:167534:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127a: verify the client stats are sane ==== 22:09:50 (1651529390) 00000100:00100000:0.0:1651529391.198091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.198122:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557120 00000100:00100000:1.0:1651529391.198144:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153818 00000100:00100000:1.0:1651529391.198147:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:413892:x1731746396557120:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529391.198157:0:127526:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529391.198170:0:127526:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a2d lrc: 2/0,0 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da4ff expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.198181:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.198191:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.198192:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.198196:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a2d lrc: 3/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4ff expref: 55 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.198203:0:127526:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a2d lrc: 3/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4ff expref: 55 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.198209:0:127526:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006aba5b52, rc 0) 00000100:00100000:1.0:1651529391.198238:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:413892:x1731746396557120:12345-10.240.43.64@tcp:101:dd.0 Request processed in 90us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529391.198242:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153818 00000100:00100000:0.0:1651529391.198495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.198546:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557184 00002000:00010000:1.0:1651529391.198571:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178608/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529391.198573:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f30a901 with x1731746396557184 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529391.198577:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f30a901. 00000100:00100000:1.0:1651529391.198603:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15749 00000100:00100000:1.0:1651529391.198606:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396557184:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529391.198710:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529391.198712:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb mtime from disk: 0 -> 1651529391 00002000:00010000:1.0:1651529391.198713:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529391.198714:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb ctime from disk: 0 -> 1651529391 00002000:00010000:1.0:1651529391.198715:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529391.198732:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396557184:12345-10.240.43.64@tcp:10:dd.0 Request processed in 126us (238us total) trans 30064894630 rc 0/0 00000100:00100000:1.0:1651529391.198735:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15749 00002000:00010000:1.0:1651529391.198736:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178608/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529391.198737:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f30a901 with x1731746396557184 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529391.198739:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f30a901. 00000100:00100000:0.0:1651529391.212386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.212409:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557376 00002000:00100000:1.0:1651529391.212429:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b0:0x0] (0->2097151) req@0000000082408984 x1731746396557376/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:117/0 lens 488/0 e 0 to 0 dl 1651529397 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529391.212438:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082408984 with x1731746396557376 ext(0->2097151) 00002000:00010000:1.0:1651529391.212440:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082408984 00000100:00100000:1.0:1651529391.212451:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15750 00000100:00100000:1.0:1651529391.212453:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41279:x1731746396557376:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529391.216188:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41279:x1731746396557376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3732us (3801us total) trans 30064894631 rc 0/0 00000100:00100000:1.0:1651529391.216193:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15750 00002000:00100000:1.0:1651529391.216198:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b0:0x0] (0->2097151) req@0000000082408984 x1731746396557376/t30064894631(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:117/0 lens 488/448 e 0 to 0 dl 1651529397 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529391.216203:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082408984 with x1731746396557376 ext(0->2097151) 00002000:00010000:1.0:1651529391.216205:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082408984 00000100:00100000:0.0:1651529391.217463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.217489:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557440 00000100:00100000:1.0:1651529391.217510:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 81 00000100:00100000:1.0:1651529391.217512:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:347569:x1731746396557440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529391.217517:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 50 locks, starting at 0 00002000:00010000:1.0:1651529391.217523:0:127517:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1651529391.217525:0:127517:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b0:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:1.0:1651529391.217534:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a2d lrc: 0/0,0 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4ff expref: 58 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.217546:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c08c1 lrc: 0/0,0 mode: --/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1b7 expref: 57 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217553:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000528fa145/0xa29a79078f3c08c8 lrc: 0/0,0 mode: --/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1be expref: 56 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217560:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c08ba lrc: 0/0,0 mode: --/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da19b expref: 55 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217566:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c08b3 lrc: 0/0,0 mode: --/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da18d expref: 54 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217572:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c08ac lrc: 0/0,0 mode: --/PR res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da17f expref: 53 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217589:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c08a5 lrc: 0/0,0 mode: --/PR res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da139 expref: 52 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217601:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c089e lrc: 0/0,0 mode: --/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da12b expref: 51 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217608:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0897 lrc: 0/0,0 mode: --/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0f3 expref: 50 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217614:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0890 lrc: 0/0,0 mode: --/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ec expref: 49 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217621:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0889 lrc: 0/0,0 mode: --/PR res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0bb expref: 48 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217632:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0882 lrc: 0/0,0 mode: --/PR res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0ad expref: 47 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217638:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c087b lrc: 0/0,0 mode: --/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da09f expref: 46 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217644:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0874 lrc: 0/0,0 mode: --/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da091 expref: 45 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217649:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c086d lrc: 0/0,0 mode: --/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da083 expref: 44 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217661:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0866 lrc: 0/0,0 mode: --/PR res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da07c expref: 43 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217667:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c085f lrc: 0/0,0 mode: --/PR res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da059 expref: 42 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217673:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0858 lrc: 0/0,0 mode: --/PR res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da04b expref: 41 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217678:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0851 lrc: 0/0,0 mode: --/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da013 expref: 40 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217685:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c084a lrc: 0/0,0 mode: --/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da00c expref: 39 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217700:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0843 lrc: 0/0,0 mode: --/PR res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ff7 expref: 38 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217707:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c083c lrc: 0/0,0 mode: --/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe9 expref: 37 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217713:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0835 lrc: 0/0,0 mode: --/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fc6 expref: 36 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217718:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c082e lrc: 0/0,0 mode: --/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fb1 expref: 35 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217730:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0827 lrc: 0/0,0 mode: --/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f6b expref: 34 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217736:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0820 lrc: 0/0,0 mode: --/PR res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f5d expref: 33 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217742:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0819 lrc: 0/0,0 mode: --/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f2c expref: 32 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217748:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0812 lrc: 0/0,0 mode: --/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f09 expref: 31 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217753:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c080b lrc: 0/0,0 mode: --/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9efb expref: 30 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217767:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0804 lrc: 0/0,0 mode: --/PR res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eed expref: 29 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217773:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c07fd lrc: 0/0,0 mode: --/PR res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eca expref: 28 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217779:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c07ef lrc: 0/0,0 mode: --/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e7d expref: 27 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217785:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845529d3/0xa29a79078f3c07e8 lrc: 0/0,0 mode: --/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e92 expref: 26 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217797:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c07f6 lrc: 0/0,0 mode: --/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e8b expref: 25 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217825:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000626f6c4e/0xa29a79078f3c07da lrc: 0/0,0 mode: --/PR res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e29 expref: 24 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217833:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c07e1 lrc: 0/0,0 mode: --/PR res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e22 expref: 23 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217845:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c07d3 lrc: 0/0,0 mode: --/PR res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e1b expref: 22 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217852:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c07c5 lrc: 0/0,0 mode: --/PR res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dea expref: 21 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217857:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d8850a/0xa29a79078f3c07be lrc: 0/0,0 mode: --/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9de3 expref: 20 pid: 127523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217863:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c07cc lrc: 0/0,0 mode: --/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dff expref: 19 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217873:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c07b7 lrc: 0/0,0 mode: --/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9dce expref: 18 pid: 127525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217880:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dce4d58/0xa29a79078f3c07a9 lrc: 0/0,0 mode: --/PR res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d42 expref: 17 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217891:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c07b0 lrc: 0/0,0 mode: --/PR res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d88 expref: 16 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217902:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c07a2 lrc: 0/0,0 mode: --/PR res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d73 expref: 15 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217908:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9df0d3/0xa29a79078f3c079b lrc: 0/0,0 mode: --/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d34 expref: 14 pid: 128009 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217914:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0794 lrc: 0/0,0 mode: --/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d2d expref: 13 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217919:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c46f175/0xa29a79078f3c078d lrc: 0/0,0 mode: --/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ccb expref: 12 pid: 144527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217925:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0778 lrc: 0/0,0 mode: --/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cc4 expref: 11 pid: 142995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217932:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d159d212/0xa29a79078f3c077f lrc: 0/0,0 mode: --/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cbd expref: 10 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217937:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c28435/0xa29a79078f3c0771 lrc: 0/0,0 mode: --/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c77 expref: 9 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.217941:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529391.217962:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:347569:x1731746396557440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 449us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529391.217965:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 81 00000100:00100000:0.0:1651529391.229165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.229189:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557696 00000100:00100000:1.0:1651529391.229200:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153819 00000100:00100000:1.0:1651529391.229202:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:413896:x1731746396557696:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529391.229207:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529391.229213:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a34 lrc: 2/0,0 mode: --/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da50d expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.229219:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b0:0x0] initial LVB size: 2097152, mtime: 0x627056af, atime: 0x0, ctime: 0x627056af, blocks: 0x1000 00010000:00010000:1.0:1651529391.229225:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.229226:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.229230:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a34 lrc: 3/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da50d expref: 9 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.229236:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a34 lrc: 3/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da50d expref: 9 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.229240:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006aba5b52, rc 0) 00000100:00100000:1.0:1651529391.229257:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:413896:x1731746396557696:12345-10.240.43.64@tcp:101:dd.0 Request processed in 54us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529391.229260:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153819 00000100:00100000:0.0:1651529391.230306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.230328:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557824 00002000:00100000:1.0:1651529391.230337:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b0:0x0] (0->2097151) req@00000000b1dff28f x1731746396557824/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:117/0 lens 488/0 e 0 to 0 dl 1651529397 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529391.230341:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b1dff28f with x1731746396557824 ext(0->2097151) 00002000:00010000:1.0:1651529391.230349:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b1dff28f 00000100:00100000:1.0:1651529391.230360:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15751 00000100:00100000:1.0:1651529391.230362:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396557824:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529391.232017:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dff28f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396557824:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1654us (1711us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1651529391.232021:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15751 00002000:00100000:1.0:1651529391.232024:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b0:0x0] (0->2097151) req@00000000b1dff28f x1731746396557824/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:117/0 lens 488/440 e 0 to 0 dl 1651529397 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'dd.0' 00002000:00100000:1.0:1651529391.232028:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b1dff28f with x1731746396557824 ext(0->2097151) 00002000:00010000:1.0:1651529391.232030:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b1dff28f 00000100:00100000:0.0:1651529391.246352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.246382:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396558080 00000100:00100000:1.0:1651529391.246396:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153820 00000100:00100000:1.0:1651529391.246398:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396558080:12345-10.240.43.64@tcp:101:grep.0 00010000:00010000:1.0:1651529391.246405:0:127526:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529391.246414:0:127526:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 2/0,0 mode: --/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da522 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.246423:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.246431:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.246432:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.246435:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 3/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 10 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.246441:0:127526:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 3/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 10 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.246458:0:127526:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9c803a4, rc 0) 00000100:00100000:1.0:1651529391.246478:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396558080:12345-10.240.43.64@tcp:101:grep.0 Request processed in 79us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529391.246482:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153820 00000100:00100000:0.0:1651529391.247384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.247406:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396558208 00000100:00100000:1.0:1651529391.247414:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153821 00000100:00100000:1.0:1651529391.247416:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:413898:x1731746396558208:12345-10.240.43.64@tcp:101:grep.0 00010000:00010000:1.0:1651529391.247419:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529391.247423:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 2/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da530 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.247430:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 2/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.247434:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.247434:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.247435:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 4/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 11 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.247448:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 3/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529391.247453:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 4/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 13140 lvb_type: 1 00000100:00100000:1.0:1651529391.247458:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529391.247483:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fbf83597 going to sleep for 6 seconds 00000100:00100000:0.0:1651529391.247785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529391.247801:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000949e31c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529391.247825:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 3/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 11 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.247830:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5dfcad9, rc 0) 00000100:00100000:0.0:1651529391.247836:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396558272 00000100:00100000:1.0:1651529391.247842:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:413898:x1731746396558208:12345-10.240.43.64@tcp:101:grep.0 Request processed in 426us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529391.247845:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153821 00010000:00010000:0.0:1651529391.247853:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 4/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 13140 lvb_type: 1 00000100:00100000:0.0:1651529391.247865:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12730 00000100:00100000:0.0:1651529391.247868:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396558272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529391.247872:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529391.247878:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 4/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 13140 lvb_type: 1 00010000:00010000:0.0:1651529391.247883:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 3/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 13140 lvb_type: 1 00010000:00010000:0.0:1651529391.247892:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0a3b lrc: 0/0,0 mode: --/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da522 expref: 11 pid: 127526 timeout: 13140 lvb_type: 1 00010000:00010000:0.0:1651529391.247897:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.247907:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.247909:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 2/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 10 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.247913:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 3/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 10 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.247924:0:127517:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 3/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 10 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.247928:0:127517:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:127517:1731745966715712:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651529391.247941:0:127517:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d0891b3f going to sleep for 6 seconds 00000100:00100000:0.0:1651529391.248355:0:127517:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007378f4ed pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:127517:1731745966715712:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651529391.248360:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529391.248369:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a7dfce9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396558272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 501us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529391.248372:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12730 00000100:00100000:0.0:1651529391.286435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286446:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286459:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589952 00000100:00100000:0.0:1651529391.286460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286471:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590080 00000100:00100000:1.0:1651529391.286476:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590208 00000100:00100000:0.0:1651529391.286478:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590336 00000100:00100000:1.0:1651529391.286481:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153822 00000100:00100000:1.0:1651529391.286482:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946589952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529391.286491:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153823 00000100:00100000:0.0:1651529391.286493:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946590080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.286496:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178559 count 1 00002000:00080000:0.0:1651529391.286501:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178561 count 1 00002000:00010000:1.0:1651529391.286504:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b97f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286506:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 3/0,1 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.286509:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b981:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286510:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286511:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286511:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 3/0,1 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286512:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286517:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286520:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286524:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286530:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286531:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286532:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286537:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286540:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286553:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.286633:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946589952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 149us (198us total) trans 30064894632 rc 0/0 00000100:00100000:1.0:1651529391.286636:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153822 00000100:00100000:0.0:1651529391.286638:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946590080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 144us (192us total) trans 30064894633 rc 0/0 00000100:00100000:1.0:1651529391.286641:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153824 00000100:00100000:1.0:1651529391.286643:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946590208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529391.286643:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153823 00002000:00080000:1.0:1651529391.286648:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178563 count 1 00000100:00100000:0.0:1651529391.286649:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153825 00000100:00100000:0.0:1651529391.286651:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946590336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529391.286654:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b983:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286655:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 3/0,1 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.286656:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178565 count 1 00010000:00010000:1.0:1651529391.286659:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286660:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286661:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.286663:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b985:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286664:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286665:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 3/0,1 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286668:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286669:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286669:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286670:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286670:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286674:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286678:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286680:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.286728:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946590208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (276us total) trans 30064894634 rc 0/0 00000100:00100000:0.0:1651529391.286729:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946590336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (269us total) trans 30064894635 rc 0/0 00000100:00100000:1.0:1651529391.286731:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153824 00000100:00100000:0.0:1651529391.286733:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153825 00010000:00010000:1.0:1651529391.286744:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286748:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.286750:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286753:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 3/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286769:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 1/0,0 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286772:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0a49 lrc: 0/0,0 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286778:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286780:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcf340a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.286781:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286787:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 3/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286790:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 1/0,0 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286793:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0a50 lrc: 0/0,0 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286796:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286799:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000030b026f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.286800:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286819:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 3/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286823:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 1/0,0 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286826:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030b026f/0xa29a79078f3c0a57 lrc: 0/0,0 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286830:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286833:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003efc2cef already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.286834:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286837:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 3/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286840:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 1/0,0 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286842:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003efc2cef/0xa29a79078f3c0a5e lrc: 0/0,0 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.286891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286931:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590016 00000100:00100000:1.0:1651529391.286946:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590144 00000100:00100000:1.0:1651529391.286950:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590272 00000100:00100000:1.0:1651529391.286954:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153826 00000100:00100000:1.0:1651529391.286956:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946590016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.286961:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178560 count 1 00002000:00010000:1.0:1651529391.286968:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b980:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286969:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 3/0,1 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286973:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286974:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286975:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.286986:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153827 00000100:00100000:0.0:1651529391.286990:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946590144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.287000:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178562 count 1 00010000:00010000:1.0:1651529391.287001:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287010:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287013:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.287031:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b982:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529391.287032:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153828 00000100:00100000:1.0:1651529391.287034:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946590272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529391.287035:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 3/0,1 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.287040:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178564 count 1 00002000:00010000:1.0:1651529391.287045:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b984:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287046:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 3/0,1 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287049:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287050:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287051:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287054:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287055:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287055:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287056:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287057:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287060:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287061:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287067:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287070:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287072:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287075:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2712372 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287076:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287085:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 3/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287090:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 1/0,0 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287093:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2712372/0xa29a79078f3c0a65 lrc: 0/0,0 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287097:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287100:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000306a57a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287101:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287106:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 3/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287109:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 1/0,0 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287111:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000306a57a/0xa29a79078f3c0a73 lrc: 0/0,0 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287115:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287117:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc44840e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287118:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287120:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 3/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287124:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 1/0,0 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287126:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc44840e/0xa29a79078f3c0a6c lrc: 0/0,0 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287147:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590400 00000100:00100000:1.0:1651529391.287154:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153829 00000100:00100000:1.0:1651529391.287155:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946590400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529391.287285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.287295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287302:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590528 00000100:00100000:0.0:1651529391.287304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287309:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590656 00000100:00100000:0.0:1651529391.287312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287331:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590464 00000100:00100000:1.0:1651529391.287337:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590592 00000100:00100000:0.0:1651529391.287339:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153830 00000100:00100000:1.0:1651529391.287342:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153831 00000100:00100000:0.0:1651529391.287342:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946590528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.287344:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946590656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.287350:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153832 00000100:00100000:1.0:1651529391.287352:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946590464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.287356:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153833 00000100:00100000:1.0:1651529391.287358:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946590592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.287384:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178566 count 1 00002000:00010000:1.0:1651529391.287391:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b986:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287392:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 3/0,1 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287398:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946590144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 408us (489us total) trans 30064894636 rc 0/0 00010000:00010000:1.0:1651529391.287401:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529391.287401:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153827 00010000:00010000:1.0:1651529391.287402:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287403:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287406:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287409:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287412:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287455:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946590400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 299us (315us total) trans 30064894639 rc 0/0 00000100:00100000:1.0:1651529391.287458:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153829 00010000:00010000:1.0:1651529391.287466:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287469:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ccb916 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287471:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287473:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 3/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287478:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 1/0,0 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287481:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ccb916/0xa29a79078f3c0a7a lrc: 0/0,0 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287508:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946590016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 552us (617us total) trans 30064894637 rc 0/0 00000100:00100000:1.0:1651529391.287511:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153826 00002000:00080000:0.0:1651529391.287545:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178568 count 1 00000100:00100000:1.0:1651529391.287550:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:39030:x1731745946590272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 515us (628us total) trans 30064894638 rc 0/0 00002000:00010000:0.0:1651529391.287553:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b988:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529391.287554:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153828 00010000:00010000:0.0:1651529391.287555:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 3/0,1 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287559:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287560:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287561:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287565:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287568:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.287571:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178570 count 1 00010000:00010000:0.0:1651529391.287571:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.287582:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287584:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 3/0,1 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287588:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287589:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287589:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287593:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287596:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287599:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287616:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946590528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 274us (332us total) trans 30064894640 rc 0/0 00000100:00100000:0.0:1651529391.287620:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153830 00000100:00100000:1.0:1651529391.287640:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946590656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 295us (344us total) trans 30064894641 rc 0/0 00000100:00100000:1.0:1651529391.287643:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153831 00010000:00010000:1.0:1651529391.287651:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287654:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d320122 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287655:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287658:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 3/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287663:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 1/0,0 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287666:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d320122/0xa29a79078f3c0a81 lrc: 0/0,0 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287670:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287673:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d3269cb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287673:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287676:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 3/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287679:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 1/0,0 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287682:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3269cb/0xa29a79078f3c0a88 lrc: 0/0,0 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.287700:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178567 count 1 00002000:00010000:1.0:1651529391.287710:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b987:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287711:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 3/0,1 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287715:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287716:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287716:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287720:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287723:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287725:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287772:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946590464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 419us (468us total) trans 30064894642 rc 0/0 00000100:00100000:1.0:1651529391.287775:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153832 00010000:00010000:1.0:1651529391.287783:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287786:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1f871a0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287787:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287789:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 3/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287802:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 1/0,0 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287817:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f871a0/0xa29a79078f3c0a8f lrc: 0/0,0 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.287834:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178569 count 1 00002000:00010000:1.0:1651529391.287839:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b989:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287841:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 3/0,1 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287844:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287845:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287846:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287849:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287852:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287855:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287934:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946590592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 574us (621us total) trans 30064894643 rc 0/0 00000100:00100000:1.0:1651529391.287945:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153833 00010000:00010000:1.0:1651529391.287961:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287965:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002360c752 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.287966:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287969:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 3/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287974:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 1/0,0 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287977:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002360c752/0xa29a79078f3c0a96 lrc: 0/0,0 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288132:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.288160:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591296 00000100:00100000:1.0:1651529391.288167:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591424 00000100:00100000:1.0:1651529391.288182:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153834 00000100:00100000:1.0:1651529391.288183:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946591296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.288189:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178572 count 1 00000100:00100000:0.0:1651529391.288192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529391.288194:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288202:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 3/0,1 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288206:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529391.288212:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288219:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288220:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288224:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288227:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288229:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288229:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591232 00000100:00100000:0.0:1651529391.288239:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591360 00000100:00100000:0.0:1651529391.288264:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591488 00000100:00100000:0.0:1651529391.288269:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591680 00000100:00100000:0.0:1651529391.288273:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153835 00000100:00100000:0.0:1651529391.288275:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946591424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.288281:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178574 count 1 00000100:00100000:1.0:1651529391.288287:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946591296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (156us total) trans 30064894644 rc 0/0 00000100:00100000:1.0:1651529391.288291:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153834 00002000:00010000:0.0:1651529391.288293:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288295:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 3/0,1 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288296:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153836 00000100:00100000:1.0:1651529391.288298:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529391.288302:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288302:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529391.288303:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178571 count 1 00010000:00010000:0.0:1651529391.288303:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288307:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.288308:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288310:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 3/0,1 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288310:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288313:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288314:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288314:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288315:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288319:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288329:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288332:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288374:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (228us total) trans 30064894645 rc 0/0 00000100:00100000:1.0:1651529391.288375:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (183us total) trans 30064894646 rc 0/0 00000100:00100000:0.0:1651529391.288378:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153835 00000100:00100000:1.0:1651529391.288379:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153836 00000100:00100000:0.0:1651529391.288383:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153837 00000100:00100000:1.0:1651529391.288386:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153838 00000100:00100000:0.0:1651529391.288386:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.288387:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.288390:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178573 count 1 00002000:00080000:1.0:1651529391.288392:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178575 count 1 00002000:00010000:1.0:1651529391.288397:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529391.288397:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b98d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288398:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 3/0,1 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288399:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 3/0,1 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288402:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288402:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288403:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288403:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288403:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288403:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288407:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288407:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288410:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288411:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288413:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288415:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288450:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (238us total) trans 30064894648 rc 0/0 00000100:00100000:1.0:1651529391.288453:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153838 00000100:00100000:0.0:1651529391.288455:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (250us total) trans 30064894647 rc 0/0 00000100:00100000:0.0:1651529391.288458:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153837 00000100:00100000:1.0:1651529391.288460:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153839 00000100:00100000:1.0:1651529391.288461:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.288465:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178577 count 1 00002000:00010000:1.0:1651529391.288471:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b991:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288472:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 3/0,1 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288475:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288476:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529391.288476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288477:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288480:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288483:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288486:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288521:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591616 00000100:00100000:0.0:1651529391.288547:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591808 00000100:00100000:1.0:1651529391.288555:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946591680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (333us total) trans 30064894649 rc 0/0 00000100:00100000:1.0:1651529391.288558:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153839 00000100:00100000:1.0:1651529391.288564:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153840 00000100:00100000:1.0:1651529391.288565:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529391.288567:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153841 00000100:00100000:0.0:1651529391.288570:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946591808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.288571:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178576 count 1 00002000:00010000:1.0:1651529391.288577:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b990:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288578:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 3/0,1 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.288579:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178578 count 1 00010000:00010000:1.0:1651529391.288582:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288583:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288584:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288587:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.288588:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b992:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288590:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288592:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288613:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 3/0,1 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288620:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288621:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288622:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288629:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288634:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288636:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946591616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (160us total) trans 30064894650 rc 0/0 00010000:00010000:0.0:1651529391.288640:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288641:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153840 00010000:00010000:1.0:1651529391.288649:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288652:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c6d6d282 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288653:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288656:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 3/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288660:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 1/0,0 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288663:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d6d282/0xa29a79078f3c0a9d lrc: 0/0,0 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288668:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288670:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b634d3da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288671:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288674:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 3/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288680:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 1/0,0 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288682:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634d3da/0xa29a79078f3c0aa4 lrc: 0/0,0 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288686:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288688:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1fc51a5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288689:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288692:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 3/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288695:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 1/0,0 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288697:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fc51a5/0xa29a79078f3c0aab lrc: 0/0,0 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288698:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946591808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 127us (206us total) trans 30064894651 rc 0/0 00010000:00010000:1.0:1651529391.288700:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288702:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153841 00010000:00010000:1.0:1651529391.288703:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006bfcf3fb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288704:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288707:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 3/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288710:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 1/0,0 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288712:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bfcf3fb/0xa29a79078f3c0ab2 lrc: 0/0,0 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288715:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288718:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c259925 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288719:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288721:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 3/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288724:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 1/0,0 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288727:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c259925/0xa29a79078f3c0ab9 lrc: 0/0,0 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288733:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288735:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9c803a4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288736:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288739:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 3/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288741:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 1/0,0 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288744:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c803a4/0xa29a79078f3c0ac0 lrc: 0/0,0 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288747:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288750:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044c25a68 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288750:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288753:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 3/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288768:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288776:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 1/0,0 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288779:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c0ac7 lrc: 0/0,0 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288783:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288786:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c24392a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.288786:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288789:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 3/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288792:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 1/0,0 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288795:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c24392a/0xa29a79078f3c0ace lrc: 0/0,0 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288824:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592384 00000100:00100000:1.0:1651529391.288839:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592512 00000100:00100000:1.0:1651529391.288843:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592448 00000100:00100000:1.0:1651529391.288847:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153842 00000100:00100000:1.0:1651529391.288848:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946592384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.288861:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178579 count 1 00000100:00100000:0.0:1651529391.288863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529391.288867:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b993:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288869:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 3/0,1 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.288872:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288873:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288874:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288877:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288878:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592576 00010000:00010000:1.0:1651529391.288880:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288883:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288884:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592640 00000100:00100000:0.0:1651529391.288887:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153843 00000100:00100000:0.0:1651529391.288889:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946592512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.288894:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178581 count 1 00002000:00010000:0.0:1651529391.288901:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b995:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288903:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 3/0,1 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288909:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288910:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288911:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288914:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288917:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288920:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288927:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (168us total) trans 30064894652 rc 0/0 00000100:00100000:1.0:1651529391.288931:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153842 00000100:00100000:1.0:1651529391.288936:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153844 00000100:00100000:1.0:1651529391.288938:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946592448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.288942:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178580 count 1 00002000:00010000:1.0:1651529391.288947:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b994:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288949:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 3/0,1 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288967:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288968:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288969:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288973:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288976:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288979:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289001:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946592512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 111us (217us total) trans 30064894653 rc 0/0 00000100:00100000:0.0:1651529391.289004:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153843 00000100:00100000:0.0:1651529391.289010:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153845 00000100:00100000:0.0:1651529391.289011:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.289016:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (223us total) trans 30064894654 rc 0/0 00002000:00080000:0.0:1651529391.289016:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178582 count 1 00000100:00100000:1.0:1651529391.289019:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153844 00002000:00010000:0.0:1651529391.289022:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b996:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289024:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 3/0,1 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289025:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153846 00000100:00100000:1.0:1651529391.289026:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946592640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529391.289028:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289028:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289029:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.289031:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178583 count 1 00010000:00010000:0.0:1651529391.289033:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.289036:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b997:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289036:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289038:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 3/0,1 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289039:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289041:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289042:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289043:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289055:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289058:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289061:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289091:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946592576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (228us total) trans 30064894655 rc 0/0 00000100:00100000:0.0:1651529391.289094:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153845 00000100:00100000:1.0:1651529391.289098:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (226us total) trans 30064894656 rc 0/0 00000100:00100000:1.0:1651529391.289101:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153846 00010000:00010000:1.0:1651529391.289111:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289114:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079f5db30 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289115:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289118:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 3/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289123:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 1/0,0 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289126:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c0ad5 lrc: 0/0,0 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289138:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289141:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006872a4bf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289141:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289144:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 3/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289147:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 1/0,0 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289150:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006872a4bf/0xa29a79078f3c0adc lrc: 0/0,0 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289153:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289156:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f016294 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289156:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289159:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 3/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289170:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 1/0,0 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289172:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c0ae3 lrc: 0/0,0 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289181:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592768 00000100:00100000:0.0:1651529391.289188:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592704 00000100:00100000:0.0:1651529391.289195:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592832 00000100:00100000:0.0:1651529391.289199:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153847 00000100:00100000:0.0:1651529391.289200:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946592768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.289205:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178585 count 1 00010000:00010000:1.0:1651529391.289207:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289210:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004fc3b419 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289211:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.289212:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b999:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289213:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 3/0,1 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289214:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 3/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289217:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 1/0,0 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289217:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289218:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289219:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289220:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc3b419/0xa29a79078f3c0aea lrc: 0/0,0 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289222:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289223:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289226:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000962f47d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529391.289226:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289228:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289233:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289236:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 3/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289239:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 1/0,0 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289242:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c0af1 lrc: 0/0,0 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289246:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289249:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9d270f1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289250:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289252:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 3/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289255:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 1/0,0 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289258:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d270f1/0xa29a79078f3c0af8 lrc: 0/0,0 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289274:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153848 00000100:00100000:1.0:1651529391.289276:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.289281:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178584 count 1 00002000:00010000:1.0:1651529391.289286:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b998:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529391.289287:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 85us (157us total) trans 30064894657 rc 0/0 00010000:00010000:1.0:1651529391.289288:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 3/0,1 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289290:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153847 00010000:00010000:1.0:1651529391.289291:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289292:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289292:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289295:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153849 00010000:00010000:1.0:1651529391.289296:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289297:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946592832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529391.289299:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289301:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.289301:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178586 count 1 00002000:00010000:0.0:1651529391.289327:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289329:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 3/0,1 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289333:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289334:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289335:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289338:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289340:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (197us total) trans 30064894658 rc 0/0 00000100:00100000:1.0:1651529391.289342:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153848 00010000:00010000:0.0:1651529391.289342:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289344:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289360:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289373:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e7621 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289374:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289377:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 3/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289382:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 1/0,0 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289384:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c0aff lrc: 0/0,0 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289389:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289391:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062d024ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289392:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289395:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 3/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289398:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 1/0,0 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289403:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d024ae/0xa29a79078f3c0b06 lrc: 0/0,0 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289410:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 101us (245us total) trans 30064894659 rc 0/0 00000100:00100000:0.0:1651529391.289413:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153849 00000100:00100000:1.0:1651529391.289486:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289496:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593408 00000100:00100000:1.0:1651529391.289498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289514:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593472 00000100:00100000:1.0:1651529391.289515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289522:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593600 00000100:00100000:0.0:1651529391.289528:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593536 00000100:00100000:1.0:1651529391.289535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289542:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593664 00000100:00100000:0.0:1651529391.289546:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153850 00000100:00100000:0.0:1651529391.289548:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946593408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.289550:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153851 00000100:00100000:1.0:1651529391.289552:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946593472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.289553:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178587 count 1 00002000:00080000:1.0:1651529391.289557:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178588 count 1 00002000:00010000:0.0:1651529391.289559:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289561:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 3/0,1 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.289564:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289565:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 3/0,1 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289565:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289565:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289566:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289569:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289570:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289570:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289570:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289574:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289576:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289577:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289578:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289582:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289624:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946593408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (138us total) trans 30064894660 rc 0/0 00000100:00100000:0.0:1651529391.289627:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153850 00000100:00100000:1.0:1651529391.289629:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946593472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (131us total) trans 30064894661 rc 0/0 00000100:00100000:0.0:1651529391.289632:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153852 00000100:00100000:1.0:1651529391.289634:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153851 00000100:00100000:0.0:1651529391.289634:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946593600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.289638:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178590 count 1 00000100:00100000:1.0:1651529391.289640:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153853 00000100:00100000:1.0:1651529391.289641:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946593536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.289646:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178589 count 1 00002000:00010000:1.0:1651529391.289651:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289653:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 3/0,1 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289656:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289657:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289658:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289669:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.289669:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289673:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289675:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289686:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 3/0,1 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289691:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289692:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289692:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289696:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289700:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289714:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946593536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (199us total) trans 30064894662 rc 0/0 00010000:00010000:0.0:1651529391.289714:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289717:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153853 00000100:00100000:1.0:1651529391.289722:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153854 00000100:00100000:1.0:1651529391.289724:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946593664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.289728:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178591 count 1 00002000:00010000:1.0:1651529391.289734:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b99f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289736:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 3/0,1 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289739:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289740:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289740:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289744:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289747:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289749:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289756:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946593600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 121us (249us total) trans 30064894663 rc 0/0 00000100:00100000:0.0:1651529391.289768:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153852 00000100:00100000:1.0:1651529391.289794:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946593664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (262us total) trans 30064894664 rc 0/0 00000100:00100000:1.0:1651529391.289799:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153854 00000100:00100000:0.0:1651529391.289829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289830:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289839:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c540a557 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289840:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289843:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 3/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289848:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 1/0,0 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289851:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c540a557/0xa29a79078f3c0b0d lrc: 0/0,0 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289855:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289858:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdac3b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289859:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289861:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 3/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289867:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 1/0,0 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289869:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c0b14 lrc: 0/0,0 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289873:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289875:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003044d8ef already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529391.289881:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593728 00000100:00100000:0.0:1651529391.289888:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593856 00000100:00100000:0.0:1651529391.289891:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593792 00010000:00010000:1.0:1651529391.289894:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289898:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153855 00000100:00100000:0.0:1651529391.289900:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946593728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.289906:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178592 count 1 00010000:00010000:1.0:1651529391.289908:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 3/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289912:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 1/0,0 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.289912:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289914:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c0b22 lrc: 0/0,0 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289914:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 3/0,1 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289917:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289918:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289918:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289919:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289921:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047613beb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289922:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289923:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289925:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 3/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289928:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 1/0,0 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289931:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047613beb/0xa29a79078f3c0b1b lrc: 0/0,0 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289934:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289936:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289937:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289937:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289939:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289940:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 3/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289943:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 1/0,0 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289945:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c0b29 lrc: 0/0,0 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289951:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289954:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcf340a7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.289955:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289957:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 3/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289960:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 1/0,0 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289963:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf340a7/0xa29a79078f3c0b30 lrc: 0/0,0 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289970:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153856 00000100:00100000:1.0:1651529391.289972:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946593856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.289977:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178594 count 1 00002000:00010000:1.0:1651529391.289983:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289984:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 3/0,1 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289987:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289988:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289988:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289992:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289995:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289995:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946593728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (166us total) trans 30064894665 rc 0/0 00010000:00010000:1.0:1651529391.289997:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289998:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153855 00000100:00100000:0.0:1651529391.290003:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153857 00000100:00100000:0.0:1651529391.290005:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946593792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.290010:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178593 count 1 00002000:00010000:0.0:1651529391.290016:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290017:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 3/0,1 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290021:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290022:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290022:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290026:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290029:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290043:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290046:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946593856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (200us total) trans 30064894666 rc 0/0 00000100:00100000:1.0:1651529391.290049:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153856 00010000:00010000:1.0:1651529391.290057:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290060:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290061:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290064:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 3/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290068:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 1/0,0 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290071:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c0b37 lrc: 0/0,0 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290084:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290087:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003416f7b2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290088:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290090:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 3/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290094:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 1/0,0 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290096:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0b3e lrc: 0/0,0 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290115:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946593792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 109us (257us total) trans 30064894667 rc 0/0 00000100:00100000:1.0:1651529391.290130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290131:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153857 00000100:00100000:0.0:1651529391.290136:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594176 00000100:00100000:0.0:1651529391.290147:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153858 00000100:00100000:0.0:1651529391.290148:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946594176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.290152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529391.290153:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178595 count 1 00002000:00010000:0.0:1651529391.290159:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290160:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 3/0,1 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290162:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529391.290164:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290165:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290165:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290169:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290172:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290174:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290211:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594304 00000100:00100000:1.0:1651529391.290217:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594432 00000100:00100000:1.0:1651529391.290219:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594240 00000100:00100000:1.0:1651529391.290221:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594368 00000100:00100000:0.0:1651529391.290226:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946594176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (96us total) trans 30064894668 rc 0/0 00000100:00100000:0.0:1651529391.290229:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153858 00000100:00100000:1.0:1651529391.290231:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153859 00000100:00100000:1.0:1651529391.290233:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946594304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.290246:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178597 count 1 00000100:00100000:0.0:1651529391.290250:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153860 00002000:00010000:1.0:1651529391.290251:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529391.290252:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946594432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529391.290253:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 3/0,1 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290257:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290257:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529391.290257:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178599 count 1 00010000:00010000:1.0:1651529391.290258:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290262:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.290263:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290265:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290265:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 3/0,1 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290268:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290268:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290269:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290270:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290274:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290277:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290279:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290314:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946594304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (162us total) trans 30064894669 rc 0/0 00000100:00100000:1.0:1651529391.290317:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153859 00000100:00100000:1.0:1651529391.290322:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153861 00000100:00100000:1.0:1651529391.290324:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946594240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529391.290327:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946594432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (165us total) trans 30064894670 rc 0/0 00002000:00080000:1.0:1651529391.290328:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178596 count 1 00000100:00100000:0.0:1651529391.290332:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153860 00002000:00010000:1.0:1651529391.290333:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290335:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 3/0,1 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290338:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153862 00000100:00100000:0.0:1651529391.290339:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946594368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.290344:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178598 count 1 00010000:00010000:1.0:1651529391.290347:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290348:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290349:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.290349:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290350:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 3/0,1 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290352:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290354:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290354:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290355:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290355:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290358:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290359:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290376:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290379:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290392:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946594240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (196us total) trans 30064894671 rc 0/0 00000100:00100000:1.0:1651529391.290395:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153861 00010000:00010000:1.0:1651529391.290403:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290407:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000806805c0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290408:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290410:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 3/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290416:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946594368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (211us total) trans 30064894672 rc 0/0 00000100:00100000:0.0:1651529391.290419:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153862 00010000:00010000:1.0:1651529391.290425:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 1/0,0 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290428:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0b45 lrc: 0/0,0 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290432:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290435:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290436:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290439:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 3/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290441:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 1/0,0 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290444:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c0b4c lrc: 0/0,0 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290447:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290450:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b4498e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290451:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290454:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 3/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290465:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 1/0,0 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290468:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0b53 lrc: 0/0,0 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.290472:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290475:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290475:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290478:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 3/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290481:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 1/0,0 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.290484:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c0b5a lrc: 0/0,0 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290489:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290492:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000590e4cfe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.290492:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.290495:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 3/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290498:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 1/0,0 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290501:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0b61 lrc: 0/0,0 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290509:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594560 00000100:00100000:0.0:1651529391.290518:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594496 00000100:00100000:1.0:1651529391.290545:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594624 00000100:00100000:0.0:1651529391.290547:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153863 00000100:00100000:0.0:1651529391.290549:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946594560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.290551:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153864 00000100:00100000:1.0:1651529391.290553:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946594496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.290554:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178601 count 1 00002000:00080000:1.0:1651529391.290558:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178600 count 1 00002000:00010000:0.0:1651529391.290560:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290562:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 3/0,1 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.290564:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290565:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 3/0,1 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290565:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290566:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290567:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290569:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290569:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290570:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290571:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290574:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290574:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290576:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290577:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290579:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290629:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946594496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (146us total) trans 30064894674 rc 0/0 00000100:00100000:1.0:1651529391.290633:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153864 00000100:00100000:1.0:1651529391.290638:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153865 00000100:00100000:1.0:1651529391.290640:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946594624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.290644:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178602 count 1 00002000:00010000:1.0:1651529391.290649:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290651:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 3/0,1 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290653:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946594560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (184us total) trans 30064894673 rc 0/0 00010000:00010000:1.0:1651529391.290654:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290655:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290656:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290658:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153863 00010000:00010000:1.0:1651529391.290659:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290662:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290665:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290685:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290702:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946594624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (209us total) trans 30064894675 rc 0/0 00000100:00100000:1.0:1651529391.290705:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153865 00000100:00100000:1.0:1651529391.290709:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595200 00000100:00100000:1.0:1651529391.290723:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153866 00000100:00100000:1.0:1651529391.290725:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946595200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.290730:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178603 count 1 00002000:00010000:1.0:1651529391.290735:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290736:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 3/0,1 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.290740:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290740:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290741:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290745:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290748:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290751:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290821:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946595200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (119us total) trans 30064894676 rc 0/0 00000100:00100000:0.0:1651529391.290822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290824:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153866 00000100:00100000:1.0:1651529391.290829:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595264 00000100:00100000:1.0:1651529391.290833:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595392 00000100:00100000:1.0:1651529391.290835:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595328 00000100:00100000:1.0:1651529391.290838:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595456 00000100:00100000:1.0:1651529391.290840:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153867 00000100:00100000:0.0:1651529391.290845:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153868 00000100:00100000:0.0:1651529391.290847:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946595392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529391.290849:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946595264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529391.290853:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178606 count 1 00002000:00080000:1.0:1651529391.290854:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178604 count 1 00002000:00010000:1.0:1651529391.290859:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529391.290859:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290861:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 3/0,1 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290861:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 3/0,1 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290864:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290865:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290865:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290865:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290866:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290866:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290870:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290870:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290873:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290873:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290878:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290891:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290918:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946595264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (182us total) trans 30064894677 rc 0/0 00000100:00100000:1.0:1651529391.290921:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153867 00000100:00100000:1.0:1651529391.290926:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153869 00000100:00100000:1.0:1651529391.290928:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946595328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529391.290932:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178605 count 1 00002000:00010000:1.0:1651529391.290937:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290939:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 3/0,1 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290939:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946595392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (149us total) trans 30064894678 rc 0/0 00010000:00010000:1.0:1651529391.290942:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529391.290942:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153868 00010000:00010000:1.0:1651529391.290943:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290944:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290947:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290948:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153870 00010000:00010000:1.0:1651529391.290950:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290950:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946595456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529391.290953:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.290954:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178607 count 1 00002000:00010000:0.0:1651529391.290959:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290961:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 3/0,1 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290964:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290965:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290966:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290969:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290972:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290975:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290988:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946595328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (188us total) trans 30064894679 rc 0/0 00000100:00100000:1.0:1651529391.290991:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153869 00010000:00010000:1.0:1651529391.291001:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291005:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa865cce already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291006:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.291008:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946595456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (186us total) trans 30064894680 rc 0/0 00010000:00010000:1.0:1651529391.291009:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 3/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.291011:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153870 00010000:00010000:1.0:1651529391.291013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 1/0,0 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291016:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0b68 lrc: 0/0,0 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291020:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291022:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291023:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291028:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 3/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291031:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 1/0,0 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291034:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c0b6f lrc: 0/0,0 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291037:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291040:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291040:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291043:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 3/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291067:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 1/0,0 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291075:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c0b76 lrc: 0/0,0 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291079:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291090:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291091:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291093:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 3/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291097:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 1/0,0 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291100:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c0b7d lrc: 0/0,0 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291103:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291106:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfdfe09b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291107:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291110:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 3/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291113:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 1/0,0 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291122:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdfe09b/0xa29a79078f3c0b8b lrc: 0/0,0 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291126:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291128:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4f97720 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291129:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291132:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 3/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291135:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 1/0,0 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291138:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0b84 lrc: 0/0,0 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291141:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291143:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291144:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291153:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 3/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291157:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 1/0,0 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291160:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0b92 lrc: 0/0,0 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291163:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291166:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040c1504b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529391.291166:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291169:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 3/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291172:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 1/0,0 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291174:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0b99 lrc: 0/0,0 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.293860:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966715776:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529391.293863:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966715840:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529391.294167:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966715840:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529391.294167:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077faa899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966715776:10.240.43.61@tcp:400:kworker/u4:0.0 00000001:00080000:1.0:1651529391.480129:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894635 is committed 00000001:00080000:1.0:1651529391.480136:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894631 is committed 00000400:00000080:0.0:1651529392.614393:0:167752:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529392.614406:0:167752:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127b: verify the llite client stats are sane ========================================================== 22:09:52 (1651529392) 00000100:00100000:0.0:1651529392.673776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529392.673795:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559296 00002000:00100000:0.0:1651529392.673829:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b1:0x0] (0->588) req@0000000077faa899 x1731746396559296/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 1080/0 e 0 to 0 dl 1651529398 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651529392.673836:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000077faa899 with x1731746396559296 ext(0->588) 00002000:00010000:0.0:1651529392.673839:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000077faa899 00000100:00100000:0.0:1651529392.673850:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15752 00000100:00100000:0.0:1651529392.673852:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41279:x1731746396559296:12345-10.240.43.64@tcp:4:bash.0 00000100:00100000:0.0:1651529392.674311:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396559296:12345-10.240.43.64@tcp:4:bash.0 Request processed in 458us (537us total) trans 30064894681 rc 0/0 00000100:00100000:0.0:1651529392.674316:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15752 00002000:00100000:0.0:1651529392.674319:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b1:0x0] (0->588) req@0000000077faa899 x1731746396559296/t30064894681(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 1080/448 e 0 to 0 dl 1651529398 ref 1 fl Complete:/0/0 rc 0/0 job:'bash.0' 00002000:00100000:0.0:1651529392.674323:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000077faa899 with x1731746396559296 ext(0->588) 00002000:00010000:0.0:1651529392.674325:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000077faa899 00000100:00100000:0.0:1651529392.675385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529392.675396:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559360 00000100:00100000:0.0:1651529392.675409:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 82 00000100:00100000:0.0:1651529392.675411:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:357524:x1731746396559360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529392.675417:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1651529392.675422:0:127517:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b1:0x0] updating lvb size from disk: 0 -> 589 00002000:00010000:0.0:1651529392.675423:0:127517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b1:0x0] updating lvb mtime from disk: 0 -> 1651529391 00002000:00010000:0.0:1651529392.675424:0:127517:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b1:0x0] updating lvb atime from disk: 0 -> 1651529391 00002000:00010000:0.0:1651529392.675425:0:127517:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b1:0x0] updating lvb ctime from disk: 0 -> 1651529391 00002000:00010000:0.0:1651529392.675435:0:127517:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b1:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1651529392.675447:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5dfcad9/0xa29a79078f3c0a42 lrc: 0/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da530 expref: 9 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.675459:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aba5b52/0xa29a79078f3c0a34 lrc: 0/0,0 mode: --/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da50d expref: 8 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.675464:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529392.675480:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:357524:x1731746396559360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 68us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529392.675483:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 82 00000400:00000080:1.0:1651529393.940928:0:167971:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529393.940931:0:167971:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127c: test llite extent stats with regular 00000100:00100000:0.0:1651529393.978712:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529393.978738:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396560896 00000100:00100000:1.0:1651529393.978769:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153871 00000100:00100000:1.0:1651529393.978772:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:415096:x1731746396560896:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529393.978782:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529393.978794:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 2/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da592 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529393.978821:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529393.978832:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529393.978833:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529393.978837:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 8 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529393.978845:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 8 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529393.978851:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d8e7f88a, rc 0) 00000100:00100000:1.0:1651529393.978876:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:415096:x1731746396560896:12345-10.240.43.64@tcp:101:dd.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529393.978879:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153871 00000100:00100000:0.0:1651529393.979127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529393.979138:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396561024 00002000:00010000:0.0:1651529393.979149:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178610/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529393.979151:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046c87d96 with x1731746396561024 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529393.979156:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046c87d96. 00000100:00100000:0.0:1651529393.979163:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15753 00000100:00100000:0.0:1651529393.979165:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41279:x1731746396561024:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529393.979241:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529393.979243:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb mtime from disk: 0 -> 1651529393 00002000:00010000:0.0:1651529393.979244:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529393.979245:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb ctime from disk: 0 -> 1651529393 00002000:00010000:0.0:1651529393.979246:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529393.979265:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c87d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396561024:12345-10.240.43.64@tcp:10:dd.0 Request processed in 99us (138us total) trans 30064894682 rc 0/0 00000100:00100000:0.0:1651529393.979269:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15753 00002000:00010000:0.0:1651529393.979277:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178610/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529393.979278:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046c87d96 with x1731746396561024 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529393.979280:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046c87d96. 00000100:00100000:0.0:1651529393.982691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529393.982699:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396561536 00002000:00010000:0.0:1651529393.982705:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178610/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529393.982706:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a128203e with x1731746396561536 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529393.982709:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a128203e. 00000100:00100000:0.0:1651529393.982714:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15754 00000100:00100000:0.0:1651529393.982716:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396561536:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529393.982740:0:144083:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529393.982742:0:144083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb mtime from disk: 1651529393 -> 1651529393 00002000:00010000:0.0:1651529393.982742:0:144083:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529393.982743:0:144083:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb ctime from disk: 1651529393 -> 1651529393 00002000:00010000:0.0:1651529393.982744:0:144083:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529393.982769:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a128203e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396561536:12345-10.240.43.64@tcp:10:dd.0 Request processed in 52us (79us total) trans 30064894683 rc 0/0 00000100:00100000:0.0:1651529393.982773:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15754 00002000:00010000:0.0:1651529393.982774:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178610/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529393.982775:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a128203e with x1731746396561536 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529393.982777:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a128203e. 00000100:00100000:0.0:1651529394.009368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.009393:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396563840 00000100:00100000:1.0:1651529394.009407:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153872 00000100:00100000:1.0:1651529394.009409:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:415106:x1731746396563840:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.009413:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.009418:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 2/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da5df expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.009424:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.009428:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.009429:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.009431:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 3/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 11 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.009436:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 3/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 11 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.009440:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b8457821, rc 0) 00000100:00100000:1.0:1651529394.009451:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:415106:x1731746396563840:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.009454:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153872 00000100:00100000:0.0:1651529394.013040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.013048:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396564352 00002000:00010000:0.0:1651529394.013054:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178611/0 (122880->18446744073709551615) 00002000:00100000:0.0:1651529394.013055:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d33ef30e with x1731746396564352 ext(122880->18446744073709551615) 00002000:00010000:0.0:1651529394.013066:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d33ef30e. 00000100:00100000:0.0:1651529394.013072:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15755 00000100:00100000:0.0:1651529394.013074:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396564352:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529394.013122:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b3:0x0] updating lvb size from disk: 0 -> 122880 00002000:00010000:0.0:1651529394.013123:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b3:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.013124:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529394.013125:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b3:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.013126:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529394.013143:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41279:x1731746396564352:12345-10.240.43.64@tcp:10:dd.0 Request processed in 68us (103us total) trans 30064894684 rc 0/0 00000100:00100000:0.0:1651529394.013146:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15755 00002000:00010000:0.0:1651529394.013148:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178611/0 (122880->18446744073709551615) 00002000:00100000:0.0:1651529394.013149:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d33ef30e with x1731746396564352 ext(122880->18446744073709551615) 00002000:00010000:0.0:1651529394.013150:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d33ef30e. 00000100:00100000:0.0:1651529394.039295:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.039319:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396566528 00000100:00100000:1.0:1651529394.039332:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153873 00000100:00100000:1.0:1651529394.039334:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:415116:x1731746396566528:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.039338:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.039342:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 2/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da633 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.039348:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.039352:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.039353:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.039355:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.039359:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.039363:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003add3d75, rc 0) 00000100:00100000:1.0:1651529394.039374:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:415116:x1731746396566528:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.039377:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153873 00000100:00100000:0.0:1651529394.043208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.043216:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396567040 00002000:00010000:0.0:1651529394.043222:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178612/0 (491520->18446744073709551615) 00002000:00100000:0.0:1651529394.043223:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002245d7d1 with x1731746396567040 ext(491520->18446744073709551615) 00002000:00010000:0.0:1651529394.043226:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002245d7d1. 00000100:00100000:0.0:1651529394.043232:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15756 00000100:00100000:0.0:1651529394.043234:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396567040:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529394.043264:0:144083:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b4:0x0] updating lvb size from disk: 0 -> 491520 00002000:00010000:0.0:1651529394.043265:0:144083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b4:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.043266:0:144083:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529394.043267:0:144083:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b4:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.043268:0:144083:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529394.043286:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396567040:12345-10.240.43.64@tcp:10:dd.0 Request processed in 52us (79us total) trans 30064894685 rc 0/0 00000100:00100000:0.0:1651529394.043290:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15756 00002000:00010000:0.0:1651529394.043291:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178612/0 (491520->18446744073709551615) 00002000:00100000:0.0:1651529394.043292:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002245d7d1 with x1731746396567040 ext(491520->18446744073709551615) 00002000:00010000:0.0:1651529394.043294:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002245d7d1. 00000100:00100000:0.0:1651529394.070744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.070772:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396569216 00000100:00100000:1.0:1651529394.070785:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153874 00000100:00100000:1.0:1651529394.070787:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:415126:x1731746396569216:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.070791:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.070795:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 2/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da687 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.070801:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.070817:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.070818:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.070820:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 15 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.070825:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 15 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.070832:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000071a5e057, rc 0) 00000100:00100000:1.0:1651529394.070843:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:415126:x1731746396569216:12345-10.240.43.64@tcp:101:dd.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.070846:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153874 00000100:00100000:0.0:1651529394.075303:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.075311:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396569728 00002000:00010000:0.0:1651529394.075317:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178613/0 (1966080->18446744073709551615) 00002000:00100000:0.0:1651529394.075318:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e0a6e736 with x1731746396569728 ext(1966080->18446744073709551615) 00002000:00010000:0.0:1651529394.075321:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e0a6e736. 00000100:00100000:0.0:1651529394.075326:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15757 00000100:00100000:0.0:1651529394.075328:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396569728:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529394.075357:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b5:0x0] updating lvb size from disk: 0 -> 1966080 00002000:00010000:0.0:1651529394.075358:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b5:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.075359:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529394.075360:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b5:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.075361:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529394.075378:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a6e736 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396569728:12345-10.240.43.64@tcp:10:dd.0 Request processed in 49us (76us total) trans 30064894686 rc 0/0 00000100:00100000:0.0:1651529394.075381:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15757 00002000:00010000:0.0:1651529394.075383:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178613/0 (1966080->18446744073709551615) 00002000:00100000:0.0:1651529394.075384:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e0a6e736 with x1731746396569728 ext(1966080->18446744073709551615) 00002000:00010000:0.0:1651529394.075386:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e0a6e736. 00000100:00100000:0.0:1651529394.107198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.107223:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396571904 00000100:00100000:1.0:1651529394.107237:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153875 00000100:00100000:1.0:1651529394.107238:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:415136:x1731746396571904:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.107242:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.107247:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 2/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da6db expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.107252:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.107256:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.107257:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.107259:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 17 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.107264:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 17 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.107267:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000068fe190e, rc 0) 00000100:00100000:1.0:1651529394.107278:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:415136:x1731746396571904:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.107281:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153875 00000100:00100000:0.0:1651529394.113964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.113974:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396572416 00002000:00010000:0.0:1651529394.113980:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178614/0 (7864320->18446744073709551615) 00002000:00100000:0.0:1651529394.113981:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdde08e with x1731746396572416 ext(7864320->18446744073709551615) 00002000:00010000:0.0:1651529394.113984:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bfdde08e. 00000100:00100000:0.0:1651529394.113990:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15758 00000100:00100000:0.0:1651529394.113991:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396572416:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529394.114022:0:144083:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b6:0x0] updating lvb size from disk: 0 -> 7864320 00002000:00010000:0.0:1651529394.114024:0:144083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b6:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.114025:0:144083:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529394.114025:0:144083:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b6:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.114026:0:144083:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529394.114044:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396572416:12345-10.240.43.64@tcp:10:dd.0 Request processed in 52us (80us total) trans 30064894687 rc 0/0 00000100:00100000:0.0:1651529394.114048:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15758 00002000:00010000:0.0:1651529394.114049:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178614/0 (7864320->18446744073709551615) 00002000:00100000:0.0:1651529394.114050:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdde08e with x1731746396572416 ext(7864320->18446744073709551615) 00002000:00010000:0.0:1651529394.114052:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bfdde08e. 00000100:00100000:0.0:1651529394.161401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.161428:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396574592 00000100:00100000:1.0:1651529394.161444:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153876 00000100:00100000:1.0:1651529394.161446:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:415146:x1731746396574592:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.161451:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.161457:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 2/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da72f expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.161464:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.161469:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.161470:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.161473:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 19 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.161478:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 19 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.161482:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfcbc7ed, rc 0) 00000100:00100000:1.0:1651529394.161496:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:415146:x1731746396574592:12345-10.240.43.64@tcp:101:dd.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.161499:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153876 00000100:00100000:0.0:1651529394.177328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.177338:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396575104 00002000:00010000:0.0:1651529394.177346:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178615/0 (31457280->18446744073709551615) 00002000:00100000:0.0:1651529394.177348:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000983fda71 with x1731746396575104 ext(31457280->18446744073709551615) 00002000:00010000:0.0:1651529394.177352:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000983fda71. 00000100:00100000:0.0:1651529394.177359:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15759 00000100:00100000:0.0:1651529394.177361:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396575104:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529394.177408:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b7:0x0] updating lvb size from disk: 0 -> 31457280 00002000:00010000:0.0:1651529394.177410:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b7:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.177411:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529394.177412:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b7:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:0.0:1651529394.177412:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529394.177431:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:41279:x1731746396575104:12345-10.240.43.64@tcp:10:dd.0 Request processed in 69us (104us total) trans 30064894688 rc 0/0 00000100:00100000:0.0:1651529394.177434:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15759 00002000:00010000:0.0:1651529394.177436:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178615/0 (31457280->18446744073709551615) 00002000:00100000:0.0:1651529394.177436:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000983fda71 with x1731746396575104 ext(31457280->18446744073709551615) 00002000:00010000:0.0:1651529394.177438:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000983fda71. 00000100:00100000:0.0:1651529394.293514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.293549:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396577536 00000100:00100000:1.0:1651529394.293573:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153877 00000100:00100000:1.0:1651529394.293575:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:415156:x1731746396577536:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.293585:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.293596:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 2/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da783 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.293607:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.293617:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.293618:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.293622:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 21 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.293628:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 21 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.293633:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c9cf9467, rc 0) 00000100:00100000:1.0:1651529394.293655:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:415156:x1731746396577536:12345-10.240.43.64@tcp:101:dd.0 Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.293658:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153877 00000100:00100000:0.0:1651529394.337037:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.337055:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396577664 00002000:00100000:0.0:1651529394.337078:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (0->4194303) req@000000001745b514 x1731746396577664/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529394.337084:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001745b514 with x1731746396577664 ext(0->4194303) 00002000:00010000:0.0:1651529394.337087:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001745b514 00000100:00100000:0.0:1651529394.337097:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15760 00000100:00100000:0.0:1651529394.337100:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:41278:x1731746396577664:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.340934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.341392:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396577792 00002000:00100000:0.0:1651529394.341411:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b8:0x0] (4194304->8388607) req@000000009a62f9b5 x1731746396577792/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529394.341420:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a62f9b5 with x1731746396577792 ext(4194304->8388607) 00002000:00010000:0.0:1651529394.341423:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009a62f9b5 00000100:00100000:0.0:1651529394.341439:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15761 00000100:00100000:0.0:1651529394.341442:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:41279:x1731746396577792:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.344991:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:41278:x1731746396577664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7886us (7954us total) trans 30064894689 rc 0/0 00000100:00100000:1.0:1651529394.344997:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15760 00002000:00100000:1.0:1651529394.345004:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (0->4194303) req@000000001745b514 x1731746396577664/t30064894689(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.345010:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001745b514 with x1731746396577664 ext(0->4194303) 00002000:00010000:1.0:1651529394.345013:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001745b514 00000100:00100000:1.0:1651529394.345230:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.345241:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396578048 00002000:00100000:1.0:1651529394.345255:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (8388608->12582911) req@00000000d6184e3b x1731746396578048/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.345259:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6184e3b with x1731746396578048 ext(8388608->12582911) 00002000:00010000:1.0:1651529394.345260:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d6184e3b 00000100:00100000:1.0:1651529394.345271:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15762 00000100:00100000:1.0:1651529394.345274:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:41278:x1731746396578048:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.350162:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a62f9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:41279:x1731746396577792:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8715us (9225us total) trans 30064894690 rc 0/0 00000100:00100000:1.0:1651529394.350169:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15761 00002000:00100000:1.0:1651529394.350177:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b8:0x0] (4194304->8388607) req@000000009a62f9b5 x1731746396577792/t30064894690(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.350182:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a62f9b5 with x1731746396577792 ext(4194304->8388607) 00002000:00010000:1.0:1651529394.350185:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009a62f9b5 00000100:00100000:1.0:1651529394.350294:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.350306:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396578432 00002000:00010000:1.0:1651529394.350319:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178616/0 (125829120->18446744073709551615) 00002000:00100000:1.0:1651529394.350320:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000015403a07 with x1731746396578432 ext(125829120->18446744073709551615) 00002000:00010000:1.0:1651529394.350327:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000015403a07. 00000100:00100000:1.0:1651529394.350335:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15763 00000100:00100000:1.0:1651529394.350337:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:41279:x1731746396578432:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.350398:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b8:0x0] updating lvb size from disk: 0 -> 125829120 00002000:00010000:1.0:1651529394.350400:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b8:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.350401:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.350401:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b8:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.350402:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b8:0x0] updating lvb blocks from disk: 0 -> 16384 00000100:00100000:1.0:1651529394.350413:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015403a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:41279:x1731746396578432:12345-10.240.43.64@tcp:10:dd.0 Request processed in 75us (120us total) trans 30064894691 rc 0/0 00000100:00100000:1.0:1651529394.350416:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15763 00002000:00010000:1.0:1651529394.350417:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178616/0 (125829120->18446744073709551615) 00002000:00100000:1.0:1651529394.350418:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000015403a07 with x1731746396578432 ext(125829120->18446744073709551615) 00002000:00010000:1.0:1651529394.350420:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000015403a07. 00000100:00100000:1.0:1651529394.352895:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6184e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:41278:x1731746396578048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7616us (7661us total) trans 30064894692 rc 0/0 00000100:00100000:1.0:1651529394.352901:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15762 00002000:00100000:1.0:1651529394.352906:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (8388608->12582911) req@00000000d6184e3b x1731746396578048/t30064894692(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.352911:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6184e3b with x1731746396578048 ext(8388608->12582911) 00002000:00010000:1.0:1651529394.352913:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d6184e3b 00000100:00100000:0.0:1651529394.403035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.403063:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396578560 00002000:00100000:1.0:1651529394.403086:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (125829120->130023423) req@0000000047b883b5 x1731746396578560/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.403091:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047b883b5 with x1731746396578560 ext(125829120->130023423) 00002000:00010000:1.0:1651529394.403094:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047b883b5 00000100:00100000:1.0:1651529394.403105:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15764 00000100:00100000:1.0:1651529394.403107:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:41278:x1731746396578560:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.407017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.407031:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396578688 00002000:00100000:1.0:1651529394.407056:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b8:0x0] (130023424->134217727) req@00000000bd843992 x1731746396578688/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.407062:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd843992 with x1731746396578688 ext(130023424->134217727) 00002000:00010000:1.0:1651529394.407063:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd843992 00000100:00100000:1.0:1651529394.407080:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15765 00000100:00100000:1.0:1651529394.407082:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:41279:x1731746396578688:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.410944:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:41278:x1731746396578560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7832us (7909us total) trans 30064894693 rc 0/0 00000100:00100000:1.0:1651529394.410951:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15764 00002000:00100000:1.0:1651529394.410958:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (125829120->130023423) req@0000000047b883b5 x1731746396578560/t30064894693(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.410963:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047b883b5 with x1731746396578560 ext(125829120->130023423) 00002000:00010000:1.0:1651529394.410966:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047b883b5 00000100:00100000:1.0:1651529394.412340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.412353:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396578816 00002000:00100000:1.0:1651529394.412368:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (134217728->138412031) req@00000000520a69d1 x1731746396578816/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.412374:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000520a69d1 with x1731746396578816 ext(134217728->138412031) 00002000:00010000:1.0:1651529394.412376:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000520a69d1 00000100:00100000:1.0:1651529394.412393:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15766 00000100:00100000:1.0:1651529394.412396:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:41278:x1731746396578816:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.413536:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd843992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:41279:x1731746396578688:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6452us (6521us total) trans 30064894694 rc 0/0 00000100:00100000:1.0:1651529394.413540:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15765 00002000:00100000:1.0:1651529394.413543:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b8:0x0] (130023424->134217727) req@00000000bd843992 x1731746396578688/t30064894694(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.413548:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd843992 with x1731746396578688 ext(130023424->134217727) 00002000:00010000:1.0:1651529394.413549:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd843992 00000100:00100000:1.0:1651529394.420472:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520a69d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:41278:x1731746396578816:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8070us (8129us total) trans 30064894695 rc 0/0 00000100:00100000:1.0:1651529394.420480:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15766 00002000:00100000:1.0:1651529394.420487:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b8:0x0] (134217728->138412031) req@00000000520a69d1 x1731746396578816/t30064894695(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.420492:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000520a69d1 with x1731746396578816 ext(134217728->138412031) 00002000:00010000:1.0:1651529394.420495:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000520a69d1 00000100:00100000:1.0:1651529394.801977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.801998:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396582528 00000100:00100000:1.0:1651529394.802025:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153878 00000100:00100000:1.0:1651529394.802028:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:415166:x1731746396582528:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529394.802038:0:127523:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529394.802052:0:127523:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 2/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da7d7 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529394.802064:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529394.802075:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.802076:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529394.802081:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 35 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.802090:0:127523:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 35 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529394.802096:0:127523:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000230803cc, rc 0) 00000100:00100000:1.0:1651529394.802122:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:415166:x1731746396582528:12345-10.240.43.64@tcp:101:dd.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.802126:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153878 00000100:00100000:1.0:1651529395.023474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.023493:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396582656 00002000:00100000:1.0:1651529395.023516:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (0->4194303) req@00000000f4126e44 x1731746396582656/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.023522:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4126e44 with x1731746396582656 ext(0->4194303) 00002000:00010000:1.0:1651529395.023525:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f4126e44 00000100:00100000:1.0:1651529395.023536:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15767 00000100:00100000:1.0:1651529395.023538:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41279:x1731746396582656:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.027173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.027182:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396582784 00002000:00100000:1.0:1651529395.027190:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (4194304->8388607) req@000000004d486ca2 x1731746396582784/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.027195:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d486ca2 with x1731746396582784 ext(4194304->8388607) 00002000:00010000:1.0:1651529395.027196:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004d486ca2 00000100:00100000:1.0:1651529395.027207:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15768 00000100:00100000:1.0:1651529395.027209:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:41278:x1731746396582784:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.031785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.031799:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396582912 00002000:00100000:1.0:1651529395.031829:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b9:0x0] (8388608->12582911) req@000000007378f4ed x1731746396582912/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.031834:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007378f4ed with x1731746396582912 ext(8388608->12582911) 00002000:00010000:1.0:1651529395.031836:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007378f4ed 00000100:00100000:1.0:1651529395.031855:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15769 00000100:00100000:1.0:1651529395.031857:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41278:x1731746396582912:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.035464:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41279:x1731746396582656:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11922us (11991us total) trans 30064894696 rc 0/0 00000100:00100000:1.0:1651529395.035471:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15767 00002000:00100000:1.0:1651529395.035478:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (0->4194303) req@00000000f4126e44 x1731746396582656/t30064894696(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.035483:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4126e44 with x1731746396582656 ext(0->4194303) 00002000:00010000:1.0:1651529395.035486:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f4126e44 00000100:00100000:1.0:1651529395.036115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.036127:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583040 00002000:00100000:1.0:1651529395.036140:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (12582912->16777215) req@00000000f71c0be7 x1731746396583040/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.036144:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f71c0be7 with x1731746396583040 ext(12582912->16777215) 00002000:00010000:1.0:1651529395.036145:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f71c0be7 00000100:00100000:1.0:1651529395.036152:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15770 00000100:00100000:1.0:1651529395.036154:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41279:x1731746396583040:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.039935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.039948:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583168 00002000:00100000:1.0:1651529395.039962:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9b9:0x0] (16777216->20971519) req@000000009c3625c3 x1731746396583168/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.039967:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c3625c3 with x1731746396583168 ext(16777216->20971519) 00002000:00010000:1.0:1651529395.039969:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009c3625c3 00000100:00100000:1.0:1651529395.039989:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15771 00000100:00100000:1.0:1651529395.039991:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:41278:x1731746396583168:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.043081:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41278:x1731746396582784:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15868us (15905us total) trans 30064894697 rc 0/0 00000100:00100000:1.0:1651529395.043089:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15768 00002000:00100000:1.0:1651529395.043095:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (4194304->8388607) req@000000004d486ca2 x1731746396582784/t30064894697(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.043100:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d486ca2 with x1731746396582784 ext(4194304->8388607) 00002000:00010000:1.0:1651529395.043103:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004d486ca2 00000100:00100000:1.0:1651529395.043883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.043894:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583296 00002000:00100000:1.0:1651529395.043907:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (20971520->25165823) req@00000000b8c32785 x1731746396583296/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.043911:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b8c32785 with x1731746396583296 ext(20971520->25165823) 00002000:00010000:1.0:1651529395.043912:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b8c32785 00000100:00100000:1.0:1651529395.043920:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15772 00000100:00100000:1.0:1651529395.043922:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41279:x1731746396583296:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.047675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.047686:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583424 00002000:00100000:1.0:1651529395.047706:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (25165824->29360127) req@00000000682ee2c3 x1731746396583424/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.047710:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000682ee2c3 with x1731746396583424 ext(25165824->29360127) 00002000:00010000:1.0:1651529395.047712:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000682ee2c3 00000100:00100000:1.0:1651529395.047729:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15773 00000100:00100000:1.0:1651529395.047731:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:41278:x1731746396583424:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.050876:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:41278:x1731746396582912:12345-10.240.43.64@tcp:4:dd.0 Request processed in 19015us (19091us total) trans 30064894698 rc 0/0 00000100:00100000:1.0:1651529395.050882:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15769 00002000:00100000:1.0:1651529395.050888:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b9:0x0] (8388608->12582911) req@000000007378f4ed x1731746396582912/t30064894698(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.050893:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007378f4ed with x1731746396582912 ext(8388608->12582911) 00002000:00010000:1.0:1651529395.050895:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007378f4ed 00000100:00100000:1.0:1651529395.052592:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.052605:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583552 00002000:00100000:1.0:1651529395.052622:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b9:0x0] (29360128->33554431) req@00000000e920db98 x1731746396583552/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.052626:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e920db98 with x1731746396583552 ext(29360128->33554431) 00002000:00010000:1.0:1651529395.052627:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e920db98 00000100:00100000:1.0:1651529395.052635:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15774 00000100:00100000:1.0:1651529395.052638:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:41279:x1731746396583552:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.057312:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:41279:x1731746396583040:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21153us (21193us total) trans 30064894699 rc 0/0 00000100:00100000:1.0:1651529395.057319:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15770 00002000:00100000:1.0:1651529395.057325:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (12582912->16777215) req@00000000f71c0be7 x1731746396583040/t30064894699(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.057330:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f71c0be7 with x1731746396583040 ext(12582912->16777215) 00002000:00010000:1.0:1651529395.057333:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f71c0be7 00000100:00100000:1.0:1651529395.058535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.058554:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583680 00002000:00100000:1.0:1651529395.058570:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (33554432->37748735) req@000000008278e0d9 x1731746396583680/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.058575:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008278e0d9 with x1731746396583680 ext(33554432->37748735) 00002000:00010000:1.0:1651529395.058576:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008278e0d9 00000100:00100000:1.0:1651529395.058584:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15775 00000100:00100000:1.0:1651529395.058587:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:41279:x1731746396583680:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.062728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.062747:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583808 00002000:00100000:1.0:1651529395.062788:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (37748736->41943039) req@00000000b7be67e9 x1731746396583808/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.062795:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7be67e9 with x1731746396583808 ext(37748736->41943039) 00002000:00010000:1.0:1651529395.062799:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b7be67e9 00000100:00100000:1.0:1651529395.062833:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15776 00000100:00100000:1.0:1651529395.062835:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396583808:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.063664:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396583168:12345-10.240.43.64@tcp:4:dd.0 Request processed in 23671us (23730us total) trans 30064894700 rc 0/0 00000100:00100000:1.0:1651529395.063669:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15771 00002000:00100000:1.0:1651529395.063672:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9b9:0x0] (16777216->20971519) req@000000009c3625c3 x1731746396583168/t30064894700(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.063676:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c3625c3 with x1731746396583168 ext(16777216->20971519) 00002000:00010000:1.0:1651529395.063677:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009c3625c3 00000100:00100000:1.0:1651529395.066099:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41279:x1731746396583296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 22172us (22212us total) trans 30064894701 rc 0/0 00000100:00100000:1.0:1651529395.066118:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15772 00002000:00100000:1.0:1651529395.066125:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (20971520->25165823) req@00000000b8c32785 x1731746396583296/t30064894701(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.066130:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b8c32785 with x1731746396583296 ext(20971520->25165823) 00002000:00010000:1.0:1651529395.066133:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b8c32785 00000100:00100000:1.0:1651529395.066891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.066903:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396583936 00002000:00100000:1.0:1651529395.066915:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (41943040->46137343) req@0000000080862d10 x1731746396583936/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.066919:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080862d10 with x1731746396583936 ext(41943040->46137343) 00002000:00010000:1.0:1651529395.066920:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080862d10 00000100:00100000:1.0:1651529395.066932:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15777 00000100:00100000:1.0:1651529395.066935:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41279:x1731746396583936:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.069159:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000682ee2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396583424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21423us (21482us total) trans 30064894702 rc 0/0 00000100:00100000:1.0:1651529395.069166:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15773 00002000:00100000:1.0:1651529395.069172:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (25165824->29360127) req@00000000682ee2c3 x1731746396583424/t30064894702(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.069177:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000682ee2c3 with x1731746396583424 ext(25165824->29360127) 00002000:00010000:1.0:1651529395.069180:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000682ee2c3 00000100:00100000:1.0:1651529395.070632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.070644:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396584192 00002000:00100000:1.0:1651529395.070658:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (46137344->50331647) req@00000000dc905c76 x1731746396584192/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.070676:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc905c76 with x1731746396584192 ext(46137344->50331647) 00002000:00010000:1.0:1651529395.070677:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dc905c76 00000100:00100000:1.0:1651529395.070686:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15778 00000100:00100000:1.0:1651529395.070688:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41279:x1731746396584192:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.074351:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e920db98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396583552:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21709us (21756us total) trans 30064894703 rc 0/0 00000100:00100000:1.0:1651529395.074359:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15774 00002000:00100000:1.0:1651529395.074366:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9b9:0x0] (29360128->33554431) req@00000000e920db98 x1731746396583552/t30064894703(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.074371:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e920db98 with x1731746396583552 ext(29360128->33554431) 00002000:00010000:1.0:1651529395.074375:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e920db98 00000100:00100000:1.0:1651529395.077442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.077465:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396584576 00002000:00010000:1.0:1651529395.077484:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178617/0 (503316480->18446744073709551615) 00002000:00100000:1.0:1651529395.077487:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b95db0aa with x1731746396584576 ext(503316480->18446744073709551615) 00002000:00010000:1.0:1651529395.077497:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b95db0aa. 00000100:00100000:1.0:1651529395.077511:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15779 00000100:00100000:1.0:1651529395.077515:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41279:x1731746396584576:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529395.077597:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9b9:0x0] updating lvb size from disk: 0 -> 503316480 00002000:00010000:1.0:1651529395.077600:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9b9:0x0] updating lvb mtime from disk: 0 -> 1651529395 00002000:00010000:1.0:1651529395.077601:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529395.077603:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9b9:0x0] updating lvb ctime from disk: 0 -> 1651529395 00002000:00010000:1.0:1651529395.077604:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9b9:0x0] updating lvb blocks from disk: 0 -> 73728 00000100:00100000:1.0:1651529395.077649:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396584576:12345-10.240.43.64@tcp:10:dd.0 Request processed in 133us (212us total) trans 30064894705 rc 0/0 00000100:00100000:1.0:1651529395.077655:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15779 00002000:00010000:1.0:1651529395.077657:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178617/0 (503316480->18446744073709551615) 00002000:00100000:1.0:1651529395.077659:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b95db0aa with x1731746396584576 ext(503316480->18446744073709551615) 00002000:00010000:1.0:1651529395.077662:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b95db0aa. 00000100:00100000:1.0:1651529395.079373:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396583680:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20782us (20835us total) trans 30064894704 rc 0/0 00000100:00100000:1.0:1651529395.079380:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15775 00002000:00100000:1.0:1651529395.079386:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (33554432->37748735) req@000000008278e0d9 x1731746396583680/t30064894704(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.079392:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008278e0d9 with x1731746396583680 ext(33554432->37748735) 00002000:00010000:1.0:1651529395.079395:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008278e0d9 00000100:00100000:1.0:1651529395.083192:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396583808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20352us (20465us total) trans 30064894706 rc 0/0 00000100:00100000:1.0:1651529395.083199:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15776 00002000:00100000:1.0:1651529395.083206:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (37748736->41943039) req@00000000b7be67e9 x1731746396583808/t30064894706(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.083210:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7be67e9 with x1731746396583808 ext(37748736->41943039) 00002000:00010000:1.0:1651529395.083214:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b7be67e9 00000100:00100000:1.0:1651529395.088092:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396583936:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21152us (21197us total) trans 30064894707 rc 0/0 00000100:00100000:1.0:1651529395.088098:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15777 00002000:00100000:1.0:1651529395.088105:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (41943040->46137343) req@0000000080862d10 x1731746396583936/t30064894707(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.088112:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080862d10 with x1731746396583936 ext(41943040->46137343) 00002000:00010000:1.0:1651529395.088115:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080862d10 00000100:00100000:1.0:1651529395.092043:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc905c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396584192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21349us (21407us total) trans 30064894708 rc 0/0 00000100:00100000:1.0:1651529395.092050:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15778 00002000:00100000:1.0:1651529395.092055:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (46137344->50331647) req@00000000dc905c76 x1731746396584192/t30064894708(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529395.092060:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc905c76 with x1731746396584192 ext(46137344->50331647) 00002000:00010000:1.0:1651529395.092063:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dc905c76 00000100:00100000:0.0:1651529395.316641:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529395.316674:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396584704 00002000:00100000:1.0:1651529395.316697:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (503316480->507510783) req@000000000057fefa x1731746396584704/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529395.316703:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000057fefa with x1731746396584704 ext(503316480->507510783) 00002000:00010000:1.0:1651529395.316705:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000057fefa 00000100:00100000:1.0:1651529395.316717:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15780 00000100:00100000:1.0:1651529395.316719:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396584704:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529395.320535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.320566:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396584832 00002000:00100000:0.0:1651529395.320585:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (507510784->511705087) req@00000000405f9b91 x1731746396584832/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.320591:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000405f9b91 with x1731746396584832 ext(507510784->511705087) 00002000:00010000:0.0:1651529395.320594:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000405f9b91 00000100:00100000:0.0:1651529395.320607:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15781 00000100:00100000:0.0:1651529395.320609:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396584832:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.322958:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396584704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6234us (6318us total) trans 30064894709 rc 0/0 00000100:00100000:0.0:1651529395.322990:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15780 00002000:00100000:0.0:1651529395.322996:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (503316480->507510783) req@000000000057fefa x1731746396584704/t30064894709(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.323001:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000057fefa with x1731746396584704 ext(503316480->507510783) 00002000:00010000:0.0:1651529395.323004:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000057fefa 00000100:00100000:0.0:1651529395.324423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.324434:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396584960 00002000:00100000:0.0:1651529395.324447:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (511705088->515899391) req@0000000085c8028b x1731746396584960/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.324451:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085c8028b with x1731746396584960 ext(511705088->515899391) 00002000:00010000:0.0:1651529395.324453:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085c8028b 00000100:00100000:0.0:1651529395.324463:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15782 00000100:00100000:0.0:1651529395.324465:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396584960:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.329036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.329053:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585088 00002000:00100000:0.0:1651529395.329073:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (515899392->520093695) req@000000004ac34838 x1731746396585088/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.329079:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ac34838 with x1731746396585088 ext(515899392->520093695) 00002000:00010000:0.0:1651529395.329082:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004ac34838 00000100:00100000:0.0:1651529395.329097:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15783 00000100:00100000:0.0:1651529395.329099:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396585088:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.329793:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396584832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9183us (9261us total) trans 30064894710 rc 0/0 00000100:00100000:0.0:1651529395.329797:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15781 00002000:00100000:0.0:1651529395.329800:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (507510784->511705087) req@00000000405f9b91 x1731746396584832/t30064894710(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.329816:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000405f9b91 with x1731746396584832 ext(507510784->511705087) 00002000:00010000:0.0:1651529395.329818:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000405f9b91 00000100:00100000:0.0:1651529395.333431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.333447:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585216 00002000:00100000:0.0:1651529395.333466:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (520093696->524287999) req@000000004da50ea5 x1731746396585216/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.333475:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004da50ea5 with x1731746396585216 ext(520093696->524287999) 00002000:00010000:0.0:1651529395.333478:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004da50ea5 00000100:00100000:0.0:1651529395.333492:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15784 00000100:00100000:0.0:1651529395.333495:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396585216:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.334453:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396584960:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9986us (10029us total) trans 30064894711 rc 0/0 00000100:00100000:0.0:1651529395.334457:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15782 00002000:00100000:0.0:1651529395.334461:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (511705088->515899391) req@0000000085c8028b x1731746396584960/t30064894711(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.334465:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085c8028b with x1731746396584960 ext(511705088->515899391) 00002000:00010000:0.0:1651529395.334466:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085c8028b 00000100:00100000:0.0:1651529395.337383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.337396:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585344 00002000:00100000:0.0:1651529395.337412:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (524288000->528482303) req@00000000dc3d7b14 x1731746396585344/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.337416:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc3d7b14 with x1731746396585344 ext(524288000->528482303) 00002000:00010000:0.0:1651529395.337418:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dc3d7b14 00000100:00100000:0.0:1651529395.337427:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15785 00000100:00100000:0.0:1651529395.337429:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41278:x1731746396585344:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.341407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.341423:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585472 00002000:00100000:0.0:1651529395.341444:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (528482304->532676607) req@000000001c302487 x1731746396585472/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.341453:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001c302487 with x1731746396585472 ext(528482304->532676607) 00002000:00010000:0.0:1651529395.341456:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001c302487 00000100:00100000:0.0:1651529395.341472:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15786 00000100:00100000:0.0:1651529395.341475:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396585472:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.345066:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396585088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15964us (16031us total) trans 30064894712 rc 0/0 00000100:00100000:0.0:1651529395.345072:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15783 00002000:00100000:0.0:1651529395.345078:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (515899392->520093695) req@000000004ac34838 x1731746396585088/t30064894712(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.345082:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ac34838 with x1731746396585088 ext(515899392->520093695) 00002000:00010000:0.0:1651529395.345085:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004ac34838 00000100:00100000:0.0:1651529395.345194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.345204:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585600 00002000:00100000:0.0:1651529395.345216:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (532676608->536870911) req@000000006d610303 x1731746396585600/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.345220:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d610303 with x1731746396585600 ext(532676608->536870911) 00002000:00010000:0.0:1651529395.345221:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d610303 00000100:00100000:0.0:1651529395.345232:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15787 00000100:00100000:0.0:1651529395.345234:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41279:x1731746396585600:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.351796:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396585216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 18296us (18364us total) trans 30064894713 rc 0/0 00000100:00100000:0.0:1651529395.351814:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15784 00002000:00100000:0.0:1651529395.351824:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (520093696->524287999) req@000000004da50ea5 x1731746396585216/t30064894713(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.351829:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004da50ea5 with x1731746396585216 ext(520093696->524287999) 00002000:00010000:0.0:1651529395.351833:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004da50ea5 00000100:00100000:0.0:1651529395.352148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.352159:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585728 00002000:00100000:0.0:1651529395.352172:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (536870912->541065215) req@00000000870c23d5 x1731746396585728/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.352176:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000870c23d5 with x1731746396585728 ext(536870912->541065215) 00002000:00010000:0.0:1651529395.352177:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000870c23d5 00000100:00100000:0.0:1651529395.352185:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15788 00000100:00100000:0.0:1651529395.352187:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396585728:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.355106:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3d7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396585344:12345-10.240.43.64@tcp:4:dd.0 Request processed in 17672us (17722us total) trans 30064894714 rc 0/0 00000100:00100000:0.0:1651529395.355113:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15785 00002000:00100000:0.0:1651529395.355120:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (524288000->528482303) req@00000000dc3d7b14 x1731746396585344/t30064894714(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.355124:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc3d7b14 with x1731746396585344 ext(524288000->528482303) 00002000:00010000:0.0:1651529395.355127:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dc3d7b14 00000100:00100000:0.0:1651529395.356605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.356617:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585856 00002000:00100000:0.0:1651529395.356631:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (541065216->545259519) req@0000000040519434 x1731746396585856/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.356635:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040519434 with x1731746396585856 ext(541065216->545259519) 00002000:00010000:0.0:1651529395.356638:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000040519434 00000100:00100000:0.0:1651529395.356646:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15789 00000100:00100000:0.0:1651529395.356649:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396585856:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.361548:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396585472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20068us (20140us total) trans 30064894715 rc 0/0 00000100:00100000:0.0:1651529395.361556:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15786 00002000:00100000:0.0:1651529395.361563:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (528482304->532676607) req@000000001c302487 x1731746396585472/t30064894715(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.361582:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001c302487 with x1731746396585472 ext(528482304->532676607) 00002000:00010000:0.0:1651529395.361586:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001c302487 00000100:00100000:0.0:1651529395.362975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.362987:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396585984 00002000:00100000:0.0:1651529395.363001:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (545259520->549453823) req@0000000014c7e474 x1731746396585984/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.363006:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014c7e474 with x1731746396585984 ext(545259520->549453823) 00002000:00010000:0.0:1651529395.363007:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000014c7e474 00000100:00100000:0.0:1651529395.363016:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15790 00000100:00100000:0.0:1651529395.363018:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396585984:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.364500:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396585600:12345-10.240.43.64@tcp:4:dd.0 Request processed in 19263us (19305us total) trans 30064894716 rc 0/0 00000100:00100000:0.0:1651529395.364505:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15787 00002000:00100000:0.0:1651529395.364509:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (532676608->536870911) req@000000006d610303 x1731746396585600/t30064894716(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.364514:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d610303 with x1731746396585600 ext(532676608->536870911) 00002000:00010000:0.0:1651529395.364516:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d610303 00000100:00100000:0.0:1651529395.367304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.367319:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396586112 00002000:00100000:0.0:1651529395.367337:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (549453824->553648127) req@00000000949e31c0 x1731746396586112/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/0 e 0 to 0 dl 1651529401 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529395.367342:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000949e31c0 with x1731746396586112 ext(549453824->553648127) 00002000:00010000:0.0:1651529395.367345:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000949e31c0 00000100:00100000:0.0:1651529395.367355:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15791 00000100:00100000:0.0:1651529395.367357:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396586112:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529395.370209:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396585728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 18017us (18057us total) trans 30064894717 rc 0/0 00000100:00100000:0.0:1651529395.370234:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15788 00002000:00100000:0.0:1651529395.370240:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9b9:0x0] (536870912->541065215) req@00000000870c23d5 x1731746396585728/t30064894717(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.370245:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000870c23d5 with x1731746396585728 ext(536870912->541065215) 00002000:00010000:0.0:1651529395.370247:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000870c23d5 00000100:00100000:0.0:1651529395.377450:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396585856:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20797us (20842us total) trans 30064894718 rc 0/0 00000100:00100000:0.0:1651529395.377458:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15789 00002000:00100000:0.0:1651529395.377465:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9b9:0x0] (541065216->545259519) req@0000000040519434 x1731746396585856/t30064894718(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.377470:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040519434 with x1731746396585856 ext(541065216->545259519) 00002000:00010000:0.0:1651529395.377474:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000040519434 00000100:00100000:0.0:1651529395.383408:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396585984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20384us (20428us total) trans 30064894719 rc 0/0 00000100:00100000:0.0:1651529395.383416:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15790 00002000:00100000:0.0:1651529395.383424:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9b9:0x0] (545259520->549453823) req@0000000014c7e474 x1731746396585984/t30064894719(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.383429:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014c7e474 with x1731746396585984 ext(545259520->549453823) 00002000:00010000:0.0:1651529395.383432:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000014c7e474 00000100:00100000:0.0:1651529395.386419:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396586112:12345-10.240.43.64@tcp:4:dd.0 Request processed in 19058us (19115us total) trans 30064894720 rc 0/0 00000100:00100000:0.0:1651529395.386426:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15791 00002000:00100000:0.0:1651529395.386432:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9b9:0x0] (549453824->553648127) req@00000000949e31c0 x1731746396586112/t30064894720(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:121/0 lens 488/448 e 0 to 0 dl 1651529401 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529395.386436:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000949e31c0 with x1731746396586112 ext(549453824->553648127) 00002000:00010000:0.0:1651529395.386440:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000949e31c0 00000100:00100000:0.0:1651529395.424151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529395.424170:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946596992 00000100:00100000:0.0:1651529395.424193:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 316 00000100:00100000:0.0:1651529395.424195:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946596992:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529395.424209:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12656640 granted 267791936 pending 126595072 free 81214820352 avail 77044109312 00000100:00100000:0.0:1651529395.424239:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946596992:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529395.424242:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 316 00000400:00000080:0.0:1651529397.111832:0:168190:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529397.111835:0:168190:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 128: interactive lfs for 2 consecutive find's ========================================================== 22:09:56 (1651529396) 00000100:00100000:0.0:1651529397.133839:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529397.133857:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396588288 00000100:00100000:0.0:1651529397.133877:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153879 00000100:00100000:0.0:1651529397.133879:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396588288:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:0.0:1651529397.134009:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396588288:12345-10.240.43.64@tcp:2:touch.0 Request processed in 128us (172us total) trans 30064894721 rc 0/0 00000100:00100000:0.0:1651529397.134013:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153879 00000100:00100000:0.0:1651529397.145645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529397.145655:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396588544 00000100:00100000:0.0:1651529397.145670:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153880 00000100:00100000:0.0:1651529397.145674:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396588544:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651529397.145681:0:161133:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529397.145692:0:161133:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 2/0,0 mode: --/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da832 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529397.145702:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ba:0x0] initial LVB size: 0, mtime: 0x627056b5, atime: 0x627056b5, ctime: 0x627056b5, blocks: 0x0 00010000:00010000:0.0:1651529397.145710:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529397.145711:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529397.145715:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 86 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529397.145722:0:161133:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 86 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529397.145727:0:161133:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095cff58f, rc 0) 00000100:00100000:0.0:1651529397.145740:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396588544:12345-10.240.43.64@tcp:101:rm.0 Request processed in 66us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529397.145743:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153880 00000001:00080000:1.0:1651529398.150429:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894721 is committed 00000001:00080000:1.0:1651529398.150463:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894680 is committed 00000400:00000080:1.0:1651529398.388305:0:168408:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529398.388308:0:168408:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 129: test directory size limit ================================================================================== 22:09:58 (1651529398) 00000100:00100000:0.0:1651529398.498323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529398.498336:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529398.498352:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597376 00000100:00100000:0.0:1651529398.498376:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597504 00000100:00100000:0.0:1651529398.498383:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153881 00000100:00100000:0.0:1651529398.498385:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946597376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529398.498392:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153882 00000100:00100000:1.0:1651529398.498396:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946597504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529398.498402:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178611 count 1 00002000:00080000:1.0:1651529398.498406:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178613 count 1 00010000:00010000:1.0:1651529398.498416:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498416:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498426:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498426:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498430:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498430:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498431:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498431:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498432:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 4/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498432:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 4/0,1 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498446:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498446:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 3/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498451:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 4/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.498451:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 4/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:1.0:1651529398.498458:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529398.498458:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529398.498486:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f38c7416 going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498487:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd6cefab going to sleep for 6 seconds 00000100:00100000:0.0:1651529398.498565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529398.498579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529398.498592:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597632 00000100:00100000:1.0:1651529398.498604:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597760 00000100:00100000:0.0:1651529398.498604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529398.498613:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597312 00000100:00100000:1.0:1651529398.498621:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153883 00000100:00100000:1.0:1651529398.498623:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946597632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529398.498623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529398.498629:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178615 count 1 00000100:00100000:0.0:1651529398.498631:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529398.498634:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.498644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529398.498652:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.498655:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597440 00010000:00010000:1.0:1651529398.498656:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498656:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498657:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 4/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498665:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.498666:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597568 00010000:00010000:1.0:1651529398.498669:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 4/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.498671:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597696 00000100:00100000:1.0:1651529398.498673:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966716032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529398.498678:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153884 00000100:00100000:0.0:1651529398.498681:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946597760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529398.498689:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003a3ac4ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498697:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153885 00002000:00080000:0.0:1651529398.498697:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178617 count 1 00000100:00100000:1.0:1651529398.498699:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946597312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529398.498704:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178610 count 1 00010000:00010000:0.0:1651529398.498704:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498708:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498710:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498713:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498714:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498714:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498715:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 4/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498716:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498717:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498717:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 4/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498723:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498724:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498727:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 4/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:1.0:1651529398.498728:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 4/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.498732:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966716096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498733:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966716160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498741:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b948b7ee going to sleep for 6 seconds 00000100:00100000:0.0:1651529398.498744:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000310e84ec going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498748:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153886 00000100:00100000:1.0:1651529398.498749:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946597440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529398.498752:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153887 00002000:00080000:1.0:1651529398.498754:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178612 count 1 00000100:00100000:0.0:1651529398.498754:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946597568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529398.498760:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178614 count 1 00010000:00010000:1.0:1651529398.498776:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498777:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498781:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498782:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498784:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498785:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498785:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 4/0,1 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498785:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498785:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529398.498786:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 4/0,1 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498793:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498794:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.498798:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 4/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:1.0:1651529398.498799:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 4/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.498816:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966716288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498817:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966716224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498826:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498834:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153888 00000100:00100000:1.0:1651529398.498835:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946597696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529398.498841:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178616 count 1 00000100:00100000:0.0:1651529398.498841:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007cf8eae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529398.498845:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498849:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498852:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498853:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498854:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 4/0,1 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498860:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 13 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498864:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 4/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:1.0:1651529398.498868:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966716352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498883:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc8d5bb going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498896:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a825ad07 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966715968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.498902:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.498933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.498949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.498971:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589184 00010000:00010000:0.0:1651529398.498979:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 4/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 14 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499006:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589120 00010000:00010000:0.0:1651529398.499010:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 5/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499017:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12731 00000100:00100000:0.0:1651529398.499018:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396589184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529398.499022:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499024:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 4/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499028:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499038:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c0bb5 lrc: 0/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da687 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499042:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499043:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499044:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499048:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 4/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499061:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499072:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396589184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529398.499073:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499077:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499077:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12731 00010000:00010000:1.0:1651529398.499081:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499083:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12732 00010000:00010000:1.0:1651529398.499084:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499085:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41278:x1731746396589120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529398.499087:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499089:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 5/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499092:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 4/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499098:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499098:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499099:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499102:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 4/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499106:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499111:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41278:x1731746396589120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499113:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12732 00010000:00010000:0.0:1651529398.499160:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c0ba7 lrc: 0/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5df expref: 12 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499164:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d242d477 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966715904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529398.499188:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499192:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499195:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499198:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499202:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946597504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 806us (865us total) trans 30064894722 rc 0/0 00000100:00100000:1.0:1651529398.499206:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153882 00010000:00010000:1.0:1651529398.499216:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499218:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499220:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.499222:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499228:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499234:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 1/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499237:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c0be6 lrc: 0/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499242:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499245:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f25ba4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.499246:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499249:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 3/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499252:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 1/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499255:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0bdf lrc: 0/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499274:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946597376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 888us (955us total) trans 30064894723 rc 0/0 00000100:00100000:0.0:1651529398.499278:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153881 00000100:00100000:1.0:1651529398.499333:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae10592b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966716032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499349:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499358:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000505fb1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966716160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499360:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499387:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5c4902 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966716224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499390:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499402:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b8ceea4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966716352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499405:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499405:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.499412:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529398.499416:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d179b834 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966716096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499419:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499428:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5b5141c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966716288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.499431:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.499447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.499453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.499459:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.499465:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589312 00010000:00010000:0.0:1651529398.499471:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 4/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 12 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499480:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589440 00010000:00010000:0.0:1651529398.499482:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 4/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499486:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589248 00010000:00010000:0.0:1651529398.499489:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 4/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 14 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499492:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589376 00010000:00010000:0.0:1651529398.499494:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 4/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499498:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589504 00010000:00010000:0.0:1651529398.499500:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 4/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 16 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499504:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589568 00010000:00010000:0.0:1651529398.499506:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 4/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 17 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:0.0:1651529398.499510:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12733 00000100:00100000:0.0:1651529398.499512:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396589312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529398.499514:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499516:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 4/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 17 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499522:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 17 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499528:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c0ba0 lrc: 0/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da592 expref: 17 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499531:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499532:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499533:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499536:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 4/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499549:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529398.499558:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499559:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396589312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499562:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12733 00000100:00100000:0.0:1651529398.499567:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12734 00010000:00010000:1.0:1651529398.499568:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499569:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396589440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529398.499571:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529398.499572:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499573:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 4/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:1.0:1651529398.499575:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499576:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499581:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c0bae lrc: 0/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->49151) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da633 expref: 15 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499585:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499586:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499586:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499589:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 4/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499597:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499603:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396589440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499605:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12734 00000100:00100000:0.0:1651529398.499609:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12735 00000100:00100000:0.0:1651529398.499611:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396589248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529398.499613:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499614:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 4/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499617:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499622:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c0bc3 lrc: 0/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da72f expref: 13 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:1.0:1651529398.499628:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946597312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 929us (1024us total) trans 30064894724 rc 0/0 00010000:00010000:0.0:1651529398.499628:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499628:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499629:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499632:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153885 00010000:00010000:0.0:1651529398.499632:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 4/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499639:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499645:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41279:x1731746396589248:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499647:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12735 00010000:00010000:1.0:1651529398.499648:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499651:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12736 00010000:00010000:1.0:1651529398.499652:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529398.499652:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396589376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529398.499653:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499654:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529398.499656:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499656:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 4/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 11 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499659:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 11 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:1.0:1651529398.499661:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 1/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499663:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0bfb lrc: 0/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499664:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c0bd1 lrc: 0/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->50331647) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7d7 expref: 11 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499667:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499667:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499668:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499671:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 4/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499678:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529398.499683:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499683:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080dcf2df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396589376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499686:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12736 00010000:00010000:1.0:1651529398.499687:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499690:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499692:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499695:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12737 00000100:00100000:0.0:1651529398.499696:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396589504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529398.499698:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499700:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 4/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 9 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499703:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 9 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499708:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c0bca lrc: 0/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12582911) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da783 expref: 9 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:0.0:1651529398.499711:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499711:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499712:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499715:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 4/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499723:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499729:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41279:x1731746396589504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529398.499731:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12737 00000100:00100000:0.0:1651529398.499735:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12738 00000100:00100000:0.0:1651529398.499737:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396589568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529398.499739:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499740:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 4/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 7 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:1.0:1651529398.499744:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946597440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 993us (1124us total) trans 30064894725 rc 0/0 00010000:00010000:0.0:1651529398.499744:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 7 pid: 127523 timeout: 13148 lvb_type: 0 00000100:00100000:1.0:1651529398.499747:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153886 00010000:00010000:0.0:1651529398.499748:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c0bbc lrc: 0/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->786431) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6db expref: 7 pid: 127523 timeout: 13148 lvb_type: 0 00010000:00010000:1.0:1651529398.499753:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499757:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.499758:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499761:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499776:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 1/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499776:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499777:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499778:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499781:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 4/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499785:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0c02 lrc: 0/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499789:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529398.499796:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746396589568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (336us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529398.499797:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499799:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12738 00010000:00010000:1.0:1651529398.499800:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499813:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499820:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529398.499886:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499890:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529398.499891:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499895:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499900:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 1/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499902:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c0c10 lrc: 0/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499911:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499914:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499917:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499923:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499993:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946597632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1368us (1427us total) trans 30064894727 rc 0/0 00000100:00100000:0.0:1651529398.499996:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153883 00000100:00100000:0.0:1651529398.500002:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597888 00000100:00100000:0.0:1651529398.500013:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153889 00000100:00100000:0.0:1651529398.500015:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946597888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529398.500020:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178618 count 1 00010000:00010000:0.0:1651529398.500025:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500030:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 2/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 5 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529398.500033:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.500034:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.500035:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 4/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500042:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 5 pid: 161133 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529398.500045:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 5 pid: 161133 timeout: 13148 lvb_type: 1 00000100:00100000:0.0:1651529398.500053:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000978de632 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966716416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529398.500064:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8ea0618 going to sleep for 6 seconds 00010000:00010000:0.0:1651529398.500102:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500106:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500110:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500112:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.500176:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946597568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1420us (1544us total) trans 30064894728 rc 0/0 00000100:00100000:0.0:1651529398.500179:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153887 00010000:00010000:0.0:1651529398.500186:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500189:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500192:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.500198:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.502113:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946597696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3276us (3468us total) trans 30064894726 rc 0/0 00000100:00100000:1.0:1651529398.502117:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153888 00010000:00010000:1.0:1651529398.502130:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502134:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.502135:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502139:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502144:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 1/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502147:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0bed lrc: 0/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502152:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502154:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f782055 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.502155:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502158:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502161:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 1/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502164:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c09 lrc: 0/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502167:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502169:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015f46ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.502170:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502173:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502176:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 1/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502179:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0bf4 lrc: 0/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.502470:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529398.502516:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000978de632 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966716416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.502521:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.502532:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589632 00010000:00010000:1.0:1651529398.502538:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 6 pid: 161133 timeout: 13148 lvb_type: 1 00000100:00100000:1.0:1651529398.502550:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12739 00000100:00100000:1.0:1651529398.502552:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746396589632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529398.502556:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529398.502557:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 6 pid: 161133 timeout: 13148 lvb_type: 1 00010000:00010000:1.0:1651529398.502564:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 6 pid: 161133 timeout: 13148 lvb_type: 1 00010000:00010000:1.0:1651529398.502570:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0bd8 lrc: 0/0,0 mode: --/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da832 expref: 6 pid: 161133 timeout: 13148 lvb_type: 1 00010000:00010000:1.0:1651529398.502574:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529398.502575:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529398.502576:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502579:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 4/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502585:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529398.502594:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41278:x1731746396589632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529398.502597:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12739 00010000:00010000:1.0:1651529398.502603:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502606:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502609:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502623:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.502670:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946597888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2654us (2839us total) trans 30064894730 rc 0/0 00000100:00100000:1.0:1651529398.502673:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153889 00010000:00010000:1.0:1651529398.502680:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502683:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000566545e3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529398.502684:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502687:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 3/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502692:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 1/0,0 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.502695:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c17 lrc: 0/0,0 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.507670:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946597760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 8989us (9090us total) trans 30064894729 rc 0/0 00000100:00100000:0.0:1651529398.507674:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153884 00000100:00100000:1.0:1651529400.544158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529400.544183:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598016 00000100:00100000:0.0:1651529400.544205:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 317 00000100:00100000:0.0:1651529400.544208:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946598016:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529400.544225:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12656640 granted 141196864 pending 0 free 81227403264 avail 77056692224 00000100:00100000:0.0:1651529400.544255:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5c4902 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946598016:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 46us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529400.544258:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 317 00000100:00100000:1.0:1651529401.536925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529401.536952:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396670400 00000100:00100000:0.0:1651529401.536972:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 38 00000100:00100000:0.0:1651529401.536974:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41279:x1731746396670400:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529401.536998:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41279:x1731746396670400:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 23us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529401.537001:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 38 00000100:00100000:1.0:1651529405.664218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529405.664250:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598656 00000100:00100000:0.0:1651529405.664272:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 318 00000100:00100000:0.0:1651529405.664275:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946598656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529405.664292:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12656640 granted 141196864 pending 0 free 81227403264 avail 77056692224 00000100:00100000:0.0:1651529405.664324:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10592b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946598656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529405.664328:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 318 00000400:00000080:1.0:1651529405.984317:0:168734:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529405.984330:0:168734:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130a: FIEMAP (1-stripe file) ============== 22:10:05 (1651529405) 00000100:00100000:1.0:1651529406.018265:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529406.018296:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396765312 00000100:00100000:0.0:1651529406.018322:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153890 00000100:00100000:0.0:1651529406.018325:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:418387:x1731746396765312:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529406.018335:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529406.018346:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c0c1e lrc: 2/0,0 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc137 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529406.018359:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529406.018369:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529406.018370:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529406.018374:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c0c1e lrc: 3/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc137 expref: 6 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529406.018382:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c0c1e lrc: 3/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc137 expref: 6 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529406.018387:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a79ef65, rc 0) 00000100:00100000:0.0:1651529406.018416:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:418387:x1731746396765312:12345-10.240.43.64@tcp:101:dd.0 Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529406.018419:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153890 00000100:00100000:1.0:1651529406.018684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529406.018702:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396765376 00002000:00010000:0.0:1651529406.018711:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178621/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529406.018712:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a5b5141c with x1731746396765376 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529406.018716:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a5b5141c. 00000100:00100000:0.0:1651529406.018724:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15792 00000100:00100000:0.0:1651529406.018726:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746396765376:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529406.018801:0:144088:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529406.018822:0:144088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb mtime from disk: 0 -> 1651529406 00002000:00010000:0.0:1651529406.018823:0:144088:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529406.018824:0:144088:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb ctime from disk: 0 -> 1651529406 00002000:00010000:0.0:1651529406.018825:0:144088:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529406.018840:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b5141c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396765376:12345-10.240.43.64@tcp:10:dd.0 Request processed in 113us (156us total) trans 30064894731 rc 0/0 00000100:00100000:0.0:1651529406.018843:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15792 00002000:00010000:0.0:1651529406.018845:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178621/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529406.018846:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a5b5141c with x1731746396765376 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529406.018848:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a5b5141c. 00000100:00100000:1.0:1651529406.023978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529406.024001:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396765824 00002000:00100000:0.0:1651529406.024011:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9bd:0x0] (0->65535) req@00000000d32c1c69 x1731746396765824/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:132/0 lens 488/0 e 0 to 0 dl 1651529412 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529406.024015:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d32c1c69 with x1731746396765824 ext(0->65535) 00002000:00010000:0.0:1651529406.024017:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d32c1c69 00000100:00100000:0.0:1651529406.024027:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15793 00000100:00100000:0.0:1651529406.024029:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396765824:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529406.024749:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396765824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 719us (770us total) trans 30064894732 rc 0/0 00000100:00100000:0.0:1651529406.024753:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15793 00002000:00100000:0.0:1651529406.024755:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9bd:0x0] (0->65535) req@00000000d32c1c69 x1731746396765824/t30064894732(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:132/0 lens 488/448 e 0 to 0 dl 1651529412 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529406.024763:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d32c1c69 with x1731746396765824 ext(0->65535) 00002000:00010000:0.0:1651529406.024764:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d32c1c69 00000100:00100000:1.0:1651529406.025029:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529406.025045:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396765888 00000100:00100000:0.0:1651529406.025056:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153891 00000100:00100000:0.0:1651529406.025058:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:418388:x1731746396765888:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529406.025110:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:418388:x1731746396765888:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 51us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529406.025113:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153891 00000100:00100000:1.0:1651529406.038066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529406.038089:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396766016 00000100:00100000:0.0:1651529406.038102:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153892 00000100:00100000:0.0:1651529406.038104:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:418393:x1731746396766016:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529406.038126:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:418393:x1731746396766016:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529406.038129:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153892 00000400:00000080:0.0:1651529407.297618:0:168952:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529407.297620:0:168952:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130b: FIEMAP (2-stripe file) ============== 22:10:07 (1651529407) 00000100:00100000:1.0:1651529407.342058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.342089:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396767296 00000100:00100000:0.0:1651529407.342115:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153893 00000100:00100000:0.0:1651529407.342118:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:419000:x1731746396767296:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529407.342128:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529407.342140:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c0c25 lrc: 2/0,0 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc176 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529407.342153:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529407.342163:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529407.342165:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529407.342168:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c0c25 lrc: 3/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc176 expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529407.342176:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c0c25 lrc: 3/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc176 expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529407.342182:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000386c4efa, rc 0) 00000100:00100000:0.0:1651529407.342210:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:419000:x1731746396767296:12345-10.240.43.64@tcp:101:dd.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.342214:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153893 00000100:00100000:1.0:1651529407.342868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.342893:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396767424 00002000:00010000:0.0:1651529407.342902:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178622/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529407.342904:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2acff34 with x1731746396767424 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529407.342908:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2acff34. 00000100:00100000:0.0:1651529407.342919:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15794 00000100:00100000:0.0:1651529407.342921:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396767424:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529407.342982:0:144088:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529407.342984:0:144088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb mtime from disk: 0 -> 1651529407 00002000:00010000:0.0:1651529407.342985:0:144088:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529407.342986:0:144088:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb ctime from disk: 0 -> 1651529407 00002000:00010000:0.0:1651529407.342987:0:144088:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529407.343003:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396767424:12345-10.240.43.64@tcp:10:dd.0 Request processed in 81us (136us total) trans 30064894733 rc 0/0 00000100:00100000:0.0:1651529407.343006:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15794 00002000:00010000:0.0:1651529407.343008:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178622/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529407.343009:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2acff34 with x1731746396767424 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529407.343011:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2acff34. 00000100:00100000:1.0:1651529407.357282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.357302:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396767936 00002000:00100000:0.0:1651529407.357312:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9be:0x0] (0->1048575) req@00000000ec734a72 x1731746396767936/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:133/0 lens 488/0 e 0 to 0 dl 1651529413 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529407.357317:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ec734a72 with x1731746396767936 ext(0->1048575) 00002000:00010000:0.0:1651529407.357319:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ec734a72 00000100:00100000:0.0:1651529407.357328:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15795 00000100:00100000:0.0:1651529407.357330:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396767936:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529407.359438:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396767936:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2105us (2155us total) trans 30064894734 rc 0/0 00000100:00100000:0.0:1651529407.359442:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15795 00002000:00100000:0.0:1651529407.359446:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9be:0x0] (0->1048575) req@00000000ec734a72 x1731746396767936/t30064894734(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:133/0 lens 488/448 e 0 to 0 dl 1651529413 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529407.359450:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ec734a72 with x1731746396767936 ext(0->1048575) 00002000:00010000:0.0:1651529407.359452:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ec734a72 00000100:00100000:1.0:1651529407.360447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.360470:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768064 00000100:00100000:0.0:1651529407.360484:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153894 00000100:00100000:0.0:1651529407.360486:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419001:x1731746396768064:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.360516:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419001:x1731746396768064:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 29us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.360520:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153894 00000100:00100000:1.0:1651529407.360753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.360773:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768128 00000100:00100000:0.0:1651529407.360783:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153895 00000100:00100000:0.0:1651529407.360785:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419001:x1731746396768128:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.360820:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419001:x1731746396768128:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.360823:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153895 00000100:00100000:1.0:1651529407.365622:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.365643:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768256 00000100:00100000:0.0:1651529407.365656:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153896 00000100:00100000:0.0:1651529407.365658:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419003:x1731746396768256:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.365681:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419003:x1731746396768256:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 22us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.365683:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153896 00000100:00100000:1.0:1651529407.366874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.366896:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768320 00000100:00100000:0.0:1651529407.366907:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153897 00000100:00100000:0.0:1651529407.366909:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419003:x1731746396768320:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.366930:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419003:x1731746396768320:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.366933:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153897 00000400:00000080:1.0:1651529408.647678:0:169170:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529408.647681:0:169170:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130c: FIEMAP (2-stripe file with hole) ==== 22:10:08 (1651529408) 00000100:00100000:1.0:1651529408.692094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529408.692120:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396769664 00000100:00100000:0.0:1651529408.692147:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153898 00000100:00100000:0.0:1651529408.692150:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:419624:x1731746396769664:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529408.692161:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529408.692172:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c2c lrc: 2/0,0 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc1c3 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529408.692184:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529408.692194:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529408.692196:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529408.692199:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c2c lrc: 3/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1c3 expref: 14 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529408.692207:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c2c lrc: 3/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1c3 expref: 14 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529408.692213:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000566545e3, rc 0) 00000100:00100000:0.0:1651529408.692241:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:419624:x1731746396769664:12345-10.240.43.64@tcp:101:dd.0 Request processed in 90us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529408.692245:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153898 00000100:00100000:1.0:1651529408.692500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529408.692514:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396769792 00002000:00010000:0.0:1651529408.692523:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178623/0 (524288->18446744073709551615) 00002000:00100000:0.0:1651529408.692524:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa867bc6 with x1731746396769792 ext(524288->18446744073709551615) 00002000:00010000:0.0:1651529408.692528:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aa867bc6. 00000100:00100000:0.0:1651529408.692538:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15796 00000100:00100000:0.0:1651529408.692540:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396769792:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529408.692611:0:144088:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb size from disk: 0 -> 524288 00002000:00010000:0.0:1651529408.692612:0:144088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb mtime from disk: 0 -> 1651529408 00002000:00010000:0.0:1651529408.692613:0:144088:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529408.692614:0:144088:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb ctime from disk: 0 -> 1651529408 00002000:00010000:0.0:1651529408.692615:0:144088:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529408.692632:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa867bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396769792:12345-10.240.43.64@tcp:10:dd.0 Request processed in 91us (132us total) trans 30064894735 rc 0/0 00000100:00100000:0.0:1651529408.692635:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15796 00002000:00010000:0.0:1651529408.692637:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178623/0 (524288->18446744073709551615) 00002000:00100000:0.0:1651529408.692638:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa867bc6 with x1731746396769792 ext(524288->18446744073709551615) 00002000:00010000:0.0:1651529408.692640:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aa867bc6. 00000100:00100000:1.0:1651529408.702821:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529408.702845:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770240 00002000:00100000:0.0:1651529408.702855:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9bf:0x0] (524288->1048575) req@00000000d000b113 x1731746396770240/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:134/0 lens 488/0 e 0 to 0 dl 1651529414 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529408.702860:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d000b113 with x1731746396770240 ext(524288->1048575) 00002000:00010000:0.0:1651529408.702862:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d000b113 00000100:00100000:0.0:1651529408.702872:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15797 00000100:00100000:0.0:1651529408.702874:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396770240:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529408.704521:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396770240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 1646us (1700us total) trans 30064894736 rc 0/0 00000100:00100000:0.0:1651529408.704526:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15797 00002000:00100000:0.0:1651529408.704528:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9bf:0x0] (524288->1048575) req@00000000d000b113 x1731746396770240/t30064894736(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:134/0 lens 488/448 e 0 to 0 dl 1651529414 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529408.704533:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d000b113 with x1731746396770240 ext(524288->1048575) 00002000:00010000:0.0:1651529408.704534:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d000b113 00000100:00100000:1.0:1651529408.705490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529408.705513:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770432 00000100:00100000:0.0:1651529408.705526:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153899 00000100:00100000:0.0:1651529408.705528:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:419625:x1731746396770432:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529408.705560:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:419625:x1731746396770432:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 31us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529408.705563:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153899 00000100:00100000:1.0:1651529408.711447:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529408.711470:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770624 00000100:00100000:0.0:1651529408.711482:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153900 00000100:00100000:0.0:1651529408.711484:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:419627:x1731746396770624:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529408.711507:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:419627:x1731746396770624:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 22us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529408.711510:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153900 00000400:00000080:0.0:1651529409.990143:0:169388:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529409.990145:0:169388:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130d: FIEMAP (N-stripe file) ============== 22:10:09 (1651529409) 00000400:00000080:1.0:1651529410.294880:0:169442:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529410.294883:0:169442:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_130d needs >= 3 OSTs 00000400:00000080:1.0:1651529410.632519:0:169496:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529410.632521:0:169496:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130e: FIEMAP (test continuation FIEMAP calls) ========================================================== 22:10:10 (1651529410) 00000100:00100000:1.0:1651529410.666318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529410.666345:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396771456 00000100:00100000:0.0:1651529410.666372:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153901 00000100:00100000:0.0:1651529410.666374:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:420546:x1731746396771456:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529410.666384:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529410.666396:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0c33 lrc: 2/0,0 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc1f4 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529410.666408:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529410.666419:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529410.666419:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529410.666425:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0c33 lrc: 3/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1f4 expref: 18 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529410.666432:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0c33 lrc: 3/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1f4 expref: 18 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529410.666438:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095cff58f, rc 0) 00000100:00100000:0.0:1651529410.666466:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:420546:x1731746396771456:12345-10.240.43.64@tcp:101:dd.0 Request processed in 91us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529410.666469:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153901 00000100:00100000:1.0:1651529410.784117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529410.784144:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599168 00000100:00100000:0.0:1651529410.784158:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 319 00000100:00100000:0.0:1651529410.784160:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529410.784172:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 166510144 pending 1712128 free 81225764864 avail 77055053824 00000100:00100000:0.0:1651529410.784194:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087880af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 32us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529410.784197:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 319 00000001:00080000:1.0:1651529411.288115:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894736 is committed 00000100:00100000:1.0:1651529411.856425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529411.856455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.856459:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772352 00000100:00100000:1.0:1651529411.856472:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772416 00002000:00100000:1.0:1651529411.856485:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9c0:0x0] (8388608->16711679) req@00000000f685b181 x1731746396772416/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529411.856485:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9c0:0x0] (0->8323071) req@00000000f51dad16 x1731746396772352/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529411.856491:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f685b181 with x1731746396772416 ext(8388608->16711679) 00002000:00100000:0.0:1651529411.856491:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f51dad16 with x1731746396772352 ext(0->8323071) 00002000:00010000:1.0:1651529411.856494:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f685b181 00002000:00010000:0.0:1651529411.856494:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f51dad16 00000100:00100000:1.0:1651529411.856507:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15798 00000100:00100000:1.0:1651529411.856510:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396772416:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529411.856513:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15799 00000100:00100000:0.0:1651529411.856516:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396772352:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529411.857550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.857573:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772480 00002000:00100000:0.0:1651529411.857618:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9c0:0x0] (16777216->25100287) req@00000000ffc345cf x1731746396772480/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529411.857623:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731746396772480 ext(16777216->25100287) 00002000:00010000:0.0:1651529411.857625:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00000100:00100000:0.0:1651529411.857632:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15800 00000100:00100000:0.0:1651529411.857634:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396772480:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529411.865911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.865929:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772544 00002000:00100000:0.0:1651529411.865954:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9c0:0x0] (25165824->33488895) req@0000000088e71ac2 x1731746396772544/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529411.865961:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731746396772544 ext(25165824->33488895) 00002000:00010000:0.0:1651529411.865964:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:0.0:1651529411.865976:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15801 00000100:00100000:0.0:1651529411.865979:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41278:x1731746396772544:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529411.866410:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f51dad16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396772352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9892us (9986us total) trans 30064894737 rc 0/0 00000100:00100000:1.0:1651529411.866415:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15799 00002000:00100000:1.0:1651529411.866419:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9c0:0x0] (0->8323071) req@00000000f51dad16 x1731746396772352/t30064894737(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529411.866424:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f51dad16 with x1731746396772352 ext(0->8323071) 00002000:00010000:1.0:1651529411.866426:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f51dad16 00000100:00100000:1.0:1651529411.871424:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41278:x1731746396772416:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14909us (14965us total) trans 30064894738 rc 0/0 00000100:00100000:1.0:1651529411.871434:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15798 00002000:00100000:1.0:1651529411.871442:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9c0:0x0] (8388608->16711679) req@00000000f685b181 x1731746396772416/t30064894738(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529411.871448:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f685b181 with x1731746396772416 ext(8388608->16711679) 00002000:00010000:1.0:1651529411.871451:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f685b181 00000100:00100000:0.0:1651529411.874855:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396772480:12345-10.240.43.64@tcp:4:dd.0 Request processed in 17215us (17301us total) trans 30064894739 rc 0/0 00000100:00100000:0.0:1651529411.874864:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15800 00002000:00100000:0.0:1651529411.874872:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9c0:0x0] (16777216->25100287) req@00000000ffc345cf x1731746396772480/t30064894739(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529411.874880:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731746396772480 ext(16777216->25100287) 00002000:00010000:0.0:1651529411.874884:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00000100:00100000:0.0:1651529411.879287:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41278:x1731746396772544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 13304us (13378us total) trans 30064894740 rc 0/0 00000100:00100000:0.0:1651529411.879294:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15801 00002000:00100000:0.0:1651529411.879300:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9c0:0x0] (25165824->33488895) req@0000000088e71ac2 x1731746396772544/t30064894740(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529411.879305:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731746396772544 ext(25165824->33488895) 00002000:00010000:0.0:1651529411.879308:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:1.0:1651529411.886187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.886215:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772864 00000100:00100000:0.0:1651529411.886235:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153902 00000100:00100000:0.0:1651529411.886237:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772864:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.886802:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772864:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 564us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.886824:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153902 00000100:00100000:1.0:1651529411.887097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.887120:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772928 00000100:00100000:0.0:1651529411.887133:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153903 00000100:00100000:0.0:1651529411.887135:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012c9051d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772928:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.887514:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012c9051d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772928:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 378us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.887517:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153903 00000100:00100000:1.0:1651529411.887754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.887775:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772992 00000100:00100000:0.0:1651529411.887786:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153904 00000100:00100000:0.0:1651529411.887787:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772992:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.888020:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396772992:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 232us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.888023:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153904 00000100:00100000:1.0:1651529411.888250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.888271:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773056 00000100:00100000:0.0:1651529411.888281:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153905 00000100:00100000:0.0:1651529411.888282:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396773056:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.888349:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396773056:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 66us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.888352:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153905 00000100:00100000:1.0:1651529411.888573:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.888587:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773120 00000100:00100000:0.0:1651529411.888597:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153906 00000100:00100000:0.0:1651529411.888598:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396773120:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.888619:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421058:x1731746396773120:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.888623:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153906 00000100:00100000:1.0:1651529412.083910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.083937:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773568 00000100:00100000:0.0:1651529412.083956:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153907 00000100:00100000:0.0:1651529412.083959:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773568:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.084507:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773568:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 548us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.084510:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153907 00000100:00100000:1.0:1651529412.084725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.084740:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773632 00000100:00100000:0.0:1651529412.084750:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153908 00000100:00100000:0.0:1651529412.084752:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773632:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.085151:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773632:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 398us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.085154:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153908 00000100:00100000:1.0:1651529412.085357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.085372:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773696 00000100:00100000:0.0:1651529412.085382:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153909 00000100:00100000:0.0:1651529412.085384:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773696:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.085604:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773696:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 220us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.085607:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153909 00000100:00100000:1.0:1651529412.085796:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.085813:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773760 00000100:00100000:0.0:1651529412.085823:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153910 00000100:00100000:0.0:1651529412.085825:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773760:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.085890:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773760:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.085893:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153910 00000100:00100000:1.0:1651529412.086080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.086094:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773824 00000100:00100000:0.0:1651529412.086103:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153911 00000100:00100000:0.0:1651529412.086105:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3a5a2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773824:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.086125:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3a5a2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:421060:x1731746396773824:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.086127:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153911 00000100:00100000:1.0:1651529415.874003:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529415.874030:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774336 00000100:00100000:0.0:1651529415.874053:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 39 00000100:00100000:0.0:1651529415.874056:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41278:x1731746396774336:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529415.874089:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41278:x1731746396774336:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529415.874093:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 39 00000100:00100000:1.0:1651529415.904104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529415.904128:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599360 00000100:00100000:0.0:1651529415.904139:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 320 00000100:00100000:0.0:1651529415.904141:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599360:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529415.904154:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 17301504 granted 198549056 pending 23068672 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529415.904172:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599360:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529415.904175:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 320 00000100:00100000:1.0:1651529416.381868:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062ba7e7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966716544:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529416.381868:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628382ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966716480:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529416.382277:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062ba7e7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966716544:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529416.382277:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628382ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966716480:10.240.43.61@tcp:400:kworker/u4:2.0 00000400:00000080:0.0:1651529417.355606:0:169715:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529417.355608:0:169715:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130f: FIEMAP (unstriped file) ============= 22:10:17 (1651529417) 00000001:00080000:1.0:1651529417.475210:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894740 is committed 00000400:00000080:0.0:1651529418.654214:0:169933:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529418.654217:0:169933:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130g: FIEMAP (overstripe file) ============ 22:10:18 (1651529418) 00000100:00100000:1.0:1651529418.677437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529418.677464:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599616 00000100:00100000:0.0:1651529418.677490:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 153912 00000100:00100000:0.0:1651529418.677493:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:137464:x1731745946599616:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1651529418.677516:0:144527:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x0 at 178690 00000100:00100000:0.0:1651529418.678550:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:137464:x1731745946599616:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 1055us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.678554:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 153912 00000100:00100000:1.0:1651529418.686549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.686573:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776576 00000100:00100000:0.0:1651529418.686588:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153913 00000100:00100000:0.0:1651529418.686590:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:425322:x1731746396776576:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.686596:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.686607:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 2/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc25d expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.686616:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.686624:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.686625:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.686629:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 3/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.686636:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 3/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.686642:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000015f46ac3, rc 0) 00000100:00100000:0.0:1651529418.686660:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:425322:x1731746396776576:12345-10.240.43.64@tcp:101:dd.0 Request processed in 69us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.686663:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153913 00000100:00100000:1.0:1651529418.687353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.687375:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776704 00000100:00100000:0.0:1651529418.687387:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153914 00000100:00100000:0.0:1651529418.687389:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:425322:x1731746396776704:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.687392:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.687397:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 2/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc26b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.687402:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.687406:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687407:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687409:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 3/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 11 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687413:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 3/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 11 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687417:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f782055, rc 0) 00000100:00100000:0.0:1651529418.687432:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:425322:x1731746396776704:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.687434:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153914 00000100:00100000:1.0:1651529418.687948:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.687969:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776832 00000100:00100000:0.0:1651529418.687981:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153915 00000100:00100000:0.0:1651529418.687983:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:425322:x1731746396776832:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.687986:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.687991:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 2/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc279 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.687997:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.688001:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688001:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688003:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 3/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 12 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688007:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 3/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 12 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688011:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f25ba4b, rc 0) 00000100:00100000:0.0:1651529418.688026:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:425322:x1731746396776832:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.688028:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153915 00000100:00100000:1.0:1651529418.688538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.688559:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776960 00000100:00100000:0.0:1651529418.688571:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153916 00000100:00100000:0.0:1651529418.688572:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:425322:x1731746396776960:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.688576:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.688580:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 2/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc287 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.688585:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.688589:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688589:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688591:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 3/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 13 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688597:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 3/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 13 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688601:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000040c1504b, rc 0) 00000100:00100000:0.0:1651529418.688615:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:425322:x1731746396776960:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.688618:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153916 00000100:00100000:1.0:1651529418.689125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.689146:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777088 00000100:00100000:0.0:1651529418.689159:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153917 00000100:00100000:0.0:1651529418.689161:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:425322:x1731746396777088:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.689164:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.689168:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 2/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc295 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.689173:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.689177:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689178:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689179:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 3/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 14 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689183:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 3/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 14 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689187:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a4f97720, rc 0) 00000100:00100000:0.0:1651529418.689202:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:425322:x1731746396777088:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.689205:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153917 00000100:00100000:1.0:1651529418.689669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.689690:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777216 00000100:00100000:0.0:1651529418.689701:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153918 00000100:00100000:0.0:1651529418.689703:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:425322:x1731746396777216:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.689706:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.689710:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 2/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2a3 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.689715:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.689720:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689720:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689722:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 3/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 15 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689726:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 3/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 15 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689730:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aa865cce, rc 0) 00000100:00100000:0.0:1651529418.689744:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:425322:x1731746396777216:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.689746:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153918 00000100:00100000:1.0:1651529418.690220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.690242:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777344 00000100:00100000:0.0:1651529418.690253:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153919 00000100:00100000:0.0:1651529418.690255:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:425322:x1731746396777344:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.690258:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.690262:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 2/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2b1 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.690267:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.690271:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690272:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690273:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 3/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 16 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690277:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 3/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 16 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690281:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000590e4cfe, rc 0) 00000100:00100000:0.0:1651529418.690295:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:425322:x1731746396777344:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.690298:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153919 00000100:00100000:1.0:1651529418.690759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.690784:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777472 00000100:00100000:0.0:1651529418.690796:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153920 00000100:00100000:0.0:1651529418.690798:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:425322:x1731746396777472:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.690801:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.690816:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 2/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2bf expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.690821:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.690825:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690826:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690827:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 3/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 17 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690834:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 3/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 17 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690838:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000059b4498e, rc 0) 00000100:00100000:0.0:1651529418.690851:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:425322:x1731746396777472:12345-10.240.43.64@tcp:101:dd.0 Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.690854:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153920 00000100:00100000:1.0:1651529418.691313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.691334:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777600 00000100:00100000:0.0:1651529418.691345:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153921 00000100:00100000:0.0:1651529418.691347:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:425322:x1731746396777600:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.691350:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.691354:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 2/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2cd expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.691359:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.691363:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691363:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691365:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 3/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 18 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691369:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 3/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 18 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691372:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000806805c0, rc 0) 00000100:00100000:0.0:1651529418.691386:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:425322:x1731746396777600:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.691389:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153921 00000100:00100000:1.0:1651529418.691877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.691899:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777728 00000100:00100000:0.0:1651529418.691910:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153922 00000100:00100000:0.0:1651529418.691912:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:425322:x1731746396777728:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.691915:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.691920:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 2/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2db expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.691924:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.691928:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691929:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691930:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 19 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691934:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 19 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691938:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003416f7b2, rc 0) 00000100:00100000:0.0:1651529418.691952:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:425322:x1731746396777728:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.691955:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153922 00000100:00100000:1.0:1651529418.692433:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.692454:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777856 00000100:00100000:0.0:1651529418.692465:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153923 00000100:00100000:0.0:1651529418.692467:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:425322:x1731746396777856:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.692470:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.692475:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 2/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2e9 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.692480:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.692484:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692485:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692486:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 20 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692490:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 20 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692494:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000061446d72, rc 0) 00000100:00100000:0.0:1651529418.692507:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:425322:x1731746396777856:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.692510:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153923 00000100:00100000:1.0:1651529418.692985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.693006:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777984 00000100:00100000:0.0:1651529418.693017:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153924 00000100:00100000:0.0:1651529418.693019:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:425322:x1731746396777984:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.693022:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.693026:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 2/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2f7 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.693031:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.693035:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693035:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693037:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 3/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 21 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693043:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 3/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 21 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693047:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017268066, rc 0) 00000100:00100000:0.0:1651529418.693060:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:425322:x1731746396777984:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.693063:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153924 00000100:00100000:1.0:1651529418.693520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.693540:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778112 00000100:00100000:0.0:1651529418.693551:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153925 00000100:00100000:0.0:1651529418.693553:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:425322:x1731746396778112:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.693556:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.693560:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 2/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc305 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.693566:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.693570:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693570:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693572:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 22 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693576:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 22 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693580:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000313829b, rc 0) 00000100:00100000:0.0:1651529418.693594:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:425322:x1731746396778112:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.693605:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153925 00000100:00100000:1.0:1651529418.694060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.694081:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778240 00000100:00100000:0.0:1651529418.694093:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153926 00000100:00100000:0.0:1651529418.694095:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:425322:x1731746396778240:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.694098:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.694102:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 2/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc313 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.694107:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.694111:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694112:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694113:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 3/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 23 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694117:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 3/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 23 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694121:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eb48a81e, rc 0) 00000100:00100000:0.0:1651529418.694135:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:425322:x1731746396778240:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.694138:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153926 00000100:00100000:1.0:1651529418.694600:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.694621:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778368 00000100:00100000:0.0:1651529418.694632:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153927 00000100:00100000:0.0:1651529418.694634:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:425322:x1731746396778368:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.694637:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.694641:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 2/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc321 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.694653:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.694657:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694658:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694659:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 3/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 24 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694663:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 3/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 24 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694667:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000021305674, rc 0) 00000100:00100000:0.0:1651529418.694681:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:425322:x1731746396778368:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.694683:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153927 00000100:00100000:1.0:1651529418.695157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.695178:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778496 00000100:00100000:0.0:1651529418.695190:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153928 00000100:00100000:0.0:1651529418.695191:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:425322:x1731746396778496:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.695194:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.695198:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 2/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc32f expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.695204:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.695207:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695208:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695209:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 3/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 25 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695224:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 3/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 25 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695228:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000044216735, rc 0) 00000100:00100000:0.0:1651529418.695241:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:425322:x1731746396778496:12345-10.240.43.64@tcp:101:dd.0 Request processed in 49us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.695244:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153928 00000100:00100000:1.0:1651529418.695698:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.695719:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778624 00000100:00100000:0.0:1651529418.695730:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153929 00000100:00100000:0.0:1651529418.695732:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d6ceda5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:425322:x1731746396778624:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.695735:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.695739:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 2/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc33d expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.695744:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.695748:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695749:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695750:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 26 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695754:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 26 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695758:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c90bba11, rc 0) 00000100:00100000:0.0:1651529418.695771:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d6ceda5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:425322:x1731746396778624:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.695786:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153929 00000100:00100000:1.0:1651529418.696252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.696273:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778752 00000100:00100000:0.0:1651529418.696284:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153930 00000100:00100000:0.0:1651529418.696286:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d974ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:425322:x1731746396778752:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.696289:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.696293:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 2/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc34b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.696298:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.696302:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696303:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696304:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 27 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696308:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 27 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696312:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001edcc069, rc 0) 00000100:00100000:0.0:1651529418.696326:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d974ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:425322:x1731746396778752:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.696328:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153930 00000100:00100000:1.0:1651529418.696787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.696812:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778880 00000100:00100000:0.0:1651529418.696824:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153931 00000100:00100000:0.0:1651529418.696826:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000381e5a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:425322:x1731746396778880:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.696829:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.696833:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 2/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc359 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.696838:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.696842:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696842:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696844:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 28 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696848:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 28 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696852:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c28d57aa, rc 0) 00000100:00100000:0.0:1651529418.696866:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000381e5a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:425322:x1731746396778880:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.696868:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153931 00000100:00100000:1.0:1651529418.697347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.697368:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779008 00000100:00100000:0.0:1651529418.697379:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153932 00000100:00100000:0.0:1651529418.697381:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006fc0a8fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:425322:x1731746396779008:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.697385:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.697389:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 2/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc367 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.697394:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.697398:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697399:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697400:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 29 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697406:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 29 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697410:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080006241, rc 0) 00000100:00100000:0.0:1651529418.697424:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006fc0a8fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:425322:x1731746396779008:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.697426:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153932 00000100:00100000:1.0:1651529418.697928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.697949:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779136 00000100:00100000:0.0:1651529418.697960:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153933 00000100:00100000:0.0:1651529418.697962:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f14698e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:425322:x1731746396779136:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.697965:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.697969:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 2/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc375 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.697974:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.697978:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697978:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697980:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 3/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 30 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697984:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 3/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 30 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697987:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a023b8c2, rc 0) 00000100:00100000:0.0:1651529418.698001:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f14698e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:425322:x1731746396779136:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.698004:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153933 00000100:00100000:1.0:1651529418.698494:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.698515:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779264 00000100:00100000:0.0:1651529418.698526:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153934 00000100:00100000:0.0:1651529418.698528:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4cd7ed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:425322:x1731746396779264:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.698531:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.698535:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 2/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc383 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.698540:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.698544:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698544:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698546:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 31 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698550:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 31 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698553:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001bf25d5b, rc 0) 00000100:00100000:0.0:1651529418.698567:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4cd7ed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:425322:x1731746396779264:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.698570:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153934 00000100:00100000:1.0:1651529418.699071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.699092:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779392 00000100:00100000:0.0:1651529418.699103:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153935 00000100:00100000:0.0:1651529418.699105:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094d15512 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:425322:x1731746396779392:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.699108:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.699112:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 2/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc391 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.699117:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.699121:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699121:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699123:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 3/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 32 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699127:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 3/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 32 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699131:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6dda103, rc 0) 00000100:00100000:0.0:1651529418.699144:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094d15512 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:425322:x1731746396779392:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.699147:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153935 00000100:00100000:1.0:1651529418.699629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.699649:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779520 00000100:00100000:0.0:1651529418.699661:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153936 00000100:00100000:0.0:1651529418.699662:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054d63fed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:425322:x1731746396779520:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.699666:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.699670:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 2/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc39f expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.699674:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.699679:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699679:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699681:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 3/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 33 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699687:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 3/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 33 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699691:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec101cd, rc 0) 00000100:00100000:0.0:1651529418.699704:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054d63fed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:425322:x1731746396779520:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.699707:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153936 00000100:00100000:1.0:1651529418.700182:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.700203:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779648 00000100:00100000:0.0:1651529418.700214:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153937 00000100:00100000:0.0:1651529418.700216:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5df4036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:425322:x1731746396779648:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.700219:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.700224:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 2/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3ad expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.700229:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.700233:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700233:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700235:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 3/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 34 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700239:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 3/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 34 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700242:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba5b8d96, rc 0) 00000100:00100000:0.0:1651529418.700256:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5df4036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:425322:x1731746396779648:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.700259:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153937 00000100:00100000:1.0:1651529418.700732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.700754:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779776 00000100:00100000:0.0:1651529418.700767:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153938 00000100:00100000:0.0:1651529418.700769:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000069066df1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:425322:x1731746396779776:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.700773:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.700784:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 2/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3bb expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.700789:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.700793:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700794:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700795:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 35 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700800:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 35 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700821:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000081ada84a, rc 0) 00000100:00100000:0.0:1651529418.700834:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000069066df1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:425322:x1731746396779776:12345-10.240.43.64@tcp:101:dd.0 Request processed in 64us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.700837:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153938 00000100:00100000:1.0:1651529418.701338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.701356:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779904 00000100:00100000:0.0:1651529418.701369:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153939 00000100:00100000:0.0:1651529418.701371:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a853e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:425322:x1731746396779904:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.701374:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.701379:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 2/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3c9 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.701384:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.701388:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701388:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701390:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 3/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 36 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701394:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 3/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 36 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701398:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e5d5897, rc 0) 00000100:00100000:0.0:1651529418.701412:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a853e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+36:425322:x1731746396779904:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.701415:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153939 00000100:00100000:1.0:1651529418.701910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.701927:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780032 00000100:00100000:0.0:1651529418.701940:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153940 00000100:00100000:0.0:1651529418.701942:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000421790ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+36:425322:x1731746396780032:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.701945:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.701949:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 2/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3d7 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.701954:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.701959:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701959:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701961:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 37 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701968:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 37 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701971:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a90bfd37, rc 0) 00000100:00100000:0.0:1651529418.701985:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000421790ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:425322:x1731746396780032:12345-10.240.43.64@tcp:101:dd.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.701988:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153940 00000100:00100000:1.0:1651529418.702474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.702491:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780160 00000100:00100000:0.0:1651529418.702503:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153941 00000100:00100000:0.0:1651529418.702504:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb206345 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:425322:x1731746396780160:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.702507:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.702512:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 2/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3e5 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.702517:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.702521:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702521:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702523:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 3/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 38 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702527:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 3/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 38 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702530:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f4be2ac0, rc 0) 00000100:00100000:0.0:1651529418.702544:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb206345 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+38:425322:x1731746396780160:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.702547:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153941 00000100:00100000:1.0:1651529418.703018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.703035:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780288 00000100:00100000:0.0:1651529418.703048:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153942 00000100:00100000:0.0:1651529418.703050:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+38:425322:x1731746396780288:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.703054:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.703066:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 2/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3f3 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.703071:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.703075:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703076:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703077:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 3/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 39 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703082:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 3/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 39 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703085:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000203d678c, rc 0) 00000100:00100000:0.0:1651529418.703100:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:425322:x1731746396780288:12345-10.240.43.64@tcp:101:dd.0 Request processed in 49us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.703103:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153942 00000100:00100000:1.0:1651529418.703555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.703571:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780416 00000100:00100000:0.0:1651529418.703584:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153943 00000100:00100000:0.0:1651529418.703585:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:425322:x1731746396780416:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.703589:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.703592:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 2/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc401 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.703597:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.703601:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703602:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703603:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 3/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 40 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703607:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 3/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 40 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703611:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0accd18, rc 0) 00000100:00100000:0.0:1651529418.703624:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+40:425322:x1731746396780416:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.703627:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153943 00000100:00100000:1.0:1651529418.704112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.704129:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780544 00000100:00100000:0.0:1651529418.704142:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153944 00000100:00100000:0.0:1651529418.704144:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+40:425322:x1731746396780544:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.704147:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.704151:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 2/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc40f expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.704156:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.704160:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704161:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704162:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 3/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 41 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704169:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 3/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 41 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704172:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000021275de8, rc 0) 00000100:00100000:0.0:1651529418.704186:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:425322:x1731746396780544:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.704188:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153944 00000100:00100000:1.0:1651529418.704628:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.704645:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780672 00000100:00100000:0.0:1651529418.704660:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153945 00000100:00100000:0.0:1651529418.704663:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:425322:x1731746396780672:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.704668:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.704673:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 2/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc41d expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.704681:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.704688:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704689:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704691:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 3/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 42 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704698:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 3/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 42 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704703:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009966b94f, rc 0) 00000100:00100000:0.0:1651529418.704719:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:425322:x1731746396780672:12345-10.240.43.64@tcp:101:dd.0 Request processed in 56us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.704722:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153945 00000100:00100000:1.0:1651529418.705180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.705197:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780800 00000100:00100000:0.0:1651529418.705210:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153946 00000100:00100000:0.0:1651529418.705211:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:425322:x1731746396780800:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.705215:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.705219:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 2/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc42b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.705224:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.705228:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705228:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705230:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 43 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705234:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 43 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705238:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000062e9b49, rc 0) 00000100:00100000:0.0:1651529418.705252:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:425322:x1731746396780800:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.705255:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153946 00000100:00100000:1.0:1651529418.705712:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.705729:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780928 00000100:00100000:0.0:1651529418.705742:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153947 00000100:00100000:0.0:1651529418.705744:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:425322:x1731746396780928:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.705747:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.705751:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 2/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc439 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.705756:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.705760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705760:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705762:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 44 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705766:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 44 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705770:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088561f21, rc 0) 00000100:00100000:0.0:1651529418.705792:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+44:425322:x1731746396780928:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.705794:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153947 00000100:00100000:1.0:1651529418.706271:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.706288:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781056 00000100:00100000:0.0:1651529418.706300:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153948 00000100:00100000:0.0:1651529418.706302:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+44:425322:x1731746396781056:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.706305:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.706309:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 2/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc447 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.706315:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.706318:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706319:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706320:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 3/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 45 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706327:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 3/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 45 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706330:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e0d18c5, rc 0) 00000100:00100000:0.0:1651529418.706344:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:425322:x1731746396781056:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.706346:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153948 00000100:00100000:1.0:1651529418.706823:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.706833:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781184 00000100:00100000:0.0:1651529418.706847:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153949 00000100:00100000:0.0:1651529418.706849:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:425322:x1731746396781184:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.706853:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.706856:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 2/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc455 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.706861:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.706865:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706866:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706867:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 3/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 46 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706871:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 3/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 46 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706875:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000015b2637, rc 0) 00000100:00100000:0.0:1651529418.706889:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:425322:x1731746396781184:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.706892:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153949 00000100:00100000:1.0:1651529418.707385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.707402:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781312 00000100:00100000:0.0:1651529418.707416:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153950 00000100:00100000:0.0:1651529418.707418:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:425322:x1731746396781312:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.707421:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.707425:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 2/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc463 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.707430:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.707434:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707435:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707436:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 3/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 47 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707441:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 3/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 47 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707444:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002d1f099d, rc 0) 00000100:00100000:0.0:1651529418.707458:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:425322:x1731746396781312:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.707461:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153950 00000100:00100000:1.0:1651529418.707940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.707957:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781440 00000100:00100000:0.0:1651529418.707970:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153951 00000100:00100000:0.0:1651529418.707972:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:425322:x1731746396781440:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.707975:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.707980:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 2/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc471 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.707985:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.707989:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707990:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707991:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 3/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 48 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707995:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 3/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 48 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707999:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748a867f, rc 0) 00000100:00100000:0.0:1651529418.708014:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:425322:x1731746396781440:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.708016:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153951 00000100:00100000:1.0:1651529418.708488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.708505:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781568 00000100:00100000:0.0:1651529418.708517:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153952 00000100:00100000:0.0:1651529418.708518:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:425322:x1731746396781568:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.708522:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.708525:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 2/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc47f expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.708531:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.708534:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708535:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708536:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 3/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 49 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708543:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 3/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 49 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708547:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014e2ea2c, rc 0) 00000100:00100000:0.0:1651529418.708560:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:425322:x1731746396781568:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.708563:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153952 00000100:00100000:1.0:1651529418.709037:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.709054:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781696 00000100:00100000:0.0:1651529418.709066:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153953 00000100:00100000:0.0:1651529418.709068:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:425322:x1731746396781696:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.709072:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.709075:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 2/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc48d expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.709080:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.709084:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709085:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709086:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 3/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 50 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709090:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 3/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 50 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709094:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a60e195, rc 0) 00000100:00100000:0.0:1651529418.709108:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:425322:x1731746396781696:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.709111:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153953 00000100:00100000:1.0:1651529418.709562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.709579:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781824 00000100:00100000:0.0:1651529418.709591:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153954 00000100:00100000:0.0:1651529418.709592:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:425322:x1731746396781824:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.709595:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.709599:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 2/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc49b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.709604:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.709608:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709608:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709610:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 3/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 51 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709614:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 3/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 51 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709617:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036531b38, rc 0) 00000100:00100000:0.0:1651529418.709631:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:425322:x1731746396781824:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.709634:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153954 00000100:00100000:1.0:1651529418.710111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.710128:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781952 00000100:00100000:0.0:1651529418.710142:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153955 00000100:00100000:0.0:1651529418.710143:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:425322:x1731746396781952:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.710147:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.710151:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 2/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4a9 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.710156:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.710160:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710160:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710162:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 3/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 52 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710166:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 3/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 52 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710169:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6e2a7ad, rc 0) 00000100:00100000:0.0:1651529418.710184:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:425322:x1731746396781952:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.710187:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153955 00000100:00100000:1.0:1651529418.710635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.710653:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782080 00000100:00100000:0.0:1651529418.710670:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153956 00000100:00100000:0.0:1651529418.710673:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:425322:x1731746396782080:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.710679:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.710684:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 2/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4b7 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.710692:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.710696:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710696:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710698:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 53 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710705:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 53 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710708:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b415eb38, rc 0) 00000100:00100000:0.0:1651529418.710723:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+53:425322:x1731746396782080:12345-10.240.43.64@tcp:101:dd.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.710725:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153956 00000100:00100000:1.0:1651529418.711185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.711202:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782208 00000100:00100000:0.0:1651529418.711214:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153957 00000100:00100000:0.0:1651529418.711215:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033321bfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+53:425322:x1731746396782208:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.711219:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.711223:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 2/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4c5 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.711227:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.711232:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711232:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711234:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 54 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711238:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 54 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711241:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ff9a3a, rc 0) 00000100:00100000:0.0:1651529418.711255:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033321bfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:425322:x1731746396782208:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.711258:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153957 00000100:00100000:1.0:1651529418.711714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.711732:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782336 00000100:00100000:0.0:1651529418.711745:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153958 00000100:00100000:0.0:1651529418.711747:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:425322:x1731746396782336:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.711750:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.711754:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 2/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4d3 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.711759:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.711763:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711763:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711765:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 3/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 55 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711769:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 3/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 55 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711773:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a1af0c60, rc 0) 00000100:00100000:0.0:1651529418.711795:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:425322:x1731746396782336:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.711797:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153958 00000100:00100000:1.0:1651529418.712272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.712289:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782464 00000100:00100000:0.0:1651529418.712301:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153959 00000100:00100000:0.0:1651529418.712303:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:425322:x1731746396782464:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.712306:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.712310:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 2/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4e1 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.712315:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.712319:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712319:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712321:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 3/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 56 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712325:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 3/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 56 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712328:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000008e74d38, rc 0) 00000100:00100000:0.0:1651529418.712342:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:425322:x1731746396782464:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.712345:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153959 00000100:00100000:1.0:1651529418.712815:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.712827:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782592 00000100:00100000:0.0:1651529418.712842:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153960 00000100:00100000:0.0:1651529418.712844:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:425322:x1731746396782592:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.712848:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.712852:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 2/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4ef expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.712857:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.712861:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712861:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712863:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 57 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712869:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 57 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712873:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055085556, rc 0) 00000100:00100000:0.0:1651529418.712887:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:425322:x1731746396782592:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.712889:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153960 00000100:00100000:1.0:1651529418.713359:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.713376:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782720 00000100:00100000:0.0:1651529418.713388:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153961 00000100:00100000:0.0:1651529418.713390:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:425322:x1731746396782720:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.713393:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.713397:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 2/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4fd expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.713402:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.713406:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713406:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713408:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 3/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 58 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713412:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 3/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 58 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713415:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000116ed8ae, rc 0) 00000100:00100000:0.0:1651529418.713429:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:425322:x1731746396782720:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.713432:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153961 00000100:00100000:1.0:1651529418.713909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.713930:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782848 00000100:00100000:0.0:1651529418.713943:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153962 00000100:00100000:0.0:1651529418.713945:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:425322:x1731746396782848:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.713948:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.713952:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 2/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc50b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.713957:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.713960:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713961:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713963:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 3/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 59 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713967:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 3/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 59 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713970:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f821ef24, rc 0) 00000100:00100000:0.0:1651529418.713984:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:425322:x1731746396782848:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.713987:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153962 00000100:00100000:1.0:1651529418.714518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.714539:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782976 00000100:00100000:0.0:1651529418.714550:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153963 00000100:00100000:0.0:1651529418.714552:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:425322:x1731746396782976:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.714555:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.714559:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 2/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc519 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.714564:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.714567:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714568:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714569:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 3/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 60 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714573:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 3/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 60 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714577:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2f9496d, rc 0) 00000100:00100000:0.0:1651529418.714591:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:425322:x1731746396782976:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.714593:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153963 00000100:00100000:1.0:1651529418.715110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.715130:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783104 00000100:00100000:0.0:1651529418.715142:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153964 00000100:00100000:0.0:1651529418.715143:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:425322:x1731746396783104:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.715147:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.715150:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 2/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc527 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.715156:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.715159:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715160:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715161:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 61 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715167:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 61 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715171:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000020767202, rc 0) 00000100:00100000:0.0:1651529418.715185:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:425322:x1731746396783104:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.715187:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153964 00000100:00100000:1.0:1651529418.715680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.715700:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783232 00000100:00100000:0.0:1651529418.715711:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153965 00000100:00100000:0.0:1651529418.715713:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:425322:x1731746396783232:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.715716:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.715721:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 2/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc535 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.715726:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.715729:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715730:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715731:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 3/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 62 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715735:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 3/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 62 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715739:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006e35abc3, rc 0) 00000100:00100000:0.0:1651529418.715753:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:425322:x1731746396783232:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.715756:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153965 00000100:00100000:1.0:1651529418.716255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.716275:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783360 00000100:00100000:0.0:1651529418.716287:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153966 00000100:00100000:0.0:1651529418.716288:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:425322:x1731746396783360:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.716292:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.716296:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 2/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc543 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.716300:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.716304:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716305:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716306:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 3/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 63 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716310:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 3/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 63 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716314:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eab8f50b, rc 0) 00000100:00100000:0.0:1651529418.716328:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:425322:x1731746396783360:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.716330:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153966 00000100:00100000:1.0:1651529418.716831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.716846:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783488 00000100:00100000:0.0:1651529418.716858:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153967 00000100:00100000:0.0:1651529418.716860:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:425322:x1731746396783488:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.716863:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.716867:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 2/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc551 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.716872:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.716876:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716876:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716878:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 64 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716882:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 64 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716886:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e79ca9ff, rc 0) 00000100:00100000:0.0:1651529418.716900:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:425322:x1731746396783488:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.716902:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153967 00000100:00100000:1.0:1651529418.717386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.717407:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783616 00000100:00100000:0.0:1651529418.717418:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153968 00000100:00100000:0.0:1651529418.717419:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:425322:x1731746396783616:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.717423:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.717426:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 2/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc55f expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.717432:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.717435:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717436:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717437:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 65 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717444:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 65 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717447:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006ba49a0b, rc 0) 00000100:00100000:0.0:1651529418.717461:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:425322:x1731746396783616:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.717463:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153968 00000100:00100000:1.0:1651529418.717960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.717981:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783744 00000100:00100000:0.0:1651529418.717993:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153969 00000100:00100000:0.0:1651529418.717995:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:425322:x1731746396783744:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.717998:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.718002:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 2/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc56d expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.718007:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.718011:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718011:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718013:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 66 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718017:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 66 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718021:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fe3ca94c, rc 0) 00000100:00100000:0.0:1651529418.718034:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:425322:x1731746396783744:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.718037:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153969 00000100:00100000:1.0:1651529418.718504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.718525:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783872 00000100:00100000:0.0:1651529418.718536:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153970 00000100:00100000:0.0:1651529418.718538:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:425322:x1731746396783872:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.718541:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.718545:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 2/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc57b expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.718550:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.718553:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718554:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718555:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 3/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 67 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718559:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 3/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 67 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718563:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000278eaea9, rc 0) 00000100:00100000:0.0:1651529418.718577:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:425322:x1731746396783872:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.718579:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153970 00000100:00100000:1.0:1651529418.719050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.719071:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784000 00000100:00100000:0.0:1651529418.719082:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153971 00000100:00100000:0.0:1651529418.719084:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:425322:x1731746396784000:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.719087:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.719091:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 2/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc589 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.719096:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.719100:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719100:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719102:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 3/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 68 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719106:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 3/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 68 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719110:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000094f73a37, rc 0) 00000100:00100000:0.0:1651529418.719123:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:425322:x1731746396784000:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.719126:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153971 00000100:00100000:1.0:1651529418.719599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.719619:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784128 00000100:00100000:0.0:1651529418.719630:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153972 00000100:00100000:0.0:1651529418.719632:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:425322:x1731746396784128:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.719635:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.719640:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 2/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc597 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.719645:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.719648:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719649:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719651:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 3/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 69 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719657:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 3/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 69 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719661:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e66e6d31, rc 0) 00000100:00100000:0.0:1651529418.719674:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:425322:x1731746396784128:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.719677:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153972 00000100:00100000:1.0:1651529418.720164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.720185:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784256 00000100:00100000:0.0:1651529418.720196:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153973 00000100:00100000:0.0:1651529418.720198:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:425322:x1731746396784256:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.720201:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.720206:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 2/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5a5 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.720211:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.720215:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720215:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720217:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 3/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 70 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720221:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 3/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 70 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720224:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000372ca287, rc 0) 00000100:00100000:0.0:1651529418.720238:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:425322:x1731746396784256:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.720241:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153973 00000100:00100000:1.0:1651529418.720714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.720735:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784384 00000100:00100000:0.0:1651529418.720746:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153974 00000100:00100000:0.0:1651529418.720748:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:425322:x1731746396784384:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.720751:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.720755:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 2/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5b3 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.720760:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.720764:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720765:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720766:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 71 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720770:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 71 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720781:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000064deda1c, rc 0) 00000100:00100000:0.0:1651529418.720795:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:425322:x1731746396784384:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.720797:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153974 00000100:00100000:1.0:1651529418.721295:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.721315:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784512 00000100:00100000:0.0:1651529418.721327:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153975 00000100:00100000:0.0:1651529418.721329:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:425322:x1731746396784512:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.721332:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.721336:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 2/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5c1 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.721341:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2b9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.721344:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721345:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721346:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 3/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 72 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721350:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 3/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 72 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721354:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000073a493a1, rc 0) 00000100:00100000:0.0:1651529418.721368:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:425322:x1731746396784512:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.721371:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153975 00000100:00100000:1.0:1651529418.721872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.721893:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784640 00000100:00100000:0.0:1651529418.721904:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153976 00000100:00100000:0.0:1651529418.721906:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:425322:x1731746396784640:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.721909:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.721913:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 2/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5cf expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.721918:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.721922:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721923:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721924:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 73 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721931:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 73 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721934:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2e7abbd, rc 0) 00000100:00100000:0.0:1651529418.721948:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:425322:x1731746396784640:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.721951:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153976 00000100:00100000:1.0:1651529418.722442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.722462:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784768 00000100:00100000:0.0:1651529418.722473:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153977 00000100:00100000:0.0:1651529418.722475:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:425322:x1731746396784768:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.722478:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.722482:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 2/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5dd expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.722487:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.722490:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722491:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722492:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 74 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722497:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 74 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722500:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0f7309, rc 0) 00000100:00100000:0.0:1651529418.722514:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:425322:x1731746396784768:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.722517:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153977 00000100:00100000:1.0:1651529418.727211:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.727232:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785984 00000100:00100000:0.0:1651529418.727243:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153978 00000100:00100000:0.0:1651529418.727245:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:425322:x1731746396785984:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.727249:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.727260:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 2/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc662 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.727265:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.727269:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727269:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727271:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 75 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727275:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 75 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727279:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fe7aa555, rc 0) 00000100:00100000:0.0:1651529418.727293:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:425322:x1731746396785984:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.727296:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153978 00000100:00100000:1.0:1651529418.727787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.727815:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786112 00000100:00100000:0.0:1651529418.727826:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153979 00000100:00100000:0.0:1651529418.727828:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:425322:x1731746396786112:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.727832:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.727835:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 2/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc670 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.727847:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.727851:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727852:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727853:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 3/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 76 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727858:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 3/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 76 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727861:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d4befcc8, rc 0) 00000100:00100000:0.0:1651529418.727875:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:425322:x1731746396786112:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.727878:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153979 00000100:00100000:1.0:1651529418.728358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.728378:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786240 00000100:00100000:0.0:1651529418.728390:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153980 00000100:00100000:0.0:1651529418.728392:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:425322:x1731746396786240:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.728395:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.728398:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 2/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc67e expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.728403:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.728407:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728407:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728409:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 3/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 77 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728423:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 3/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 77 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728427:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005859f450, rc 0) 00000100:00100000:0.0:1651529418.728440:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:425322:x1731746396786240:12345-10.240.43.64@tcp:101:dd.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.728443:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153980 00000100:00100000:1.0:1651529418.728927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.728948:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786368 00000100:00100000:0.0:1651529418.728959:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153981 00000100:00100000:0.0:1651529418.728961:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:425322:x1731746396786368:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.728964:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.728967:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 2/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc68c expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.728972:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.728976:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728977:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728978:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 3/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 78 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728983:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 3/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 78 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728986:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043da83ee, rc 0) 00000100:00100000:0.0:1651529418.729000:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:425322:x1731746396786368:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.729009:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153981 00000100:00100000:1.0:1651529418.729491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.729512:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786496 00000100:00100000:0.0:1651529418.729523:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153982 00000100:00100000:0.0:1651529418.729525:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:425322:x1731746396786496:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.729528:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.729532:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 2/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc69a expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.729537:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.729540:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729541:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729542:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 79 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729546:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 79 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729550:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087766569, rc 0) 00000100:00100000:0.0:1651529418.729564:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:425322:x1731746396786496:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.729567:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153982 00000100:00100000:1.0:1651529418.730055:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.730076:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786624 00000100:00100000:0.0:1651529418.730087:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153983 00000100:00100000:0.0:1651529418.730089:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:425322:x1731746396786624:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.730092:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.730096:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 2/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6a8 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.730108:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.730112:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730113:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730114:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 3/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 80 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730118:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 3/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 80 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730122:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096f8488a, rc 0) 00000100:00100000:0.0:1651529418.730136:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:425322:x1731746396786624:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.730139:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153983 00000100:00100000:1.0:1651529418.730616:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.730637:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786752 00000100:00100000:0.0:1651529418.730648:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153984 00000100:00100000:0.0:1651529418.730650:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:425322:x1731746396786752:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.730653:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.730657:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 2/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6b6 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.730662:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.730665:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730666:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730667:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 3/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 81 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730682:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 3/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 81 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730686:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df94e3f2, rc 0) 00000100:00100000:0.0:1651529418.730700:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:425322:x1731746396786752:12345-10.240.43.64@tcp:101:dd.0 Request processed in 49us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.730702:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153984 00000100:00100000:1.0:1651529418.731212:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.731233:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786880 00000100:00100000:0.0:1651529418.731245:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153985 00000100:00100000:0.0:1651529418.731246:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:425322:x1731746396786880:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.731250:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.731253:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 2/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6c4 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.731258:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.731262:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.731263:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.731264:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 3/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 82 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.731268:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 3/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 82 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.731272:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5430163, rc 0) 00000100:00100000:0.0:1651529418.731286:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:425322:x1731746396786880:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.731295:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153985 00000100:00100000:1.0:1651529418.732272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732284:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732332:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787072 00002000:00010000:0.0:1651529418.732339:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178625/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732341:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000032c68d7 with x1731746396787072 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732345:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000032c68d7. 00000100:00100000:1.0:1651529418.732346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732360:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787200 00002000:00010000:0.0:1651529418.732363:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178626/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732364:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000030d201c0 with x1731746396787200 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732366:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000030d201c0. 00000100:00100000:0.0:1651529418.732373:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787328 00002000:00010000:0.0:1651529418.732376:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178627/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732377:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000505fb1b with x1731746396787328 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732378:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000505fb1b. 00000100:00100000:0.0:1651529418.732391:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787456 00000100:00100000:1.0:1651529418.732393:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787584 00002000:00010000:0.0:1651529418.732394:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178628/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732395:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a825ad07 with x1731746396787456 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732397:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a825ad07. 00002000:00010000:1.0:1651529418.732402:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178629/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732404:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a51eb8b1 with x1731746396787584 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732408:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a51eb8b1. 00000100:00100000:0.0:1651529418.732408:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15802 00000100:00100000:0.0:1651529418.732410:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396787072:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.732426:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15803 00000100:00100000:1.0:1651529418.732428:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396787200:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.732455:0:144086:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732456:0:144086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732457:0:144086:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732458:0:144086:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732459:0:144086:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732467:0:144083:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732469:0:144083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732470:0:144083:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c2:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732474:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000032c68d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396787072:12345-10.240.43.64@tcp:10:dd.0 Request processed in 63us (202us total) trans 30064894741 rc 0/0 00002000:00010000:1.0:1651529418.732478:0:144083:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732479:0:144083:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732485:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15802 00002000:00010000:0.0:1651529418.732487:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178625/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732488:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000032c68d7 with x1731746396787072 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732489:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000032c68d7. 00000100:00100000:1.0:1651529418.732490:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396787200:12345-10.240.43.64@tcp:10:dd.0 Request processed in 61us (206us total) trans 30064894742 rc 0/0 00000100:00100000:1.0:1651529418.732494:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15803 00002000:00010000:1.0:1651529418.732495:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178626/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732496:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000030d201c0 with x1731746396787200 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.732496:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15804 00002000:00010000:1.0:1651529418.732498:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000030d201c0. 00000100:00100000:0.0:1651529418.732498:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396787328:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.732504:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15805 00000100:00100000:1.0:1651529418.732506:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396787456:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.732521:0:144086:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732523:0:144086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732523:0:144086:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732524:0:144086:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732525:0:144086:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732528:0:144083:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732530:0:144083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732531:0:144083:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732532:0:144083:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732532:0:144083:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732533:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396787328:12345-10.240.43.64@tcp:10:dd.0 Request processed in 35us (187us total) trans 30064894743 rc 0/0 00000100:00100000:0.0:1651529418.732536:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15804 00002000:00010000:0.0:1651529418.732537:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178627/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732538:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000505fb1b with x1731746396787328 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732539:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000505fb1b. 00000100:00100000:1.0:1651529418.732540:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396787456:12345-10.240.43.64@tcp:10:dd.0 Request processed in 33us (175us total) trans 30064894744 rc 0/0 00000100:00100000:1.0:1651529418.732543:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15805 00002000:00010000:1.0:1651529418.732544:0:144083:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178628/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732545:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a825ad07 with x1731746396787456 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.732545:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15806 00002000:00010000:1.0:1651529418.732547:0:144083:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a825ad07. 00000100:00100000:0.0:1651529418.732547:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396787584:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.732565:0:144086:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732566:0:144086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732567:0:144086:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732568:0:144086:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732569:0:144086:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732584:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396787584:12345-10.240.43.64@tcp:10:dd.0 Request processed in 37us (206us total) trans 30064894745 rc 0/0 00000100:00100000:0.0:1651529418.732587:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15806 00002000:00010000:0.0:1651529418.732588:0:144086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178629/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732589:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a51eb8b1 with x1731746396787584 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732591:0:144086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a51eb8b1. 00000100:00100000:1.0:1651529418.732650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732656:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787712 00002000:00010000:0.0:1651529418.732661:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178630/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732662:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d179b834 with x1731746396787712 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732665:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d179b834. 00000100:00100000:1.0:1651529418.732670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732683:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787840 00000100:00100000:1.0:1651529418.732689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732701:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178631/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732702:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c851d0b0 with x1731746396787840 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732704:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c851d0b0. 00000100:00100000:0.0:1651529418.732712:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787968 00002000:00010000:0.0:1651529418.732716:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178632/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732717:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008c0d7ff with x1731746396787968 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732718:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008c0d7ff. 00000100:00100000:1.0:1651529418.732720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732733:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788096 00002000:00010000:0.0:1651529418.732736:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178633/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732737:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000956bf807 with x1731746396788096 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732739:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000956bf807. 00000100:00100000:0.0:1651529418.732745:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15807 00000100:00100000:0.0:1651529418.732747:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396787712:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.732755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732796:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732802:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732814:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732815:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732816:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732816:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.732826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732831:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41279:x1731746396787712:12345-10.240.43.64@tcp:10:dd.0 Request processed in 83us (188us total) trans 30064894746 rc 0/0 00000100:00100000:0.0:1651529418.732834:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15807 00002000:00010000:0.0:1651529418.732836:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178630/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732836:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d179b834 with x1731746396787712 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732838:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d179b834. 00000100:00100000:0.0:1651529418.732843:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788224 00002000:00010000:0.0:1651529418.732859:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178634/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732860:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b31d3513 with x1731746396788224 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732880:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b31d3513. 00000100:00100000:1.0:1651529418.732883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732885:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788352 00000100:00100000:1.0:1651529418.732888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732888:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178635/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732889:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020c4d9b1 with x1731746396788352 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732891:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000020c4d9b1. 00000100:00100000:0.0:1651529418.732892:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788480 00002000:00010000:0.0:1651529418.732894:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178636/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732895:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000659cfc1e with x1731746396788480 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732897:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000659cfc1e. 00000100:00100000:0.0:1651529418.732899:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788608 00000100:00100000:1.0:1651529418.732900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732900:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178637/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732901:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6988550 with x1731746396788608 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732902:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a6988550. 00000100:00100000:0.0:1651529418.732904:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788736 00002000:00010000:0.0:1651529418.732906:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178638/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732907:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f63cb8d2 with x1731746396788736 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732908:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f63cb8d2. 00000100:00100000:0.0:1651529418.732910:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788864 00002000:00010000:0.0:1651529418.732912:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178639/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732912:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009aa874ae with x1731746396788864 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732913:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009aa874ae. 00000100:00100000:0.0:1651529418.732915:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788992 00002000:00010000:0.0:1651529418.732917:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178640/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.732918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.732918:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ebd06bc with x1731746396788992 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732919:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004ebd06bc. 00000100:00100000:0.0:1651529418.732921:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789120 00000100:00100000:1.0:1651529418.732923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732923:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178641/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732923:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9c06969 with x1731746396789120 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732925:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d9c06969. 00000100:00100000:0.0:1651529418.732926:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789248 00000100:00100000:1.0:1651529418.732928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732929:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178642/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732929:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d2ff3bea with x1731746396789248 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732931:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d2ff3bea. 00000100:00100000:0.0:1651529418.732932:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789376 00002000:00010000:0.0:1651529418.732934:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178643/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732935:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065695016 with x1731746396789376 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732936:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000065695016. 00000100:00100000:0.0:1651529418.732938:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789504 00002000:00010000:0.0:1651529418.732940:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178644/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732940:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098b78f41 with x1731746396789504 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732941:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000098b78f41. 00000100:00100000:0.0:1651529418.732943:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789632 00002000:00010000:0.0:1651529418.732945:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178645/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.732946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.732946:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000514c4ae3 with x1731746396789632 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732947:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000514c4ae3. 00000100:00100000:0.0:1651529418.732949:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789760 00000100:00100000:1.0:1651529418.732950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732951:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178646/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732952:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000057488d72 with x1731746396789760 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732953:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000057488d72. 00000100:00100000:1.0:1651529418.732955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732955:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789888 00002000:00010000:0.0:1651529418.732957:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178647/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732957:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fcf79521 with x1731746396789888 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732958:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fcf79521. 00000100:00100000:0.0:1651529418.732960:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790016 00002000:00010000:0.0:1651529418.732962:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178648/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732963:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a77d8e7 with x1731746396790016 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732964:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008a77d8e7. 00000100:00100000:1.0:1651529418.732965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732966:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790144 00002000:00010000:0.0:1651529418.732967:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178649/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732968:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082eeec8f with x1731746396790144 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732969:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082eeec8f. 00000100:00100000:1.0:1651529418.732971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732971:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790272 00002000:00010000:0.0:1651529418.732973:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178650/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732973:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000070f7ea74 with x1731746396790272 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732974:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000070f7ea74. 00000100:00100000:1.0:1651529418.732975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732976:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790400 00002000:00010000:0.0:1651529418.732978:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178651/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732978:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007604197e with x1731746396790400 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732979:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007604197e. 00000100:00100000:1.0:1651529418.732980:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732996:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790528 00002000:00010000:0.0:1651529418.733000:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178652/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733001:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a0d143e3 with x1731746396790528 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733003:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a0d143e3. 00000100:00100000:0.0:1651529418.733005:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790656 00000100:00100000:1.0:1651529418.733007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733007:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178653/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733007:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000634bab6f with x1731746396790656 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733009:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000634bab6f. 00000100:00100000:0.0:1651529418.733011:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790784 00000100:00100000:1.0:1651529418.733019:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733022:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178654/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733023:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000410a3a4d with x1731746396790784 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733024:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000410a3a4d. 00000100:00100000:0.0:1651529418.733027:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790912 00000100:00100000:1.0:1651529418.733030:0:144087:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791040 00002000:00010000:0.0:1651529418.733034:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178655/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733035:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000642e76ce with x1731746396790912 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733036:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000642e76ce. 00000100:00100000:0.0:1651529418.733038:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791168 00002000:00010000:0.0:1651529418.733040:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178657/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733041:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059bfd81f with x1731746396791168 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733042:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178656/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733042:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000059bfd81f. 00002000:00100000:1.0:1651529418.733044:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad940a10 with x1731746396791040 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.733044:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791296 00002000:00010000:1.0:1651529418.733046:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad940a10. 00000100:00100000:1.0:1651529418.733055:0:144087:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791424 00002000:00010000:1.0:1651529418.733058:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178659/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733059:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000886ebdb8 with x1731746396791424 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733061:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000886ebdb8. 00000100:00100000:1.0:1651529418.733063:0:144087:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791552 00002000:00010000:1.0:1651529418.733065:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178660/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733071:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178658/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733072:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d630823 with x1731746396791296 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733074:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004d630823. 00000100:00100000:0.0:1651529418.733078:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791680 00002000:00100000:1.0:1651529418.733079:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000050af345b with x1731746396791552 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733080:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178661/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733080:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a3a2b06f with x1731746396791680 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733081:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000050af345b. 00002000:00010000:0.0:1651529418.733082:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a3a2b06f. 00000100:00100000:0.0:1651529418.733085:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15808 00000100:00100000:0.0:1651529418.733086:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396787840:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733087:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15809 00000100:00100000:1.0:1651529418.733089:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396787968:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733114:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733116:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733117:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733117:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733118:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733127:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396787968:12345-10.240.43.64@tcp:10:dd.0 Request processed in 38us (438us total) trans 30064894747 rc 0/0 00000100:00100000:1.0:1651529418.733130:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15809 00002000:00010000:1.0:1651529418.733131:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178632/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733132:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008c0d7ff with x1731746396787968 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733132:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733133:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008c0d7ff. 00002000:00010000:0.0:1651529418.733134:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733135:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733136:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733136:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733139:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15810 00000100:00100000:1.0:1651529418.733140:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788096:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733159:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733160:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733161:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9c9:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733161:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c851d0b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396787840:12345-10.240.43.64@tcp:10:dd.0 Request processed in 73us (490us total) trans 30064894748 rc 0/0 00002000:00010000:1.0:1651529418.733162:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733163:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733164:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15808 00002000:00010000:0.0:1651529418.733165:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178631/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733166:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c851d0b0 with x1731746396787840 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733167:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c851d0b0. 00000100:00100000:1.0:1651529418.733170:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396788096:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (449us total) trans 30064894749 rc 0/0 00000100:00100000:1.0:1651529418.733172:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15810 00002000:00010000:1.0:1651529418.733173:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178633/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733174:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000956bf807 with x1731746396788096 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733176:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000956bf807. 00000100:00100000:1.0:1651529418.733180:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15811 00000100:00100000:1.0:1651529418.733181:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396788224:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733182:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15812 00000100:00100000:0.0:1651529418.733184:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396788352:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733199:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733201:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ca:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733202:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733202:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ca:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733203:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733210:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788224:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (455us total) trans 30064894750 rc 0/0 00000100:00100000:1.0:1651529418.733212:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15811 00002000:00010000:1.0:1651529418.733213:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178634/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733214:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b31d3513 with x1731746396788224 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733215:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b31d3513. 00000100:00100000:1.0:1651529418.733220:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15813 00000100:00100000:1.0:1651529418.733221:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396788480:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733230:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733232:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9cb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733240:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733241:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9cc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733241:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733242:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733242:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9cb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733243:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9cc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733243:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9cc:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733243:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733250:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396788480:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (463us total) trans 30064894752 rc 0/0 00000100:00100000:1.0:1651529418.733252:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15813 00000100:00100000:0.0:1651529418.733252:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396788352:12345-10.240.43.64@tcp:10:dd.0 Request processed in 68us (488us total) trans 30064894751 rc 0/0 00002000:00010000:1.0:1651529418.733253:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178636/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733254:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000659cfc1e with x1731746396788480 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733255:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000659cfc1e. 00000100:00100000:1.0:1651529418.733259:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15814 00000100:00100000:1.0:1651529418.733261:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788608:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733264:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15812 00002000:00010000:0.0:1651529418.733266:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178635/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733267:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020c4d9b1 with x1731746396788352 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733268:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000020c4d9b1. 00002000:00010000:1.0:1651529418.733277:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9cd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733278:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9cd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733279:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9cd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733280:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9cd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733281:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9cd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733283:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15815 00000100:00100000:0.0:1651529418.733284:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f63cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788736:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733287:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788608:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (491us total) trans 30064894753 rc 0/0 00000100:00100000:1.0:1651529418.733290:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15814 00002000:00010000:1.0:1651529418.733291:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178637/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733292:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6988550 with x1731746396788608 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733293:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a6988550. 00000100:00100000:1.0:1651529418.733297:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15816 00000100:00100000:1.0:1651529418.733299:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396788864:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733315:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733316:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9cf:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733317:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9cf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733318:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9cf:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733319:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733325:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396788864:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (456us total) trans 30064894754 rc 0/0 00000100:00100000:1.0:1651529418.733328:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15816 00002000:00010000:1.0:1651529418.733329:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178639/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733330:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009aa874ae with x1731746396788864 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733331:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009aa874ae. 00002000:00010000:0.0:1651529418.733331:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ce:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733332:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ce:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733333:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ce:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733334:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ce:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733335:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15817 00002000:00010000:0.0:1651529418.733335:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ce:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733337:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788992:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733350:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f63cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396788736:12345-10.240.43.64@tcp:10:dd.0 Request processed in 65us (524us total) trans 30064894755 rc 0/0 00002000:00010000:1.0:1651529418.733353:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d0:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733353:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15815 00002000:00010000:0.0:1651529418.733354:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178638/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.733355:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:0.0:1651529418.733355:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f63cb8d2 with x1731746396788736 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733356:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733356:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733357:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733357:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f63cb8d2. 00000100:00100000:1.0:1651529418.733362:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396788992:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (479us total) trans 30064894756 rc 0/0 00000100:00100000:0.0:1651529418.733362:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15818 00000100:00100000:0.0:1651529418.733364:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789120:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733365:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15817 00002000:00010000:1.0:1651529418.733366:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178640/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733367:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ebd06bc with x1731746396788992 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733368:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004ebd06bc. 00000100:00100000:1.0:1651529418.733372:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15819 00000100:00100000:1.0:1651529418.733374:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396789248:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733382:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733383:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733384:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733385:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733386:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733391:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733392:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733392:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396789120:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (504us total) trans 30064894757 rc 0/0 00002000:00010000:1.0:1651529418.733393:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733394:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733394:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15818 00002000:00010000:1.0:1651529418.733395:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d2:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733395:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178641/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733396:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9c06969 with x1731746396789120 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733398:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d9c06969. 00000100:00100000:1.0:1651529418.733400:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789248:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (500us total) trans 30064894758 rc 0/0 00000100:00100000:0.0:1651529418.733402:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15820 00000100:00100000:1.0:1651529418.733404:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15819 00000100:00100000:0.0:1651529418.733404:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065695016 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789376:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733405:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178642/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733405:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d2ff3bea with x1731746396789248 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733407:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d2ff3bea. 00000100:00100000:1.0:1651529418.733411:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15821 00000100:00100000:1.0:1651529418.733413:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396789504:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733422:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733423:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733424:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733425:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733426:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733431:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d4:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733431:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065695016 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396789376:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (519us total) trans 30064894759 rc 0/0 00002000:00010000:1.0:1651529418.733432:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733433:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733433:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733434:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733434:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15820 00002000:00010000:0.0:1651529418.733435:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178643/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733436:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065695016 with x1731746396789376 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733437:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000065695016. 00000100:00100000:1.0:1651529418.733440:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789504:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (521us total) trans 30064894760 rc 0/0 00000100:00100000:0.0:1651529418.733441:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15822 00000100:00100000:1.0:1651529418.733443:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15821 00000100:00100000:0.0:1651529418.733443:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789632:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733444:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178644/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733445:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098b78f41 with x1731746396789504 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733446:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000098b78f41. 00000100:00100000:1.0:1651529418.733450:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15823 00000100:00100000:1.0:1651529418.733452:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396789760:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733460:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733461:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733462:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733462:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733463:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733468:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396789632:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (545us total) trans 30064894761 rc 0/0 00002000:00010000:1.0:1651529418.733469:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733470:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733471:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733471:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733471:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15822 00002000:00010000:1.0:1651529418.733472:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733472:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178645/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733473:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000514c4ae3 with x1731746396789632 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733474:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000514c4ae3. 00000100:00100000:1.0:1651529418.733477:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789760:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (549us total) trans 30064894762 rc 0/0 00000100:00100000:0.0:1651529418.733479:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15824 00000100:00100000:0.0:1651529418.733480:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396789888:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733481:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15823 00002000:00010000:1.0:1651529418.733481:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178646/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733483:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000057488d72 with x1731746396789760 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733484:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000057488d72. 00000100:00100000:1.0:1651529418.733488:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15825 00000100:00100000:1.0:1651529418.733490:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396790016:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733496:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733498:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733498:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733499:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733500:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733505:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396789888:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (569us total) trans 30064894763 rc 0/0 00002000:00010000:1.0:1651529418.733507:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733508:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733508:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15824 00002000:00010000:1.0:1651529418.733509:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733509:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178647/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733509:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fcf79521 with x1731746396789888 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733510:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733510:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733511:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fcf79521. 00000100:00100000:1.0:1651529418.733515:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790016:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (575us total) trans 30064894764 rc 0/0 00000100:00100000:0.0:1651529418.733515:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15826 00000100:00100000:0.0:1651529418.733517:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790144:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733518:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15825 00002000:00010000:1.0:1651529418.733519:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178648/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733520:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a77d8e7 with x1731746396790016 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733521:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008a77d8e7. 00000100:00100000:1.0:1651529418.733525:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15827 00000100:00100000:1.0:1651529418.733527:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396790272:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733533:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733534:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9d9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733534:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733535:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9d9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733536:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733541:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396790144:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (596us total) trans 30064894765 rc 0/0 00002000:00010000:1.0:1651529418.733544:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9da:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733544:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15826 00002000:00010000:1.0:1651529418.733545:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9da:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733545:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178649/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.733546:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:0.0:1651529418.733546:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082eeec8f with x1731746396790144 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733547:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9da:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733547:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082eeec8f. 00002000:00010000:1.0:1651529418.733548:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733552:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15828 00000100:00100000:1.0:1651529418.733553:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790272:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (603us total) trans 30064894766 rc 0/0 00000100:00100000:0.0:1651529418.733553:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790400:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733556:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15827 00002000:00010000:1.0:1651529418.733557:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178650/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733558:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000070f7ea74 with x1731746396790272 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733559:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000070f7ea74. 00000100:00100000:1.0:1651529418.733563:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15829 00000100:00100000:1.0:1651529418.733565:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396790528:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733571:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733572:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9db:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733573:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733574:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9db:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733575:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9db:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733580:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396790400:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (625us total) trans 30064894767 rc 0/0 00002000:00010000:1.0:1651529418.733583:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9dc:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733583:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15828 00002000:00010000:0.0:1651529418.733583:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178651/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.733584:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9dc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:0.0:1651529418.733584:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007604197e with x1731746396790400 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733585:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733586:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9dc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733586:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007604197e. 00002000:00010000:1.0:1651529418.733587:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733590:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15830 00000100:00100000:0.0:1651529418.733591:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790656:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733592:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790528:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (627us total) trans 30064894768 rc 0/0 00000100:00100000:1.0:1651529418.733595:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15829 00002000:00010000:1.0:1651529418.733596:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178652/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733596:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a0d143e3 with x1731746396790528 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733598:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a0d143e3. 00000100:00100000:1.0:1651529418.733602:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15831 00000100:00100000:1.0:1651529418.733604:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790784:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733607:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9dd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733608:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9dd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733609:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9dd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733610:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9dd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733611:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9dd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733616:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790656:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (645us total) trans 30064894769 rc 0/0 00002000:00010000:1.0:1651529418.733620:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9de:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733620:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15830 00002000:00010000:0.0:1651529418.733621:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178653/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.733622:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9de:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733622:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9de:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:0.0:1651529418.733622:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000634bab6f with x1731746396790656 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733623:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9de:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733623:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000634bab6f. 00002000:00010000:1.0:1651529418.733624:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9de:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733627:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15832 00000100:00100000:1.0:1651529418.733629:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790784:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (654us total) trans 30064894770 rc 0/0 00000100:00100000:0.0:1651529418.733629:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790912:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733634:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15831 00002000:00010000:1.0:1651529418.733635:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178654/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733636:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000410a3a4d with x1731746396790784 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733637:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000410a3a4d. 00000100:00100000:1.0:1651529418.733641:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15833 00000100:00100000:1.0:1651529418.733643:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396791168:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733644:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9df:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733646:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9df:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733646:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733647:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9df:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733648:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733653:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396790912:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (673us total) trans 30064894771 rc 0/0 00000100:00100000:0.0:1651529418.733656:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15832 00002000:00010000:0.0:1651529418.733657:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178655/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733658:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000642e76ce with x1731746396790912 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733659:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733659:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000642e76ce. 00002000:00010000:1.0:1651529418.733661:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733661:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733662:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733663:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733663:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15834 00000100:00100000:0.0:1651529418.733665:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396791040:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.733679:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396791168:12345-10.240.43.64@tcp:10:dd.0 Request processed in 35us (688us total) trans 30064894772 rc 0/0 00000100:00100000:1.0:1651529418.733682:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15833 00002000:00010000:0.0:1651529418.733682:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733683:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178657/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733683:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.733684:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059bfd81f with x1731746396791168 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733684:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733685:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000059bfd81f. 00002000:00010000:0.0:1651529418.733685:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733685:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733690:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15835 00000100:00100000:0.0:1651529418.733691:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396791040:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (706us total) trans 30064894773 rc 0/0 00000100:00100000:1.0:1651529418.733692:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396791424:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733694:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15834 00002000:00010000:0.0:1651529418.733695:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178656/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733696:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad940a10 with x1731746396791040 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733697:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad940a10. 00000100:00100000:0.0:1651529418.733701:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15836 00000100:00100000:0.0:1651529418.733702:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396791296:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733713:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733714:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733715:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733716:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733716:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733719:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733720:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733721:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733721:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733722:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396791424:12345-10.240.43.64@tcp:10:dd.0 Request processed in 30us (720us total) trans 30064894774 rc 0/0 00002000:00010000:0.0:1651529418.733722:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733725:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15835 00002000:00010000:1.0:1651529418.733726:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178659/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733727:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000886ebdb8 with x1731746396791424 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.733727:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396791296:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (732us total) trans 30064894775 rc 0/0 00002000:00010000:1.0:1651529418.733728:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000886ebdb8. 00000100:00100000:0.0:1651529418.733730:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15836 00002000:00010000:0.0:1651529418.733731:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178658/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733732:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d630823 with x1731746396791296 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733733:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15837 00002000:00010000:0.0:1651529418.733733:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004d630823. 00000100:00100000:1.0:1651529418.733734:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396791552:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733737:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15838 00000100:00100000:0.0:1651529418.733739:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396791680:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733751:0:144087:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733752:0:144087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733753:0:144087:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733754:0:144087:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733755:0:144087:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e4:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733757:0:144085:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733758:0:144085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733759:0:144085:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733759:0:144085:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733760:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396791552:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (753us total) trans 30064894776 rc 0/0 00002000:00010000:0.0:1651529418.733760:0:144085:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733762:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15837 00002000:00010000:1.0:1651529418.733764:0:144087:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178660/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733764:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000050af345b with x1731746396791552 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733766:0:144087:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000050af345b. 00000100:00100000:0.0:1651529418.733766:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396791680:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (746us total) trans 30064894777 rc 0/0 00000100:00100000:0.0:1651529418.733768:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15838 00002000:00010000:0.0:1651529418.733770:0:144085:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178661/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733770:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a3a2b06f with x1731746396791680 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733772:0:144085:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a3a2b06f. 00000100:00100000:1.0:1651529418.733822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.733925:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791808 00000100:00100000:1.0:1651529418.733933:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733951:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178662/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.733958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.733973:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029859a81 with x1731746396791808 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733976:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000029859a81. 00000100:00100000:0.0:1651529418.733990:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791936 00000100:00100000:1.0:1651529418.733991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733994:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178663/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733995:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000690d5269 with x1731746396791936 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733997:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000690d5269. 00000100:00100000:1.0:1651529418.733999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734008:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792064 00002000:00010000:0.0:1651529418.734011:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178664/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734012:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e2b12a5 with x1731746396792064 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734013:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003e2b12a5. 00000100:00100000:0.0:1651529418.734015:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792192 00002000:00010000:0.0:1651529418.734017:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178665/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734018:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c55989b2 with x1731746396792192 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734019:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c55989b2. 00000100:00100000:0.0:1651529418.734021:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792320 00002000:00010000:0.0:1651529418.734023:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178666/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734023:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a8621713 with x1731746396792320 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734025:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a8621713. 00000100:00100000:1.0:1651529418.734027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734027:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792448 00002000:00010000:0.0:1651529418.734029:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178667/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734029:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000809be23f with x1731746396792448 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734031:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000809be23f. 00000100:00100000:1.0:1651529418.734032:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734032:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792576 00002000:00010000:0.0:1651529418.734034:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178668/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734035:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090c9d293 with x1731746396792576 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734036:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090c9d293. 00000100:00100000:0.0:1651529418.734037:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792704 00000100:00100000:1.0:1651529418.734038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734039:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178669/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734040:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052db3370 with x1731746396792704 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734041:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052db3370. 00000100:00100000:1.0:1651529418.734043:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734043:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792832 00002000:00010000:0.0:1651529418.734044:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178670/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734045:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023180596 with x1731746396792832 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734046:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000023180596. 00000100:00100000:1.0:1651529418.734048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734048:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792960 00002000:00010000:0.0:1651529418.734049:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178671/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734050:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cb0a453d with x1731746396792960 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734051:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cb0a453d. 00000100:00100000:0.0:1651529418.734053:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793088 00002000:00010000:0.0:1651529418.734055:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178672/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734056:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4cd207e with x1731746396793088 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734057:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a4cd207e. 00000100:00100000:1.0:1651529418.734059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734059:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793216 00002000:00010000:0.0:1651529418.734061:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178673/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734062:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cdeb19 with x1731746396793216 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734063:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052cdeb19. 00000100:00100000:1.0:1651529418.734065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734065:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793344 00002000:00010000:0.0:1651529418.734067:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178674/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734068:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006dd10e15 with x1731746396793344 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734069:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006dd10e15. 00000100:00100000:1.0:1651529418.734070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734072:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15839 00000100:00100000:0.0:1651529418.734073:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41279:x1731746396791808:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.734075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734096:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734097:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734098:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734099:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734100:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734107:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+132:41279:x1731746396791808:12345-10.240.43.64@tcp:10:dd.0 Request processed in 33us (305us total) trans 30064894778 rc 0/0 00000100:00100000:0.0:1651529418.734110:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15839 00000100:00100000:1.0:1651529418.734111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734111:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178662/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734111:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029859a81 with x1731746396791808 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734113:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000029859a81. 00000100:00100000:1.0:1651529418.734117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734117:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793472 00002000:00010000:0.0:1651529418.734120:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178675/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734121:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e1dc5128 with x1731746396793472 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734122:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734122:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e1dc5128. 00000100:00100000:0.0:1651529418.734125:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793600 00000100:00100000:1.0:1651529418.734126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734127:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178676/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734127:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2e34af1 with x1731746396793600 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734129:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2e34af1. 00000100:00100000:0.0:1651529418.734130:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793728 00000100:00100000:1.0:1651529418.734131:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734133:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178677/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734134:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037de0484 with x1731746396793728 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734135:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037de0484. 00000100:00100000:1.0:1651529418.734136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734137:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793856 00002000:00010000:0.0:1651529418.734139:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178678/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734139:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad84e216 with x1731746396793856 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734140:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad84e216. 00000100:00100000:0.0:1651529418.734142:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793984 00000100:00100000:1.0:1651529418.734145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734150:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178679/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734151:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef6270ee with x1731746396793984 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734153:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef6270ee. 00000100:00100000:0.0:1651529418.734155:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794112 00000100:00100000:1.0:1651529418.734158:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794240 00002000:00010000:0.0:1651529418.734158:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178680/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734159:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000205d1e30 with x1731746396794112 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734160:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000205d1e30. 00000100:00100000:0.0:1651529418.734162:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794368 00002000:00010000:1.0:1651529418.734164:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178681/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734164:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178682/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734165:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c7cac11 with x1731746396794240 ext(0->18446744073709551615) 00002000:00100000:0.0:1651529418.734165:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4d94c74 with x1731746396794368 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734166:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e4d94c74. 00002000:00010000:1.0:1651529418.734167:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008c7cac11. 00000100:00100000:0.0:1651529418.734167:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794496 00002000:00010000:0.0:1651529418.734169:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178683/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734170:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008459a94b with x1731746396794496 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734171:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794624 00002000:00010000:0.0:1651529418.734171:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008459a94b. 00002000:00010000:1.0:1651529418.734173:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178684/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.734173:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794752 00002000:00100000:1.0:1651529418.734174:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000632d1c38 with x1731746396794624 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734175:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000632d1c38. 00002000:00010000:0.0:1651529418.734175:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178685/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734176:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff948d3f with x1731746396794752 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734177:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794880 00002000:00010000:0.0:1651529418.734177:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ff948d3f. 00002000:00010000:1.0:1651529418.734179:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178686/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.734179:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795008 00002000:00100000:1.0:1651529418.734180:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000514184ad with x1731746396794880 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734181:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178687/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.734182:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000514184ad. 00002000:00100000:0.0:1651529418.734182:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f967d96c with x1731746396795008 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734183:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f967d96c. 00000100:00100000:1.0:1651529418.734184:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795136 00000100:00100000:0.0:1651529418.734185:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795264 00002000:00010000:1.0:1651529418.734186:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178688/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734187:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f724141 with x1731746396795136 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734188:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004f724141. 00002000:00010000:0.0:1651529418.734188:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178689/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734189:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000336ba633 with x1731746396795264 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734190:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796480 00002000:00010000:0.0:1651529418.734190:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000336ba633. 00002000:00010000:1.0:1651529418.734192:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178690/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.734192:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796608 00002000:00100000:1.0:1651529418.734193:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000086421b63 with x1731746396796480 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734194:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000086421b63. 00002000:00010000:0.0:1651529418.734194:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178691/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734195:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c6d9ed99 with x1731746396796608 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734196:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796736 00002000:00010000:0.0:1651529418.734196:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c6d9ed99. 00002000:00010000:1.0:1651529418.734198:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178692/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.734198:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796864 00002000:00100000:1.0:1651529418.734199:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000968dbd41 with x1731746396796736 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734200:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000968dbd41. 00000100:00100000:1.0:1651529418.734202:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796992 00002000:00010000:1.0:1651529418.734204:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178694/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734205:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028133584 with x1731746396796992 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734205:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178693/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.734206:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000028133584. 00002000:00100000:0.0:1651529418.734206:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006778b2e0 with x1731746396796864 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734207:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006778b2e0. 00000100:00100000:1.0:1651529418.734208:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797120 00000100:00100000:0.0:1651529418.734209:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797248 00002000:00010000:1.0:1651529418.734210:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178695/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734211:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000291fa891 with x1731746396797120 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734212:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000291fa891. 00002000:00010000:0.0:1651529418.734212:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178696/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734212:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080a383af with x1731746396797248 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734213:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080a383af. 00000100:00100000:1.0:1651529418.734214:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797376 00002000:00010000:1.0:1651529418.734216:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178697/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.734216:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15840 00002000:00100000:1.0:1651529418.734217:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e0353c23 with x1731746396797376 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734218:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e0353c23. 00000100:00100000:0.0:1651529418.734218:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396791936:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.734221:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15841 00000100:00100000:1.0:1651529418.734222:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396792064:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734238:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734239:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734240:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734240:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734241:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e7:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734246:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e8:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734247:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396791936:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (365us total) trans 30064894779 rc 0/0 00002000:00010000:1.0:1651529418.734248:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734248:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734249:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734250:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734257:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792064:12345-10.240.43.64@tcp:10:dd.0 Request processed in 34us (352us total) trans 30064894780 rc 0/0 00000100:00100000:0.0:1651529418.734258:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15840 00000100:00100000:1.0:1651529418.734260:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15841 00002000:00010000:0.0:1651529418.734260:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178663/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.734261:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178664/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734261:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000690d5269 with x1731746396791936 ext(0->18446744073709551615) 00002000:00100000:1.0:1651529418.734262:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e2b12a5 with x1731746396792064 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734262:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000690d5269. 00002000:00010000:1.0:1651529418.734263:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003e2b12a5. 00000100:00100000:0.0:1651529418.734267:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15842 00000100:00100000:1.0:1651529418.734269:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15843 00000100:00100000:0.0:1651529418.734269:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396792192:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.734271:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396792320:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734289:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ea:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734290:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ea:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734291:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734291:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734292:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ea:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734293:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ea:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734293:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9e9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734293:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734294:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9e9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734295:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9e9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734301:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792192:12345-10.240.43.64@tcp:10:dd.0 Request processed in 32us (368us total) trans 30064894782 rc 0/0 00000100:00100000:0.0:1651529418.734304:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15842 00002000:00010000:0.0:1651529418.734304:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178665/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734305:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c55989b2 with x1731746396792192 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734307:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792320:12345-10.240.43.64@tcp:10:dd.0 Request processed in 36us (365us total) trans 30064894781 rc 0/0 00002000:00010000:0.0:1651529418.734307:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c55989b2. 00000100:00100000:1.0:1651529418.734310:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15843 00002000:00010000:1.0:1651529418.734311:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178666/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734312:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a8621713 with x1731746396792320 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.734312:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15844 00002000:00010000:1.0:1651529418.734314:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a8621713. 00000100:00100000:0.0:1651529418.734314:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396792448:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.734319:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15845 00000100:00100000:1.0:1651529418.734320:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396792576:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734333:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9eb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734335:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9eb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734335:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734336:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9eb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734337:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9eb:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734341:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734342:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ec:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734343:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734344:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ec:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734345:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ec:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734350:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792576:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (392us total) trans 30064894784 rc 0/0 00000100:00100000:1.0:1651529418.734353:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15845 00002000:00010000:1.0:1651529418.734353:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178668/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734354:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090c9d293 with x1731746396792576 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734355:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090c9d293. 00000100:00100000:0.0:1651529418.734356:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792448:12345-10.240.43.64@tcp:10:dd.0 Request processed in 41us (406us total) trans 30064894783 rc 0/0 00000100:00100000:0.0:1651529418.734359:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15844 00002000:00010000:0.0:1651529418.734360:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178667/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734361:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15846 00002000:00100000:0.0:1651529418.734361:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000809be23f with x1731746396792448 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734362:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396792704:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734362:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000809be23f. 00000100:00100000:0.0:1651529418.734367:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15847 00000100:00100000:0.0:1651529418.734369:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396792832:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734379:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734380:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ed:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734381:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734381:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ed:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734382:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ed:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734388:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792704:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (423us total) trans 30064894785 rc 0/0 00002000:00010000:0.0:1651529418.734388:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734389:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ee:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734389:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ee:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734390:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15846 00002000:00010000:0.0:1651529418.734390:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ee:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734391:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178669/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734391:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ee:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:1.0:1651529418.734392:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052db3370 with x1731746396792704 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734393:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052db3370. 00000100:00100000:0.0:1651529418.734397:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396792832:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (422us total) trans 30064894786 rc 0/0 00000100:00100000:1.0:1651529418.734398:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15848 00000100:00100000:1.0:1651529418.734399:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396792960:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734399:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15847 00002000:00010000:0.0:1651529418.734401:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178670/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734401:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023180596 with x1731746396792832 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734403:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000023180596. 00000100:00100000:0.0:1651529418.734407:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15849 00000100:00100000:0.0:1651529418.734409:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396793088:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734417:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ef:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734418:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ef:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734419:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ef:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734420:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ef:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734420:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ef:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734425:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396792960:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (434us total) trans 30064894787 rc 0/0 00002000:00010000:0.0:1651529418.734425:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734426:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734427:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f0:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734428:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15848 00002000:00010000:0.0:1651529418.734428:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734429:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178671/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734430:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cb0a453d with x1731746396792960 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734431:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cb0a453d. 00000100:00100000:1.0:1651529418.734435:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15850 00002000:00010000:0.0:1651529418.734436:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734437:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793216:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734446:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793088:12345-10.240.43.64@tcp:10:dd.0 Request processed in 37us (447us total) trans 30064894788 rc 0/0 00000100:00100000:0.0:1651529418.734449:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15849 00002000:00010000:0.0:1651529418.734450:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178672/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734451:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4cd207e with x1731746396793088 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734453:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a4cd207e. 00000100:00100000:0.0:1651529418.734457:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15851 00000100:00100000:0.0:1651529418.734459:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793344:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734464:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734465:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734466:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734467:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734468:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734474:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793216:12345-10.240.43.64@tcp:10:dd.0 Request processed in 37us (461us total) trans 30064894789 rc 0/0 00000100:00100000:1.0:1651529418.734477:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15850 00002000:00010000:1.0:1651529418.734478:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178673/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734479:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cdeb19 with x1731746396793216 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734479:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734480:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052cdeb19. 00002000:00010000:0.0:1651529418.734480:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734481:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734482:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734483:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734485:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15852 00000100:00100000:1.0:1651529418.734486:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e1dc5128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793472:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734488:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793344:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (469us total) trans 30064894790 rc 0/0 00000100:00100000:0.0:1651529418.734491:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15851 00002000:00010000:0.0:1651529418.734492:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178674/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734493:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006dd10e15 with x1731746396793344 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734494:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006dd10e15. 00000100:00100000:0.0:1651529418.734498:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15853 00000100:00100000:0.0:1651529418.734500:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e34af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396793600:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734504:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734506:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734507:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734507:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734508:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734514:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e1dc5128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396793472:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (487us total) trans 30064894791 rc 0/0 00000100:00100000:1.0:1651529418.734516:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15852 00002000:00010000:0.0:1651529418.734516:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734517:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178675/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734517:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.734518:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e1dc5128 with x1731746396793472 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734518:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734519:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e1dc5128. 00000100:00100000:1.0:1651529418.734523:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15854 00000100:00100000:1.0:1651529418.734525:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037de0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793728:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734526:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734527:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734533:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e34af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793600:12345-10.240.43.64@tcp:10:dd.0 Request processed in 33us (501us total) trans 30064894792 rc 0/0 00000100:00100000:0.0:1651529418.734536:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15853 00002000:00010000:0.0:1651529418.734537:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178676/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734538:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2e34af1 with x1731746396793600 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734539:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2e34af1. 00002000:00010000:1.0:1651529418.734544:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f5:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734544:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15855 00000100:00100000:0.0:1651529418.734545:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad84e216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793856:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734546:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734546:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734547:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734548:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734553:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037de0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793728:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (515us total) trans 30064894793 rc 0/0 00000100:00100000:1.0:1651529418.734556:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15854 00002000:00010000:1.0:1651529418.734557:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178677/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734558:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037de0484 with x1731746396793728 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734559:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037de0484. 00000100:00100000:1.0:1651529418.734563:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15856 00002000:00010000:0.0:1651529418.734564:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f6:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734565:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6270ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793984:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734565:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734566:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734567:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734568:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734573:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad84e216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793856:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (530us total) trans 30064894794 rc 0/0 00000100:00100000:0.0:1651529418.734576:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15855 00002000:00010000:0.0:1651529418.734577:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178678/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734578:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad84e216 with x1731746396793856 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734579:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad84e216. 00002000:00010000:1.0:1651529418.734582:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734583:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.734583:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15857 00002000:00010000:1.0:1651529418.734584:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734585:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.734585:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000205d1e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794112:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734586:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734591:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6270ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396793984:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (543us total) trans 30064894795 rc 0/0 00000100:00100000:1.0:1651529418.734593:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15856 00002000:00010000:1.0:1651529418.734594:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178679/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734595:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef6270ee with x1731746396793984 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734596:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef6270ee. 00000100:00100000:1.0:1651529418.734601:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15858 00002000:00010000:0.0:1651529418.734601:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f8:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734602:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d94c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794368:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734602:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734603:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734604:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734605:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734610:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000205d1e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794112:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (551us total) trans 30064894796 rc 0/0 00000100:00100000:0.0:1651529418.734613:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15857 00002000:00010000:0.0:1651529418.734614:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178680/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734614:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000205d1e30 with x1731746396794112 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734616:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000205d1e30. 00000100:00100000:0.0:1651529418.734620:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15859 00002000:00010000:1.0:1651529418.734621:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9fa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734622:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9fa:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.734622:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c7cac11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794240:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734623:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9fa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734624:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9fa:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734625:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9fa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734630:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d94c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794368:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (560us total) trans 30064894797 rc 0/0 00000100:00100000:1.0:1651529418.734633:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15858 00002000:00010000:1.0:1651529418.734634:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178682/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734635:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4d94c74 with x1731746396794368 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734636:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e4d94c74. 00002000:00010000:0.0:1651529418.734639:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9f9:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734640:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15860 00002000:00010000:0.0:1651529418.734640:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9f9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734641:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9f9:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734642:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008459a94b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794496:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734642:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9f9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734642:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9f9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734648:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c7cac11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794240:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (582us total) trans 30064894798 rc 0/0 00000100:00100000:0.0:1651529418.734650:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15859 00002000:00010000:0.0:1651529418.734651:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178681/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734652:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c7cac11 with x1731746396794240 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734653:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008c7cac11. 00000100:00100000:0.0:1651529418.734658:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15861 00002000:00010000:1.0:1651529418.734659:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9fb:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734659:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000632d1c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794624:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734660:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9fb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734661:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9fb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734662:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9fb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734663:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9fb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734668:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008459a94b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794496:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (593us total) trans 30064894799 rc 0/0 00000100:00100000:1.0:1651529418.734670:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15860 00002000:00010000:1.0:1651529418.734671:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178683/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734672:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008459a94b with x1731746396794496 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734673:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008459a94b. 00002000:00010000:0.0:1651529418.734675:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734677:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9fc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734677:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9fc:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734678:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15862 00002000:00010000:0.0:1651529418.734678:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9fc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734679:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff948d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794752:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734679:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9fc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734684:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000632d1c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794624:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (604us total) trans 30064894800 rc 0/0 00000100:00100000:0.0:1651529418.734687:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15861 00002000:00010000:0.0:1651529418.734688:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178684/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734689:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000632d1c38 with x1731746396794624 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734690:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000632d1c38. 00000100:00100000:0.0:1651529418.734694:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15863 00002000:00010000:1.0:1651529418.734696:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9fd:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734696:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514184ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794880:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734697:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9fd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734698:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734699:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9fd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734700:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9fd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734705:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff948d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794752:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (620us total) trans 30064894801 rc 0/0 00000100:00100000:1.0:1651529418.734707:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15862 00002000:00010000:1.0:1651529418.734708:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178685/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734709:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff948d3f with x1731746396794752 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734711:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ff948d3f. 00002000:00010000:0.0:1651529418.734712:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734713:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9fe:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734714:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9fe:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734715:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15864 00002000:00010000:0.0:1651529418.734715:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9fe:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734716:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f967d96c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795008:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734716:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9fe:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734721:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514184ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396794880:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (632us total) trans 30064894802 rc 0/0 00000100:00100000:0.0:1651529418.734724:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15863 00002000:00010000:0.0:1651529418.734725:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178686/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734725:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000514184ad with x1731746396794880 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734727:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000514184ad. 00000100:00100000:0.0:1651529418.734731:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15865 00000100:00100000:0.0:1651529418.734732:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f724141 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795136:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734733:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9ff:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734734:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9ff:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734735:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2b9ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734736:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9ff:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734737:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9ff:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734742:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f967d96c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795008:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (648us total) trans 30064894803 rc 0/0 00000100:00100000:1.0:1651529418.734744:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15864 00002000:00010000:1.0:1651529418.734745:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178687/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734746:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f967d96c with x1731746396795008 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734748:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f967d96c. 00002000:00010000:0.0:1651529418.734750:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734751:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba00:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734752:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15866 00002000:00010000:0.0:1651529418.734752:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734753:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba00:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734754:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336ba633 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795264:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734754:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.734759:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f724141 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795136:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (660us total) trans 30064894804 rc 0/0 00000100:00100000:0.0:1651529418.734761:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15865 00002000:00010000:0.0:1651529418.734762:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178688/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734763:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f724141 with x1731746396795136 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734765:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004f724141. 00000100:00100000:0.0:1651529418.734769:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15867 00000100:00100000:0.0:1651529418.734770:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086421b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796480:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734772:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba01:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734782:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba01:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734783:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba01:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734784:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba01:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734785:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba01:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734792:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336ba633 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396795264:12345-10.240.43.64@tcp:10:dd.0 Request processed in 37us (681us total) trans 30064894805 rc 0/0 00000100:00100000:1.0:1651529418.734794:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15866 00002000:00010000:1.0:1651529418.734795:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178689/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734796:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000336ba633 with x1731746396795264 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734798:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000336ba633. 00002000:00010000:0.0:1651529418.734799:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba02:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734800:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba02:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734801:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba02:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734802:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15868 00002000:00010000:0.0:1651529418.734802:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba02:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734816:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba02:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734817:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d9ed99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796608:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734824:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086421b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796480:12345-10.240.43.64@tcp:10:dd.0 Request processed in 53us (706us total) trans 30064894806 rc 0/0 00000100:00100000:0.0:1651529418.734827:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15867 00002000:00010000:0.0:1651529418.734828:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178690/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734829:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000086421b63 with x1731746396796480 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734830:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000086421b63. 00000100:00100000:0.0:1651529418.734835:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15869 00000100:00100000:0.0:1651529418.734837:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000968dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796736:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734838:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba03:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734839:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba03:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734840:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba03:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734841:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba03:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734842:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba03:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734848:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d9ed99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796608:12345-10.240.43.64@tcp:10:dd.0 Request processed in 30us (725us total) trans 30064894807 rc 0/0 00000100:00100000:1.0:1651529418.734850:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15868 00002000:00010000:1.0:1651529418.734851:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178691/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734856:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba04:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734858:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba04:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734858:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba04:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734859:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba04:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.734860:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c6d9ed99 with x1731746396796608 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734860:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba04:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734862:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c6d9ed99. 00000100:00100000:0.0:1651529418.734866:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000968dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796736:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (739us total) trans 30064894808 rc 0/0 00000100:00100000:1.0:1651529418.734867:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15870 00000100:00100000:1.0:1651529418.734868:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028133584 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396796992:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734868:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15869 00002000:00010000:0.0:1651529418.734869:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178692/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734870:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000968dbd41 with x1731746396796736 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734871:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000968dbd41. 00000100:00100000:0.0:1651529418.734876:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15871 00000100:00100000:0.0:1651529418.734877:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006778b2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396796864:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734887:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba06:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734889:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba06:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734890:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba06:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734890:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba06:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734891:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba06:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734894:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba05:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734895:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba05:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734896:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba05:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734896:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba05:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734897:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028133584 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41278:x1731746396796992:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (761us total) trans 30064894809 rc 0/0 00002000:00010000:0.0:1651529418.734897:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba05:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734900:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15870 00002000:00010000:1.0:1651529418.734901:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178694/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734902:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028133584 with x1731746396796992 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.734902:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006778b2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41278:x1731746396796864:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (771us total) trans 30064894810 rc 0/0 00002000:00010000:1.0:1651529418.734903:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000028133584. 00000100:00100000:0.0:1651529418.734905:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15871 00002000:00010000:0.0:1651529418.734906:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178693/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734907:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15872 00002000:00100000:0.0:1651529418.734907:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006778b2e0 with x1731746396796864 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734908:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006778b2e0. 00000100:00100000:1.0:1651529418.734909:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000291fa891 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396797120:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734913:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15873 00000100:00100000:0.0:1651529418.734914:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080a383af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396797248:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734926:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba07:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734927:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba07:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734928:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba07:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734929:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba07:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734929:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba07:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734930:0:127529:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba08:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734932:0:127529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba08:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734932:0:127529:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba08:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734933:0:127529:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba08:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734934:0:127529:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba08:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734939:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000291fa891 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41278:x1731746396797120:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (798us total) trans 30064894811 rc 0/0 00000100:00100000:1.0:1651529418.734941:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15872 00000100:00100000:0.0:1651529418.734943:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080a383af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41278:x1731746396797248:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (798us total) trans 30064894812 rc 0/0 00002000:00010000:1.0:1651529418.734950:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178695/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734950:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000291fa891 with x1731746396797120 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734952:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000291fa891. 00000100:00100000:0.0:1651529418.734952:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15873 00002000:00010000:0.0:1651529418.734953:0:127529:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178696/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734954:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080a383af with x1731746396797248 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734956:0:127529:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080a383af. 00000100:00100000:1.0:1651529418.734957:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15874 00000100:00100000:1.0:1651529418.734958:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0353c23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41278:x1731746396797376:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734978:0:127531:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba09:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734980:0:127531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba09:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734981:0:127531:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba09:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734981:0:127531:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba09:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734982:0:127531:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba09:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734988:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0353c23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396797376:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (837us total) trans 30064894813 rc 0/0 00000100:00100000:1.0:1651529418.734991:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15874 00002000:00010000:1.0:1651529418.734992:0:127531:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178697/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734992:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e0353c23 with x1731746396797376 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734994:0:127531:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e0353c23. 00000100:00100000:1.0:1651529419.689178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689206:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689221:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798336 00002000:00100000:1.0:1651529419.689245:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c1:0x0] (0->2097151) req@0000000029999330 x1731746396798336/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.689252:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029999330 with x1731746396798336 ext(0->2097151) 00002000:00010000:1.0:1651529419.689255:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000029999330 00000100:00100000:1.0:1651529419.689264:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798464 00002000:00100000:1.0:1651529419.689276:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c2:0x0] (0->2097151) req@00000000ef1e941b x1731746396798464/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.689280:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef1e941b with x1731746396798464 ext(0->2097151) 00002000:00010000:1.0:1651529419.689281:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef1e941b 00000100:00100000:1.0:1651529419.689291:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798592 00002000:00100000:1.0:1651529419.689295:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c3:0x0] (0->2097151) req@00000000722203ca x1731746396798592/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.689298:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000722203ca with x1731746396798592 ext(0->2097151) 00002000:00010000:1.0:1651529419.689300:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000722203ca 00000100:00100000:1.0:1651529419.689306:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798720 00002000:00100000:1.0:1651529419.689310:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c4:0x0] (0->2097151) req@00000000fdadf085 x1731746396798720/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.689314:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fdadf085 with x1731746396798720 ext(0->2097151) 00002000:00010000:1.0:1651529419.689315:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fdadf085 00000100:00100000:0.0:1651529419.689316:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15875 00000100:00100000:0.0:1651529419.689320:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029999330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41278:x1731746396798336:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.689326:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15876 00000100:00100000:1.0:1651529419.689328:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1e941b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41278:x1731746396798464:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.689707:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15877 00000100:00100000:1.0:1651529419.689709:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000722203ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+160:41278:x1731746396798592:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.689734:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15878 00000100:00100000:0.0:1651529419.689737:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdadf085 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+160:41279:x1731746396798720:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.690073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.690119:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798848 00002000:00100000:0.0:1651529419.690130:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9c5:0x0] (0->2097151) req@000000006e046bcb x1731746396798848/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.690135:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e046bcb with x1731746396798848 ext(0->2097151) 00002000:00010000:0.0:1651529419.690137:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006e046bcb 00000100:00100000:0.0:1651529419.690147:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15879 00000100:00100000:0.0:1651529419.690149:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e046bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+163:41279:x1731746396798848:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.695609:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1e941b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+167:41278:x1731746396798464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6276us (6411us total) trans 30064894814 rc 0/0 00000100:00100000:1.0:1651529419.695616:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15876 00002000:00100000:1.0:1651529419.695623:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c2:0x0] (0->2097151) req@00000000ef1e941b x1731746396798464/t30064894814(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.695641:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef1e941b with x1731746396798464 ext(0->2097151) 00002000:00010000:1.0:1651529419.695644:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef1e941b 00000100:00100000:0.0:1651529419.698397:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029999330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+169:41278:x1731746396798336:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9074us (9220us total) trans 30064894815 rc 0/0 00000100:00100000:0.0:1651529419.698406:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15875 00002000:00100000:0.0:1651529419.698413:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9c1:0x0] (0->2097151) req@0000000029999330 x1731746396798336/t30064894815(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.698419:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029999330 with x1731746396798336 ext(0->2097151) 00002000:00010000:0.0:1651529419.698422:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000029999330 00000100:00100000:1.0:1651529419.698982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.699001:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799680 00002000:00100000:0.0:1651529419.699018:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9ea:0x0] (0->1048575) req@000000000028453d x1731746396799680/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.699023:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731746396799680 ext(0->1048575) 00002000:00010000:0.0:1651529419.699025:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:0.0:1651529419.699037:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15880 00000100:00100000:0.0:1651529419.699040:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41278:x1731746396799680:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.699429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.699439:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798976 00002000:00100000:1.0:1651529419.699449:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c6:0x0] (0->2097151) req@00000000f07681a2 x1731746396798976/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.699453:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f07681a2 with x1731746396798976 ext(0->2097151) 00002000:00010000:1.0:1651529419.699455:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f07681a2 00000100:00100000:1.0:1651529419.699462:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15881 00000100:00100000:1.0:1651529419.699464:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+173:41278:x1731746396798976:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.699984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.700008:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799104 00002000:00100000:1.0:1651529419.700018:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9c7:0x0] (0->2097151) req@00000000628382ce x1731746396799104/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.700022:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000628382ce with x1731746396799104 ext(0->2097151) 00002000:00010000:1.0:1651529419.700024:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000628382ce 00000100:00100000:1.0:1651529419.700031:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15882 00000100:00100000:1.0:1651529419.700033:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+175:41278:x1731746396799104:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.700346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.700369:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.700414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.700439:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799232 00002000:00100000:0.0:1651529419.700449:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9c8:0x0] (0->2097151) req@00000000307b836d x1731746396799232/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.700453:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000307b836d with x1731746396799232 ext(0->2097151) 00002000:00010000:0.0:1651529419.700455:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000307b836d 00000100:00100000:0.0:1651529419.700472:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799360 00002000:00100000:0.0:1651529419.700477:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9c9:0x0] (0->2097151) req@00000000830ccf65 x1731746396799360/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.700484:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000830ccf65 with x1731746396799360 ext(0->2097151) 00002000:00010000:0.0:1651529419.700485:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000830ccf65 00000100:00100000:1.0:1651529419.700492:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799744 00000100:00100000:0.0:1651529419.700492:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15883 00000100:00100000:0.0:1651529419.700494:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41278:x1731746396799232:12345-10.240.43.64@tcp:4:dd.0 00002000:00100000:1.0:1651529419.700500:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9eb:0x0] (0->1048575) req@00000000bd6e46f6 x1731746396799744/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.700504:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731746396799744 ext(0->1048575) 00002000:00010000:1.0:1651529419.700506:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:1.0:1651529419.700516:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15884 00000100:00100000:1.0:1651529419.700518:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41278:x1731746396799360:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.700919:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15885 00000100:00100000:0.0:1651529419.700921:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41278:x1731746396799744:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.700953:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000722203ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41278:x1731746396798592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11242us (11753us total) trans 30064894816 rc 0/0 00000100:00100000:1.0:1651529419.700957:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15877 00002000:00100000:1.0:1651529419.700961:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9c3:0x0] (0->2097151) req@00000000722203ca x1731746396798592/t30064894816(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.700964:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000722203ca with x1731746396798592 ext(0->2097151) 00002000:00010000:1.0:1651529419.700966:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000722203ca 00000100:00100000:0.0:1651529419.702612:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdadf085 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41279:x1731746396798720:12345-10.240.43.64@tcp:4:dd.0 Request processed in 12871us (13402us total) trans 30064894817 rc 0/0 00000100:00100000:0.0:1651529419.702618:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15878 00002000:00100000:0.0:1651529419.702622:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9c4:0x0] (0->2097151) req@00000000fdadf085 x1731746396798720/t30064894817(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.702627:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fdadf085 with x1731746396798720 ext(0->2097151) 00002000:00010000:0.0:1651529419.702630:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fdadf085 00000100:00100000:0.0:1651529419.704666:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e046bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41279:x1731746396798848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14514us (14591us total) trans 30064894818 rc 0/0 00000100:00100000:0.0:1651529419.704671:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15879 00002000:00100000:0.0:1651529419.704675:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9c5:0x0] (0->2097151) req@000000006e046bcb x1731746396798848/t30064894818(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.704680:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e046bcb with x1731746396798848 ext(0->2097151) 00002000:00010000:0.0:1651529419.704683:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006e046bcb 00000100:00100000:0.0:1651529419.705446:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41278:x1731746396799680:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6395us (6455us total) trans 30064894819 rc 0/0 00000100:00100000:0.0:1651529419.705452:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15880 00002000:00100000:0.0:1651529419.705456:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9ea:0x0] (0->1048575) req@000000000028453d x1731746396799680/t30064894819(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.705460:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731746396799680 ext(0->1048575) 00002000:00010000:0.0:1651529419.705461:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:1.0:1651529419.705559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.705585:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800064 00002000:00100000:0.0:1651529419.705600:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9ec:0x0] (0->1048575) req@000000009afa4f6b x1731746396800064/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.705604:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009afa4f6b with x1731746396800064 ext(0->1048575) 00002000:00010000:0.0:1651529419.705606:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009afa4f6b 00000100:00100000:0.0:1651529419.705614:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15886 00000100:00100000:0.0:1651529419.705616:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41278:x1731746396800064:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.707935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.707951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.707960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.707976:0:127530:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800128 00000100:00100000:1.0:1651529419.707978:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800256 00002000:00100000:1.0:1651529419.707999:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9ee:0x0] (0->1048575) req@000000003b723b39 x1731746396800256/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.707999:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9ed:0x0] (0->1048575) req@000000001d3bbd7f x1731746396800128/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.708005:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731746396800256 ext(0->1048575) 00002000:00100000:0.0:1651529419.708005:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731746396800128 ext(0->1048575) 00002000:00010000:1.0:1651529419.708008:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39 00002000:00010000:0.0:1651529419.708008:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00000100:00100000:1.0:1651529419.708026:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800192 00002000:00100000:1.0:1651529419.708031:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9ce:0x0] (0->2097151) req@00000000528e2dbd x1731746396800192/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.708042:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731746396800192 ext(0->2097151) 00002000:00010000:1.0:1651529419.708043:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd 00000100:00100000:0.0:1651529419.708049:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15887 00000100:00100000:1.0:1651529419.708052:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15888 00000100:00100000:0.0:1651529419.708052:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41279:x1731746396800256:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.708054:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41279:x1731746396800128:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.708278:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15889 00000100:00100000:1.0:1651529419.708281:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+185:41279:x1731746396800192:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.709104:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+187:41278:x1731746396798976:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9637us (9673us total) trans 30064894820 rc 0/0 00000100:00100000:1.0:1651529419.709109:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15881 00002000:00100000:1.0:1651529419.709113:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9c6:0x0] (0->2097151) req@00000000f07681a2 x1731746396798976/t30064894820(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.709117:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f07681a2 with x1731746396798976 ext(0->2097151) 00002000:00010000:1.0:1651529419.709120:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f07681a2 00000100:00100000:1.0:1651529419.712052:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+189:41278:x1731746396799104:12345-10.240.43.64@tcp:4:dd.0 Request processed in 12014us (12064us total) trans 30064894821 rc 0/0 00000100:00100000:1.0:1651529419.712061:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15882 00002000:00100000:1.0:1651529419.712068:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9c7:0x0] (0->2097151) req@00000000628382ce x1731746396799104/t30064894821(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.712079:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000628382ce with x1731746396799104 ext(0->2097151) 00002000:00010000:1.0:1651529419.712083:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000628382ce 00000100:00100000:0.0:1651529419.712325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.712404:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800512 00002000:00100000:1.0:1651529419.712422:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9f0:0x0] (0->1048575) req@0000000073ff402b x1731746396800512/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.712426:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ff402b with x1731746396800512 ext(0->1048575) 00002000:00010000:1.0:1651529419.712428:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ff402b 00000100:00100000:1.0:1651529419.712436:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15890 00000100:00100000:1.0:1651529419.712438:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396800512:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.713557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.713569:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800832 00002000:00100000:1.0:1651529419.713583:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9f1:0x0] (0->1048575) req@00000000aae53944 x1731746396800832/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.713588:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aae53944 with x1731746396800832 ext(0->1048575) 00002000:00010000:1.0:1651529419.713591:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aae53944 00000100:00100000:1.0:1651529419.713599:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15891 00000100:00100000:1.0:1651529419.713602:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+195:41278:x1731746396800832:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.714029:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+195:41278:x1731746396799360:12345-10.240.43.64@tcp:4:dd.0 Request processed in 13509us (13659us total) trans 30064894822 rc 0/0 00000100:00100000:1.0:1651529419.714034:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15884 00002000:00100000:1.0:1651529419.714037:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9c9:0x0] (0->2097151) req@00000000830ccf65 x1731746396799360/t30064894822(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.714041:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000830ccf65 with x1731746396799360 ext(0->2097151) 00002000:00010000:1.0:1651529419.714042:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000830ccf65 00000100:00100000:0.0:1651529419.716199:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396799232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15701us (15850us total) trans 30064894823 rc 0/0 00000100:00100000:0.0:1651529419.716208:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15883 00002000:00100000:0.0:1651529419.716216:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9c8:0x0] (0->2097151) req@00000000307b836d x1731746396799232/t30064894823(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.716221:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000307b836d with x1731746396799232 ext(0->2097151) 00002000:00010000:0.0:1651529419.716225:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000307b836d 00000100:00100000:1.0:1651529419.717404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.717431:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801152 00002000:00100000:0.0:1651529419.717446:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9f2:0x0] (0->1048575) req@00000000db30feb6 x1731746396801152/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.717450:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db30feb6 with x1731746396801152 ext(0->1048575) 00002000:00010000:0.0:1651529419.717452:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000db30feb6 00000100:00100000:0.0:1651529419.717464:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15892 00000100:00100000:0.0:1651529419.717467:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41278:x1731746396801152:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.718795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.718820:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801344 00002000:00100000:1.0:1651529419.718836:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9f3:0x0] (0->1048575) req@000000004fbbd270 x1731746396801344/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.718842:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004fbbd270 with x1731746396801344 ext(0->1048575) 00002000:00010000:1.0:1651529419.718844:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004fbbd270 00000100:00100000:1.0:1651529419.718854:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15893 00000100:00100000:1.0:1651529419.718856:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41278:x1731746396801344:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.722190:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396799744:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21263us (21771us total) trans 30064894824 rc 0/0 00000100:00100000:1.0:1651529419.722192:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41279:x1731746396800128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14135us (14260us total) trans 30064894826 rc 0/0 00000100:00100000:0.0:1651529419.722197:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15885 00000100:00100000:1.0:1651529419.722200:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15888 00002000:00100000:1.0:1651529419.722204:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9ed:0x0] (0->1048575) req@000000001d3bbd7f x1731746396800128/t30064894826(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.722204:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9eb:0x0] (0->1048575) req@00000000bd6e46f6 x1731746396799744/t30064894824(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.722209:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731746396800128 ext(0->1048575) 00002000:00100000:0.0:1651529419.722209:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731746396799744 ext(0->1048575) 00002000:00010000:1.0:1651529419.722212:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00002000:00010000:0.0:1651529419.722212:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:0.0:1651529419.722260:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41279:x1731746396800256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14208us (14308us total) trans 30064894827 rc 0/0 00000100:00100000:0.0:1651529419.722264:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15887 00002000:00100000:0.0:1651529419.722266:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9ee:0x0] (0->1048575) req@000000003b723b39 x1731746396800256/t30064894827(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.722270:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731746396800256 ext(0->1048575) 00002000:00010000:0.0:1651529419.722271:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39 00000100:00100000:0.0:1651529419.722306:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41278:x1731746396800064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 16689us (16748us total) trans 30064894825 rc 0/0 00000100:00100000:0.0:1651529419.722309:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15886 00002000:00100000:0.0:1651529419.722311:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9ec:0x0] (0->1048575) req@000000009afa4f6b x1731746396800064/t30064894825(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.722314:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009afa4f6b with x1731746396800064 ext(0->1048575) 00002000:00010000:0.0:1651529419.722315:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009afa4f6b 00000100:00100000:1.0:1651529419.722358:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41279:x1731746396800192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14075us (14396us total) trans 30064894828 rc 0/0 00000100:00100000:1.0:1651529419.722361:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15889 00002000:00100000:1.0:1651529419.722364:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9ce:0x0] (0->2097151) req@00000000528e2dbd x1731746396800192/t30064894828(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.722368:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731746396800192 ext(0->2097151) 00002000:00010000:1.0:1651529419.722369:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd 00000100:00100000:0.0:1651529419.724318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.724333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.724349:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801728 00000100:00100000:0.0:1651529419.724349:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801792 00002000:00100000:1.0:1651529419.724363:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9f4:0x0] (0->1048575) req@0000000080249b71 x1731746396801728/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.724363:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9df:0x0] (0->1048575) req@00000000ae427147 x1731746396801792/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.724367:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080249b71 with x1731746396801728 ext(0->1048575) 00002000:00100000:0.0:1651529419.724367:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae427147 with x1731746396801792 ext(0->1048575) 00002000:00010000:1.0:1651529419.724369:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080249b71 00002000:00010000:0.0:1651529419.724369:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ae427147 00000100:00100000:0.0:1651529419.724376:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15894 00000100:00100000:1.0:1651529419.724378:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15895 00000100:00100000:0.0:1651529419.724378:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41279:x1731746396801792:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.724380:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41278:x1731746396801728:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.724621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.724637:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801856 00002000:00100000:1.0:1651529419.724658:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9f5:0x0] (0->1048575) req@00000000af89e34e x1731746396801856/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.724666:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000af89e34e with x1731746396801856 ext(0->1048575) 00002000:00010000:1.0:1651529419.724667:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000af89e34e 00000100:00100000:1.0:1651529419.724678:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15896 00000100:00100000:1.0:1651529419.724679:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af89e34e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41278:x1731746396801856:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.724932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.724945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.724946:0:127530:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801920 00002000:00100000:0.0:1651529419.724961:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9f7:0x0] (0->1048575) req@000000001dfd8468 x1731746396801920/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.724965:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001dfd8468 with x1731746396801920 ext(0->1048575) 00002000:00010000:0.0:1651529419.724983:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001dfd8468 00000100:00100000:0.0:1651529419.724995:0:127530:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801984 00002000:00100000:0.0:1651529419.725001:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9f8:0x0] (0->1048575) req@0000000044516f7a x1731746396801984/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.725004:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000044516f7a with x1731746396801984 ext(0->1048575) 00002000:00010000:0.0:1651529419.725005:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000044516f7a 00000100:00100000:0.0:1651529419.725011:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15897 00000100:00100000:1.0:1651529419.725013:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15898 00000100:00100000:0.0:1651529419.725013:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396801920:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.725016:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396801984:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.727074:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41278:x1731746396801152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9603us (9668us total) trans 30064894831 rc 0/0 00000100:00100000:0.0:1651529419.727082:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15892 00002000:00100000:0.0:1651529419.727088:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9f2:0x0] (0->1048575) req@00000000db30feb6 x1731746396801152/t30064894831(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.727093:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db30feb6 with x1731746396801152 ext(0->1048575) 00002000:00010000:0.0:1651529419.727095:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000db30feb6 00000100:00100000:1.0:1651529419.727136:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41278:x1731746396800512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14696us (14812us total) trans 30064894829 rc 0/0 00000100:00100000:1.0:1651529419.727140:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15890 00002000:00100000:1.0:1651529419.727144:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9f0:0x0] (0->1048575) req@0000000073ff402b x1731746396800512/t30064894829(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.727148:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ff402b with x1731746396800512 ext(0->1048575) 00002000:00010000:1.0:1651529419.727149:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ff402b 00000100:00100000:1.0:1651529419.727185:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41278:x1731746396800832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 13583us (13630us total) trans 30064894830 rc 0/0 00000100:00100000:1.0:1651529419.727188:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15891 00002000:00100000:1.0:1651529419.727190:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9f1:0x0] (0->1048575) req@00000000aae53944 x1731746396800832/t30064894830(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.727193:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aae53944 with x1731746396800832 ext(0->1048575) 00002000:00010000:1.0:1651529419.727195:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aae53944 00000100:00100000:1.0:1651529419.727224:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41278:x1731746396801344:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8368us (8431us total) trans 30064894832 rc 0/0 00000100:00100000:1.0:1651529419.727228:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15893 00002000:00100000:1.0:1651529419.727230:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9f3:0x0] (0->1048575) req@000000004fbbd270 x1731746396801344/t30064894832(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.727233:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004fbbd270 with x1731746396801344 ext(0->1048575) 00002000:00010000:1.0:1651529419.727234:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004fbbd270 00000100:00100000:0.0:1651529419.728611:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41279:x1731746396801792:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4231us (4293us total) trans 30064894833 rc 0/0 00000100:00100000:0.0:1651529419.728628:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15894 00002000:00100000:0.0:1651529419.728632:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9df:0x0] (0->1048575) req@00000000ae427147 x1731746396801792/t30064894833(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.728636:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae427147 with x1731746396801792 ext(0->1048575) 00002000:00010000:0.0:1651529419.728638:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ae427147 00000100:00100000:1.0:1651529419.729234:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.729280:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802304 00002000:00100000:0.0:1651529419.729296:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9f9:0x0] (0->1048575) req@000000004cbc277d x1731746396802304/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.729307:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004cbc277d with x1731746396802304 ext(0->1048575) 00002000:00010000:0.0:1651529419.729309:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004cbc277d 00000100:00100000:0.0:1651529419.729322:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15899 00000100:00100000:0.0:1651529419.729325:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41279:x1731746396802304:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.729884:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41278:x1731746396801728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5502us (5551us total) trans 30064894834 rc 0/0 00000100:00100000:1.0:1651529419.729889:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15895 00002000:00100000:1.0:1651529419.729893:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9f4:0x0] (0->1048575) req@0000000080249b71 x1731746396801728/t30064894834(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.729897:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080249b71 with x1731746396801728 ext(0->1048575) 00002000:00010000:1.0:1651529419.729899:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080249b71 00000100:00100000:1.0:1651529419.730245:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.730253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.730261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.730269:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802432 00002000:00100000:1.0:1651529419.730279:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9fa:0x0] (0->1048575) req@000000003b840a8c x1731746396802432/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.730283:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b840a8c with x1731746396802432 ext(0->1048575) 00002000:00010000:1.0:1651529419.730285:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b840a8c 00000100:00100000:1.0:1651529419.730290:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802368 00002000:00100000:1.0:1651529419.730293:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9e2:0x0] (0->1048575) req@0000000091613880 x1731746396802368/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.730300:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091613880 with x1731746396802368 ext(0->1048575) 00002000:00010000:1.0:1651529419.730301:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000091613880 00000100:00100000:1.0:1651529419.730309:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802496 00002000:00100000:1.0:1651529419.730313:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9fb:0x0] (0->1048575) req@00000000c5078479 x1731746396802496/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.730316:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5078479 with x1731746396802496 ext(0->1048575) 00002000:00010000:1.0:1651529419.730317:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5078479 00000100:00100000:1.0:1651529419.730324:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15900 00000100:00100000:1.0:1651529419.730326:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+213:41279:x1731746396802432:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.730362:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15901 00000100:00100000:0.0:1651529419.730365:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+213:41279:x1731746396802368:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.730495:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15902 00000100:00100000:1.0:1651529419.730497:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+214:41279:x1731746396802496:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.731031:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af89e34e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746396801856:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6350us (6410us total) trans 30064894835 rc 0/0 00000100:00100000:1.0:1651529419.731035:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15896 00002000:00100000:1.0:1651529419.731039:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9f5:0x0] (0->1048575) req@00000000af89e34e x1731746396801856/t30064894835(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.731042:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000af89e34e with x1731746396801856 ext(0->1048575) 00002000:00010000:1.0:1651529419.731044:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000af89e34e 00000100:00100000:0.0:1651529419.733728:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.733743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.733872:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802688 00000100:00100000:0.0:1651529419.733878:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41278:x1731746396801920:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8864us (8946us total) trans 30064894837 rc 0/0 00000100:00100000:0.0:1651529419.733886:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15897 00002000:00100000:1.0:1651529419.733891:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9fd:0x0] (0->1048575) req@00000000ffc345cf x1731746396802688/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.733891:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9f7:0x0] (0->1048575) req@000000001dfd8468 x1731746396801920/t30064894837(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.733896:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731746396802688 ext(0->1048575) 00002000:00100000:0.0:1651529419.733896:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001dfd8468 with x1731746396801920 ext(0->1048575) 00002000:00010000:1.0:1651529419.733899:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00002000:00010000:0.0:1651529419.733899:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001dfd8468 00000100:00100000:1.0:1651529419.733910:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802752 00002000:00100000:1.0:1651529419.733914:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9fe:0x0] (0->1048575) req@0000000088e71ac2 x1731746396802752/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.733918:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731746396802752 ext(0->1048575) 00000100:00100000:0.0:1651529419.733918:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15903 00002000:00010000:1.0:1651529419.733919:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:0.0:1651529419.733920:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41279:x1731746396802688:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.733926:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15904 00000100:00100000:1.0:1651529419.733928:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41278:x1731746396802752:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.734145:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+219:41278:x1731746396801984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9128us (9199us total) trans 30064894836 rc 0/0 00000100:00100000:1.0:1651529419.734149:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15898 00002000:00100000:1.0:1651529419.734151:0:144087:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x2b9f8:0x0] (0->1048575) req@0000000044516f7a x1731746396801984/t30064894836(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.734155:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000044516f7a with x1731746396801984 ext(0->1048575) 00002000:00010000:1.0:1651529419.734156:0:144087:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000044516f7a 00000100:00100000:0.0:1651529419.734348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.734442:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802944 00002000:00100000:1.0:1651529419.734450:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9ff:0x0] (0->1048575) req@00000000628382ce x1731746396802944/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.734454:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000628382ce with x1731746396802944 ext(0->1048575) 00002000:00010000:1.0:1651529419.734455:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000628382ce 00000100:00100000:1.0:1651529419.734461:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15905 00000100:00100000:1.0:1651529419.734463:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+223:41279:x1731746396802944:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.734861:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+223:41279:x1731746396802304:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5535us (5627us total) trans 30064894838 rc 0/0 00000100:00100000:1.0:1651529419.734866:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15899 00002000:00100000:1.0:1651529419.734871:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9f9:0x0] (0->1048575) req@000000004cbc277d x1731746396802304/t30064894838(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.734874:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004cbc277d with x1731746396802304 ext(0->1048575) 00002000:00010000:1.0:1651529419.734876:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004cbc277d 00000100:00100000:0.0:1651529419.736172:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41279:x1731746396802368:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5803us (5915us total) trans 30064894839 rc 0/0 00000100:00100000:0.0:1651529419.736208:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15901 00002000:00100000:0.0:1651529419.736215:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9e2:0x0] (0->1048575) req@0000000091613880 x1731746396802368/t30064894839(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.736224:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091613880 with x1731746396802368 ext(0->1048575) 00002000:00010000:0.0:1651529419.736228:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000091613880 00000100:00100000:0.0:1651529419.736254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.736266:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803200 00002000:00100000:0.0:1651529419.736282:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2ba00:0x0] (0->1048575) req@000000001d3bbd7f x1731746396803200/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.736286:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731746396803200 ext(0->1048575) 00002000:00010000:0.0:1651529419.736288:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00000100:00100000:0.0:1651529419.736302:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15906 00000100:00100000:0.0:1651529419.736304:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41279:x1731746396803200:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.737260:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41279:x1731746396802496:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6760us (6997us total) trans 30064894840 rc 0/0 00000100:00100000:1.0:1651529419.737265:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15902 00002000:00100000:1.0:1651529419.737268:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9fb:0x0] (0->1048575) req@00000000c5078479 x1731746396802496/t30064894840(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.737272:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5078479 with x1731746396802496 ext(0->1048575) 00002000:00010000:1.0:1651529419.737274:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5078479 00000100:00100000:0.0:1651529419.737591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.737607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.737617:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803264 00002000:00100000:1.0:1651529419.737626:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2ba01:0x0] (0->1048575) req@00000000bd6e46f6 x1731746396803264/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.737630:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731746396803264 ext(0->1048575) 00002000:00010000:1.0:1651529419.737632:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:1.0:1651529419.737638:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803328 00002000:00100000:1.0:1651529419.737641:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2ba02:0x0] (0->1048575) req@000000003b723b39 x1731746396803328/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.737645:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731746396803328 ext(0->1048575) 00002000:00010000:1.0:1651529419.737647:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39 00000100:00100000:1.0:1651529419.737651:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15907 00000100:00100000:1.0:1651529419.737653:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+228:41278:x1731746396803264:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.737878:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15908 00000100:00100000:1.0:1651529419.737880:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41278:x1731746396803328:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.738254:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41279:x1731746396802432:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7926us (8009us total) trans 30064894841 rc 0/0 00000100:00100000:1.0:1651529419.738258:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15900 00002000:00100000:1.0:1651529419.738261:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9fa:0x0] (0->1048575) req@000000003b840a8c x1731746396802432/t30064894841(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.738265:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b840a8c with x1731746396802432 ext(0->1048575) 00002000:00010000:1.0:1651529419.738267:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b840a8c 00000100:00100000:1.0:1651529419.738505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.738513:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803456 00002000:00100000:1.0:1651529419.738523:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba03:0x0] (0->1048575) req@000000000028453d x1731746396803456/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.738528:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731746396803456 ext(0->1048575) 00002000:00010000:1.0:1651529419.738529:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:1.0:1651529419.738535:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15909 00000100:00100000:1.0:1651529419.738536:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41278:x1731746396803456:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.739070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.739080:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803520 00002000:00100000:1.0:1651529419.739091:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2ba04:0x0] (0->1048575) req@00000000f07681a2 x1731746396803520/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.739095:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f07681a2 with x1731746396803520 ext(0->1048575) 00002000:00010000:1.0:1651529419.739097:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f07681a2 00000100:00100000:1.0:1651529419.739104:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15910 00000100:00100000:1.0:1651529419.739106:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396803520:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.739310:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396802688:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5388us (5583us total) trans 30064894842 rc 0/0 00000100:00100000:0.0:1651529419.739331:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15903 00002000:00100000:0.0:1651529419.739335:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9fd:0x0] (0->1048575) req@00000000ffc345cf x1731746396802688/t30064894842(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.739341:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731746396802688 ext(0->1048575) 00002000:00010000:0.0:1651529419.739344:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00000100:00100000:1.0:1651529419.740116:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41278:x1731746396802752:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6186us (6371us total) trans 30064894843 rc 0/0 00000100:00100000:1.0:1651529419.740121:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15904 00002000:00100000:1.0:1651529419.740129:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9fe:0x0] (0->1048575) req@0000000088e71ac2 x1731746396802752/t30064894843(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.740133:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731746396802752 ext(0->1048575) 00002000:00010000:1.0:1651529419.740135:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:1.0:1651529419.740389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.740398:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803776 00002000:00100000:1.0:1651529419.740410:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2ba05:0x0] (0->1048575) req@00000000830ccf65 x1731746396803776/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.740413:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000830ccf65 with x1731746396803776 ext(0->1048575) 00002000:00010000:1.0:1651529419.740415:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000830ccf65 00000100:00100000:1.0:1651529419.740421:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15911 00000100:00100000:1.0:1651529419.740423:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41279:x1731746396803776:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.740880:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41279:x1731746396803200:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4574us (4625us total) trans 30064894845 rc 0/0 00000100:00100000:1.0:1651529419.740884:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15906 00002000:00100000:1.0:1651529419.740887:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2ba00:0x0] (0->1048575) req@000000001d3bbd7f x1731746396803200/t30064894845(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.740890:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731746396803200 ext(0->1048575) 00002000:00010000:1.0:1651529419.740892:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00000100:00100000:1.0:1651529419.741861:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396803264:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4206us (4270us total) trans 30064894846 rc 0/0 00000100:00100000:1.0:1651529419.741866:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15907 00002000:00100000:1.0:1651529419.741870:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2ba01:0x0] (0->1048575) req@00000000bd6e46f6 x1731746396803264/t30064894846(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.741874:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731746396803264 ext(0->1048575) 00002000:00010000:1.0:1651529419.741876:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:1.0:1651529419.742065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.742084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.742093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.742106:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803904 00002000:00100000:1.0:1651529419.742117:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9e8:0x0] (0->1048575) req@00000000307b836d x1731746396803904/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.742121:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000307b836d with x1731746396803904 ext(0->1048575) 00002000:00010000:1.0:1651529419.742123:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000307b836d 00000100:00100000:0.0:1651529419.742125:0:127530:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803840 00000100:00100000:1.0:1651529419.742129:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803968 00002000:00100000:1.0:1651529419.742133:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2ba07:0x0] (0->1048575) req@00000000db30feb6 x1731746396803968/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.742136:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db30feb6 with x1731746396803968 ext(0->1048575) 00002000:00010000:1.0:1651529419.742138:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000db30feb6 00002000:00100000:0.0:1651529419.742138:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2ba06:0x0] (0->1048575) req@000000009afa4f6b x1731746396803840/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:1.0:1651529419.742146:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15912 00000100:00100000:1.0:1651529419.742148:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746396803904:12345-10.240.43.64@tcp:4:dd.0 00002000:00100000:0.0:1651529419.742153:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009afa4f6b with x1731746396803840 ext(0->1048575) 00002000:00010000:0.0:1651529419.742156:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009afa4f6b 00000100:00100000:0.0:1651529419.742168:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15913 00000100:00100000:0.0:1651529419.742171:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746396803968:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.742321:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15914 00000100:00100000:1.0:1651529419.742323:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41278:x1731746396803840:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.742744:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396803328:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4863us (5137us total) trans 30064894847 rc 0/0 00000100:00100000:1.0:1651529419.742748:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15908 00002000:00100000:1.0:1651529419.742751:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2ba02:0x0] (0->1048575) req@000000003b723b39 x1731746396803328/t30064894847(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.742755:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731746396803328 ext(0->1048575) 00002000:00010000:1.0:1651529419.742756:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39 00000100:00100000:1.0:1651529419.743855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.743867:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804160 00002000:00100000:1.0:1651529419.743879:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2ba09:0x0] (0->1048575) req@00000000aae53944 x1731746396804160/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.743889:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aae53944 with x1731746396804160 ext(0->1048575) 00002000:00010000:1.0:1651529419.743891:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aae53944 00000100:00100000:1.0:1651529419.743902:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15915 00000100:00100000:1.0:1651529419.743912:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396804160:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.744303:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41278:x1731746396803456:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5765us (5798us total) trans 30064894848 rc 0/0 00000100:00100000:1.0:1651529419.744307:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15909 00002000:00100000:1.0:1651529419.744311:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba03:0x0] (0->1048575) req@000000000028453d x1731746396803456/t30064894848(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.744315:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731746396803456 ext(0->1048575) 00002000:00010000:1.0:1651529419.744317:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:0.0:1651529419.744945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.744965:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396803520:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5857us (5896us total) trans 30064894849 rc 0/0 00000100:00100000:1.0:1651529419.744970:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15910 00002000:00100000:1.0:1651529419.744973:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2ba04:0x0] (0->1048575) req@00000000f07681a2 x1731746396803520/t30064894849(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.744980:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f07681a2 with x1731746396803520 ext(0->1048575) 00002000:00010000:1.0:1651529419.744981:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f07681a2 00000100:00100000:1.0:1651529419.744989:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804288 00002000:00100000:1.0:1651529419.744998:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9da:0x0] (0->1048575) req@00000000528e2dbd x1731746396804288/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.745002:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731746396804288 ext(0->1048575) 00002000:00010000:1.0:1651529419.745011:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd 00000100:00100000:1.0:1651529419.745019:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15916 00000100:00100000:1.0:1651529419.745021:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396804288:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.745530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.745581:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804416 00002000:00100000:1.0:1651529419.745590:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9db:0x0] (0->1048575) req@0000000073ff402b x1731746396804416/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.745593:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ff402b with x1731746396804416 ext(0->1048575) 00002000:00010000:1.0:1651529419.745595:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ff402b 00000100:00100000:1.0:1651529419.745603:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15917 00000100:00100000:1.0:1651529419.745605:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396804416:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.746315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.746324:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804480 00002000:00100000:0.0:1651529419.746334:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9ef:0x0] (0->1048575) req@00000000ae427147 x1731746396804480/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.746340:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae427147 with x1731746396804480 ext(0->1048575) 00002000:00010000:0.0:1651529419.746341:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ae427147 00000100:00100000:0.0:1651529419.746349:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15918 00000100:00100000:0.0:1651529419.746351:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+253:41278:x1731746396804480:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.746394:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41279:x1731746396803776:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5970us (6005us total) trans 30064894850 rc 0/0 00000100:00100000:1.0:1651529419.746398:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15911 00002000:00100000:1.0:1651529419.746401:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2ba05:0x0] (0->1048575) req@00000000830ccf65 x1731746396803776/t30064894850(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.746404:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000830ccf65 with x1731746396803776 ext(0->1048575) 00002000:00010000:1.0:1651529419.746406:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000830ccf65 00000100:00100000:1.0:1651529419.747497:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396803904:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5347us (5431us total) trans 30064894851 rc 0/0 00000100:00100000:1.0:1651529419.747501:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15912 00002000:00100000:1.0:1651529419.747505:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9e8:0x0] (0->1048575) req@00000000307b836d x1731746396803904/t30064894851(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.747508:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000307b836d with x1731746396803904 ext(0->1048575) 00002000:00010000:1.0:1651529419.747510:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000307b836d 00000100:00100000:1.0:1651529419.748976:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396803840:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6650us (6890us total) trans 30064894852 rc 0/0 00000100:00100000:1.0:1651529419.748981:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15914 00002000:00100000:1.0:1651529419.748986:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2ba06:0x0] (0->1048575) req@000000009afa4f6b x1731746396803840/t30064894852(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.748989:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009afa4f6b with x1731746396803840 ext(0->1048575) 00002000:00010000:1.0:1651529419.748991:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009afa4f6b 00000100:00100000:0.0:1651529419.749942:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396803968:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7770us (7847us total) trans 30064894853 rc 0/0 00000100:00100000:0.0:1651529419.749949:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15913 00002000:00100000:0.0:1651529419.749954:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2ba07:0x0] (0->1048575) req@00000000db30feb6 x1731746396803968/t30064894853(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.750016:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db30feb6 with x1731746396803968 ext(0->1048575) 00002000:00010000:0.0:1651529419.750019:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000db30feb6 00000100:00100000:0.0:1651529419.750047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.750467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.750479:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804672 00002000:00100000:1.0:1651529419.750492:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9dd:0x0] (0->1048575) req@0000000080249b71 x1731746396804672/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.750496:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080249b71 with x1731746396804672 ext(0->1048575) 00002000:00010000:1.0:1651529419.750498:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080249b71 00000100:00100000:1.0:1651529419.750505:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804800 00002000:00100000:1.0:1651529419.750509:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9de:0x0] (0->1048575) req@000000004fbbd270 x1731746396804800/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.750512:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004fbbd270 with x1731746396804800 ext(0->1048575) 00002000:00010000:1.0:1651529419.750513:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004fbbd270 00000100:00100000:1.0:1651529419.750524:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15919 00000100:00100000:1.0:1651529419.750526:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41278:x1731746396804672:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.750676:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15920 00000100:00100000:0.0:1651529419.750680:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41278:x1731746396804800:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.750746:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41278:x1731746396804160:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6841us (6891us total) trans 30064894854 rc 0/0 00000100:00100000:1.0:1651529419.750750:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15915 00002000:00100000:1.0:1651529419.750753:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2ba09:0x0] (0->1048575) req@00000000aae53944 x1731746396804160/t30064894854(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.750756:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aae53944 with x1731746396804160 ext(0->1048575) 00002000:00010000:1.0:1651529419.750757:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aae53944 00000100:00100000:1.0:1651529419.751047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.751079:0:127530:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805056 00002000:00100000:1.0:1651529419.751086:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9cf:0x0] (0->2097151) req@00000000d4277c50 x1731746396805056/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.751090:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4277c50 with x1731746396805056 ext(0->2097151) 00002000:00010000:1.0:1651529419.751091:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4277c50 00000100:00100000:1.0:1651529419.751097:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15921 00000100:00100000:1.0:1651529419.751099:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+253:41278:x1731746396805056:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.751937:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+255:41279:x1731746396804288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6914us (6993us total) trans 30064894855 rc 0/0 00000100:00100000:1.0:1651529419.751942:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15916 00002000:00100000:1.0:1651529419.751946:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9da:0x0] (0->1048575) req@00000000528e2dbd x1731746396804288/t30064894855(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.751949:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731746396804288 ext(0->1048575) 00002000:00010000:1.0:1651529419.751952:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd 00000100:00100000:0.0:1651529419.752144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.752168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.752313:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805184 00002000:00100000:1.0:1651529419.752327:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e1:0x0] (0->1048575) req@0000000062ba7e7d x1731746396805184/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.752331:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000062ba7e7d with x1731746396805184 ext(0->1048575) 00002000:00010000:1.0:1651529419.752333:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062ba7e7d 00000100:00100000:1.0:1651529419.752340:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805120 00002000:00100000:1.0:1651529419.752344:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e0:0x0] (0->1048575) req@00000000978de632 x1731746396805120/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.752347:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000978de632 with x1731746396805120 ext(0->1048575) 00002000:00010000:1.0:1651529419.752349:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000978de632 00000100:00100000:1.0:1651529419.752354:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15922 00000100:00100000:1.0:1651529419.752356:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41278:x1731746396805184:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.752532:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15923 00000100:00100000:1.0:1651529419.752534:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396805120:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.752844:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396804416:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7238us (7315us total) trans 30064894856 rc 0/0 00000100:00100000:1.0:1651529419.752848:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15917 00002000:00100000:1.0:1651529419.752851:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9db:0x0] (0->1048575) req@0000000073ff402b x1731746396804416/t30064894856(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.752854:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ff402b with x1731746396804416 ext(0->1048575) 00002000:00010000:1.0:1651529419.752856:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ff402b 00000100:00100000:0.0:1651529419.753010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.753035:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805248 00002000:00100000:1.0:1651529419.753048:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9d6:0x0] (0->1048575) req@00000000cf518e04 x1731746396805248/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.753055:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf518e04 with x1731746396805248 ext(0->1048575) 00002000:00010000:1.0:1651529419.753057:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cf518e04 00000100:00100000:1.0:1651529419.753063:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15924 00000100:00100000:1.0:1651529419.753064:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41279:x1731746396805248:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.754115:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396804480:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7763us (7799us total) trans 30064894857 rc 0/0 00000100:00100000:0.0:1651529419.754121:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15918 00002000:00100000:0.0:1651529419.754125:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9ef:0x0] (0->1048575) req@00000000ae427147 x1731746396804480/t30064894857(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.754129:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae427147 with x1731746396804480 ext(0->1048575) 00002000:00010000:0.0:1651529419.754131:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ae427147 00000100:00100000:0.0:1651529419.754299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.754308:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805312 00002000:00100000:0.0:1651529419.754322:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9e3:0x0] (0->1048575) req@0000000018e07a76 x1731746396805312/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.754327:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000018e07a76 with x1731746396805312 ext(0->1048575) 00002000:00010000:0.0:1651529419.754328:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000018e07a76 00000100:00100000:0.0:1651529419.754340:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15925 00000100:00100000:0.0:1651529419.754342:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396805312:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.755095:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746396804672:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4567us (5047us total) trans 30064894858 rc 0/0 00000100:00100000:1.0:1651529419.755100:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15919 00002000:00100000:1.0:1651529419.755103:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9dd:0x0] (0->1048575) req@0000000080249b71 x1731746396804672/t30064894858(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.755107:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080249b71 with x1731746396804672 ext(0->1048575) 00002000:00010000:1.0:1651529419.755109:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080249b71 00000100:00100000:0.0:1651529419.756197:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746396804800:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5515us (5729us total) trans 30064894859 rc 0/0 00000100:00100000:0.0:1651529419.756203:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15920 00002000:00100000:0.0:1651529419.756224:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9de:0x0] (0->1048575) req@000000004fbbd270 x1731746396804800/t30064894859(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.756229:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004fbbd270 with x1731746396804800 ext(0->1048575) 00002000:00010000:0.0:1651529419.756232:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004fbbd270 00000100:00100000:0.0:1651529419.756852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.756863:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805568 00002000:00100000:0.0:1651529419.756876:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9e4:0x0] (0->1048575) req@0000000039c89c54 x1731746396805568/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.756880:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000039c89c54 with x1731746396805568 ext(0->1048575) 00002000:00010000:0.0:1651529419.756881:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000039c89c54 00000100:00100000:0.0:1651529419.756893:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15926 00000100:00100000:0.0:1651529419.756919:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41279:x1731746396805568:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.757606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.757637:0:132211:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805632 00002000:00100000:1.0:1651529419.757658:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9e5:0x0] (0->1048575) req@0000000021498c6d x1731746396805632/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.757667:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021498c6d with x1731746396805632 ext(0->1048575) 00002000:00010000:1.0:1651529419.757670:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000021498c6d 00000100:00100000:1.0:1651529419.757684:0:132211:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15927 00000100:00100000:1.0:1651529419.757688:0:132211:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396805632:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.758622:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396805056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7520us (7574us total) trans 30064894860 rc 0/0 00000100:00100000:1.0:1651529419.758627:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15921 00002000:00100000:1.0:1651529419.758631:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9cf:0x0] (0->2097151) req@00000000d4277c50 x1731746396805056/t30064894860(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.758639:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4277c50 with x1731746396805056 ext(0->2097151) 00002000:00010000:1.0:1651529419.758641:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4277c50 00000100:00100000:1.0:1651529419.760040:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396805184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7680us (7895us total) trans 30064894861 rc 0/0 00000100:00100000:1.0:1651529419.760045:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15922 00002000:00100000:1.0:1651529419.760051:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e1:0x0] (0->1048575) req@0000000062ba7e7d x1731746396805184/t30064894861(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.760055:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000062ba7e7d with x1731746396805184 ext(0->1048575) 00002000:00010000:1.0:1651529419.760057:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062ba7e7d 00000100:00100000:1.0:1651529419.761123:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396805120:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8587us (8954us total) trans 30064894862 rc 0/0 00000100:00100000:1.0:1651529419.761128:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15923 00002000:00100000:1.0:1651529419.761131:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9e0:0x0] (0->1048575) req@00000000978de632 x1731746396805120/t30064894862(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.761135:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000978de632 with x1731746396805120 ext(0->1048575) 00002000:00010000:1.0:1651529419.761137:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000978de632 00000100:00100000:0.0:1651529419.761216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.761230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.761242:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805824 00002000:00100000:1.0:1651529419.761256:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e6:0x0] (0->1048575) req@0000000081f2c15e x1731746396805824/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.761260:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000081f2c15e with x1731746396805824 ext(0->1048575) 00002000:00010000:1.0:1651529419.761261:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000081f2c15e 00000100:00100000:1.0:1651529419.761269:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805952 00002000:00100000:1.0:1651529419.761273:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e7:0x0] (0->1048575) req@00000000a9ee32db x1731746396805952/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.761279:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9ee32db with x1731746396805952 ext(0->1048575) 00002000:00010000:1.0:1651529419.761281:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9ee32db 00000100:00100000:1.0:1651529419.761286:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15928 00000100:00100000:1.0:1651529419.761288:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396805824:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.761457:0:127530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15929 00000100:00100000:1.0:1651529419.761459:0:127530:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41279:x1731746396805952:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.761557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.761642:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806144 00002000:00100000:1.0:1651529419.761649:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9d9:0x0] (0->1048575) req@00000000f685b181 x1731746396806144/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.761653:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f685b181 with x1731746396806144 ext(0->1048575) 00002000:00010000:1.0:1651529419.761654:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f685b181 00000100:00100000:1.0:1651529419.761660:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15930 00000100:00100000:1.0:1651529419.761662:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746396806144:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.761868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.761895:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806208 00002000:00100000:0.0:1651529419.761905:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9e9:0x0] (0->1048575) req@0000000051b6a45c x1731746396806208/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.761910:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051b6a45c with x1731746396806208 ext(0->1048575) 00002000:00010000:0.0:1651529419.761912:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000051b6a45c 00000100:00100000:0.0:1651529419.761921:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15931 00000100:00100000:0.0:1651529419.761923:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746396806208:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.762396:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41279:x1731746396805248:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9330us (9385us total) trans 30064894863 rc 0/0 00000100:00100000:1.0:1651529419.762400:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15924 00002000:00100000:1.0:1651529419.762403:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9d6:0x0] (0->1048575) req@00000000cf518e04 x1731746396805248/t30064894863(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.762406:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf518e04 with x1731746396805248 ext(0->1048575) 00002000:00010000:1.0:1651529419.762409:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cf518e04 00000100:00100000:0.0:1651529419.763530:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746396805312:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9160us (9205us total) trans 30064894864 rc 0/0 00000100:00100000:0.0:1651529419.763537:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15925 00002000:00100000:0.0:1651529419.763542:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9e3:0x0] (0->1048575) req@0000000018e07a76 x1731746396805312/t30064894864(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.763570:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000018e07a76 with x1731746396805312 ext(0->1048575) 00002000:00010000:0.0:1651529419.763573:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000018e07a76 00000100:00100000:0.0:1651529419.765219:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41279:x1731746396805568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8321us (8366us total) trans 30064894865 rc 0/0 00000100:00100000:0.0:1651529419.765225:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15926 00002000:00100000:0.0:1651529419.765231:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9e4:0x0] (0->1048575) req@0000000039c89c54 x1731746396805568/t30064894865(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.765236:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000039c89c54 with x1731746396805568 ext(0->1048575) 00002000:00010000:0.0:1651529419.765238:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000039c89c54 00000100:00100000:0.0:1651529419.765358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.765428:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806336 00002000:00100000:0.0:1651529419.765443:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9d2:0x0] (0->2097151) req@00000000622c21ca x1731746396806336/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.765447:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000622c21ca with x1731746396806336 ext(0->2097151) 00002000:00010000:0.0:1651529419.765449:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000622c21ca 00000100:00100000:0.0:1651529419.765457:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15932 00000100:00100000:0.0:1651529419.765459:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746396806336:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.765514:0:132211:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396805632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7824us (7906us total) trans 30064894866 rc 0/0 00000100:00100000:1.0:1651529419.765534:0:132211:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15927 00002000:00100000:1.0:1651529419.765540:0:132211:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x2b9e5:0x0] (0->1048575) req@0000000021498c6d x1731746396805632/t30064894866(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.765546:0:132211:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021498c6d with x1731746396805632 ext(0->1048575) 00002000:00010000:1.0:1651529419.765550:0:132211:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000021498c6d 00000100:00100000:1.0:1651529419.766588:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746396805824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5298us (5371us total) trans 30064894867 rc 0/0 00000100:00100000:1.0:1651529419.766592:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15928 00002000:00100000:1.0:1651529419.766596:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9e6:0x0] (0->1048575) req@0000000081f2c15e x1731746396805824/t30064894867(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.766600:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000081f2c15e with x1731746396805824 ext(0->1048575) 00000100:00100000:0.0:1651529419.766610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:1.0:1651529419.766611:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000081f2c15e 00000100:00100000:1.0:1651529419.766625:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806720 00002000:00100000:1.0:1651529419.766632:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9cc:0x0] (0->2097151) req@00000000d242d477 x1731746396806720/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.766636:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d242d477 with x1731746396806720 ext(0->2097151) 00002000:00010000:1.0:1651529419.766643:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d242d477 00000100:00100000:1.0:1651529419.766649:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15933 00000100:00100000:1.0:1651529419.766651:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746396806720:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.766681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.766729:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.767000:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806656 00002000:00100000:1.0:1651529419.767008:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9d3:0x0] (0->1048575) req@00000000f3bcca9b x1731746396806656/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.767012:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f3bcca9b with x1731746396806656 ext(0->1048575) 00002000:00010000:1.0:1651529419.767026:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f3bcca9b 00000100:00100000:1.0:1651529419.767033:0:127529:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806784 00002000:00100000:1.0:1651529419.767037:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9d4:0x0] (0->1048575) req@00000000f9a0ac54 x1731746396806784/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.767049:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9a0ac54 with x1731746396806784 ext(0->1048575) 00002000:00010000:1.0:1651529419.767050:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f9a0ac54 00000100:00100000:1.0:1651529419.767059:0:127529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15934 00000100:00100000:1.0:1651529419.767061:0:127529:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396806656:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.767144:0:144089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15935 00000100:00100000:0.0:1651529419.767147:0:144089:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396806784:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.767455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.767589:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806848 00002000:00100000:1.0:1651529419.767597:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9fc:0x0] (0->1048575) req@00000000e3f0d742 x1731746396806848/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.767601:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3f0d742 with x1731746396806848 ext(0->1048575) 00002000:00010000:1.0:1651529419.767603:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e3f0d742 00000100:00100000:1.0:1651529419.767609:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15936 00000100:00100000:1.0:1651529419.767610:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41278:x1731746396806848:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.768136:0:127530:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41279:x1731746396805952:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6675us (6905us total) trans 30064894868 rc 0/0 00000100:00100000:1.0:1651529419.768141:0:127530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15929 00002000:00100000:1.0:1651529419.768144:0:127530:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2b9e7:0x0] (0->1048575) req@00000000a9ee32db x1731746396805952/t30064894868(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.768147:0:127530:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9ee32db with x1731746396805952 ext(0->1048575) 00002000:00010000:1.0:1651529419.768149:0:127530:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9ee32db 00000100:00100000:1.0:1651529419.769091:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41278:x1731746396806144:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7425us (7531us total) trans 30064894869 rc 0/0 00000100:00100000:1.0:1651529419.769109:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15930 00002000:00100000:1.0:1651529419.769114:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9d9:0x0] (0->1048575) req@00000000f685b181 x1731746396806144/t30064894869(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.769118:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f685b181 with x1731746396806144 ext(0->1048575) 00002000:00010000:1.0:1651529419.769121:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f685b181 00000100:00100000:0.0:1651529419.770514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.770529:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806976 00000100:00100000:0.0:1651529419.770552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:1.0:1651529419.770559:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9d8:0x0] (0->1048575) req@00000000ff4a4558 x1731746396806976/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.770563:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff4a4558 with x1731746396806976 ext(0->1048575) 00002000:00010000:1.0:1651529419.770565:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ff4a4558 00000100:00100000:1.0:1651529419.770573:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806912 00002000:00100000:1.0:1651529419.770578:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9d7:0x0] (0->1048575) req@000000002ce3bc2c x1731746396806912/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.770581:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ce3bc2c with x1731746396806912 ext(0->1048575) 00002000:00010000:1.0:1651529419.770582:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ce3bc2c 00000100:00100000:1.0:1651529419.770587:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15937 00000100:00100000:1.0:1651529419.770590:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41278:x1731746396806976:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.770692:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746396806208:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8768us (8823us total) trans 30064894870 rc 0/0 00000100:00100000:0.0:1651529419.770708:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15931 00002000:00100000:0.0:1651529419.770711:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9e9:0x0] (0->1048575) req@0000000051b6a45c x1731746396806208/t30064894870(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.770716:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051b6a45c with x1731746396806208 ext(0->1048575) 00002000:00010000:0.0:1651529419.770718:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000051b6a45c 00000100:00100000:0.0:1651529419.770738:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15938 00000100:00100000:0.0:1651529419.770741:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396806912:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.772255:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396806336:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6789us (6892us total) trans 30064894871 rc 0/0 00000100:00100000:0.0:1651529419.772263:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15932 00002000:00100000:0.0:1651529419.772281:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2b9d2:0x0] (0->2097151) req@00000000622c21ca x1731746396806336/t30064894871(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.772288:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000622c21ca with x1731746396806336 ext(0->2097151) 00002000:00010000:0.0:1651529419.772292:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000622c21ca 00000100:00100000:0.0:1651529419.773006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.773077:0:141357:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807296 00002000:00100000:0.0:1651529419.773092:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2ba08:0x0] (0->1048575) req@0000000056934c87 x1731746396807296/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.773098:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000056934c87 with x1731746396807296 ext(0->1048575) 00002000:00010000:0.0:1651529419.773101:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000056934c87 00000100:00100000:0.0:1651529419.773148:0:141357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15939 00000100:00100000:0.0:1651529419.773152:0:141357:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396807296:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.774994:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41278:x1731746396806720:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8339us (8381us total) trans 30064894872 rc 0/0 00000100:00100000:1.0:1651529419.775000:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15933 00002000:00100000:1.0:1651529419.775007:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9cc:0x0] (0->2097151) req@00000000d242d477 x1731746396806720/t30064894872(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.775012:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d242d477 with x1731746396806720 ext(0->2097151) 00002000:00010000:1.0:1651529419.775026:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d242d477 00000100:00100000:0.0:1651529419.775075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.775092:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807360 00002000:00100000:1.0:1651529419.775103:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9dc:0x0] (0->1048575) req@0000000052921917 x1731746396807360/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.775107:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052921917 with x1731746396807360 ext(0->1048575) 00002000:00010000:1.0:1651529419.775109:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052921917 00000100:00100000:1.0:1651529419.775116:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15940 00000100:00100000:1.0:1651529419.775118:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41279:x1731746396807360:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.775980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.776027:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807616 00002000:00100000:1.0:1651529419.776055:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9d5:0x0] (0->1048575) req@00000000d7a26869 x1731746396807616/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.776059:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d7a26869 with x1731746396807616 ext(0->1048575) 00002000:00010000:1.0:1651529419.776061:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d7a26869 00000100:00100000:1.0:1651529419.776067:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15941 00000100:00100000:1.0:1651529419.776069:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41278:x1731746396807616:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.776278:0:127529:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41279:x1731746396806656:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9216us (9596us total) trans 30064894873 rc 0/0 00000100:00100000:1.0:1651529419.776282:0:127529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15934 00002000:00100000:1.0:1651529419.776285:0:127529:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2b9d3:0x0] (0->1048575) req@00000000f3bcca9b x1731746396806656/t30064894873(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.776289:0:127529:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f3bcca9b with x1731746396806656 ext(0->1048575) 00002000:00010000:1.0:1651529419.776290:0:127529:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f3bcca9b 00000100:00100000:0.0:1651529419.777343:0:144089:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41279:x1731746396806784:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10194us (10612us total) trans 30064894874 rc 0/0 00000100:00100000:0.0:1651529419.777350:0:144089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15935 00002000:00100000:0.0:1651529419.777356:0:144089:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x2b9d4:0x0] (0->1048575) req@00000000f9a0ac54 x1731746396806784/t30064894874(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.777363:0:144089:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9a0ac54 with x1731746396806784 ext(0->1048575) 00002000:00010000:0.0:1651529419.777366:0:144089:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f9a0ac54 00000100:00100000:0.0:1651529419.777490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.777501:0:144089:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807680 00002000:00100000:0.0:1651529419.777514:0:144089:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x2b9d0:0x0] (0->2097151) req@000000005f689d7a x1731746396807680/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.777520:0:144089:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f689d7a with x1731746396807680 ext(0->2097151) 00002000:00010000:0.0:1651529419.777523:0:144089:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005f689d7a 00000100:00100000:0.0:1651529419.777537:0:144089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15942 00000100:00100000:0.0:1651529419.777540:0:144089:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41278:x1731746396807680:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.778303:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41278:x1731746396806848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10690us (10848us total) trans 30064894875 rc 0/0 00000100:00100000:1.0:1651529419.778310:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15936 00002000:00100000:1.0:1651529419.778313:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9fc:0x0] (0->1048575) req@00000000e3f0d742 x1731746396806848/t30064894875(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.778317:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3f0d742 with x1731746396806848 ext(0->1048575) 00002000:00010000:1.0:1651529419.778319:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e3f0d742 00000100:00100000:1.0:1651529419.778616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.778624:0:144084:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807808 00002000:00100000:1.0:1651529419.778632:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9d1:0x0] (0->2097151) req@0000000095fdfa67 x1731746396807808/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.778636:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095fdfa67 with x1731746396807808 ext(0->2097151) 00002000:00010000:1.0:1651529419.778637:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095fdfa67 00000100:00100000:1.0:1651529419.778643:0:144084:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15943 00000100:00100000:1.0:1651529419.778645:0:144084:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396807808:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.779140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.779151:0:144087:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807936 00002000:00100000:0.0:1651529419.779160:0:144087:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x2b9f6:0x0] (0->1048575) req@00000000c5f5c711 x1731746396807936/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.779167:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5f5c711 with x1731746396807936 ext(0->1048575) 00002000:00010000:0.0:1651529419.779169:0:144087:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5f5c711 00000100:00100000:0.0:1651529419.779182:0:144087:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15944 00000100:00100000:0.0:1651529419.779184:0:144087:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41278:x1731746396807936:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.779249:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41278:x1731746396806976:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8658us (8751us total) trans 30064894876 rc 0/0 00000100:00100000:1.0:1651529419.779253:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15937 00002000:00100000:1.0:1651529419.779256:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9d8:0x0] (0->1048575) req@00000000ff4a4558 x1731746396806976/t30064894876(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.779259:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff4a4558 with x1731746396806976 ext(0->1048575) 00002000:00010000:1.0:1651529419.779261:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ff4a4558 00000100:00100000:0.0:1651529419.780575:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41278:x1731746396806912:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9831us (10021us total) trans 30064894877 rc 0/0 00000100:00100000:0.0:1651529419.780582:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15938 00002000:00100000:0.0:1651529419.780587:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9d7:0x0] (0->1048575) req@000000002ce3bc2c x1731746396806912/t30064894877(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.780591:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ce3bc2c with x1731746396806912 ext(0->1048575) 00002000:00010000:0.0:1651529419.780594:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ce3bc2c 00000100:00100000:1.0:1651529419.780906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.781048:0:144085:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808064 00002000:00100000:0.0:1651529419.781074:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9cd:0x0] (0->2097151) req@00000000abd26db6 x1731746396808064/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.781089:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abd26db6 with x1731746396808064 ext(0->2097151) 00002000:00010000:0.0:1651529419.781090:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abd26db6 00000100:00100000:0.0:1651529419.781103:0:144085:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15945 00000100:00100000:0.0:1651529419.781105:0:144085:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41278:x1731746396808064:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.781424:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396802944:12345-10.240.43.64@tcp:4:dd.0 Request processed in 46960us (47076us total) trans 30064894844 rc 0/0 00000100:00100000:1.0:1651529419.781432:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15905 00002000:00100000:1.0:1651529419.781436:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9ff:0x0] (0->1048575) req@00000000628382ce x1731746396802944/t30064894844(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.781440:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000628382ce with x1731746396802944 ext(0->1048575) 00002000:00010000:1.0:1651529419.781443:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000628382ce 00000100:00100000:0.0:1651529419.781955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.782096:0:127531:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808192 00002000:00100000:1.0:1651529419.782111:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9cb:0x0] (0->2097151) req@00000000dd23a90b x1731746396808192/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.782116:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd23a90b with x1731746396808192 ext(0->2097151) 00002000:00010000:1.0:1651529419.782119:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd23a90b 00000100:00100000:1.0:1651529419.782127:0:127531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15946 00000100:00100000:1.0:1651529419.782137:0:127531:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41278:x1731746396808192:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.783209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.783495:0:144086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808320 00002000:00100000:1.0:1651529419.783512:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9ca:0x0] (0->2097151) req@00000000907f6ae6 x1731746396808320/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.783519:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000907f6ae6 with x1731746396808320 ext(0->2097151) 00002000:00010000:1.0:1651529419.783522:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000907f6ae6 00000100:00100000:1.0:1651529419.783533:0:144086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15947 00000100:00100000:1.0:1651529419.783536:0:144086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41279:x1731746396808320:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.784217:0:144089:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41278:x1731746396807680:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6675us (6727us total) trans 30064894881 rc 0/0 00000100:00100000:0.0:1651529419.784222:0:144089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15942 00002000:00100000:0.0:1651529419.784226:0:144089:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x2b9d0:0x0] (0->2097151) req@000000005f689d7a x1731746396807680/t30064894881(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.784231:0:144089:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f689d7a with x1731746396807680 ext(0->2097151) 00002000:00010000:0.0:1651529419.784233:0:144089:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005f689d7a 00000100:00100000:1.0:1651529419.786646:0:144084:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41279:x1731746396807808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7996us (8026us total) trans 30064894882 rc 0/0 00000100:00100000:1.0:1651529419.786653:0:144084:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15943 00002000:00100000:1.0:1651529419.786659:0:144084:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x2b9d1:0x0] (0->2097151) req@0000000095fdfa67 x1731746396807808/t30064894882(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.786665:0:144084:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095fdfa67 with x1731746396807808 ext(0->2097151) 00002000:00010000:1.0:1651529419.786668:0:144084:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095fdfa67 00000100:00100000:0.0:1651529419.787973:0:144087:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41278:x1731746396807936:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8787us (8834us total) trans 30064894883 rc 0/0 00000100:00100000:0.0:1651529419.787981:0:144087:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15944 00002000:00100000:0.0:1651529419.787984:0:144087:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x2b9f6:0x0] (0->1048575) req@00000000c5f5c711 x1731746396807936/t30064894883(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.787988:0:144087:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5f5c711 with x1731746396807936 ext(0->1048575) 00002000:00010000:0.0:1651529419.787990:0:144087:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5f5c711 00000100:00100000:0.0:1651529419.789709:0:144085:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746396808064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8602us (8803us total) trans 30064894884 rc 0/0 00000100:00100000:0.0:1651529419.789714:0:144085:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15945 00002000:00100000:0.0:1651529419.789717:0:144085:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x2b9cd:0x0] (0->2097151) req@00000000abd26db6 x1731746396808064/t30064894884(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.789721:0:144085:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abd26db6 with x1731746396808064 ext(0->2097151) 00002000:00010000:0.0:1651529419.789722:0:144085:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abd26db6 00000100:00100000:0.0:1651529419.792172:0:127531:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+309:41278:x1731746396808192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10041us (10216us total) trans 30064894885 rc 0/0 00000100:00100000:0.0:1651529419.792177:0:127531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15946 00002000:00100000:0.0:1651529419.792181:0:127531:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2b9cb:0x0] (0->2097151) req@00000000dd23a90b x1731746396808192/t30064894885(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.792184:0:127531:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd23a90b with x1731746396808192 ext(0->2097151) 00002000:00010000:0.0:1651529419.792186:0:127531:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd23a90b 00000100:00100000:1.0:1651529419.794409:0:144086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396808320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10871us (11200us total) trans 30064894886 rc 0/0 00000100:00100000:1.0:1651529419.794414:0:144086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15947 00002000:00100000:1.0:1651529419.794418:0:144086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x2b9ca:0x0] (0->2097151) req@00000000907f6ae6 x1731746396808320/t30064894886(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.794423:0:144086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000907f6ae6 with x1731746396808320 ext(0->2097151) 00002000:00010000:1.0:1651529419.794425:0:144086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000907f6ae6 00000100:00100000:0.0:1651529419.795137:0:141357:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396807296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 21984us (22132us total) trans 30064894878 rc 0/0 00000100:00100000:0.0:1651529419.795143:0:141357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15939 00002000:00100000:0.0:1651529419.795147:0:141357:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x2ba08:0x0] (0->1048575) req@0000000056934c87 x1731746396807296/t30064894878(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.795157:0:141357:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000056934c87 with x1731746396807296 ext(0->1048575) 00002000:00010000:0.0:1651529419.795160:0:141357:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000056934c87 00000100:00100000:1.0:1651529419.795877:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396807360:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20757us (20803us total) trans 30064894879 rc 0/0 00000100:00100000:1.0:1651529419.795881:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15940 00002000:00100000:1.0:1651529419.795884:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2b9dc:0x0] (0->1048575) req@0000000052921917 x1731746396807360/t30064894879(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.795887:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052921917 with x1731746396807360 ext(0->1048575) 00002000:00010000:1.0:1651529419.795889:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052921917 00000100:00100000:1.0:1651529419.796611:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41278:x1731746396807616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 20541us (20632us total) trans 30064894880 rc 0/0 00000100:00100000:1.0:1651529419.796615:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15941 00002000:00100000:1.0:1651529419.796618:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2b9d5:0x0] (0->1048575) req@00000000d7a26869 x1731746396807616/t30064894880(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.796621:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d7a26869 with x1731746396807616 ext(0->1048575) 00002000:00010000:1.0:1651529419.796622:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d7a26869 00000100:00100000:1.0:1651529419.926235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.926266:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809216 00000100:00100000:0.0:1651529419.926289:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153986 00000100:00100000:0.0:1651529419.926292:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809216:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.926337:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809216:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 44us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.926340:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153986 00000100:00100000:1.0:1651529419.926816:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.926839:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809344 00000100:00100000:0.0:1651529419.926851:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153987 00000100:00100000:0.0:1651529419.926853:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dd40c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809344:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.926874:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dd40c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809344:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.926877:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153987 00000100:00100000:1.0:1651529419.927343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.927365:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809472 00000100:00100000:0.0:1651529419.927377:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153988 00000100:00100000:0.0:1651529419.927379:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809472:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.927398:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809472:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.927401:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153988 00000100:00100000:1.0:1651529419.927833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.927854:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809600 00000100:00100000:0.0:1651529419.927867:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153989 00000100:00100000:0.0:1651529419.927869:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809600:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.927889:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809600:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.927892:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153989 00000100:00100000:1.0:1651529419.928298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.928319:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809728 00000100:00100000:0.0:1651529419.928331:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153990 00000100:00100000:0.0:1651529419.928332:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809728:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.928352:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809728:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.928355:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153990 00000100:00100000:1.0:1651529419.928763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.928790:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809856 00000100:00100000:0.0:1651529419.928802:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153991 00000100:00100000:0.0:1651529419.928813:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809856:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.928833:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809856:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.928836:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153991 00000100:00100000:1.0:1651529419.929244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.929265:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809984 00000100:00100000:0.0:1651529419.929277:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153992 00000100:00100000:0.0:1651529419.929279:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809984:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.929298:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396809984:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.929300:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153992 00000100:00100000:1.0:1651529419.929697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.929718:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810112 00000100:00100000:0.0:1651529419.929729:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153993 00000100:00100000:0.0:1651529419.929731:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810112:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.929750:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810112:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.929752:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153993 00000100:00100000:1.0:1651529419.930165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.930187:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810240 00000100:00100000:0.0:1651529419.930198:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153994 00000100:00100000:0.0:1651529419.930200:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810240:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.930219:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810240:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.930221:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153994 00000100:00100000:1.0:1651529419.930611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.930633:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810368 00000100:00100000:0.0:1651529419.930645:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153995 00000100:00100000:0.0:1651529419.930646:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810368:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.930665:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810368:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.930667:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153995 00000100:00100000:1.0:1651529419.931091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.931113:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810496 00000100:00100000:0.0:1651529419.931125:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153996 00000100:00100000:0.0:1651529419.931126:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810496:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.931145:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810496:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.931148:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153996 00000100:00100000:1.0:1651529419.931553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.931579:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810624 00000100:00100000:0.0:1651529419.931590:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153997 00000100:00100000:0.0:1651529419.931592:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810624:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.931620:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810624:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 27us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.931623:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153997 00000100:00100000:1.0:1651529419.932035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.932057:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810752 00000100:00100000:0.0:1651529419.932068:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153998 00000100:00100000:0.0:1651529419.932070:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810752:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.932089:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810752:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.932091:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153998 00000100:00100000:1.0:1651529419.932482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.932504:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810880 00000100:00100000:0.0:1651529419.932515:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153999 00000100:00100000:0.0:1651529419.932517:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810880:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.932536:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396810880:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.932539:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153999 00000100:00100000:1.0:1651529419.932938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.932960:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811008 00000100:00100000:0.0:1651529419.932972:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154000 00000100:00100000:0.0:1651529419.932974:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811008:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.932992:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811008:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.932995:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154000 00000100:00100000:1.0:1651529419.933397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.933418:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811136 00000100:00100000:0.0:1651529419.933429:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154001 00000100:00100000:0.0:1651529419.933431:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811136:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.933457:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811136:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.933459:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154001 00000100:00100000:1.0:1651529419.933871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.933893:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811264 00000100:00100000:0.0:1651529419.933904:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154002 00000100:00100000:0.0:1651529419.933906:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811264:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.933925:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811264:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.933928:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154002 00000100:00100000:1.0:1651529419.934331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.934353:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811392 00000100:00100000:0.0:1651529419.934364:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154003 00000100:00100000:0.0:1651529419.934366:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbf1080b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811392:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.934384:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbf1080b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811392:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.934387:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154003 00000100:00100000:1.0:1651529419.935005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.935026:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811584 00000100:00100000:0.0:1651529419.935038:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154004 00000100:00100000:0.0:1651529419.935039:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811584:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.935058:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811584:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.935061:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154004 00000100:00100000:1.0:1651529419.935465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.935486:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811712 00000100:00100000:0.0:1651529419.935498:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154005 00000100:00100000:0.0:1651529419.935500:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811712:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.935525:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811712:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.935528:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154005 00000100:00100000:1.0:1651529419.935919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.935940:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811840 00000100:00100000:0.0:1651529419.935951:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154006 00000100:00100000:0.0:1651529419.935953:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811840:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.935971:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811840:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.935974:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154006 00000100:00100000:1.0:1651529419.936382:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.936404:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811968 00000100:00100000:0.0:1651529419.936415:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154007 00000100:00100000:0.0:1651529419.936417:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ef3dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811968:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.936436:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ef3dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396811968:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.936438:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154007 00000100:00100000:1.0:1651529419.936891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.936910:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812096 00000100:00100000:0.0:1651529419.936923:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154008 00000100:00100000:0.0:1651529419.936924:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812096:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.936943:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812096:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.936946:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154008 00000100:00100000:1.0:1651529419.937354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.937371:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812224 00000100:00100000:0.0:1651529419.937384:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154009 00000100:00100000:0.0:1651529419.937386:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812224:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.937411:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812224:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 25us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.937414:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154009 00000100:00100000:1.0:1651529419.937851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.937868:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812352 00000100:00100000:0.0:1651529419.937881:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154010 00000100:00100000:0.0:1651529419.937883:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812352:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.937901:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812352:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.937904:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154010 00000100:00100000:1.0:1651529419.938313:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.938330:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812480 00000100:00100000:0.0:1651529419.938342:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154011 00000100:00100000:0.0:1651529419.938344:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041385506 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812480:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.938363:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041385506 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812480:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.938365:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154011 00000100:00100000:1.0:1651529419.938762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.938787:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812608 00000100:00100000:0.0:1651529419.938799:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154012 00000100:00100000:0.0:1651529419.938800:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812608:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.938828:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812608:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 26us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.938831:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154012 00000100:00100000:1.0:1651529419.939236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.939253:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812736 00000100:00100000:0.0:1651529419.939265:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154013 00000100:00100000:0.0:1651529419.939267:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812736:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.939286:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812736:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.939289:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154013 00000100:00100000:1.0:1651529419.939672:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.939689:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812864 00000100:00100000:0.0:1651529419.939701:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154014 00000100:00100000:0.0:1651529419.939703:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812864:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.939721:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812864:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.939724:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154014 00000100:00100000:1.0:1651529419.940126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.940144:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812992 00000100:00100000:0.0:1651529419.940156:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154015 00000100:00100000:0.0:1651529419.940157:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000056f5674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812992:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.940176:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000056f5674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396812992:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.940179:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154015 00000100:00100000:1.0:1651529419.940563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.940580:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813120 00000100:00100000:0.0:1651529419.940593:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154016 00000100:00100000:0.0:1651529419.940595:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813120:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.940613:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813120:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.940616:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154016 00000100:00100000:1.0:1651529419.941016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.941026:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813248 00000100:00100000:0.0:1651529419.941038:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154017 00000100:00100000:0.0:1651529419.941040:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813248:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.941058:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813248:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.941061:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154017 00000100:00100000:1.0:1651529419.941456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.941472:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813376 00000100:00100000:0.0:1651529419.941484:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154018 00000100:00100000:0.0:1651529419.941486:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813376:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.941504:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813376:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (49us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.941507:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154018 00000100:00100000:1.0:1651529419.941910:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.941932:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813504 00000100:00100000:0.0:1651529419.941943:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154019 00000100:00100000:0.0:1651529419.941945:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ed9bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813504:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.941964:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ed9bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813504:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.941966:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154019 00000100:00100000:1.0:1651529419.942364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.942385:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813632 00000100:00100000:0.0:1651529419.942397:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154020 00000100:00100000:0.0:1651529419.942399:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813632:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.942417:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813632:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.942420:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154020 00000100:00100000:1.0:1651529419.942843:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.942865:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813760 00000100:00100000:0.0:1651529419.942876:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154021 00000100:00100000:0.0:1651529419.942878:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813760:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.942897:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813760:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.942899:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154021 00000100:00100000:1.0:1651529419.943287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.943308:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813888 00000100:00100000:0.0:1651529419.943320:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154022 00000100:00100000:0.0:1651529419.943321:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813888:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.943340:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396813888:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.943342:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154022 00000100:00100000:1.0:1651529419.943734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.943755:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814016 00000100:00100000:0.0:1651529419.943766:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154023 00000100:00100000:0.0:1651529419.943768:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814016:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.943794:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814016:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.943797:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154023 00000100:00100000:1.0:1651529419.944212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.944229:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814144 00000100:00100000:0.0:1651529419.944242:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154024 00000100:00100000:0.0:1651529419.944243:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814144:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.944262:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814144:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.944265:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154024 00000100:00100000:1.0:1651529419.944654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.944670:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814272 00000100:00100000:0.0:1651529419.944683:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154025 00000100:00100000:0.0:1651529419.944685:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814272:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.944703:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814272:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.944706:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154025 00000100:00100000:1.0:1651529419.945098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.945120:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814400 00000100:00100000:0.0:1651529419.945132:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154026 00000100:00100000:0.0:1651529419.945133:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814400:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.945152:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814400:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.945155:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154026 00000100:00100000:1.0:1651529419.945534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.945555:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814528 00000100:00100000:0.0:1651529419.945567:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154027 00000100:00100000:0.0:1651529419.945568:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814528:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.945587:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814528:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.945590:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154027 00000100:00100000:1.0:1651529419.945996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.946018:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814656 00000100:00100000:0.0:1651529419.946029:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154028 00000100:00100000:0.0:1651529419.946031:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814656:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.946049:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814656:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.946052:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154028 00000100:00100000:1.0:1651529419.946467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.946488:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814784 00000100:00100000:0.0:1651529419.946500:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154029 00000100:00100000:0.0:1651529419.946501:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814784:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.946520:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814784:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.946523:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154029 00000100:00100000:1.0:1651529419.946920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.946941:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814912 00000100:00100000:0.0:1651529419.946952:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154030 00000100:00100000:0.0:1651529419.946954:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814912:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.946973:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396814912:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.946976:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154030 00000100:00100000:1.0:1651529419.947366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.947388:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815040 00000100:00100000:0.0:1651529419.947399:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154031 00000100:00100000:0.0:1651529419.947401:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf61e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815040:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.947419:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf61e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815040:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.947422:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154031 00000100:00100000:1.0:1651529419.947825:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.947847:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815168 00000100:00100000:0.0:1651529419.947858:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154032 00000100:00100000:0.0:1651529419.947860:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815168:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.947879:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815168:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.947882:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154032 00000100:00100000:1.0:1651529419.948281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.948302:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815296 00000100:00100000:0.0:1651529419.948313:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154033 00000100:00100000:0.0:1651529419.948315:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815296:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.948334:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815296:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.948336:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154033 00000100:00100000:1.0:1651529419.948718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.948745:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815424 00000100:00100000:0.0:1651529419.948756:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154034 00000100:00100000:0.0:1651529419.948758:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815424:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.948785:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815424:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 27us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.948788:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154034 00000100:00100000:1.0:1651529419.949194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.949216:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815552 00000100:00100000:0.0:1651529419.949227:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154035 00000100:00100000:0.0:1651529419.949229:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b8765e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815552:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.949248:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b8765e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815552:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.949250:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154035 00000100:00100000:1.0:1651529419.949633:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.949654:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815680 00000100:00100000:0.0:1651529419.949666:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154036 00000100:00100000:0.0:1651529419.949668:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815680:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.949686:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815680:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.949689:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154036 00000100:00100000:1.0:1651529419.950106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.950128:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815808 00000100:00100000:0.0:1651529419.950139:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154037 00000100:00100000:0.0:1651529419.950141:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815808:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.950160:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815808:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.950163:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154037 00000100:00100000:1.0:1651529419.950546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.950567:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815936 00000100:00100000:0.0:1651529419.950578:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154038 00000100:00100000:0.0:1651529419.950580:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815936:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.950599:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396815936:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.950601:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154038 00000100:00100000:1.0:1651529419.951009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.951031:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816064 00000100:00100000:0.0:1651529419.951042:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154039 00000100:00100000:0.0:1651529419.951044:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf9f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816064:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.951063:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf9f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816064:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.951066:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154039 00000100:00100000:1.0:1651529419.951459:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.951481:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816192 00000100:00100000:0.0:1651529419.951492:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154040 00000100:00100000:0.0:1651529419.951494:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816192:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.951512:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816192:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.951515:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154040 00000100:00100000:1.0:1651529419.951917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.951938:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816320 00000100:00100000:0.0:1651529419.951949:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154041 00000100:00100000:0.0:1651529419.951951:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816320:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.951970:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816320:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.951972:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154041 00000100:00100000:1.0:1651529419.952354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.952375:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816448 00000100:00100000:0.0:1651529419.952387:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154042 00000100:00100000:0.0:1651529419.952388:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816448:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.952407:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816448:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.952410:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154042 00000100:00100000:1.0:1651529419.952802:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.952835:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816576 00000100:00100000:0.0:1651529419.952846:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154043 00000100:00100000:0.0:1651529419.952847:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d66e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816576:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.952866:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d66e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816576:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.952869:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154043 00000100:00100000:1.0:1651529419.953257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.953278:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816704 00000100:00100000:0.0:1651529419.953289:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154044 00000100:00100000:0.0:1651529419.953291:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816704:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.953310:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816704:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.953313:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154044 00000100:00100000:1.0:1651529419.953719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.953740:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816832 00000100:00100000:0.0:1651529419.953751:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154045 00000100:00100000:0.0:1651529419.953753:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816832:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.953772:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816832:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.953782:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154045 00000100:00100000:1.0:1651529419.954169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.954190:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816960 00000100:00100000:0.0:1651529419.954202:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154046 00000100:00100000:0.0:1651529419.954203:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816960:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.954222:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396816960:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.954225:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154046 00000100:00100000:1.0:1651529419.954611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.954632:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817088 00000100:00100000:0.0:1651529419.954643:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154047 00000100:00100000:0.0:1651529419.954645:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b87f7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817088:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.954664:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b87f7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817088:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.954667:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154047 00000100:00100000:1.0:1651529419.955076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.955098:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817216 00000100:00100000:0.0:1651529419.955109:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154048 00000100:00100000:0.0:1651529419.955111:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817216:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.955130:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817216:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.955132:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154048 00000100:00100000:1.0:1651529419.955532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.955553:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817344 00000100:00100000:0.0:1651529419.955564:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154049 00000100:00100000:0.0:1651529419.955566:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817344:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.955584:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817344:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.955587:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154049 00000100:00100000:1.0:1651529419.955979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.956000:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817472 00000100:00100000:0.0:1651529419.956012:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154050 00000100:00100000:0.0:1651529419.956013:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817472:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.956032:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396817472:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.956035:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154050 00000100:00100000:1.0:1651529419.959919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.959941:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818688 00000100:00100000:0.0:1651529419.959953:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154051 00000100:00100000:0.0:1651529419.959954:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb97afa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818688:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.959973:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb97afa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818688:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.959976:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154051 00000100:00100000:1.0:1651529419.960387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.960409:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818816 00000100:00100000:0.0:1651529419.960420:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154052 00000100:00100000:0.0:1651529419.960422:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818816:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.960441:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818816:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.960443:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154052 00000100:00100000:1.0:1651529419.960849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.960871:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818944 00000100:00100000:0.0:1651529419.960882:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154053 00000100:00100000:0.0:1651529419.960884:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818944:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.960902:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396818944:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.960905:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154053 00000100:00100000:1.0:1651529419.961301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.961322:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819072 00000100:00100000:0.0:1651529419.961334:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154054 00000100:00100000:0.0:1651529419.961335:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819072:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.961354:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819072:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.961357:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154054 00000100:00100000:1.0:1651529419.961747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.961768:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819200 00000100:00100000:0.0:1651529419.961785:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154055 00000100:00100000:0.0:1651529419.961787:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbfdac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819200:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.961816:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbfdac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819200:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 28us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.961819:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154055 00000100:00100000:1.0:1651529419.962220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.962242:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819328 00000100:00100000:0.0:1651529419.962254:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154056 00000100:00100000:0.0:1651529419.962256:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819328:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.962274:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819328:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.962277:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154056 00000100:00100000:1.0:1651529419.962655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.962676:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819456 00000100:00100000:0.0:1651529419.962688:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154057 00000100:00100000:0.0:1651529419.962690:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819456:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.962709:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819456:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.962711:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154057 00000100:00100000:1.0:1651529419.963108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.963134:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819584 00000100:00100000:0.0:1651529419.963146:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154058 00000100:00100000:0.0:1651529419.963147:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819584:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.963166:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425326:x1731746396819584:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.963169:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154058 00000100:00100000:1.0:1651529421.024182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529421.024200:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599808 00000100:00100000:1.0:1651529421.024227:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 321 00000100:00100000:1.0:1651529421.024229:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946599808:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529421.024247:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 456165184 pending 97214464 free 81113563136 avail 76942852096 00000100:00100000:1.0:1651529421.024276:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946599808:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529421.024280:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 321 00000400:00000080:1.0:1651529422.473139:0:170151:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529422.473141:0:170151:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 22:10:20 (1651529420) 00000100:00100000:1.0:1651529422.499604:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529422.499636:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396820160 00000100:00100000:0.0:1651529422.499662:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154059 00000100:00100000:0.0:1651529422.499665:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:425917:x1731746396820160:12345-10.240.43.64@tcp:101:rwv.0 00010000:00010000:0.0:1651529422.499675:0:144527:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529422.499687:0:144527:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 2/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6e7 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529422.499699:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529422.499710:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529422.499711:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529422.499716:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 302 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529422.499725:0:144527:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 302 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529422.499730:0:144527:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c1ba0c6, rc 0) 00000100:00100000:0.0:1651529422.499755:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:425917:x1731746396820160:12345-10.240.43.64@tcp:101:rwv.0 Request processed in 89us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529422.499759:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154059 00000100:00100000:0.0:1651529423.350875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350982:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599872 00000100:00100000:0.0:1651529423.351001:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600000 00000100:00100000:0.0:1651529423.351005:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600128 00000100:00100000:0.0:1651529423.351009:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600256 00000100:00100000:0.0:1651529423.351011:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599936 00000100:00100000:0.0:1651529423.351013:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600064 00000100:00100000:0.0:1651529423.351015:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600192 00000100:00100000:0.0:1651529423.351018:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600320 00000100:00100000:0.0:1651529423.351022:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154060 00000100:00100000:0.0:1651529423.351024:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946599872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351041:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178625 count 1 00010000:00010000:0.0:1651529423.351055:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351065:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351069:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351070:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351071:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 4/0,1 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351086:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 3/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351092:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 4/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351098:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966716608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351126:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000003caa324a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351134:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154061 00000100:00100000:0.0:1651529423.351136:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351142:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178627 count 1 00010000:00010000:0.0:1651529423.351146:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351151:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351154:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351154:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351155:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 4/0,1 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351162:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 3/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351168:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 4/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351172:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009710ff6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966716672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351180:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007eea7909 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351187:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154062 00000100:00100000:0.0:1651529423.351188:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1696324 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351193:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178629 count 1 00010000:00010000:0.0:1651529423.351201:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351205:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351209:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351209:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351210:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 4/0,1 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351216:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 3/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351219:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 4/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351226:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a38c70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966716736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351234:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a002ed0c going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351240:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154063 00000100:00100000:0.0:1651529423.351242:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351246:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178631 count 1 00010000:00010000:0.0:1651529423.351250:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351254:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351257:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351258:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351258:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 4/0,1 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351264:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 3/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351268:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 4/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351271:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000555ca74e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966716800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351278:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 0000000019c585c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351284:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154064 00000100:00100000:0.0:1651529423.351286:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946599936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351290:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178626 count 1 00010000:00010000:0.0:1651529423.351294:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351298:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351300:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351301:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351301:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 4/0,1 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351307:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 3/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351310:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 4/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351314:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bc637d0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966716864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351321:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351327:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154065 00000100:00100000:0.0:1651529423.351329:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351333:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178628 count 1 00010000:00010000:0.0:1651529423.351336:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351343:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351346:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351346:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351347:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 4/0,1 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351353:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 3/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351356:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 4/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351360:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d446d583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966716928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351366:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351420:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154066 00000100:00100000:0.0:1651529423.351422:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351428:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178630 count 1 00010000:00010000:0.0:1651529423.351433:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351437:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351440:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351441:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351442:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 4/0,1 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351448:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 3/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351452:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 4/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351456:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966716992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351467:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000443c8663 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351473:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154067 00000100:00100000:0.0:1651529423.351475:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946600320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.351480:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178632 count 1 00010000:00010000:0.0:1651529423.351506:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351511:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351514:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351515:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.351516:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 4/0,1 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351522:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 3/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 301 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.351529:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 4/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.351533:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966717056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.351540:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000006e4ddc97 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.352109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.352120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.352129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.352137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.352143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.352144:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396820864 00000100:00100000:0.0:1651529423.352150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529423.352157:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 5/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 302 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.352157:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396820992 00010000:00010000:0.0:1651529423.352164:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 5/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 303 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.352167:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821120 00010000:00010000:1.0:1651529423.352170:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 5/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 304 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.352175:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396820928 00010000:00010000:1.0:1651529423.352178:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 5/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 305 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.352182:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821056 00010000:00010000:1.0:1651529423.352185:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 5/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 306 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.352186:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821184 00000100:00100000:1.0:1651529423.352190:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12740 00010000:00010000:0.0:1651529423.352191:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 5/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 307 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.352192:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396820864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.352197:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529423.352197:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12741 00010000:00010000:1.0:1651529423.352199:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 5/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 307 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.352199:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396820992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.352203:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.352204:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 4/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 307 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.352204:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 5/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 307 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352215:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352216:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352217:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352221:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 4/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 307 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352224:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 4/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352228:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352229:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352230:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.352231:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529423.352233:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 4/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352238:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.352251:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396820864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.352254:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12740 00000100:00100000:0.0:1651529423.352255:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746396820992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.352258:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12741 00000100:00100000:1.0:1651529423.352262:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12742 00000100:00100000:1.0:1651529423.352264:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396821120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529423.352265:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12743 00010000:00010000:1.0:1651529423.352266:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529423.352266:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396820928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.352268:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 5/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 305 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.352269:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.352271:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 5/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 305 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352272:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 4/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 305 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.352275:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 4/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 305 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352278:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352278:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352279:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352280:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352280:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352282:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 4/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.352286:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529423.352288:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.352292:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396821120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529423.352292:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 4/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352296:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.352303:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e554e9c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+305:41279:x1731746396820928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.352306:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12742 00000100:00100000:0.0:1651529423.352307:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12743 00000100:00100000:1.0:1651529423.352311:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12744 00000100:00100000:1.0:1651529423.352312:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396821056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.352315:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.352316:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 5/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 303 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352320:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 4/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 303 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.352325:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352326:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.352327:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.352330:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 4/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.352334:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.352340:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396821056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.352342:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12744 00000100:00100000:0.0:1651529423.352346:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12745 00000100:00100000:0.0:1651529423.352348:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396821184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.352351:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.352353:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 5/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 303 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.352357:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 4/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 302 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.352362:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352363:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352363:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352366:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 4/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352371:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.352385:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41279:x1731746396821184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.352388:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12745 00010000:00010000:0.0:1651529423.352404:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0c41 lrc: 0/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc26b expref: 301 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.352408:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bc637d0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966716864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.352413:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352417:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352420:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352423:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352426:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.352707:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946599936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1420us (1785us total) trans 30064894887 rc 0/0 00000100:00100000:0.0:1651529423.352710:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154064 00010000:00010000:0.0:1651529423.352722:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0c64 lrc: 0/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b1 expref: 300 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.352737:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000555ca74e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966716800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.352741:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352745:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352747:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352750:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352753:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.353006:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1763us (2094us total) trans 30064894888 rc 0/0 00000100:00100000:0.0:1651529423.353009:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154063 00010000:00010000:0.0:1651529423.353021:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0c4f lrc: 0/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc287 expref: 299 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.353025:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d446d583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966716928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.353029:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353041:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353044:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353047:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353049:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.353268:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1938us (2338us total) trans 30064894889 rc 0/0 00000100:00100000:0.0:1651529423.353271:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154065 00010000:00010000:0.0:1651529423.353280:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353283:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef1a6b78 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.353284:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353288:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 3/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353293:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 1/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353304:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0e5c lrc: 0/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353310:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353313:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a911e32 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.353313:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353316:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 3/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353319:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 1/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353322:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0e55 lrc: 0/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353325:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353328:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7e11adf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.353329:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353338:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 3/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353342:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 1/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353344:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0e63 lrc: 0/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353354:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0c48 lrc: 0/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc279 expref: 298 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.353358:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009710ff6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966716672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.353361:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353364:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353367:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353370:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353372:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.353588:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2450us (2699us total) trans 30064894890 rc 0/0 00000100:00100000:0.0:1651529423.353591:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154061 00010000:00010000:0.0:1651529423.353603:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0c56 lrc: 0/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc295 expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.353607:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a38c70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966716736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.353610:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353614:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353616:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353619:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353622:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.353861:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1696324 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2672us (2960us total) trans 30064894891 rc 0/0 00000100:00100000:0.0:1651529423.353864:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154062 00010000:00010000:0.0:1651529423.353884:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353888:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046b29c31 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.353889:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353892:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 3/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353897:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 1/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353900:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b29c31/0xa29a79078f3c0e47 lrc: 0/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353904:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353907:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab1f5fc1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.353908:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353910:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 3/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353913:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 1/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.353924:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab1f5fc1/0xa29a79078f3c0e4e lrc: 0/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.353962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.353974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.354014:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821312 00010000:00010000:0.0:1651529423.354020:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 5/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.354032:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821248 00010000:00010000:0.0:1651529423.354035:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 5/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 298 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.354043:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12746 00000100:00100000:0.0:1651529423.354045:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41278:x1731746396821312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.354048:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.354050:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 5/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 298 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.354070:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 4/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 298 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.354076:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.354077:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.354078:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354092:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 4/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354098:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.354122:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41278:x1731746396821312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.354125:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12746 00000100:00100000:0.0:1651529423.354130:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12747 00000100:00100000:0.0:1651529423.354132:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41278:x1731746396821248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.354135:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.354136:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 5/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.354140:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 4/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.354146:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.354146:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.354147:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354150:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 4/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354154:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.354159:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41278:x1731746396821248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.354170:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12747 00010000:00010000:0.0:1651529423.354195:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0c5d lrc: 0/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2a3 expref: 296 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.354199:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966716992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.354203:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354206:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354209:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354212:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354215:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.354447:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3024us (3511us total) trans 30064894892 rc 0/0 00000100:00100000:0.0:1651529423.354450:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154066 00010000:00010000:0.0:1651529423.354462:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0c6b lrc: 0/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2bf expref: 295 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.354478:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966717056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.354481:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354485:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354487:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354490:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354493:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.354704:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946600320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3228us (3760us total) trans 30064894893 rc 0/0 00000100:00100000:0.0:1651529423.354707:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154067 00010000:00010000:0.0:1651529423.354715:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354718:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc40bdc6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.354719:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354732:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 3/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354738:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 1/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354740:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc40bdc6/0xa29a79078f3c0e6a lrc: 0/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354745:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354748:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9e35b61 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.354748:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354751:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 3/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354754:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 1/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354757:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e35b61/0xa29a79078f3c0e71 lrc: 0/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.354791:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.354830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.354841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.354863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.354882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.354893:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0c3a lrc: 0/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc25d expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.354897:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966716608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.354901:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354904:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354907:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354910:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.354913:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.355149:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946599872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4124us (4277us total) trans 30064894894 rc 0/0 00000100:00100000:0.0:1651529423.355152:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154060 00000100:00100000:0.0:1651529423.355166:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600448 00000100:00100000:0.0:1651529423.355183:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600512 00000100:00100000:0.0:1651529423.355186:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600576 00000100:00100000:0.0:1651529423.355190:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600704 00000100:00100000:0.0:1651529423.355193:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600640 00000100:00100000:0.0:1651529423.355197:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154068 00000100:00100000:0.0:1651529423.355199:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946600448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355204:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178633 count 1 00010000:00010000:0.0:1651529423.355210:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355215:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355218:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355219:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355220:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 4/0,1 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355227:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 3/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355231:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 4/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355235:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077498c9a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966717120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355245:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000443c8663 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355252:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154069 00000100:00100000:0.0:1651529423.355253:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946600512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355260:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178634 count 1 00010000:00010000:0.0:1651529423.355263:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355268:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355271:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355271:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355272:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 4/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355278:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355281:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 4/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355285:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a74cd038 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966717184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355291:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a002ed0c going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355298:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154070 00000100:00100000:0.0:1651529423.355299:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946600576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355304:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178635 count 1 00010000:00010000:0.0:1651529423.355307:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355311:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355315:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355315:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355316:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 4/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355321:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355325:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 4/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355329:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9e74008 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966717248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355334:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000566d494c going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355340:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154071 00000100:00100000:0.0:1651529423.355342:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946600704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355347:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178637 count 1 00010000:00010000:0.0:1651529423.355350:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355354:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355357:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355357:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355358:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 4/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355366:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355370:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 4/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355374:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000546aedd9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966717312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355379:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf9c66a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.355384:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355387:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e763957b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.355388:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355391:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 3/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355395:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 1/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355398:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e763957b/0xa29a79078f3c0e40 lrc: 0/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.355413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.355440:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.355466:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600832 00000100:00100000:0.0:1651529423.355472:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600768 00000100:00100000:0.0:1651529423.355475:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154072 00000100:00100000:0.0:1651529423.355477:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946600640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355482:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178636 count 1 00010000:00010000:0.0:1651529423.355486:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355491:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355494:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355494:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355495:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 4/0,1 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355502:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 3/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355505:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 4/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355509:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966717376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355538:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355566:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154073 00000100:00100000:0.0:1651529423.355568:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946600832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355589:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178639 count 1 00010000:00010000:0.0:1651529423.355594:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355599:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355602:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355603:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 4/0,1 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355610:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 3/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355613:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 4/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355617:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007aa9f6c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966717440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355628:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd95dbf0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.355665:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600896 00000100:00100000:0.0:1651529423.355672:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154074 00000100:00100000:0.0:1651529423.355674:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946600768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355678:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178638 count 1 00010000:00010000:0.0:1651529423.355683:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355687:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355691:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355691:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355692:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 4/0,1 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355699:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 3/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355702:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 4/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355706:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966717504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355716:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d7c4220 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.355742:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154075 00000100:00100000:0.0:1651529423.355744:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946600896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.355749:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178640 count 1 00010000:00010000:0.0:1651529423.355754:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355758:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355761:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355762:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.355762:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 4/0,1 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355772:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 3/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.355775:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 4/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.355790:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966717568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.355800:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.356064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.356075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.356084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.356091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.356100:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9e74008 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966717248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.356105:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.356112:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a74cd038 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966717184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.356115:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.356121:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000546aedd9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966717312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.356123:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.356132:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821376 00010000:00010000:0.0:1651529423.356138:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 5/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.356144:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821504 00010000:00010000:0.0:1651529423.356146:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 4/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 295 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.356150:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821440 00010000:00010000:0.0:1651529423.356152:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 4/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 296 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.356156:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821568 00010000:00010000:0.0:1651529423.356158:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 4/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.356163:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12748 00000100:00100000:0.0:1651529423.356164:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41279:x1731746396821376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.356167:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.356168:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 5/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356172:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 4/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 297 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356178:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356179:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356180:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356183:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 4/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356188:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.356225:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41279:x1731746396821376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.356229:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12748 00000100:00100000:0.0:1651529423.356234:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12749 00000100:00100000:0.0:1651529423.356236:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41279:x1731746396821504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.356239:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.356240:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 4/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 296 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356244:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 296 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356250:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0c80 lrc: 0/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e9 expref: 296 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356253:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356254:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356255:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356260:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 4/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356267:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.356272:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41279:x1731746396821504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.356274:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12749 00000100:00100000:0.0:1651529423.356278:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12750 00000100:00100000:0.0:1651529423.356280:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396821440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.356282:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.356283:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 4/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356287:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356291:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0c79 lrc: 0/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2db expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356301:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356302:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.356303:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356306:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 4/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.356307:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12751 00000100:00100000:1.0:1651529423.356310:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396821568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.356314:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529423.356315:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529423.356319:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81bb867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396821440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.356322:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12750 00010000:00010000:1.0:1651529423.356326:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 4/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 292 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.356332:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 292 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356332:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356335:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356339:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356340:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0c8e lrc: 0/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc305 expref: 292 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.356342:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356344:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.356345:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.356346:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356349:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 4/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356359:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.356369:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41279:x1731746396821568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.356373:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12751 00000100:00100000:0.0:1651529423.356580:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1325us (1749us total) trans 30064894895 rc 0/0 00000100:00100000:0.0:1651529423.356583:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154069 00010000:00010000:0.0:1651529423.356591:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356594:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356597:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356600:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356626:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356631:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c0c5d8f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.356632:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356635:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356650:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 1/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356653:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0c5d8f/0xa29a79078f3c0e7f lrc: 0/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356658:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356660:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9d647a8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.356661:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356664:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356667:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 1/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.356670:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9d647a8/0xa29a79078f3c0e8d lrc: 0/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.356842:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1499us (1979us total) trans 30064894896 rc 0/0 00000100:00100000:0.0:1651529423.356846:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154071 00010000:00010000:0.0:1651529423.356856:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356859:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356862:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.356865:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.357071:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1771us (2229us total) trans 30064894897 rc 0/0 00000100:00100000:0.0:1651529423.357074:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154070 00010000:00010000:0.0:1651529423.357082:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357086:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041e8428e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.357087:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357090:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357095:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 1/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357098:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e8428e/0xa29a79078f3c0e86 lrc: 0/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.357148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.357157:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.357194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.357216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.357223:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821696 00010000:00010000:0.0:1651529423.357229:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 5/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357235:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821632 00010000:00010000:0.0:1651529423.357238:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 5/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 292 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357242:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821824 00010000:00010000:0.0:1651529423.357244:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 5/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357247:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821760 00010000:00010000:0.0:1651529423.357249:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 5/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357254:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12752 00000100:00100000:0.0:1651529423.357255:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746396821696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.357258:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.357260:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 5/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.357263:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 4/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.357264:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12753 00000100:00100000:1.0:1651529423.357267:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746396821632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.357269:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.357270:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.357271:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.357272:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.357274:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 4/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357279:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529423.357283:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 5/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357287:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746396821696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529423.357288:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 4/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 294 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357290:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12752 00010000:00010000:1.0:1651529423.357295:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.357295:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529423.357295:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12754 00010000:00010000:1.0:1651529423.357296:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.357296:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746396821824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529423.357299:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 4/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357299:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.357300:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 5/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.357304:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 4/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 293 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.357305:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529423.357308:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.357309:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.357309:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357312:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 4/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.357313:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746396821632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529423.357316:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.357317:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12753 00000100:00100000:0.0:1651529423.357321:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+292:41278:x1731746396821824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.357323:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12755 00000100:00100000:0.0:1651529423.357324:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12754 00000100:00100000:1.0:1651529423.357325:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+292:41278:x1731746396821760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529423.357327:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.357329:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 5/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.357333:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 4/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.357337:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.357338:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.357339:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.357342:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 4/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.357346:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.357351:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41278:x1731746396821760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.357353:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12755 00010000:00010000:0.0:1651529423.357370:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0c9c lrc: 0/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc321 expref: 290 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357375:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007aa9f6c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966717440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.357380:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357383:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357386:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357389:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357392:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.357614:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2045us (2200us total) trans 30064894898 rc 0/0 00000100:00100000:0.0:1651529423.357618:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154073 00010000:00010000:0.0:1651529423.357629:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0c87 lrc: 0/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f7 expref: 289 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357633:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966717376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.357637:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357640:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357643:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357646:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357652:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.357895:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2416us (3012us total) trans 30064894899 rc 0/0 00000100:00100000:0.0:1651529423.357898:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154072 00010000:00010000:0.0:1651529423.357906:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357909:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d440f5d7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.357910:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357913:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 3/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357918:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 1/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357921:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d440f5d7/0xa29a79078f3c0e9b lrc: 0/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357925:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357928:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf3fe9a5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.357929:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357932:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 3/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357935:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 1/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357938:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3fe9a5/0xa29a79078f3c0e94 lrc: 0/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357947:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0c95 lrc: 0/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc313 expref: 288 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.357950:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966717504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.357954:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357957:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357959:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357962:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.357968:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.358213:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946600768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2538us (2772us total) trans 30064894900 rc 0/0 00000100:00100000:0.0:1651529423.358216:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154074 00010000:00010000:0.0:1651529423.358354:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0ca3 lrc: 0/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc32f expref: 287 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.358359:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966717568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.358364:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358367:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358367:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358370:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358372:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fff3facb already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.358373:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358373:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358376:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 3/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358376:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358382:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 1/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358385:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff3facb/0xa29a79078f3c0ea2 lrc: 0/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358390:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358396:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042427c2b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.358396:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358399:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 3/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358402:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 1/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358405:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042427c2b/0xa29a79078f3c0ea9 lrc: 0/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.358444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529423.358472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529423.358490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529423.358539:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0c72 lrc: 0/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2cd expref: 286 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.358544:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077498c9a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966717120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.358549:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358552:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358557:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358561:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.358564:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.358644:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946600896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2898us (3004us total) trans 30064894901 rc 0/0 00000100:00100000:0.0:1651529423.358648:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154075 00000100:00100000:0.0:1651529423.358653:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600960 00000100:00100000:0.0:1651529423.358661:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601088 00000100:00100000:0.0:1651529423.358664:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601024 00000100:00100000:0.0:1651529423.358668:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154076 00000100:00100000:0.0:1651529423.358670:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946600960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.358676:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178641 count 1 00010000:00010000:0.0:1651529423.358699:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358705:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358708:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358709:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358710:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 4/0,1 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358718:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358722:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 4/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.358729:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966717632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.358740:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d7c4220 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.358746:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358749:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aed27857 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.358750:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358753:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 3/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358758:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 1/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358761:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aed27857/0xa29a79078f3c0e78 lrc: 0/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.358769:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154077 00000100:00100000:0.0:1651529423.358771:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946601088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.358776:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178643 count 1 00010000:00010000:0.0:1651529423.358790:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358794:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358797:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358798:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358798:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 4/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358822:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358826:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 4/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.358830:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966717696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.358839:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.358846:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946600448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3645us (4054us total) trans 30064894902 rc 0/0 00000100:00100000:0.0:1651529423.358848:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154078 00000100:00100000:1.0:1651529423.358850:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154068 00000100:00100000:0.0:1651529423.358850:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946601024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.358855:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178642 count 1 00010000:00010000:0.0:1651529423.358858:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358863:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358866:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358866:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358867:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 4/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358875:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358879:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 4/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.358880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.358883:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bc637d0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966717760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.358889:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.358895:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601152 00000100:00100000:1.0:1651529423.358903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.358903:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154079 00000100:00100000:0.0:1651529423.358905:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946601152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.358916:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178644 count 1 00000100:00100000:1.0:1651529423.358921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.358921:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358930:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358933:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358934:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358935:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 4/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358941:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358947:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 4/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.358951:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac948652 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966717824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.358964:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd95dbf0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.358970:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601280 00000100:00100000:0.0:1651529423.358975:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601216 00000100:00100000:0.0:1651529423.358978:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154080 00000100:00100000:0.0:1651529423.358980:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946601280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.358984:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178646 count 1 00000100:00100000:1.0:1651529423.358987:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154081 00010000:00010000:0.0:1651529423.358988:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.358993:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.358995:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946601216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529423.358996:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358996:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.358997:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 4/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529423.359002:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178645 count 1 00010000:00010000:0.0:1651529423.359003:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.359006:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 4/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.359008:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.359014:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.359017:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.359018:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.359019:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 4/0,1 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.359023:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966717888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.359027:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 3/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.359031:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 4/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.359036:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a002ed0c going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.359042:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966717952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529423.359059:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000008b6fede5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.359845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.359874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.359921:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bc637d0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966717760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.359926:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.359934:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966717696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.359937:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.359943:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac948652 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966717824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.359945:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.359952:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966717888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.359954:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.359961:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601408 00000100:00100000:0.0:1651529423.359968:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601344 00000100:00100000:0.0:1651529423.359972:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154082 00000100:00100000:0.0:1651529423.359974:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946601408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.359989:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178648 count 1 00010000:00010000:0.0:1651529423.359994:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.359998:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360002:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.360002:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.360003:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 4/0,1 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360010:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 3/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360014:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 4/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360018:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966718016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.360030:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.360061:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154083 00000100:00100000:0.0:1651529423.360062:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946601344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.360068:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178647 count 1 00010000:00010000:0.0:1651529423.360089:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360094:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360113:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.360113:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.360114:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 4/0,1 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360122:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 3/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 285 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360125:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 4/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360130:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047a18988 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966718080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.360140:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.360165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360192:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360226:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821952 00010000:00010000:0.0:1651529423.360232:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 4/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 286 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360238:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822080 00010000:00010000:0.0:1651529423.360240:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 4/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 287 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360255:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822208 00010000:00010000:0.0:1651529423.360259:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 5/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 288 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360263:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396821888 00010000:00010000:0.0:1651529423.360265:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 5/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 289 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360286:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822016 00010000:00010000:0.0:1651529423.360289:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 4/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 290 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360293:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822144 00010000:00010000:0.0:1651529423.360295:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 4/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360313:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12756 00000100:00100000:0.0:1651529423.360315:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41278:x1731746396821952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360319:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360320:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 4/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360324:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360330:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0cb8 lrc: 0/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc359 expref: 291 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360334:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360335:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360336:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360339:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 4/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360346:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360354:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396821952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360357:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12756 00000100:00100000:0.0:1651529423.360362:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12757 00000100:00100000:0.0:1651529423.360363:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396822080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360366:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360367:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 4/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 289 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360371:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 289 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360376:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0cbf lrc: 0/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc367 expref: 289 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360379:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360380:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360380:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360383:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 4/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360389:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360394:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41278:x1731746396822080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360396:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12757 00000100:00100000:0.0:1651529423.360404:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12758 00000100:00100000:0.0:1651529423.360406:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746396822208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360408:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360410:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 5/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 287 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360413:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 4/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 287 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360418:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360418:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360419:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360436:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 4/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360441:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360447:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746396822208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360450:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12758 00000100:00100000:0.0:1651529423.360455:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12759 00000100:00100000:0.0:1651529423.360457:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396821888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360459:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360460:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 5/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 286 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360464:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 4/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 286 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360469:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360470:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360473:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 4/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360477:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360481:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396821888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360483:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12759 00000100:00100000:0.0:1651529423.360486:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12760 00000100:00100000:0.0:1651529423.360487:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41278:x1731746396822016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360490:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360491:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 4/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360494:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360499:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0cb1 lrc: 0/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc34b expref: 285 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360502:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360502:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360503:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360506:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 4/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360512:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360516:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41278:x1731746396822016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360519:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12760 00000100:00100000:0.0:1651529423.360522:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12761 00000100:00100000:0.0:1651529423.360524:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41278:x1731746396822144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360526:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360527:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 4/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360531:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360536:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0ccd lrc: 0/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc383 expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360539:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360539:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360540:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360543:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 4/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360548:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360552:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41278:x1731746396822144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360555:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12761 00000100:00100000:0.0:1651529423.360594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.360633:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822272 00010000:00010000:0.0:1651529423.360638:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 5/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360644:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822336 00010000:00010000:0.0:1651529423.360646:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 5/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.360650:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12762 00000100:00100000:0.0:1651529423.360652:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396822272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.360655:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360656:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 5/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360660:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 4/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360665:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360666:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360667:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360669:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 4/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360674:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360683:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396822272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360685:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12762 00000100:00100000:0.0:1651529423.360689:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12763 00000100:00100000:0.0:1651529423.360691:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396822336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.360693:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.360695:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 5/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360698:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 4/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.360705:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360706:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.360706:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360709:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 4/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360713:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.360717:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396822336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.360719:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12763 00010000:00010000:0.0:1651529423.360731:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360735:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360738:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360741:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.360915:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946601088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2143us (2442us total) trans 30064894903 rc 0/0 00000100:00100000:0.0:1651529423.360919:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154077 00010000:00010000:0.0:1651529423.360951:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360955:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360958:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.360960:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.361205:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946601024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2354us (2715us total) trans 30064894904 rc 0/0 00000100:00100000:0.0:1651529423.361208:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154078 00000100:00100000:0.0:1651529423.361223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.361249:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361254:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a911e32 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.361255:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361258:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361263:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 1/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361269:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a911e32/0xa29a79078f3c0eb7 lrc: 0/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361273:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361275:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef1a6b78 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.361276:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361279:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361282:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 1/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361285:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1a6b78/0xa29a79078f3c0ebe lrc: 0/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361290:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361293:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361296:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361299:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.361458:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946601152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2551us (2577us total) trans 30064894905 rc 0/0 00000100:00100000:0.0:1651529423.361461:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154079 00000100:00100000:0.0:1651529423.361466:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601472 00000100:00100000:0.0:1651529423.361472:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154084 00000100:00100000:0.0:1651529423.361474:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946601472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.361479:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178649 count 1 00010000:00010000:0.0:1651529423.361484:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361489:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 281 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361493:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.361493:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.361494:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 4/0,1 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361501:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 3/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 281 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361505:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 4/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 281 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.361512:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966718144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.361521:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c5e3a04e going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.361536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.361571:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601536 00000100:00100000:0.0:1651529423.361578:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154085 00000100:00100000:0.0:1651529423.361579:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946601536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.361584:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178650 count 1 00010000:00010000:0.0:1651529423.361589:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361593:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 281 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361596:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.361597:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.361597:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 4/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361604:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 281 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361607:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 4/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 281 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.361611:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d446d583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966718208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.361623:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.361634:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361638:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361641:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361644:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.361849:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946601280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2868us (2946us total) trans 30064894906 rc 0/0 00000100:00100000:0.0:1651529423.361853:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154080 00000100:00100000:0.0:1651529423.361869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.361902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529423.361908:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361912:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4f97720 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.361913:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361916:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361941:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 1/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361945:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c0ec5 lrc: 0/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361949:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361952:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f25ba4b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.361953:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361956:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361959:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 1/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.361962:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c0ecc lrc: 0/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.361991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.361999:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d446d583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966718208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.362003:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362013:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822400 00010000:00010000:0.0:1651529423.362018:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 5/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362042:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822464 00010000:00010000:0.0:1651529423.362045:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 4/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362051:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12764 00000100:00100000:0.0:1651529423.362052:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396822400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.362055:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.362057:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 5/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362060:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 4/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 283 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362066:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.362066:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.362067:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362070:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 4/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362075:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.362084:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396822400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.362087:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12764 00000100:00100000:0.0:1651529423.362096:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12765 00000100:00100000:0.0:1651529423.362098:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396822464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.362100:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.362101:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 4/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362105:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362109:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ce9 lrc: 0/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3bb expref: 282 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362113:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.362113:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.362114:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362117:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 4/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362122:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.362127:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41279:x1731746396822464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.362130:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12765 00000100:00100000:0.0:1651529423.362143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.362169:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362173:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362177:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362179:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362319:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0cc6 lrc: 0/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc375 expref: 280 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.362325:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966717952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.362330:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362330:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946601536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 749us (794us total) trans 30064894907 rc 0/0 00000100:00100000:0.0:1651529423.362333:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154085 00010000:00010000:1.0:1651529423.362334:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362336:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362339:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601600 00010000:00010000:1.0:1651529423.362340:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362342:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601664 00010000:00010000:1.0:1651529423.362345:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362345:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154086 00000100:00100000:0.0:1651529423.362347:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946601600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.362352:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178651 count 1 00010000:00010000:0.0:1651529423.362356:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362361:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 279 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362364:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.362366:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.362366:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 4/0,1 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362373:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 3/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 279 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362377:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 4/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362381:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966718272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.362392:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.362429:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362433:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa865cce already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.362434:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362438:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362442:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 1/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362445:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c0eef lrc: 0/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362452:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362455:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.362456:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362458:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 3/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362461:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 1/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362464:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c0ed3 lrc: 0/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362473:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0cd4 lrc: 0/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc391 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362477:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047a18988 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966718080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.362480:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362483:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362489:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.362510:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946601216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3513us (3588us total) trans 30064894908 rc 0/0 00010000:00010000:0.0:1651529423.362513:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.362514:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154081 00010000:00010000:0.0:1651529423.362516:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.362520:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154087 00000100:00100000:1.0:1651529423.362523:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946601664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529423.362528:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178652 count 1 00010000:00010000:1.0:1651529423.362533:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362539:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 278 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362542:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.362543:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.362543:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 4/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362557:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 278 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362563:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 4/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.362573:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966718336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529423.362589:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 000000008b6fede5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529423.362601:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362607:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015f46ac3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.362608:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362613:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 3/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362619:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 1/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362622:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c0ee1 lrc: 0/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.362683:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946601344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2619us (2808us total) trans 30064894909 rc 0/0 00000100:00100000:0.0:1651529423.362686:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154083 00000100:00100000:0.0:1651529423.362702:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.362748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.362762:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601728 00000100:00100000:0.0:1651529423.362768:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154088 00000100:00100000:0.0:1651529423.362770:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946601728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.362775:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178653 count 1 00010000:00010000:0.0:1651529423.362788:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362794:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 278 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362797:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.362797:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.362798:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 4/0,1 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362833:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 3/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 278 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362838:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 4/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362842:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a14ba1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966718400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.362854:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.362885:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0ce2 lrc: 0/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ad expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.362889:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966718144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.362893:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362896:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.362899:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822528 00010000:00010000:0.0:1651529423.362899:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.362902:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362907:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 5/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.362907:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.362924:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12766 00000100:00100000:1.0:1651529423.362927:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396822528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529423.362930:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.362932:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 5/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.362936:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 4/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.362943:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.362943:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.362944:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362947:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 4/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362952:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.362961:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396822528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.362964:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12766 00010000:00010000:1.0:1651529423.362972:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362976:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059b4498e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.362977:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362980:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 3/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362984:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 1/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.362989:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c0ee8 lrc: 0/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363126:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946601472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1650us (1902us total) trans 30064894910 rc 0/0 00000100:00100000:0.0:1651529423.363129:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154084 00000100:00100000:0.0:1651529423.363144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.363195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.363203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.363217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.363227:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601856 00000100:00100000:0.0:1651529423.363233:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601792 00000100:00100000:0.0:1651529423.363237:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154089 00000100:00100000:0.0:1651529423.363238:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946601856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.363244:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178655 count 1 00010000:00010000:0.0:1651529423.363249:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363254:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 277 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363257:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.363258:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.363259:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 4/0,1 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363266:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 3/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 277 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363279:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 4/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 277 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363283:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966718464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.363312:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2df7206 going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.363314:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966718336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.363320:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529423.363328:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822592 00010000:00010000:1.0:1651529423.363334:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 4/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 278 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.363347:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822656 00010000:00010000:1.0:1651529423.363350:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 5/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363359:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12767 00000100:00100000:0.0:1651529423.363361:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746396822592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529423.363364:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12768 00010000:00010000:0.0:1651529423.363365:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529423.363366:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396822656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.363367:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 4/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.363370:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.363371:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 5/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363371:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.363375:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 4/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363377:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0cf7 lrc: 0/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d7 expref: 279 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363381:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363381:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.363382:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363382:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363383:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.363384:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363385:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 4/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363387:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 4/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363392:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.363411:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396822656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529423.363411:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.363414:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12768 00000100:00100000:0.0:1651529423.363431:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746396822592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.363434:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12767 00000100:00100000:0.0:1651529423.363466:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601920 00000100:00100000:0.0:1651529423.363472:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154090 00000100:00100000:0.0:1651529423.363474:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946601792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.363479:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178654 count 1 00010000:00010000:0.0:1651529423.363484:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363489:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 276 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363492:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.363492:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.363493:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 4/0,1 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363499:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 3/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 276 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363503:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 4/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363507:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966718528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.363514:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363519:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363522:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363525:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363526:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000002cbe70 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.363554:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0cfe lrc: 0/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3e5 expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363559:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a14ba1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966718400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.363582:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363586:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363588:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363591:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363594:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.363690:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946601664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1166us (1546us total) trans 30064894911 rc 0/0 00000100:00100000:1.0:1651529423.363693:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154087 00000100:00100000:1.0:1651529423.363699:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154091 00000100:00100000:1.0:1651529423.363701:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913fbcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946601920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529423.363708:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178656 count 1 00010000:00010000:1.0:1651529423.363713:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363719:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363722:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.363722:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.363723:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 4/0,1 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363730:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 3/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363734:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 4/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.363738:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966718592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529423.363748:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce26a14f going to sleep for 6 seconds 00010000:00010000:1.0:1651529423.363754:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363757:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.363758:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363758:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946601728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 987us (1055us total) trans 30064894912 rc 0/0 00010000:00010000:1.0:1651529423.363761:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363761:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154088 00010000:00010000:1.0:1651529423.363766:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 1/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363769:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0efd lrc: 0/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363773:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363785:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000590e4cfe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.363787:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363790:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 3/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363793:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 1/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.363796:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c0f04 lrc: 0/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.363832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.363876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.363894:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822720 00010000:00010000:0.0:1651529423.363900:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 5/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363924:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822784 00010000:00010000:0.0:1651529423.363928:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 5/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 277 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.363933:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12769 00000100:00100000:0.0:1651529423.363935:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746396822720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.363938:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.363939:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 5/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 277 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363943:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 4/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 277 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363949:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363950:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363951:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363954:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 4/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363959:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.363968:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746396822720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.363971:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12769 00000100:00100000:0.0:1651529423.363976:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12770 00000100:00100000:0.0:1651529423.363977:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396822784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.363980:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.363981:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 5/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363985:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 4/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.363990:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363990:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.363991:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363994:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 4/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.363997:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.364002:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396822784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.364004:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12770 00000100:00100000:0.0:1651529423.364060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.364101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.364129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.364138:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946601984 00000100:00100000:0.0:1651529423.364143:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602048 00000100:00100000:0.0:1651529423.364146:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154092 00000100:00100000:0.0:1651529423.364148:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d6ceda5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946601984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.364155:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178657 count 1 00010000:00010000:0.0:1651529423.364160:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364165:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364168:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364169:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364169:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 4/0,1 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364192:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 3/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364196:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 4/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364200:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000381e5a13 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966718656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.364212:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd2aec76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.364240:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154093 00000100:00100000:0.0:1651529423.364242:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d974ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946602048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.364248:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178658 count 1 00010000:00010000:0.0:1651529423.364252:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364257:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364260:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364261:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364261:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 4/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364268:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 275 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364271:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 4/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364275:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006fc0a8fc pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966718720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.364285:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf9c66a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.364313:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0cf0 lrc: 0/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c9 expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364317:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb5c3aa2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966718272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.364321:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364325:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364327:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364333:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364336:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.364507:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946601600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2159us (2638us total) trans 30064894913 rc 0/0 00000100:00100000:0.0:1651529423.364511:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154086 00000100:00100000:0.0:1651529423.364550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.364573:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822848 00010000:00010000:0.0:1651529423.364579:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 5/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364585:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822912 00010000:00010000:0.0:1651529423.364587:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 5/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364592:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12771 00000100:00100000:0.0:1651529423.364593:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746396822848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.364597:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.364598:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 5/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.364602:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 4/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 276 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.364608:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.364609:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.364610:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364613:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 4/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364618:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.364627:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000587cc4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746396822848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.364629:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12771 00000100:00100000:0.0:1651529423.364638:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12772 00000100:00100000:0.0:1651529423.364640:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f14698e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746396822912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.364642:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.364644:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 5/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.364647:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 4/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 275 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.364652:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.364652:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.364653:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364659:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 4/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364663:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.364667:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f14698e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746396822912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.364669:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12772 00000100:00100000:0.0:1651529423.364723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.364745:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.364754:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602112 00000100:00100000:0.0:1651529423.364760:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154094 00000100:00100000:0.0:1651529423.364761:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946602112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.364767:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178659 count 1 00010000:00010000:0.0:1651529423.364771:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364784:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 274 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364788:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364789:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.364790:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 4/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364797:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 274 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364827:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 4/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 274 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364832:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d15512 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966718784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.364845:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.364874:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0d05 lrc: 0/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3f3 expref: 274 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.364879:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966718528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.364882:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364886:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364888:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364891:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.364894:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365064:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946601792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1589us (1869us total) trans 30064894914 rc 0/0 00000100:00100000:0.0:1651529423.365068:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154090 00000100:00100000:0.0:1651529423.365108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.365118:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006fc0a8fc pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966718720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.365121:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365129:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0d1a lrc: 0/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc41d expref: 273 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.365133:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000381e5a13 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966718656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.365135:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365138:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365141:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365144:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365146:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365299:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d6ceda5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946601984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1150us (1239us total) trans 30064894915 rc 0/0 00000100:00100000:0.0:1651529423.365303:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154092 00010000:00010000:0.0:1651529423.365310:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365313:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040c1504b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.365314:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365317:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 3/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365322:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 1/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365325:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c0ef6 lrc: 0/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365329:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365332:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000806805c0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.365333:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365336:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 3/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365341:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 1/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365344:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c0f12 lrc: 0/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365347:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365350:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.365351:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365353:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 3/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365356:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 1/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365359:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f20 lrc: 0/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365372:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.365402:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0d0c lrc: 0/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc401 expref: 272 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.365409:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966718464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.365412:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365416:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365418:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365421:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365424:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365582:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946601856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2342us (2437us total) trans 30064894916 rc 0/0 00000100:00100000:0.0:1651529423.365585:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154089 00000100:00100000:0.0:1651529423.365590:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602176 00000100:00100000:0.0:1651529423.365596:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154095 00000100:00100000:0.0:1651529423.365598:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000381e5a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946602176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.365603:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178660 count 1 00010000:00010000:0.0:1651529423.365608:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365615:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 271 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365618:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.365619:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.365619:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 4/0,1 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365626:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 3/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 271 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365629:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 4/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.365634:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006fc0a8fc pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966718848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.365642:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2df7206 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.365647:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365650:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f782055 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.365651:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365654:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 3/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365661:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 1/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365664:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c0f0b lrc: 0/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.365714:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0cdb lrc: 0/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc39f expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.365718:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966718016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.365722:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365726:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365728:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365731:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365734:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.365942:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946601408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 5967us (6097us total) trans 30064894917 rc 0/0 00000100:00100000:0.0:1651529423.365946:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154082 00000100:00100000:0.0:1651529423.365951:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602240 00000100:00100000:0.0:1651529423.365956:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154096 00000100:00100000:0.0:1651529423.365958:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5df4036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946602240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.365962:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178661 count 1 00010000:00010000:0.0:1651529423.365967:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365972:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 270 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365975:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.365976:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.365977:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 4/0,1 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365983:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 3/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 270 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.365987:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 4/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 270 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.365991:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069066df1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966718912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.365999:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.366007:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366011:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003416f7b2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.366012:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366015:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 3/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366019:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 1/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366022:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c0eda lrc: 0/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.366036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.366084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.366094:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d15512 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966718784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.366098:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.366105:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396822976 00010000:00010000:0.0:1651529423.366110:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 4/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.366115:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823040 00010000:00010000:0.0:1651529423.366117:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 4/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 272 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.366121:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823104 00010000:00010000:0.0:1651529423.366123:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 5/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 273 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.366128:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12773 00000100:00100000:0.0:1651529423.366129:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4cd7ed8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41279:x1731746396822976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.366132:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.366133:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 4/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 273 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366137:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 273 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366142:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0d21 lrc: 0/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc42b expref: 273 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366146:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366146:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366147:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366150:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 4/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366157:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.366165:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4cd7ed8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41279:x1731746396822976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.366177:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12773 00000100:00100000:0.0:1651529423.366182:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12774 00000100:00100000:0.0:1651529423.366183:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054d63fed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41279:x1731746396823040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.366186:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.366188:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 4/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366192:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366197:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0d28 lrc: 0/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc439 expref: 271 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366200:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366201:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366202:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366204:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 4/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366210:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.366216:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054d63fed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41279:x1731746396823040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.366219:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12774 00000100:00100000:0.0:1651529423.366223:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12775 00000100:00100000:0.0:1651529423.366231:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000421790ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396823104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.366251:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.366253:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 5/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366257:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 4/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.366273:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366274:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.366275:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366278:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 4/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366282:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.366289:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000421790ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396823104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.366292:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12775 00000100:00100000:0.0:1651529423.366317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.366326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529423.366350:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366354:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366367:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366369:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.366508:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d974ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946602048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2264us (2406us total) trans 30064894918 rc 0/0 00000100:00100000:0.0:1651529423.366511:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154093 00000100:00100000:0.0:1651529423.366516:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602304 00000100:00100000:0.0:1651529423.366520:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602368 00000100:00100000:0.0:1651529423.366523:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154097 00000100:00100000:0.0:1651529423.366524:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a853e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946602304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.366529:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178662 count 1 00010000:00010000:0.0:1651529423.366534:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366538:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 268 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366541:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.366542:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.366543:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 4/0,1 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366549:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 3/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 268 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366562:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 4/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.366566:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966718976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.366577:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.366582:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366585:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.366586:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366589:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366594:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 1/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366597:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f27 lrc: 0/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366631:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366635:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366648:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366651:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.366875:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002a823f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946602112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2112us (2151us total) trans 30064894919 rc 0/0 00000100:00100000:0.0:1651529423.366878:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154094 00000100:00100000:0.0:1651529423.366884:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154098 00000100:00100000:0.0:1651529423.366885:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094d15512 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946602368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.366890:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178663 count 1 00010000:00010000:0.0:1651529423.366895:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366900:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366903:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.366904:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.366904:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 4/0,1 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366911:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 3/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366927:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 4/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.366931:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966719040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.366940:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.366949:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366952:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.366953:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366956:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366960:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 1/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.366963:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f2e lrc: 0/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.366985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.367030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.367038:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823168 00010000:00010000:0.0:1651529423.367043:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 5/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367059:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823232 00010000:00010000:0.0:1651529423.367062:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 5/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 270 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367067:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12776 00000100:00100000:0.0:1651529423.367068:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb206345 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746396823168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.367071:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.367073:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 5/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 270 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.367076:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 4/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 270 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.367082:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.367082:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.367083:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367086:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 4/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367091:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.367100:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb206345 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746396823168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.367103:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12776 00000100:00100000:0.0:1651529423.367107:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12777 00000100:00100000:0.0:1651529423.367132:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41278:x1731746396823232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.367135:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.367137:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 5/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.367140:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 4/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.367146:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.367146:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.367147:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367150:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 4/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367154:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.367160:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41278:x1731746396823232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.367163:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12777 00000100:00100000:0.0:1651529423.367178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.367225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529423.367235:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0caa lrc: 0/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc33d expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367240:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e91d335b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966717632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.367244:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367248:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367250:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367254:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367256:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.367466:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946600960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 8795us (9023us total) trans 30064894920 rc 0/0 00000100:00100000:0.0:1651529423.367470:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154076 00000100:00100000:0.0:1651529423.367474:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602432 00000100:00100000:0.0:1651529423.367478:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602496 00000100:00100000:0.0:1651529423.367481:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154099 00000100:00100000:0.0:1651529423.367482:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946602432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.367487:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178664 count 1 00010000:00010000:0.0:1651529423.367492:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367497:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367502:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367503:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367504:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 4/0,1 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367510:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 3/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367514:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 4/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 267 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367518:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a14ba1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966719104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.367536:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf9c66a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.367541:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367544:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7e11adf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.367545:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.367546:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823296 00010000:00010000:0.0:1651529423.367548:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367553:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 1/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.367554:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 5/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.367558:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7e11adf/0xa29a79078f3c0eb0 lrc: 0/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.367563:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12778 00000100:00100000:1.0:1651529423.367566:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41278:x1731746396823296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529423.367570:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.367571:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 5/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.367575:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 4/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.367582:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.367583:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.367584:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.367587:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 4/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.367592:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.367601:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091e67ee9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41278:x1731746396823296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.367604:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12778 00000100:00100000:0.0:1651529423.367640:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154100 00000100:00100000:0.0:1651529423.367642:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946602496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.367647:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178665 count 1 00010000:00010000:0.0:1651529423.367652:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367657:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367660:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367661:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367661:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 4/0,1 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367668:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 3/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367672:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 4/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 267 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367676:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f2b7574 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966719168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.367687:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.367738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.367745:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602560 00000100:00100000:0.0:1651529423.367751:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154101 00000100:00100000:0.0:1651529423.367753:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946602560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.367758:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178666 count 1 00010000:00010000:0.0:1651529423.367763:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367768:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367771:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367772:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.367772:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 4/0,1 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367789:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 3/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 267 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367793:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 4/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 267 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367797:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966719232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.367825:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000002cbe70 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.367862:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0d3d lrc: 0/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc463 expref: 267 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.367867:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a8f21b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966718976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.367872:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367875:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367878:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367881:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.367901:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368048:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a853e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946602304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1523us (2011us total) trans 30064894921 rc 0/0 00000100:00100000:0.0:1651529423.368051:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154097 00010000:00010000:0.0:1651529423.368058:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368062:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080006241 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.368063:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368066:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 3/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368073:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 1/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368094:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c0f43 lrc: 0/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.368197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.368203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.368229:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823360 00010000:00010000:1.0:1651529423.368237:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 5/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 267 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.368244:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823424 00000100:00100000:1.0:1651529423.368246:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823488 00010000:00010000:1.0:1651529423.368248:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 5/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.368251:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 5/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.368256:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12779 00000100:00100000:1.0:1651529423.368258:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396823360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529423.368262:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.368264:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 5/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.368264:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12780 00000100:00100000:0.0:1651529423.368265:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396823488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.368267:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 4/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.368269:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.368270:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 5/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.368274:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.368274:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.368274:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 4/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 269 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.368275:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368278:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 4/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368280:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.368281:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.368282:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368284:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529423.368287:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 4/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368292:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.368299:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396823360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.368302:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12779 00000100:00100000:1.0:1651529423.368307:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12781 00000100:00100000:1.0:1651529423.368309:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41279:x1731746396823424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.368312:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.368314:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 5/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.368318:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 4/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 268 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.368323:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.368323:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.368324:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368324:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41279:x1731746396823488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529423.368327:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 4/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368328:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12780 00010000:00010000:1.0:1651529423.368331:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.368337:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41279:x1731746396823424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.368339:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12781 00000100:00100000:0.0:1651529423.368344:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529423.368352:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c0d13 lrc: 0/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc40f expref: 266 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.368356:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ee0cee8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966718592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.368360:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368364:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368366:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368370:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368372:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368378:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c0d52 lrc: 0/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc48d expref: 265 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.368383:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f2b7574 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966719168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.368387:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368390:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368393:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368396:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368399:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.368550:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913fbcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946601920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4847us (5222us total) trans 30064894922 rc 0/0 00000100:00100000:1.0:1651529423.368553:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154091 00000100:00100000:0.0:1651529423.368556:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946602496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 913us (1377us total) trans 30064894923 rc 0/0 00000100:00100000:0.0:1651529423.368559:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154100 00000100:00100000:0.0:1651529423.368565:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602624 00000100:00100000:0.0:1651529423.368572:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154102 00000100:00100000:0.0:1651529423.368573:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946602624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.368578:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178667 count 1 00010000:00010000:1.0:1651529423.368581:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368583:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368585:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.368586:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368588:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368589:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 3/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368591:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.368592:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.368592:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 4/0,1 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368594:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 1/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368597:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c0f19 lrc: 0/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368599:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 3/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368601:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368603:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 4/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.368604:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021305674 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.368605:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368607:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042044fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966719296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.368608:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 3/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368611:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 1/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.368613:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c0f58 lrc: 0/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368618:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.368661:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c0d59 lrc: 0/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc49b expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.368666:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074b3cc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966719232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.368670:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368673:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368676:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368679:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368682:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368900:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946602560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1145us (1161us total) trans 30064894924 rc 0/0 00000100:00100000:0.0:1651529423.368903:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154101 00010000:00010000:0.0:1651529423.368911:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368914:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000313829b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.368915:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368918:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 3/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368923:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 1/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.368926:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c0f5f lrc: 0/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.368940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.368975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.368981:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.368988:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602688 00000100:00100000:0.0:1651529423.368998:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602752 00000100:00100000:0.0:1651529423.369003:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154103 00000100:00100000:0.0:1651529423.369005:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946602688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.369010:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178668 count 1 00010000:00010000:0.0:1651529423.369015:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369020:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369023:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.369023:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.369024:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 4/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369034:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369038:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 4/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.369042:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2bcbcc3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966719360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.369053:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.369067:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154104 00000100:00100000:0.0:1651529423.369069:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946602752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.369073:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178669 count 1 00010000:00010000:0.0:1651529423.369091:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369097:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 263 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369100:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.369100:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.369101:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 4/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369108:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 263 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369111:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 4/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.369116:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966719424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.369123:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000362c7c7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.369166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529423.369185:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602816 00000100:00100000:1.0:1651529423.369194:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154105 00000100:00100000:1.0:1651529423.369195:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946602816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529423.369198:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823552 00010000:00010000:0.0:1651529423.369204:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 5/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00002000:00080000:1.0:1651529423.369211:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178670 count 1 00000100:00100000:0.0:1651529423.369216:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12782 00000100:00100000:0.0:1651529423.369218:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396823552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529423.369222:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369222:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.369223:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 5/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.369227:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 4/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.369228:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 264 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.369231:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.369231:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.369232:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 4/0,1 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369233:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.369234:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.369235:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369238:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 4/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.369240:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 3/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 264 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369243:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529423.369244:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 4/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.369249:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023757f5b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966719488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.369252:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396823552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.369255:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12782 00000100:00100000:1.0:1651529423.369260:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.369290:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0d2f lrc: 0/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc447 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.369294:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006fc0a8fc pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966718848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.369298:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369302:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369304:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369307:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.369310:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.369448:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000381e5a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946602176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3848us (4075us total) trans 30064894925 rc 0/0 00000100:00100000:0.0:1651529423.369451:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154095 00000100:00100000:0.0:1651529423.369926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.369937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.369947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.369961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.369972:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966719424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.369977:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.369985:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2bcbcc3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966719360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.369988:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.369995:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823680 00010000:00010000:0.0:1651529423.370001:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 4/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370008:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823616 00010000:00010000:0.0:1651529423.370011:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 4/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 264 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370015:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823744 00010000:00010000:0.0:1651529423.370017:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 5/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 265 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370022:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12783 00000100:00100000:0.0:1651529423.370023:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41279:x1731746396823680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.370027:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.370028:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 4/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 265 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370032:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 265 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370038:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c0d6e lrc: 0/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4c5 expref: 265 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370042:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370042:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370043:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370046:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 4/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370053:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.370061:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41279:x1731746396823680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.370064:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12783 00000100:00100000:0.0:1651529423.370069:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12784 00000100:00100000:0.0:1651529423.370070:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+263:41279:x1731746396823616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.370073:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.370074:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 4/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370078:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370083:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c0d67 lrc: 0/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b7 expref: 263 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370086:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370087:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370088:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370090:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 4/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370096:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.370100:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41279:x1731746396823616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.370103:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12784 00000100:00100000:0.0:1651529423.370106:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12785 00000100:00100000:0.0:1651529423.370108:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396823744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.370110:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.370111:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 5/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 261 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370115:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 4/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 261 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.370119:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370119:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.370120:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370123:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 4/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370127:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.370131:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396823744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.370133:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12785 00010000:00010000:0.0:1651529423.370143:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370146:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370149:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370152:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.370306:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946602752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1236us (1331us total) trans 30064894926 rc 0/0 00000100:00100000:0.0:1651529423.370310:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154104 00000100:00100000:0.0:1651529423.370315:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602880 00000100:00100000:0.0:1651529423.370320:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154106 00000100:00100000:0.0:1651529423.370322:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946602880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.370327:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178671 count 1 00010000:00010000:0.0:1651529423.370332:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370337:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 260 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370340:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.370341:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.370341:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 4/0,1 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370348:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 3/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 260 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370352:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 4/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 260 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370356:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966719552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.370365:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000007eea7909 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.370371:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370374:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370377:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370380:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.370510:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946602688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1504us (1569us total) trans 30064894927 rc 0/0 00000100:00100000:0.0:1651529423.370513:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154103 00010000:00010000:0.0:1651529423.370521:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370524:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001bf25d5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.370526:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370529:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 3/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370533:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 1/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370536:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c0f35 lrc: 0/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370541:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370543:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.370544:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370547:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370550:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 1/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370553:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c0f74 lrc: 0/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370556:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370559:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.370559:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370562:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370565:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 1/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370567:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c0f6d lrc: 0/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370619:0:142995:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0d36 lrc: 0/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc455 expref: 260 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370623:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069066df1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966718912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.370627:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370630:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370633:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370636:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370638:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.370801:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5df4036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946602240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4842us (5123us total) trans 30064894928 rc 0/0 00000100:00100000:0.0:1651529423.370825:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154096 00010000:00010000:0.0:1651529423.370837:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370843:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001edcc069 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.370844:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370862:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 3/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370867:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 1/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370870:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c0f3c lrc: 0/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370882:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c0d44 lrc: 0/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc471 expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.370885:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966719040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.370889:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370892:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370895:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370901:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.370903:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.371029:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094d15512 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946602368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4142us (4711us total) trans 30064894929 rc 0/0 00000100:00100000:0.0:1651529423.371032:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154098 00010000:00010000:0.0:1651529423.371039:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371043:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6dda103 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.371044:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371047:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 3/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371051:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 1/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371054:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c0f4a lrc: 0/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.371079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.371118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.371126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.371133:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823808 00010000:00010000:0.0:1651529423.371139:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 5/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371147:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12786 00000100:00100000:0.0:1651529423.371148:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41279:x1731746396823808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.371152:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.371153:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 5/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.371157:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 4/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.371163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.371163:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.371164:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371167:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 4/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371172:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.371180:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41279:x1731746396823808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.371183:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12786 00010000:00010000:0.0:1651529423.371213:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c0d4b lrc: 0/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc47f expref: 258 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371218:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a14ba1b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966719104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.371222:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371225:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371228:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371231:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371234:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.371387:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946602432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3903us (4402us total) trans 30064894930 rc 0/0 00000100:00100000:0.0:1651529423.371390:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154099 00000100:00100000:0.0:1651529423.371396:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603008 00000100:00100000:0.0:1651529423.371401:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946602944 00000100:00100000:0.0:1651529423.371405:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154107 00000100:00100000:0.0:1651529423.371406:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946603008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.371411:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178673 count 1 00010000:00010000:0.0:1651529423.371416:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371421:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371424:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371425:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371425:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 4/0,1 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371432:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 3/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371436:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 4/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371440:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966719616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.371449:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd2aec76 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.371454:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371457:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c28d57aa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.371459:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371461:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 3/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371468:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 1/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371471:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c0f51 lrc: 0/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.371479:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154108 00000100:00100000:0.0:1651529423.371481:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946602944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.371486:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178672 count 1 00010000:00010000:0.0:1651529423.371489:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371493:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371496:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371496:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371497:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 4/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371503:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371507:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 4/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371514:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7137b76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966719680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.371520:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.371533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.371560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.371584:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603072 00000100:00100000:0.0:1651529423.371589:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603136 00000100:00100000:0.0:1651529423.371593:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154109 00000100:00100000:0.0:1651529423.371594:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946603072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.371599:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178674 count 1 00010000:00010000:0.0:1651529423.371604:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371608:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371611:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371612:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371612:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 4/0,1 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371619:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 3/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371622:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 4/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371629:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966719744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.371640:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c5e3a04e going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.371686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.371693:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603200 00000100:00100000:0.0:1651529423.371698:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154110 00000100:00100000:0.0:1651529423.371700:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946603136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.371705:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178675 count 1 00010000:00010000:0.0:1651529423.371710:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371714:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371717:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371718:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.371718:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 4/0,1 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371726:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 3/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.371729:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 4/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.371733:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b879addf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966719808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.371745:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.372187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.372193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.372202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.372210:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7137b76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966719680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.372215:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.372222:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823872 00010000:00010000:0.0:1651529423.372228:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 5/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 258 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372233:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396823936 00010000:00010000:0.0:1651529423.372236:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 4/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372240:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824000 00010000:00010000:0.0:1651529423.372242:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 5/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 260 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372246:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12787 00000100:00100000:0.0:1651529423.372248:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396823872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.372251:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.372252:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 5/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 260 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372256:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 4/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 260 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372262:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372263:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372264:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372267:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 4/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372272:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.372281:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396823872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.372284:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12787 00000100:00100000:0.0:1651529423.372288:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12788 00000100:00100000:0.0:1651529423.372290:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396823936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.372292:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.372294:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 4/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372297:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372302:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c0d83 lrc: 0/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4ef expref: 259 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372305:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372305:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372306:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372309:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 4/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372315:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.372319:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41278:x1731746396823936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.372321:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12788 00000100:00100000:0.0:1651529423.372325:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12789 00000100:00100000:0.0:1651529423.372344:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746396824000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.372347:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.372348:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 5/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372352:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 4/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372357:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372358:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372359:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372362:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 4/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372366:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.372372:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746396824000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.372374:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12789 00010000:00010000:0.0:1651529423.372381:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372385:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372388:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372390:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.372538:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946602944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1056us (1420us total) trans 30064894931 rc 0/0 00000100:00100000:0.0:1651529423.372542:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154108 00000100:00100000:0.0:1651529423.372547:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154111 00000100:00100000:0.0:1651529423.372548:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946603200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.372553:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178676 count 1 00010000:00010000:0.0:1651529423.372558:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372563:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 256 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372568:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.372569:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.372570:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 4/0,1 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372576:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 256 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372580:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 4/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 256 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372584:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966719872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.372592:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf9c66a5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.372598:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372601:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.372602:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372605:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372610:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 1/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372615:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c0f90 lrc: 0/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.372642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.372675:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824064 00010000:00010000:0.0:1651529423.372681:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 5/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372687:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12790 00000100:00100000:0.0:1651529423.372689:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746396824064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529423.372692:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.372693:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 5/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372697:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 4/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 257 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.372702:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372703:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.372703:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372706:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 4/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372711:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.372720:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746396824064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.372722:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12790 00010000:00010000:0.0:1651529423.372733:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c0d60 lrc: 0/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a9 expref: 256 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.372737:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042044fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966719296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.372740:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372744:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372746:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372749:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372752:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.372949:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946602624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4374us (4604us total) trans 30064894932 rc 0/0 00000100:00100000:0.0:1651529423.372952:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154102 00010000:00010000:0.0:1651529423.372960:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372966:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.372967:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372970:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 3/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372975:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 1/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.372977:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c0f66 lrc: 0/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.372992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.373041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.373051:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966719872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.373055:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373062:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603264 00000100:00100000:0.0:1651529423.373070:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154112 00000100:00100000:0.0:1651529423.373071:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946603264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.373077:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178677 count 1 00010000:00010000:0.0:1651529423.373082:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373089:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 255 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373092:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.373092:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.373093:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 4/0,1 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373099:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 3/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 255 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373103:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 4/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373107:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966719936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.373118:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d7c4220 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.373126:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c0d7c lrc: 0/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e1 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373130:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966719552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.373133:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373136:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373159:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373162:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373165:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373296:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946602880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2972us (3371us total) trans 30064894933 rc 0/0 00000100:00100000:0.0:1651529423.373299:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154106 00010000:00010000:0.0:1651529423.373306:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373310:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a023b8c2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.373311:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373314:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 3/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373318:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 1/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373321:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c0f82 lrc: 0/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373329:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824128 00010000:00010000:0.0:1651529423.373333:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 4/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373339:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12791 00000100:00100000:0.0:1651529423.373341:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+255:41279:x1731746396824128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.373344:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.373345:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 4/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.373349:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.373353:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c0d9f lrc: 0/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc527 expref: 255 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.373357:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.373357:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.373358:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373361:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 4/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373367:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.373373:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396824128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.373377:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12791 00010000:00010000:0.0:1651529423.373382:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373385:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373388:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373391:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373459:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373466:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.373467:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373471:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373477:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 1/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373480:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0fa5 lrc: 0/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373495:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c0d75 lrc: 0/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4d3 expref: 253 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.373502:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023757f5b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966719488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.373507:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373510:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373513:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373516:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373519:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373520:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946603200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 971us (1834us total) trans 30064894934 rc 0/0 00000100:00100000:0.0:1651529423.373523:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154111 00010000:00010000:0.0:1651529423.373530:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373533:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.373534:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373537:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 3/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373542:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 1/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373545:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c0f7b lrc: 0/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373556:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c0d91 lrc: 0/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc50b expref: 252 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373559:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966719744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.373563:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373566:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373568:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373571:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373574:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.373665:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946602816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 4468us (4498us total) trans 30064894935 rc 0/0 00000100:00100000:1.0:1651529423.373669:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154105 00010000:00010000:1.0:1651529423.373678:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373682:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.373683:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373688:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 3/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373693:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 1/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373696:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c0f97 lrc: 0/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373707:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946603072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2111us (2173us total) trans 30064894936 rc 0/0 00000100:00100000:0.0:1651529423.373710:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154109 00010000:00010000:0.0:1651529423.373722:0:127523:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c0d98 lrc: 0/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc519 expref: 251 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373726:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b879addf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966719808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.373729:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373733:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373735:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373738:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373741:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373834:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373839:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.373840:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373843:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 3/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373848:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 1/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.373851:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c0f9e lrc: 0/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.373902:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946603136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2200us (2341us total) trans 30064894937 rc 0/0 00000100:00100000:0.0:1651529423.373905:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154110 00000100:00100000:0.0:1651529423.373923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529423.373972:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c0d8a lrc: 0/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4fd expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.373976:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966719616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.373980:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373983:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373986:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373989:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.373991:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.374143:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946603008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2735us (3063us total) trans 30064894938 rc 0/0 00000100:00100000:0.0:1651529423.374146:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154107 00000100:00100000:0.0:1651529423.374167:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603328 00000100:00100000:0.0:1651529423.374173:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154113 00000100:00100000:0.0:1651529423.374175:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946603328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.374180:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178678 count 1 00010000:00010000:0.0:1651529423.374185:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374204:0:144528:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374210:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374210:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374211:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 4/0,1 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374218:0:144528:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 3/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374222:0:144528:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 4/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374226:0:144528:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966720000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.374236:0:144528:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd2aec76 going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.374241:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374244:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c90bba11 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.374245:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374248:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 3/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374253:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 1/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374258:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c0f89 lrc: 0/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.374299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.374321:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824192 00010000:00010000:0.0:1651529423.374327:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 5/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374339:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12792 00000100:00100000:0.0:1651529423.374341:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396824192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.374344:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.374345:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 5/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.374349:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 4/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.374355:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.374355:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.374356:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374359:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 4/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374364:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.374398:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396824192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.374402:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12792 00010000:00010000:0.0:1651529423.374417:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c0da6 lrc: 0/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc535 expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374422:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966719936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.374425:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374428:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374431:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374434:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374437:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.374596:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946603264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1523us (1603us total) trans 30064894939 rc 0/0 00000100:00100000:0.0:1651529423.374599:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154112 00000100:00100000:0.0:1651529423.374635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.374697:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374715:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.374721:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603456 00000100:00100000:0.0:1651529423.374727:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603392 00000100:00100000:0.0:1651529423.374730:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603520 00000100:00100000:0.0:1651529423.374731:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603648 00000100:00100000:0.0:1651529423.374733:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603584 00000100:00100000:0.0:1651529423.374735:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603712 00000100:00100000:0.0:1651529423.374738:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154114 00000100:00100000:0.0:1651529423.374740:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946603456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.374745:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178680 count 1 00010000:00010000:0.0:1651529423.374750:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374755:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374758:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374759:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374760:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 4/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374766:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374770:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 4/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374787:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2bcbcc3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966720064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.374799:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000362c7c7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.374830:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154115 00000100:00100000:0.0:1651529423.374832:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946603392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.374837:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178679 count 1 00010000:00010000:0.0:1651529423.374841:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374846:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374849:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374850:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374850:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 4/0,1 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374856:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374860:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 4/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374864:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966720128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.374871:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000002cbe70 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.374878:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154116 00000100:00100000:0.0:1651529423.374880:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946603520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.374885:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178681 count 1 00010000:00010000:0.0:1651529423.374888:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374893:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374895:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374896:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.374897:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 4/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374902:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374905:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 4/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374909:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966720192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.374915:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000007eea7909 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.374921:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824256 00010000:00010000:0.0:1651529423.374925:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 5/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.374937:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12793 00000100:00100000:0.0:1651529423.374938:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396824256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.374943:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.374944:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 5/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.374948:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 4/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.374954:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.374954:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.374955:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374958:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 4/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.374963:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.374969:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396824256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.374971:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12793 00000100:00100000:0.0:1651529423.375006:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154117 00000100:00100000:0.0:1651529423.375008:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946603648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.375014:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178683 count 1 00010000:00010000:0.0:1651529423.375018:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375023:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375029:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375029:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375030:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 4/0,1 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375036:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 3/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375039:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 4/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375043:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042044fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966720256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.375053:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.375091:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154118 00000100:00100000:0.0:1651529423.375093:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946603584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.375098:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178682 count 1 00010000:00010000:0.0:1651529423.375103:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375124:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375127:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375128:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375129:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 4/0,1 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375148:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 3/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375151:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 4/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375155:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7137b76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966720320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.375164:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 000000003eab29c9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.375179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.375203:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603776 00000100:00100000:0.0:1651529423.375210:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154119 00000100:00100000:0.0:1651529423.375211:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946603712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.375216:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178684 count 1 00010000:00010000:0.0:1651529423.375221:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375226:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375229:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375229:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375230:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 4/0,1 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375237:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 3/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375251:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 4/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375255:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966720384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.375266:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.375272:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154120 00000100:00100000:0.0:1651529423.375274:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de606674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946603776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.375278:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178685 count 1 00010000:00010000:0.0:1651529423.375282:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375287:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375290:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375290:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.375291:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 4/0,1 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375297:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 3/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 248 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375300:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 4/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375329:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966720448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.375349:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 000000003bd1094e going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.375401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.375409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.375421:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3f9eb19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966720128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.375426:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.375433:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2bcbcc3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966720064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.375436:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.375442:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824320 00010000:00010000:0.0:1651529423.375447:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 4/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375454:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824384 00010000:00010000:0.0:1651529423.375456:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 4/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.375461:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12794 00000100:00100000:0.0:1651529423.375463:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396824320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.375466:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.375467:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 4/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375479:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375485:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c0dbb lrc: 0/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc55f expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375489:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.375489:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.375490:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375493:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 4/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375500:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.375508:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41279:x1731746396824320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.375511:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12794 00000100:00100000:0.0:1651529423.375516:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12795 00000100:00100000:0.0:1651529423.375517:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41279:x1731746396824384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529423.375520:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.375521:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 4/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375525:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375530:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c0db4 lrc: 0/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc551 expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.375533:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.375534:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.375534:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375537:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 4/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375542:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.375547:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746396824384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.375549:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12795 00010000:00010000:0.0:1651529423.375554:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375558:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375561:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375563:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.375742:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946603392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 908us (1062us total) trans 30064894940 rc 0/0 00000100:00100000:0.0:1651529423.375745:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154115 00010000:00010000:0.0:1651529423.375753:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375756:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375760:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375762:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.375934:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946603456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1192us (1298us total) trans 30064894941 rc 0/0 00000100:00100000:0.0:1651529423.375937:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154114 00010000:00010000:0.0:1651529423.375947:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375951:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.375952:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375955:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 3/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375960:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 1/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375963:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c0fac lrc: 0/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375967:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375970:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.375971:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375974:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375977:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 1/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375979:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c0fc1 lrc: 0/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375983:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375985:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.375986:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375989:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375992:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 1/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.375995:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c0fba lrc: 0/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.376059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.376079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.376086:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.376098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.376104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.376112:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966720192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.376116:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.376123:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824512 00010000:00010000:0.0:1651529423.376128:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 5/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 247 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376133:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824448 00010000:00010000:0.0:1651529423.376135:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 4/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376151:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824576 00010000:00010000:0.0:1651529423.376154:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 5/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 249 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376157:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824704 00010000:00010000:0.0:1651529423.376159:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 5/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376163:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824640 00010000:00010000:0.0:1651529423.376165:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 5/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 251 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376169:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12796 00000100:00100000:0.0:1651529423.376171:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396824512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.376174:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.376175:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 5/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 251 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376179:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 4/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 251 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376184:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376185:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376186:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376197:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 4/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376202:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.376211:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396824512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.376214:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12796 00000100:00100000:0.0:1651529423.376235:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12797 00000100:00100000:0.0:1651529423.376237:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396824448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.376241:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.376242:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 4/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376246:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376252:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c0dc2 lrc: 0/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc56d expref: 250 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376255:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376256:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376256:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376259:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 4/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376277:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.376284:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396824448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.376287:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12797 00000100:00100000:0.0:1651529423.376291:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12798 00000100:00100000:0.0:1651529423.376293:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41278:x1731746396824576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.376295:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.376297:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 5/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376300:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 4/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 248 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376305:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376305:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376306:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376309:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 4/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376313:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.376317:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41278:x1731746396824576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.376320:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12798 00000100:00100000:0.0:1651529423.376323:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12799 00000100:00100000:0.0:1651529423.376331:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746396824704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.376333:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.376335:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 5/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 247 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376338:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 4/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 247 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376343:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376344:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376344:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376347:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 4/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376351:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.376356:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b668bdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746396824704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.376358:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12799 00000100:00100000:0.0:1651529423.376366:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12800 00000100:00100000:0.0:1651529423.376368:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41279:x1731746396824640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.376370:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.376371:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 5/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 246 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376375:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 4/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 246 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.376386:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376387:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.376388:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376391:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 4/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376395:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.376400:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004da50ea5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41279:x1731746396824640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.376402:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12800 00010000:00010000:0.0:1651529423.376409:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376412:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376415:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376418:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.376550:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946603520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1668us (1852us total) trans 30064894942 rc 0/0 00000100:00100000:0.0:1651529423.376553:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154116 00010000:00010000:0.0:1651529423.376568:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376572:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.376573:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376576:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376581:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 1/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376584:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c0fc8 lrc: 0/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376594:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c0dd0 lrc: 0/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc589 expref: 245 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376597:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042044fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966720256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.376601:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376604:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376607:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376618:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376621:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.376750:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946603648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1741us (2046us total) trans 30064894943 rc 0/0 00000100:00100000:0.0:1651529423.376753:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154117 00010000:00010000:0.0:1651529423.376760:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376763:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.376764:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376767:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 3/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376771:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 1/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376774:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c0fcf lrc: 0/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376795:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c0dc9 lrc: 0/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc57b expref: 244 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.376829:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7137b76 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966720320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.376833:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376836:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376838:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376841:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376844:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.376980:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946603584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1886us (2270us total) trans 30064894944 rc 0/0 00000100:00100000:0.0:1651529423.376983:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154118 00010000:00010000:0.0:1651529423.376990:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.376993:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.376994:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377008:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 3/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377013:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 1/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377016:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c0fd6 lrc: 0/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.377033:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377084:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603904 00000100:00100000:0.0:1651529423.377091:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603840 00000100:00100000:0.0:1651529423.377095:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154121 00000100:00100000:0.0:1651529423.377097:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946603904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377102:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178687 count 1 00010000:00010000:0.0:1651529423.377107:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377112:0:142993:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 243 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377115:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377116:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377116:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 4/0,1 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377134:0:142993:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 3/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 243 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377138:0:142993:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 4/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377142:0:142993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966720512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.377174:0:142993:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075ff1d7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.377181:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154122 00000100:00100000:0.0:1651529423.377183:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946603840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377188:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178686 count 1 00010000:00010000:0.0:1651529423.377192:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377197:0:127523:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 243 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377200:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377200:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377201:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 4/0,1 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377207:0:127523:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 243 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377211:0:127523:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 4/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377224:0:127523:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966720576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.377233:0:127523:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00010000:00010000:0.0:1651529423.377241:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c0dde lrc: 0/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5a5 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377245:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983fda71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966720448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.377248:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377251:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377254:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377257:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377260:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.377412:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de606674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946603776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2137us (2233us total) trans 30064894945 rc 0/0 00000100:00100000:0.0:1651529423.377415:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154120 00010000:00010000:0.0:1651529423.377423:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377436:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.377437:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377440:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 3/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377445:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 1/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377447:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c0fe4 lrc: 0/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377458:0:127525:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c0dd7 lrc: 0/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc597 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377462:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdde08e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966720384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.377465:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377468:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377471:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377477:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377479:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.377607:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946603712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2394us (2891us total) trans 30064894946 rc 0/0 00000100:00100000:0.0:1651529423.377610:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154119 00010000:00010000:0.0:1651529423.377617:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377620:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.377621:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377624:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 3/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377628:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 1/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377631:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c0fdd lrc: 0/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.377659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377710:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946603968 00000100:00100000:0.0:1651529423.377717:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604032 00000100:00100000:0.0:1651529423.377720:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604096 00000100:00100000:0.0:1651529423.377723:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154123 00000100:00100000:0.0:1651529423.377725:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946603968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377730:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178688 count 1 00010000:00010000:0.0:1651529423.377735:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377740:0:142995:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377743:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377743:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377744:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 4/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377751:0:142995:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377754:0:142995:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 4/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377758:0:142995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966720640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.377769:0:142995:0:(client.c:2492:ptlrpc_set_wait()) set 000000003bd1094e going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.377774:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154124 00000100:00100000:0.0:1651529423.377785:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946604032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377790:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178689 count 1 00010000:00010000:0.0:1651529423.377794:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377799:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377802:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377802:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377815:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 4/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377823:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377827:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 4/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377831:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966720704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.377839:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.377845:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154125 00000100:00100000:0.0:1651529423.377847:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946604096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377867:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178690 count 1 00010000:00010000:0.0:1651529423.377872:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377879:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377882:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377883:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.377883:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 4/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377890:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377893:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 4/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.377897:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbdd46a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966720768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.377905:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000362c7c7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.377917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.377953:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604160 00000100:00100000:0.0:1651529423.377959:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154126 00000100:00100000:0.0:1651529423.377960:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7137b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946604160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.377966:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178691 count 1 00010000:00010000:0.0:1651529423.377988:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.377993:0:142996:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378005:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.378006:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.378007:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 4/0,1 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378014:0:142996:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 3/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378017:0:142996:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 4/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.378022:0:142996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966720832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.378030:0:142996:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d7c4220 going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.378056:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604224 00000100:00100000:1.0:1651529423.378072:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154127 00000100:00100000:1.0:1651529423.378074:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042044fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:39030:x1731745946604224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529423.378081:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178692 count 1 00000100:00100000:0.0:1651529423.378088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529423.378094:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378095:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529423.378100:0:144527:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.378104:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.378105:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529423.378106:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 4/0,1 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.378114:0:144527:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 3/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 241 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.378118:0:144527:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 4/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.378123:0:144527:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023757f5b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966720896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529423.378141:0:144527:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ffdb1ab0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.378148:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824768 00010000:00010000:1.0:1651529423.378154:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 5/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.378160:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824832 00010000:00010000:1.0:1651529423.378162:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 5/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.378168:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12801 00000100:00100000:1.0:1651529423.378169:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396824768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529423.378170:0:127523:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c8028b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:127523:1731745966720576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.378173:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.378174:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 5/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378176:0:127523:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.378178:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 4/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.378184:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.378185:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529423.378185:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12802 00010000:00010000:1.0:1651529423.378186:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378187:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396824832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529423.378189:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 4/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378190:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.378192:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 4/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.378194:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.378201:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396824768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.378204:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12801 00010000:00010000:0.0:1651529423.378208:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378215:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c0de5 lrc: 0/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5b3 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378218:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.378219:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.378220:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378223:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 4/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378230:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.378238:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396824832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.378241:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12802 00010000:00010000:0.0:1651529423.378249:0:127523:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378253:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378256:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378268:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378433:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b883b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946603840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1249us (1386us total) trans 30064894947 rc 0/0 00000100:00100000:0.0:1651529423.378436:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154122 00010000:00010000:0.0:1651529423.378444:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378447:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.378449:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378452:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378465:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 1/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378480:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c0ff2 lrc: 0/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378522:0:142993:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c0dec lrc: 0/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c1 expref: 240 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.378527:0:142993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000057fefa pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:142993:1731745966720512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.378540:0:142993:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378543:0:142993:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378546:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378549:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378552:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378690:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001745b514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946603904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1591us (1656us total) trans 30064894948 rc 0/0 00000100:00100000:0.0:1651529423.378693:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154121 00000100:00100000:0.0:1651529423.378750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.378770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.378799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.378834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.378849:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c851d0b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966720704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.378853:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378861:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbdd46a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966720768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.378864:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378876:0:142995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc3d7b14 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:142995:1731745966720640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.378879:0:142995:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.378913:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824960 00000100:00100000:1.0:1651529423.378919:0:127515:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396824896 00010000:00010000:0.0:1651529423.378920:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 4/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 240 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.378926:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825024 00010000:00010000:1.0:1651529423.378927:0:127515:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 4/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 241 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378929:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 4/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.378933:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825088 00000100:00100000:1.0:1651529423.378935:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12803 00010000:00010000:0.0:1651529423.378935:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 5/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.378937:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746396824960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529423.378940:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12804 00010000:00010000:1.0:1651529423.378941:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.378942:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 4/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.378942:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746396825024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.378945:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.378946:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378946:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 4/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378950:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.378953:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c0dfa lrc: 0/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5dd expref: 243 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.378956:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7aa555/0xa29a79078f3c0e01 lrc: 0/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc662 expref: 242 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.378957:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.378957:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.378958:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378961:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.378961:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.378962:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 4/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378962:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.378965:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 4/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.378972:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.378984:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000057fefa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41279:x1731746396824960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.378987:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12803 00000100:00100000:1.0:1651529423.378993:0:127515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12805 00000100:00100000:1.0:1651529423.378995:0:127515:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746396824896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529423.378998:0:127515:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.378999:0:127515:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 4/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 240 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.379001:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529423.379003:0:127515:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 240 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.379009:0:127515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c0df3 lrc: 0/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5cf expref: 240 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.379010:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746396825024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (211us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529423.379012:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.379012:0:127515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.379013:0:127515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379013:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12804 00010000:00010000:1.0:1651529423.379016:0:127515:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 4/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379019:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12806 00000100:00100000:0.0:1651529423.379021:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41278:x1731746396825088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.379024:0:127515:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529423.379030:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529423.379031:0:127515:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c8028b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41279:x1731746396824896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529423.379032:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 5/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 238 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.379034:0:127515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12805 00010000:00010000:0.0:1651529423.379036:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 4/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 237 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.379040:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379042:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.379042:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.379043:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379044:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.379045:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379047:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 4/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379048:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 3/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379051:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529423.379053:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 1/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379056:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c0feb lrc: 0/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379056:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abed653d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396825088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.379059:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12806 00010000:00010000:0.0:1651529423.379070:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379073:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379077:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379079:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379109:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379113:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.379114:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379117:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379122:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 1/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379125:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1000 lrc: 0/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379215:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000983fda71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946604032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1437us (1540us total) trans 30064894949 rc 0/0 00000100:00100000:0.0:1651529423.379218:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154124 00010000:00010000:0.0:1651529423.379225:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379228:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379232:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379235:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379357:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac34838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946604096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1509us (1672us total) trans 30064894950 rc 0/0 00000100:00100000:0.0:1651529423.379360:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154125 00010000:00010000:0.0:1651529423.379367:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379371:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.379372:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379375:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379379:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 1/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379382:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1007 lrc: 0/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379389:0:142995:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379401:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379404:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379406:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379536:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdde08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946603968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1809us (1876us total) trans 30064894951 rc 0/0 00000100:00100000:0.0:1651529423.379539:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154123 00010000:00010000:0.0:1651529423.379552:0:144528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c0dad lrc: 0/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc543 expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.379556:0:144528:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:144528:1731745966720000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.379560:0:144528:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379563:0:144528:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379566:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379580:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379583:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379718:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946603328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 5534us (5787us total) trans 30064894952 rc 0/0 00010000:00010000:1.0:1651529423.379721:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379722:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154113 00010000:00010000:1.0:1651529423.379726:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.379727:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379731:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379736:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 1/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379738:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c0ff9 lrc: 0/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379743:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379746:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.379746:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379749:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 3/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379752:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 1/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.379755:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c0fb3 lrc: 0/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.379830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.379873:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825152 00010000:00010000:0.0:1651529423.379879:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 5/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.379891:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12807 00000100:00100000:0.0:1651529423.379893:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41279:x1731746396825152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529423.379896:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.379898:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 5/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.379902:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 4/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.379908:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.379909:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.379917:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379920:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 4/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379926:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.379936:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41279:x1731746396825152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.379939:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12807 00010000:00010000:0.0:1651529423.379952:0:142996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4befcc8/0xa29a79078f3c0e08 lrc: 0/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc670 expref: 235 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.379956:0:142996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:142996:1731745966720832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.379959:0:142996:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379963:0:142996:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379965:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379969:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.379971:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380060:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380065:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.380066:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380069:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 3/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380074:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 1/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380077:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c100e lrc: 0/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380090:0:144527:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005859f450/0xa29a79078f3c0e0f lrc: 0/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc67e expref: 234 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.380093:0:144527:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023757f5b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:144527:1731745966720896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.380098:0:144527:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380101:0:144527:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380107:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380110:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.380112:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.380123:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7137b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946604160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2161us (2205us total) trans 30064894953 rc 0/0 00000100:00100000:0.0:1651529423.380126:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154126 00010000:00010000:0.0:1651529423.380133:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380137:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.380138:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380141:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 3/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380146:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 1/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380149:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1015 lrc: 0/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.380277:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042044fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946604224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2201us (2347us total) trans 30064894954 rc 0/0 00000100:00100000:1.0:1651529423.380280:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154127 00000100:00100000:0.0:1651529423.380529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.380539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.380546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.380552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.380558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.380565:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604352 00000100:00100000:0.0:1651529423.380572:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604480 00000100:00100000:0.0:1651529423.380576:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604288 00000100:00100000:0.0:1651529423.380579:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604416 00000100:00100000:0.0:1651529423.380582:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604544 00000100:00100000:0.0:1651529423.380586:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154128 00000100:00100000:0.0:1651529423.380588:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946604352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.380594:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178694 count 1 00010000:00010000:0.0:1651529423.380599:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380604:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380607:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380608:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380609:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 4/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380616:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380620:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 4/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.380625:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f63cb8d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966720960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.380637:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2df7206 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.380643:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154129 00000100:00100000:0.0:1651529423.380645:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946604480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.380649:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178696 count 1 00010000:00010000:0.0:1651529423.380653:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380657:0:128009:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380660:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380660:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380661:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 4/0,1 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380667:0:128009:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 3/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380670:0:128009:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 4/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.380674:0:128009:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ebd06bc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966721024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.380681:0:128009:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.380686:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154130 00000100:00100000:0.0:1651529423.380688:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946604288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.380692:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178693 count 1 00010000:00010000:0.0:1651529423.380696:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380700:0:161133:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380705:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380706:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380706:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 4/0,1 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380712:0:161133:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 3/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380716:0:161133:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 4/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.380719:0:161133:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9c06969 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966721088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.380725:0:161133:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.380731:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154131 00000100:00100000:0.0:1651529423.380733:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946604416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.380736:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178695 count 1 00010000:00010000:0.0:1651529423.380740:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380744:0:127526:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380746:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380747:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380747:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 4/0,1 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380755:0:127526:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 3/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380759:0:127526:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 4/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.380762:0:127526:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2ff3bea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966721152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.380768:0:127526:0:(client.c:2492:ptlrpc_set_wait()) set 00000000362c7c7a going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.380773:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154132 00000100:00100000:0.0:1651529423.380775:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946604544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529423.380789:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178697 count 1 00010000:00010000:0.0:1651529423.380793:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380797:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380800:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380801:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.380802:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 4/0,1 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380827:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 3/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 233 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.380830:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 4/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.380843:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065695016 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966721216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.380852:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a002ed0c going to sleep for 6 seconds 00000100:00100000:1.0:1651529423.381702:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.381709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.381732:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.381740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.381747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529423.381753:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825280 00010000:00010000:1.0:1651529423.381759:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 5/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 234 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.381766:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825216 00010000:00010000:1.0:1651529423.381769:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 5/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 235 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.381773:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825344 00010000:00010000:1.0:1651529423.381775:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 5/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.381790:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825472 00010000:00010000:1.0:1651529423.381792:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 5/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 237 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.381796:0:142556:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825408 00010000:00010000:1.0:1651529423.381798:0:142556:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 5/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 238 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:1.0:1651529423.381841:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12808 00000100:00100000:1.0:1651529423.381844:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41278:x1731746396825280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529423.381848:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.381849:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 5/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 238 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381854:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 4/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 238 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381860:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381867:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381868:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381871:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 4/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381879:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.381888:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f63cb8d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966720960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529423.381894:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41278:x1731746396825280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.381898:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12808 00010000:00010000:0.0:1651529423.381899:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529423.381904:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12809 00000100:00100000:1.0:1651529423.381905:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396825216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529423.381908:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.381908:0:128009:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df94e3f2/0xa29a79078f3c0e2b lrc: 0/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6b6 expref: 237 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381910:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 4/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 237 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.381912:0:128009:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ebd06bc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:128009:1731745966721024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529423.381914:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.381915:0:128009:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.381918:0:128009:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381919:0:142556:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087766569/0xa29a79078f3c0e1d lrc: 0/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc69a expref: 236 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:0.0:1651529423.381921:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381923:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381923:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381924:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.381924:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381927:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 4/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.381927:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381935:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.381941:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746396825216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.381944:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12809 00000100:00100000:1.0:1651529423.381954:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12810 00000100:00100000:1.0:1651529423.381956:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396825344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.381959:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.381960:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 5/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 234 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381964:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 4/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 234 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381969:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381969:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.381970:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381973:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 4/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.381977:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.381983:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396825344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.381985:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12810 00000100:00100000:1.0:1651529423.381989:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12811 00000100:00100000:1.0:1651529423.381990:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396825472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.381992:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.381994:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 5/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.381997:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 4/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 233 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.382001:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.382002:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.382002:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382005:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 4/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382009:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.382013:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396825472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.382016:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12811 00000100:00100000:1.0:1651529423.382019:0:142556:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12812 00000100:00100000:1.0:1651529423.382021:0:142556:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41279:x1731746396825408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529423.382023:0:142556:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529423.382024:0:142556:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 5/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 232 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.382027:0:142556:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 4/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 232 pid: 144527 timeout: 13173 lvb_type: 0 00010000:00010000:1.0:1651529423.382031:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.382032:0:142556:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529423.382033:0:142556:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382036:0:142556:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 4/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382039:0:142556:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529423.382043:0:142556:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41279:x1731746396825408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529423.382046:0:142556:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12812 00010000:00010000:1.0:1651529423.382065:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382069:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.382070:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382073:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 3/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382077:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 1/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382080:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1023 lrc: 0/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.382088:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946604480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1442us (1547us total) trans 30064894955 rc 0/0 00000100:00100000:0.0:1651529423.382091:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154129 00010000:00010000:0.0:1651529423.382104:0:161133:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043da83ee/0xa29a79078f3c0e16 lrc: 0/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc68c expref: 231 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.382108:0:161133:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9c06969 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:161133:1731745966721088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.382112:0:161133:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382115:0:161133:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382118:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382121:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382123:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.382274:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946604288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1584us (1726us total) trans 30064894956 rc 0/0 00000100:00100000:0.0:1651529423.382277:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154130 00010000:00010000:0.0:1651529423.382297:0:127526:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f8488a/0xa29a79078f3c0e24 lrc: 0/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a8 expref: 230 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.382301:0:127526:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2ff3bea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:127526:1731745966721152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.382305:0:127526:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382308:0:127526:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382311:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382314:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382317:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382364:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382372:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.382373:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382376:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 3/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382381:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 1/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382384:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c102a lrc: 0/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382389:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382391:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.382392:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382395:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 3/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382398:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 1/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.382403:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1031 lrc: 0/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.382450:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946604416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1716us (1897us total) trans 30064894957 rc 0/0 00000100:00100000:0.0:1651529423.382454:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154131 00010000:00010000:0.0:1651529423.382464:0:142994:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5430163/0xa29a79078f3c0e32 lrc: 0/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6c4 expref: 229 pid: 144527 timeout: 13173 lvb_type: 0 00000100:00100000:0.0:1651529423.382468:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065695016 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966721216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.382471:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382482:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382485:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382488:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382491:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.382617:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946604544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1841us (2058us total) trans 30064894958 rc 0/0 00000100:00100000:0.0:1651529423.382620:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154132 00010000:00010000:0.0:1651529423.382692:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382696:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529423.382697:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382700:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 3/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382706:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 1/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382716:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1038 lrc: 0/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382723:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382726:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382729:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.382732:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.382900:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946604352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2310us (2371us total) trans 30064894959 rc 0/0 00000100:00100000:0.0:1651529423.382903:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154128 00010000:00010000:1.0:1651529423.383076:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.383081:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529423.383082:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.383085:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.383090:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 1/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529423.383093:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c101c lrc: 0/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529423.784016:0:170370:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529423.784019:0:170370:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131b: test append writev ================== 22:10:23 (1651529423) 00000001:00080000:0.0:1651529424.148121:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894959 is committed 00000001:00080000:0.0:1651529424.148150:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894886 is committed 00000400:00000080:1.0:1651529425.109309:0:170588:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529425.109312:0:170588:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131c: test read/write on file w/o objects ========================================================== 22:10:24 (1651529424) 00000100:00100000:0.0:1651529426.144187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529426.144213:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604800 00000100:00100000:1.0:1651529426.144241:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 322 00000100:00100000:1.0:1651529426.144244:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065695016 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946604800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529426.144261:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:1.0:1651529426.144290:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065695016 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946604800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529426.144294:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 322 00000400:00000080:1.0:1651529426.387634:0:170807:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529426.387637:0:170807:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131d: test short read ===================== 22:10:26 (1651529426) 00000100:00100000:0.0:1651529426.412301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529426.412326:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396827072 00000100:00100000:1.0:1651529426.412354:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154133 00000100:00100000:1.0:1651529426.412357:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:427687:x1731746396827072:12345-10.240.43.64@tcp:101:rwv.0 00010000:00010000:1.0:1651529426.412367:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529426.412379:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 2/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc734 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529426.412391:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529426.412401:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529426.412402:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529426.412407:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529426.412415:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529426.412421:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000068800f9f, rc 0) 00000100:00100000:1.0:1651529426.412445:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:427687:x1731746396827072:12345-10.240.43.64@tcp:101:rwv.0 Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529426.412449:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154133 00000400:00000080:1.0:1651529427.696675:0:171025:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529427.696678:0:171025:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131e: test read hitting hole ============== 22:10:27 (1651529427) 00000100:00100000:0.0:1651529427.748380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.748410:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604864 00000100:00100000:1.0:1651529427.748436:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154134 00000100:00100000:1.0:1651529427.748439:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946604864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529427.748456:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178698 count 1 00010000:00010000:1.0:1651529427.748469:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.748480:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.748484:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.748485:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.748486:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 4/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.748501:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 10 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.748506:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 4/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 10 pid: 144527 timeout: 13177 lvb_type: 0 00000100:00100000:1.0:1651529427.748513:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002bec6a46 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.748543:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf55602f going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.748967:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002bec6a46 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.748974:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.748974:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828672 00010000:00010000:0.0:1651529427.748984:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 4/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 11 pid: 144527 timeout: 13177 lvb_type: 0 00000100:00100000:0.0:1651529427.748997:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12813 00000100:00100000:0.0:1651529427.748999:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396828672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.749004:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.749006:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 4/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 11 pid: 144527 timeout: 13177 lvb_type: 0 00010000:00010000:0.0:1651529427.749011:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 11 pid: 144527 timeout: 13177 lvb_type: 0 00010000:00010000:0.0:1651529427.749022:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1ba0c6/0xa29a79078f3c0e39 lrc: 0/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->3145727) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6e7 expref: 11 pid: 144527 timeout: 13177 lvb_type: 0 00010000:00010000:0.0:1651529427.749026:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.749027:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.749028:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749033:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 4/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749046:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.749060:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396828672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (108us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.749062:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.749064:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12813 00010000:00010000:1.0:1651529427.749066:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.749070:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.749073:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749122:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749126:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529427.749128:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749131:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749137:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 1/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749140:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1046 lrc: 0/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.749199:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946604864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 758us (821us total) trans 30064894960 rc 0/0 00000100:00100000:1.0:1651529427.749203:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154134 00000400:00000080:0.0:1651529429.219390:0:171243:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529429.219393:0:171243:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133a: Verifying MDT stats ================================================================================================== 22:10:28 (1651529428) 00000100:00100000:0.0:1651529430.061373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529430.061390:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396835200 00000100:00100000:0.0:1651529430.061410:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154135 00000100:00100000:0.0:1651529430.061412:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396835200:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:0.0:1651529430.061507:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396835200:12345-10.240.43.64@tcp:2:touch.0 Request processed in 94us (137us total) trans 30064894961 rc 0/0 00000100:00100000:0.0:1651529430.061511:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154135 00000100:00100000:0.0:1651529430.842043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529430.842055:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396835776 00000100:00100000:0.0:1651529430.842079:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154136 00000100:00100000:0.0:1651529430.842082:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396835776:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651529430.842088:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529430.842099:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 2/0,0 mode: --/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc788 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529430.842108:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0c:0x0] initial LVB size: 0, mtime: 0x627056d6, atime: 0x627056d6, ctime: 0x627056d6, blocks: 0x0 00010000:00010000:0.0:1651529430.842117:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529430.842118:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529430.842122:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 12 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529430.842130:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 12 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529430.842136:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6e2a7ad, rc 0) 00000100:00100000:0.0:1651529430.842151:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396835776:12345-10.240.43.64@tcp:101:rm.0 Request processed in 69us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529430.842154:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154136 00000100:00100000:0.0:1651529431.265105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529431.265116:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610816 00000100:00100000:0.0:1651529431.265128:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 323 00000100:00100000:0.0:1651529431.265130:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f63cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946610816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529431.265140:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529431.265155:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f63cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946610816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529431.265158:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 323 00000001:00080000:0.0:1651529433.328100:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894961 is committed 00000001:00080000:0.0:1651529433.328109:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894960 is committed 00000100:00100000:0.0:1651529433.339237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529433.339250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529433.339262:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610880 00000100:00100000:0.0:1651529433.339281:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611008 00000100:00100000:0.0:1651529433.339287:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154137 00000100:00100000:0.0:1651529433.339289:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946610880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529433.339305:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178699 count 1 00010000:00010000:0.0:1651529433.339319:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339330:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 10 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339334:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529433.339335:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529433.339336:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 4/0,1 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339351:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 10 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339356:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 4/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 10 pid: 127525 timeout: 13182 lvb_type: 0 00000100:00100000:0.0:1651529433.339363:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057488d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529433.339390:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 00000000acef4949 going to sleep for 6 seconds 00000100:00100000:0.0:1651529433.339398:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154138 00000100:00100000:0.0:1651529433.339400:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946611008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529433.339406:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178700 count 1 00010000:00010000:0.0:1651529433.339410:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339415:0:142994:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 2/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529433.339418:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.339418:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.339419:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 4/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339426:0:142994:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529433.339430:0:142994:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 13182 lvb_type: 1 00000100:00100000:0.0:1651529433.339434:0:142994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966721408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529433.339442:0:142994:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d7c4220 going to sleep for 6 seconds 00000100:00100000:0.0:1651529433.340361:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057488d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529433.340368:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529433.340483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529433.340512:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396839936 00010000:00010000:0.0:1651529433.340520:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 4/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 13182 lvb_type: 0 00000100:00100000:0.0:1651529433.340530:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12814 00000100:00100000:0.0:1651529433.340532:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396839936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529433.340536:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529433.340538:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 4/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 13182 lvb_type: 0 00010000:00010000:0.0:1651529433.340542:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 13182 lvb_type: 0 00010000:00010000:0.0:1651529433.340551:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c103f lrc: 0/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc734 expref: 11 pid: 127525 timeout: 13182 lvb_type: 0 00010000:00010000:0.0:1651529433.340555:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.340556:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.340557:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340561:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 4/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340568:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529433.340578:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396839936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529433.340581:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12814 00000100:00100000:0.0:1651529433.340593:0:142994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000637c8cd7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:142994:1731745966721408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529433.340597:0:142994:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340624:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340628:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340632:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340635:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340655:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340662:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529433.340664:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340668:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340676:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 1/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340679:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1054 lrc: 0/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529433.340755:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946610880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1464us (1519us total) trans 30064894962 rc 0/0 00000100:00100000:0.0:1651529433.340758:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154137 00000100:00100000:0.0:1651529433.340774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529433.340830:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396840000 00010000:00010000:0.0:1651529433.340836:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 13182 lvb_type: 1 00000100:00100000:0.0:1651529433.340845:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12815 00000100:00100000:0.0:1651529433.340847:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396840000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529433.340850:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529433.340862:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 13182 lvb_type: 1 00010000:00010000:0.0:1651529433.340866:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 13182 lvb_type: 1 00010000:00010000:0.0:1651529433.340887:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c104d lrc: 0/0,0 mode: --/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc788 expref: 10 pid: 142994 timeout: 13182 lvb_type: 1 00010000:00010000:0.0:1651529433.340891:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.340892:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529433.340893:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340896:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 4/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340903:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529433.340912:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396840000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529433.340915:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12815 00010000:00010000:0.0:1651529433.340922:0:142994:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340925:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340928:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340940:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529433.340986:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946611008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1585us (1736us total) trans 30064894963 rc 0/0 00000100:00100000:0.0:1651529433.340990:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154138 00010000:00010000:0.0:1651529433.340997:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.341001:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529433.341002:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.341005:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 3/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.341010:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 1/0,0 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.341013:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c105b lrc: 0/0,0 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000400:00000080:1.0:1651529434.101571:0:171515:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529434.101574:0:171515:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133b: Verifying extra MDT stats ============================================================================================ 22:10:33 (1651529433) 00000100:00100000:0.0:1651529434.193825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529434.193846:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396840960 00000100:00100000:1.0:1651529434.193873:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154139 00000100:00100000:1.0:1651529434.193876:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396840960:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651529434.193983:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396840960:12345-10.240.43.64@tcp:2:touch.0 Request processed in 106us (180us total) trans 30064894964 rc 0/0 00000100:00100000:1.0:1651529434.193987:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154139 00000100:00100000:1.0:1651529434.587862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529434.587882:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396842496 00000100:00100000:1.0:1651529434.587905:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154140 00000100:00100000:1.0:1651529434.587908:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396842496:12345-10.240.43.64@tcp:101:chmod.0 00010000:00010000:1.0:1651529434.587918:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529434.587930:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 2/0,0 mode: --/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc845 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529434.587941:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0d:0x0] initial LVB size: 0, mtime: 0x627056da, atime: 0x627056da, ctime: 0x627056da, blocks: 0x0 00010000:00010000:1.0:1651529434.587950:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529434.587951:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529434.587956:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 11 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529434.587964:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 11 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529434.587973:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000068800f9f, rc 0) 00000100:00100000:1.0:1651529434.587997:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396842496:12345-10.240.43.64@tcp:101:chmod.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529434.588000:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154140 00000100:00100000:1.0:1651529434.589220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529434.589277:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396842752 00000100:00100000:0.0:1651529434.589298:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154141 00000100:00100000:0.0:1651529434.589301:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396842752:12345-10.240.43.64@tcp:2:chmod.0 00002000:00010000:0.0:1651529434.589368:0:127525:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba0d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529434.589369:0:127525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba0d:0x0] updating lvb mtime from disk: 1651529434 -> 1651529434 00002000:00010000:0.0:1651529434.589370:0:127525:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba0d:0x0] updating lvb atime from disk: 1651529434 -> 1651529434 00002000:00010000:0.0:1651529434.589371:0:127525:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba0d:0x0] updating lvb ctime from disk: 1651529434 -> 1651529434 00002000:00010000:0.0:1651529434.589372:0:127525:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba0d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529434.589387:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396842752:12345-10.240.43.64@tcp:2:chmod.0 Request processed in 86us (168us total) trans 30064894965 rc 0/0 00000100:00100000:0.0:1651529434.589391:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154141 00000100:00100000:1.0:1651529436.384154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529436.384180:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611200 00000100:00100000:0.0:1651529436.384198:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 324 00000100:00100000:0.0:1651529436.384201:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946611200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529436.384215:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529436.384236:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946611200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529436.384240:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 324 00000100:00100000:0.0:1651529438.815229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529438.815249:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396844736 00000100:00100000:0.0:1651529438.815269:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 325 00000100:00100000:0.0:1651529438.815272:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:429787:x1731746396844736:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529438.815297:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529438.815324:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000952f2b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:429787:x1731746396844736:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529438.815328:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 325 00000100:00100000:0.0:1651529439.456229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529439.456242:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611328 00000100:00100000:0.0:1651529439.456273:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 40 00000100:00100000:0.0:1651529439.456275:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946611328:12345-10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529439.456299:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946611328:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 23us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529439.456302:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 40 00000001:00080000:0.0:1651529439.490487:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894965 is committed 00000001:00080000:0.0:1651529439.490492:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894963 is committed 00000100:00100000:0.0:1651529439.503488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529439.503496:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611520 00000100:00100000:0.0:1651529439.503512:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154142 00000100:00100000:0.0:1651529439.503514:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946611520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529439.503524:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178701 count 1 00010000:00010000:0.0:1651529439.503536:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.503546:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 2/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 9 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529439.503550:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529439.503551:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529439.503552:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 4/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.503565:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 9 pid: 142994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529439.503570:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 4/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 9 pid: 142994 timeout: 13189 lvb_type: 1 00000100:00100000:0.0:1651529439.503580:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007987a9b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529439.503600:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000019c585c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529439.503891:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007987a9b1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529439.503898:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529439.504001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529439.504012:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396844864 00010000:00010000:0.0:1651529439.504019:0:127517:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 4/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 10 pid: 142994 timeout: 13189 lvb_type: 1 00000100:00100000:0.0:1651529439.504029:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12816 00000100:00100000:0.0:1651529439.504031:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396844864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529439.504035:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529439.504037:0:127517:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 4/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 10 pid: 142994 timeout: 13189 lvb_type: 1 00010000:00010000:0.0:1651529439.504041:0:127517:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 10 pid: 142994 timeout: 13189 lvb_type: 1 00010000:00010000:0.0:1651529439.504050:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1062 lrc: 0/0,0 mode: --/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc845 expref: 10 pid: 142994 timeout: 13189 lvb_type: 1 00010000:00010000:0.0:1651529439.504054:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529439.504055:0:127517:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529439.504056:0:127517:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504060:0:127517:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 4/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504067:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529439.504076:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396844864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529439.504079:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12816 00010000:00010000:0.0:1651529439.504107:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504111:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504115:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504118:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529439.504204:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946611520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 689us (717us total) trans 30064894966 rc 0/0 00000100:00100000:0.0:1651529439.504208:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154142 00010000:00010000:0.0:1651529439.504215:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504222:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529439.504223:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504227:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 3/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504232:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 1/0,0 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529439.504235:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1069 lrc: 0/0,0 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529441.468861:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966721536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529441.468865:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0896919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966721600:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529441.469402:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0896919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966721600:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529441.469571:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008c0d7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966721536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529441.504101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529441.504113:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611648 00000100:00100000:0.0:1651529441.504129:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 326 00000100:00100000:0.0:1651529441.504132:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946611648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529441.504147:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529441.504162:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008c0d7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946611648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529441.504166:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 326 00000400:00000080:1.0:1651529443.051579:0:171949:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529443.051581:0:171949:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133c: Verifying OST stats ================================================================================================== 22:10:42 (1651529442) 00000100:00100000:0.0:1651529443.200462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529443.200480:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846208 00000100:00100000:0.0:1651529443.200505:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 83 00000100:00100000:0.0:1651529443.200508:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:347569:x1731746396846208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529443.200516:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:0.0:1651529443.200525:0:127516:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9c0:0x0] updating lvb size from disk: 0 -> 33488896 00002000:00010000:0.0:1651529443.200527:0:127516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2b9c0:0x0] updating lvb mtime from disk: 0 -> 1651529411 00002000:00010000:0.0:1651529443.200528:0:127516:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2b9c0:0x0] updating lvb ctime from disk: 0 -> 1651529411 00002000:00010000:0.0:1651529443.200528:0:127516:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9c0:0x0] updating lvb blocks from disk: 0 -> 32776 00010000:00010000:0.0:1651529443.200540:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c0c33 lrc: 0/0,0 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1f4 expref: 9 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.200551:0:127516:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb size from disk: 524288 -> 1048576 00002000:00010000:0.0:1651529443.200552:0:127516:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9bf:0x0] updating lvb blocks from disk: 0 -> 1024 00010000:00010000:0.0:1651529443.200555:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c0c2c lrc: 0/0,0 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1c3 expref: 8 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.200561:0:127516:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1651529443.200562:0:127516:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9be:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1651529443.200564:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c0c25 lrc: 0/0,0 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc176 expref: 7 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.200569:0:127516:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb size from disk: 0 -> 65536 00002000:00010000:0.0:1651529443.200570:0:127516:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2b9bd:0x0] updating lvb blocks from disk: 0 -> 128 00010000:00010000:0.0:1651529443.200572:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c0c1e lrc: 0/0,0 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc137 expref: 6 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529443.200576:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529443.200597:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:347569:x1731746396846208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529443.200601:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 83 00000001:00080000:0.0:1651529445.617358:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894966 is committed 00000100:00100000:0.0:1651529446.592988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529446.593005:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846400 00000100:00100000:0.0:1651529446.593031:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 41 00000100:00100000:0.0:1651529446.593034:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41279:x1731746396846400:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529446.593066:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41279:x1731746396846400:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 31us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529446.593069:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 41 00000100:00100000:0.0:1651529446.624095:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529446.624104:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611840 00000100:00100000:0.0:1651529446.624114:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 327 00000100:00100000:0.0:1651529446.624116:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946611840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529446.624128:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 12779520 granted 358950720 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529446.624141:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0896919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946611840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (47us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529446.624144:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 327 00000100:00100000:0.0:1651529449.215404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.215473:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846592 00000100:00100000:0.0:1651529449.215498:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154143 00000100:00100000:0.0:1651529449.215500:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:430822:x1731746396846592:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529449.215510:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529449.215521:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1070 lrc: 2/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc8bc expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529449.215536:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529449.215546:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.215547:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.215552:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1070 lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8bc expref: 6 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.215560:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1070 lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8bc expref: 6 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.215566:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055085556, rc 0) 00000100:00100000:0.0:1651529449.215588:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:430822:x1731746396846592:12345-10.240.43.64@tcp:101:dd.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529449.215591:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154143 00000100:00100000:0.0:1651529449.222068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529449.222101:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846848 00002000:00100000:1.0:1651529449.222117:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba0e:0x0] (0->524287) req@00000000b9e74008 x1731746396846848/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:175/0 lens 488/0 e 0 to 0 dl 1651529455 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529449.222123:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b9e74008 with x1731746396846848 ext(0->524287) 00002000:00010000:1.0:1651529449.222125:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b9e74008 00000100:00100000:1.0:1651529449.222134:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15948 00000100:00100000:1.0:1651529449.222136:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746396846848:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529449.223616:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746396846848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 1478us (1548us total) trans 30064894967 rc 0/0 00000100:00100000:1.0:1651529449.223621:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15948 00002000:00100000:1.0:1651529449.223624:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba0e:0x0] (0->524287) req@00000000b9e74008 x1731746396846848/t30064894967(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:175/0 lens 488/448 e 0 to 0 dl 1651529455 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529449.223631:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b9e74008 with x1731746396846848 ext(0->524287) 00002000:00010000:1.0:1651529449.223633:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b9e74008 00000100:00100000:0.0:1651529449.255619:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.255630:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846912 00000100:00100000:0.0:1651529449.255644:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 84 00000100:00100000:0.0:1651529449.255646:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:342878:x1731746396846912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529449.255651:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651529449.255656:0:127517:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb size from disk: 0 -> 524288 00002000:00010000:0.0:1651529449.255657:0:127517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb mtime from disk: 0 -> 1651529449 00002000:00010000:0.0:1651529449.255659:0:127517:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb ctime from disk: 0 -> 1651529449 00002000:00010000:0.0:1651529449.255660:0:127517:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb blocks from disk: 0 -> 1024 00010000:00010000:0.0:1651529449.255668:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1070 lrc: 0/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8bc expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.255679:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529449.255689:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:342878:x1731746396846912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529449.255692:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 84 00000100:00100000:0.0:1651529449.456289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.456307:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396847104 00000100:00100000:0.0:1651529449.456332:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154144 00000100:00100000:0.0:1651529449.456335:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:430840:x1731746396847104:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529449.456345:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529449.456356:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 2/0,0 mode: --/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc8d1 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529449.456368:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0e:0x0] initial LVB size: 524288, mtime: 0x627056e9, atime: 0x0, ctime: 0x627056e9, blocks: 0x400 00010000:00010000:0.0:1651529449.456379:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.456380:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.456385:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.456394:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.456399:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055085556, rc 0) 00000100:00100000:0.0:1651529449.456421:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:430840:x1731746396847104:12345-10.240.43.64@tcp:101:dd.0 Request processed in 86us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529449.456425:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154144 00000100:00100000:0.0:1651529449.456706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529449.456730:0:144083:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396847296 00002000:00100000:1.0:1651529449.456745:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba0e:0x0] (0->4095) req@000000002a14ba1b x1731746396847296/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:175/0 lens 488/0 e 0 to 0 dl 1651529455 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529449.456751:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a14ba1b with x1731746396847296 ext(0->4095) 00002000:00010000:1.0:1651529449.456754:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002a14ba1b 00000100:00100000:1.0:1651529449.456762:0:144083:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15949 00000100:00100000:1.0:1651529449.456764:0:144083:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41279:x1731746396847296:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529449.456829:0:144083:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41279:x1731746396847296:12345-10.240.43.64@tcp:3:dd.0 Request processed in 64us (123us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1651529449.456833:0:144083:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15949 00002000:00100000:1.0:1651529449.456835:0:144083:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x2ba0e:0x0] (0->4095) req@000000002a14ba1b x1731746396847296/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:175/0 lens 488/4536 e 0 to 0 dl 1651529455 ref 1 fl Complete:/0/0 rc 4096/4096 job:'dd.0' 00002000:00100000:1.0:1651529449.456840:0:144083:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a14ba1b with x1731746396847296 ext(0->4095) 00002000:00010000:1.0:1651529449.456841:0:144083:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002a14ba1b 00000100:00100000:0.0:1651529449.652908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.652924:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396847808 00000100:00100000:0.0:1651529449.652948:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154145 00000100:00100000:0.0:1651529449.652951:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:430313:x1731746396847808:12345-10.240.43.64@tcp:101:bash.0 00010000:00010000:0.0:1651529449.652961:0:127525:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529449.652971:0:127525:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 2/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc8df expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.652987:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 2/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.652991:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.652992:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.652994:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 4/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.653007:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.653012:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00000100:00100000:0.0:1651529449.653018:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fdb83b12 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529449.653045:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000019c585c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529449.653278:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fdb83b12 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529449.653290:0:127525:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 3/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.653317:0:127525:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6e2a7ad, rc 0) 00000100:00100000:0.0:1651529449.653357:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:430313:x1731746396847808:12345-10.240.43.64@tcp:101:bash.0 Request processed in 404us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529449.653363:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154145 00000100:00100000:0.0:1651529449.653398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.653425:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396847872 00010000:00010000:0.0:1651529449.653432:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00000100:00100000:0.0:1651529449.653443:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12817 00000100:00100000:0.0:1651529449.653445:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396847872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529449.653449:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529449.653451:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529449.653455:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529449.653464:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1077 lrc: 0/0,0 mode: --/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8d1 expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529449.653468:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.653468:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529449.653470:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.653485:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529449.653496:0:127516:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529449.653500:0:127516:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:127516:1731745966721728:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651529449.653512:0:127516:0:(client.c:2492:ptlrpc_set_wait()) set 0000000019c585c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529449.653931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529449.653947:0:127516:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000084d029b8 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:127516:1731745966721728:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651529449.653952:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529449.653955:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396847936 00000100:00100000:0.0:1651529449.653962:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396847872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 516us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529449.653965:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12817 00002000:00010000:1.0:1651529449.653968:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178702/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529449.653970:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003478f7c9 with x1731746396847936 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529449.653974:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003478f7c9. 00000100:00100000:1.0:1651529449.653983:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15950 00000100:00100000:1.0:1651529449.653985:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746396847936:12345-10.240.43.64@tcp:10:bash.0 00002000:00010000:1.0:1651529449.654135:0:144088:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb size from disk: 524288 -> 0 00002000:00010000:1.0:1651529449.654138:0:144088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb mtime from disk: 1651529449 -> 1651529449 00002000:00010000:1.0:1651529449.654139:0:144088:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529449.654140:0:144088:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb ctime from disk: 1651529449 -> 1651529449 00002000:00010000:1.0:1651529449.654141:0:144088:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2ba0e:0x0] updating lvb blocks from disk: 1024 -> 0 00000100:00100000:1.0:1651529449.654164:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396847936:12345-10.240.43.64@tcp:10:bash.0 Request processed in 179us (234us total) trans 30064894968 rc 0/0 00000100:00100000:1.0:1651529449.654168:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15950 00002000:00010000:1.0:1651529449.654169:0:144088:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 178702/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529449.654170:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003478f7c9 with x1731746396847936 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529449.654172:0:144088:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003478f7c9. 00000100:00100000:0.0:1651529450.331511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529450.331528:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611904 00000100:00100000:0.0:1651529450.331556:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154146 00000100:00100000:0.0:1651529450.331559:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946611904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529450.331575:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178702 count 1 00010000:00010000:0.0:1651529450.331588:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.331598:0:127525:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.331616:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529450.331617:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529450.331618:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 4/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.331632:0:127525:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.331638:0:127525:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 4/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 8 pid: 127525 timeout: 13199 lvb_type: 0 00000100:00100000:0.0:1651529450.331644:0:127525:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077498c9a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529450.331670:0:127525:0:(client.c:2492:ptlrpc_set_wait()) set 0000000019c585c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529450.331992:0:127525:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077498c9a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:127525:1731745966721792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529450.332002:0:127525:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529450.332081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529450.332095:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396848320 00010000:00010000:0.0:1651529450.332104:0:127516:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 4/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00000100:00100000:0.0:1651529450.332115:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12818 00000100:00100000:0.0:1651529450.332117:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396848320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529450.332121:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529450.332131:0:127516:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 4/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529450.332136:0:127516:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529450.332145:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c107e lrc: 0/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc8df expref: 9 pid: 127525 timeout: 13199 lvb_type: 0 00010000:00010000:0.0:1651529450.332150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529450.332150:0:127516:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529450.332152:0:127516:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332156:0:127516:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 4/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332164:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529450.332175:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746396848320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529450.332178:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12818 00010000:00010000:0.0:1651529450.332220:0:127525:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332224:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332228:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332231:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529450.332324:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946611904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 765us (817us total) trans 30064894969 rc 0/0 00000100:00100000:0.0:1651529450.332328:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154146 00010000:00010000:0.0:1651529450.332336:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332339:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529450.332341:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332344:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332350:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 1/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529450.332352:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1085 lrc: 0/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529451.744141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529451.744156:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946612032 00000100:00100000:0.0:1651529451.744172:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 328 00000100:00100000:0.0:1651529451.744175:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946612032:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529451.744190:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354182976 pending 548864 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529451.744211:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946612032:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529451.744214:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 328 00000001:00080000:0.0:1651529455.527774:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894969 is committed 00000001:00080000:0.0:1651529455.527779:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894968 is committed 00000100:00100000:0.0:1651529456.864175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529456.864191:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946612160 00000100:00100000:0.0:1651529456.864211:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 329 00000100:00100000:0.0:1651529456.864214:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946612160:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529456.864230:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353634112 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529456.864253:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946612160:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529456.864256:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 329 00000400:00000080:0.0:1651529460.665847:0:172437:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529460.665849:0:172437:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133d: Verifying rename_stats ================================================================================================== 22:11:00 (1651529460) 00000400:00000080:0.0:1651529465.430377:0:172763:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529465.430380:0:172763:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133e: Verifying OST read_bytes write_bytes nid stats =========================================================================== 22:11:05 (1651529465) 00000100:00100000:0.0:1651529465.815114:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529465.815142:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397052928 00000100:00100000:1.0:1651529465.815170:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154151 00000100:00100000:1.0:1651529465.815172:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:432890:x1731746397052928:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529465.815191:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529465.815207:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c108c lrc: 2/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dd80c expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529465.815219:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529465.815229:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529465.815230:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529465.815235:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c108c lrc: 3/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd80c expref: 6 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529465.815243:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c108c lrc: 3/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd80c expref: 6 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529465.815249:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000432a99, rc 0) 00000100:00100000:1.0:1651529465.815277:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:432890:x1731746397052928:12345-10.240.43.64@tcp:101:dd.0 Request processed in 104us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529465.815281:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154151 00000100:00100000:0.0:1651529465.828625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529465.828647:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053184 00002000:00100000:1.0:1651529465.828660:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (0->1376255) req@00000000687564d5 x1731746397053184/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:191/0 lens 488/0 e 0 to 0 dl 1651529471 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529465.828666:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000687564d5 with x1731746397053184 ext(0->1376255) 00002000:00010000:1.0:1651529465.828668:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000687564d5 00000100:00100000:1.0:1651529465.828681:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15951 00000100:00100000:1.0:1651529465.828683:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746397053184:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529465.831049:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000687564d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746397053184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2364us (2424us total) trans 30064894970 rc 0/0 00000100:00100000:1.0:1651529465.831054:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15951 00002000:00100000:1.0:1651529465.831058:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (0->1376255) req@00000000687564d5 x1731746397053184/t30064894970(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:191/0 lens 488/448 e 0 to 0 dl 1651529471 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529465.831062:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000687564d5 with x1731746397053184 ext(0->1376255) 00002000:00010000:1.0:1651529465.831064:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000687564d5 00000100:00100000:0.0:1651529465.894929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529465.894941:0:127517:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053248 00000100:00100000:0.0:1651529465.894959:0:127517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 85 00000100:00100000:0.0:1651529465.894961:0:127517:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:342879:x1731746397053248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529465.894967:0:127517:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651529465.894974:0:127517:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bb0f:0x0] updating lvb size from disk: 0 -> 1376256 00002000:00010000:0.0:1651529465.894976:0:127517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bb0f:0x0] updating lvb mtime from disk: 0 -> 1651529465 00002000:00010000:0.0:1651529465.894977:0:127517:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bb0f:0x0] updating lvb ctime from disk: 0 -> 1651529465 00002000:00010000:0.0:1651529465.894978:0:127517:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bb0f:0x0] updating lvb blocks from disk: 0 -> 2688 00010000:00010000:0.0:1651529465.894989:0:127517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c108c lrc: 0/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd80c expref: 8 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529465.894997:0:127517:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529465.895009:0:127517:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000637c8cd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:342879:x1731746397053248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529465.895013:0:127517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 85 00000100:00100000:0.0:1651529466.317454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529466.317539:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053440 00000100:00100000:0.0:1651529466.317561:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154152 00000100:00100000:0.0:1651529466.317563:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000421c7007 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:432916:x1731746397053440:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529466.317573:0:142994:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529466.317583:0:142994:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1093 lrc: 2/0,0 mode: --/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dd821 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529466.317595:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0f:0x0] initial LVB size: 1376256, mtime: 0x627056f9, atime: 0x0, ctime: 0x627056f9, blocks: 0xa80 00010000:00010000:0.0:1651529466.317604:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529466.317606:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529466.317611:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1093 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd821 expref: 8 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529466.317618:0:142994:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1093 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd821 expref: 8 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529466.317634:0:142994:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055085556, rc 0) 00000100:00100000:0.0:1651529466.317673:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000421c7007 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:432916:x1731746397053440:12345-10.240.43.64@tcp:101:dd.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529466.317679:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154152 00000100:00100000:0.0:1651529466.319141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529466.319168:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053632 00002000:00100000:1.0:1651529466.319184:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (0->32767) req@00000000a7137b76 x1731746397053632/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:192/0 lens 488/0 e 0 to 0 dl 1651529472 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529466.319190:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7137b76 with x1731746397053632 ext(0->32767) 00002000:00010000:1.0:1651529466.319192:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a7137b76 00000100:00100000:1.0:1651529466.319205:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15952 00000100:00100000:1.0:1651529466.319207:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7137b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746397053632:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529466.319635:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7137b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746397053632:12345-10.240.43.64@tcp:3:dd.0 Request processed in 426us (494us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1651529466.319646:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15952 00002000:00100000:1.0:1651529466.319650:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (0->32767) req@00000000a7137b76 x1731746397053632/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:192/0 lens 488/440 e 0 to 0 dl 1651529472 ref 1 fl Complete:/0/0 rc 32768/32768 job:'dd.0' 00002000:00100000:1.0:1651529466.319654:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7137b76 with x1731746397053632 ext(0->32767) 00002000:00010000:1.0:1651529466.319656:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a7137b76 00000100:00100000:0.0:1651529466.320575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529466.320590:0:144088:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053760 00002000:00100000:1.0:1651529466.320600:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (32768->1376255) req@0000000042044fbb x1731746397053760/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:192/0 lens 488/0 e 0 to 0 dl 1651529472 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529466.320605:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042044fbb with x1731746397053760 ext(32768->1376255) 00002000:00010000:1.0:1651529466.320607:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000042044fbb 00000100:00100000:1.0:1651529466.320617:0:144088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15953 00000100:00100000:1.0:1651529466.320619:0:144088:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042044fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746397053760:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529466.321976:0:144088:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042044fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746397053760:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1354us (1400us total) trans 0 rc 1343488/1343488 00000100:00100000:1.0:1651529466.321980:0:144088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15953 00002000:00100000:1.0:1651529466.321983:0:144088:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x2bb0f:0x0] (32768->1376255) req@0000000042044fbb x1731746397053760/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:192/0 lens 488/440 e 0 to 0 dl 1651529472 ref 1 fl Complete:/0/0 rc 1343488/1343488 job:'dd.0' 00002000:00100000:1.0:1651529466.321988:0:144088:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042044fbb with x1731746397053760 ext(32768->1376255) 00002000:00010000:1.0:1651529466.321990:0:144088:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000042044fbb 00000100:00100000:1.0:1651529466.361974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529466.362001:0:127516:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397053952 00000100:00100000:0.0:1651529466.362019:0:127516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 86 00000100:00100000:0.0:1651529466.362021:0:127516:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:342878:x1731746397053952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529466.362028:0:127516:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529466.362044:0:127516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1093 lrc: 0/0,0 mode: --/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dd821 expref: 8 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529466.362053:0:127516:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529466.362066:0:127516:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:342878:x1731746397053952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529466.362070:0:127516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 86 00000100:00100000:1.0:1651529466.557106:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002bec6a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966721920:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529466.557161:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529466.557165:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ad292bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39028:1731745966721856:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529466.557580:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ad292bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39028:1731745966721856:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529466.557597:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002bec6a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966721920:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529467.104873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.104891:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613120 00000100:00100000:0.0:1651529467.104910:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 331 00000100:00100000:0.0:1651529467.104913:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946613120:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529467.104928:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353635136 pending 1400832 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529467.104951:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d572fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946613120:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529467.104955:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 331 00000100:00100000:0.0:1651529467.227888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227939:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613248 00000100:00100000:0.0:1651529467.227958:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613376 00000100:00100000:0.0:1651529467.227962:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613504 00000100:00100000:0.0:1651529467.227966:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613632 00000100:00100000:0.0:1651529467.227978:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154153 00000100:00100000:0.0:1651529467.227980:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.227994:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154154 00002000:00080000:0.0:1651529467.227996:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178840 count 1 00000100:00100000:1.0:1651529467.227998:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.228008:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178793 count 1 00002000:00010000:0.0:1651529467.228013:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228017:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 3/0,1 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.228019:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228021:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 3/0,1 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228024:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228025:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228027:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228027:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228028:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228029:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228034:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228034:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228038:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228038:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228041:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228041:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228151:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5af99d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 170us (266us total) trans 30064894971 rc 0/0 00000100:00100000:1.0:1651529467.228152:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a08daa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 153us (249us total) trans 30064894972 rc 0/0 00000100:00100000:0.0:1651529467.228155:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154153 00000100:00100000:1.0:1651529467.228157:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154154 00000100:00100000:0.0:1651529467.228163:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154155 00000100:00100000:0.0:1651529467.228164:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.228165:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154156 00002000:00080000:0.0:1651529467.228170:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178946 count 1 00000100:00100000:1.0:1651529467.228175:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.228176:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228178:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 3/0,1 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.228181:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178945 count 1 00010000:00010000:0.0:1651529467.228181:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228182:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228183:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228187:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.228188:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228190:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 3/0,1 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228190:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228193:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228194:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228195:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228196:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228199:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228202:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228205:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228237:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f9eb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (329us total) trans 30064894973 rc 0/0 00000100:00100000:0.0:1651529467.228241:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154155 00000100:00100000:1.0:1651529467.228247:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007987a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946613632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (332us total) trans 30064894974 rc 0/0 00000100:00100000:1.0:1651529467.228251:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154156 00010000:00010000:0.0:1651529467.228268:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228269:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228272:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228273:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228274:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228274:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228278:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 3/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228285:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 1/0,0 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228286:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 3/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228288:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c10a1 lrc: 0/0,0 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228292:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 1/0,0 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228293:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228295:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c109a lrc: 0/0,0 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228296:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.228297:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228299:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228302:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228303:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228303:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 3/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228306:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 3/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228306:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 1/0,0 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228309:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 1/0,0 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228309:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c10a8 lrc: 0/0,0 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228312:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c10af lrc: 0/0,0 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228391:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613184 00000100:00100000:0.0:1651529467.228393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228415:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613312 00000100:00100000:1.0:1651529467.228421:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154157 00000100:00100000:0.0:1651529467.228421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228423:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.228429:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178954 count 1 00000100:00100000:0.0:1651529467.228429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.228435:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.228436:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613440 00010000:00010000:1.0:1651529467.228437:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 3/0,1 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228440:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228441:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228442:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228443:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613568 00010000:00010000:1.0:1651529467.228446:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228448:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154158 00010000:00010000:1.0:1651529467.228449:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228449:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946613312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.228451:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.228455:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178879 count 1 00002000:00010000:0.0:1651529467.228469:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2babf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228471:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 3/0,1 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228475:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228476:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228477:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228484:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228487:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228490:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228512:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bcbcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (132us total) trans 30064894975 rc 0/0 00000100:00100000:1.0:1651529467.228515:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154157 00000100:00100000:1.0:1651529467.228521:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154159 00000100:00100000:1.0:1651529467.228523:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946613440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.228528:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178726 count 1 00002000:00010000:1.0:1651529467.228535:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228536:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 3/0,1 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228540:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228540:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228541:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228545:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228548:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228551:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228551:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 100us (157us total) trans 30064894976 rc 0/0 00000100:00100000:0.0:1651529467.228554:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154158 00000100:00100000:0.0:1651529467.228560:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154160 00000100:00100000:0.0:1651529467.228562:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946613568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.228567:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178792 count 1 00002000:00010000:0.0:1651529467.228572:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228574:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 3/0,1 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228578:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228578:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228579:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228583:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228589:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228592:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228602:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (181us total) trans 30064894977 rc 0/0 00000100:00100000:1.0:1651529467.228605:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154159 00010000:00010000:1.0:1651529467.228614:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228617:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228618:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228621:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 3/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228627:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 1/0,0 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228628:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (198us total) trans 30064894978 rc 0/0 00010000:00010000:1.0:1651529467.228630:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c10b6 lrc: 0/0,0 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228630:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154160 00010000:00010000:1.0:1651529467.228634:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228636:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228637:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228640:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 3/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228643:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 1/0,0 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228646:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c10bd lrc: 0/0,0 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228649:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228652:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228653:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228656:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 3/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228659:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 1/0,0 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228662:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c10c4 lrc: 0/0,0 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228665:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228667:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228668:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228671:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 3/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228674:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 1/0,0 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228676:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c10cb lrc: 0/0,0 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228702:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614464 00000100:00100000:0.0:1651529467.228704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228720:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614528 00000100:00100000:0.0:1651529467.228723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228732:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614592 00000100:00100000:1.0:1651529467.228737:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154161 00000100:00100000:1.0:1651529467.228739:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946614464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.228744:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178891 count 1 00000100:00100000:0.0:1651529467.228754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.228758:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bacb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228765:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 3/0,1 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228768:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228769:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228770:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228774:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228777:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614656 00000100:00100000:0.0:1651529467.228786:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154162 00010000:00010000:1.0:1651529467.228787:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228787:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946614528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.228790:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.228793:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178918 count 1 00002000:00010000:0.0:1651529467.228799:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228836:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 3/0,1 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228840:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228841:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228842:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228849:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228852:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228855:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228869:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946614464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 129us (178us total) trans 30064894979 rc 0/0 00000100:00100000:1.0:1651529467.228873:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154161 00000100:00100000:1.0:1651529467.228878:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154163 00000100:00100000:1.0:1651529467.228880:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946614592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.228885:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178798 count 1 00002000:00010000:1.0:1651529467.228890:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228892:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 3/0,1 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228895:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228896:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228897:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228900:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228903:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228906:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228906:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946614528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 117us (202us total) trans 30064894980 rc 0/0 00000100:00100000:0.0:1651529467.228909:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154162 00000100:00100000:0.0:1651529467.228914:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154164 00000100:00100000:0.0:1651529467.228916:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946614656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.228921:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178786 count 1 00002000:00010000:0.0:1651529467.228926:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228928:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 3/0,1 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228932:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228932:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228933:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228937:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228942:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228943:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946614592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (220us total) trans 30064894981 rc 0/0 00010000:00010000:0.0:1651529467.228945:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228947:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154163 00010000:00010000:1.0:1651529467.228958:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228961:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228962:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228965:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 3/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228970:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 1/0,0 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228973:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c10d2 lrc: 0/0,0 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228977:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228979:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529467.228979:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946614656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (225us total) trans 30064894982 rc 0/0 00010000:00010000:1.0:1651529467.228980:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228983:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 3/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228986:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 1/0,0 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228989:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c10d9 lrc: 0/0,0 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228994:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228997:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.228998:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229000:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 3/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229003:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 1/0,0 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229005:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154164 00010000:00010000:1.0:1651529467.229006:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c10e0 lrc: 0/0,0 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229009:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229011:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.229012:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229015:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 3/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229032:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 1/0,0 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.229042:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c10e7 lrc: 0/0,0 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.229052:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614976 00000100:00100000:1.0:1651529467.229062:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615040 00000100:00100000:0.0:1651529467.229066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.229067:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154165 00000100:00100000:1.0:1651529467.229069:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946614976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.229079:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178884 count 1 00002000:00010000:1.0:1651529467.229085:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229086:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 3/0,1 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.229102:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229102:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229103:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229107:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229110:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229113:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615104 00010000:00010000:1.0:1651529467.229118:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229121:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615168 00000100:00100000:0.0:1651529467.229126:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154166 00000100:00100000:0.0:1651529467.229127:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946615040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.229139:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178931 count 1 00002000:00010000:0.0:1651529467.229159:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229161:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 3/0,1 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229165:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229166:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229166:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229172:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946614976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 102us (135us total) trans 30064894983 rc 0/0 00000100:00100000:1.0:1651529467.229175:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154165 00000100:00100000:1.0:1651529467.229181:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154167 00000100:00100000:1.0:1651529467.229182:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946615104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.229187:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178759 count 1 00010000:00010000:0.0:1651529467.229187:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229190:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.229193:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229193:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229194:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 3/0,1 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229198:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229198:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229207:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229211:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229214:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229217:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229237:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946615040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 109us (186us total) trans 30064894984 rc 0/0 00000100:00100000:0.0:1651529467.229240:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154166 00000100:00100000:0.0:1651529467.229246:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154168 00000100:00100000:0.0:1651529467.229247:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946615168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.229252:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178797 count 1 00000100:00100000:1.0:1651529467.229256:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946615104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (196us total) trans 30064894985 rc 0/0 00002000:00010000:0.0:1651529467.229257:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229259:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 3/0,1 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229270:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154167 00010000:00010000:0.0:1651529467.229277:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229278:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229279:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229279:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229283:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.229283:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229284:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229287:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 3/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229292:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 1/0,0 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229294:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c10ee lrc: 0/0,0 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229299:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229301:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.229302:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229305:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 3/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229305:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229307:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229316:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 1/0,0 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229319:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c10f5 lrc: 0/0,0 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229323:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229326:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.229327:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229329:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 3/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229332:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 1/0,0 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229335:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c10fc lrc: 0/0,0 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229338:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229341:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.229342:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229345:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 3/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229346:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946615168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (254us total) trans 30064894986 rc 0/0 00010000:00010000:1.0:1651529467.229348:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 1/0,0 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229349:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154168 00010000:00010000:1.0:1651529467.229350:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1103 lrc: 0/0,0 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229434:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615360 00000100:00100000:0.0:1651529467.229441:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154169 00000100:00100000:0.0:1651529467.229443:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946615360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.229449:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178747 count 1 00002000:00010000:0.0:1651529467.229455:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229457:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 3/0,1 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229461:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229461:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229462:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.229466:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.229476:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229483:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.229507:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229519:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229523:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.229524:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229527:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 3/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229531:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 1/0,0 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229537:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c110a lrc: 0/0,0 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229556:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946615360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 112us (149us total) trans 30064894987 rc 0/0 00000100:00100000:0.0:1651529467.229559:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154169 00000100:00100000:0.0:1651529467.229564:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615296 00000100:00100000:0.0:1651529467.229569:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615488 00000100:00100000:0.0:1651529467.229579:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615424 00000100:00100000:0.0:1651529467.229584:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154170 00000100:00100000:0.0:1651529467.229586:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946615296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.229591:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154171 00000100:00100000:1.0:1651529467.229593:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946615488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.229598:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178728 count 1 00002000:00080000:0.0:1651529467.229608:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178754 count 1 00002000:00010000:1.0:1651529467.229610:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229612:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 3/0,1 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229616:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229616:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229617:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229621:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.229622:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229624:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229625:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 3/0,1 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229627:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229629:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229629:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229630:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229634:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229637:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229651:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229668:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946615488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (193us total) trans 30064894988 rc 0/0 00000100:00100000:1.0:1651529467.229672:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154171 00000100:00100000:1.0:1651529467.229678:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154172 00000100:00100000:1.0:1651529467.229679:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946615424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.229684:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178909 count 1 00002000:00010000:1.0:1651529467.229690:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2badd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229691:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 3/0,1 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229692:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946615296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (229us total) trans 30064894989 rc 0/0 00010000:00010000:1.0:1651529467.229695:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229695:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.229695:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154170 00010000:00010000:1.0:1651529467.229696:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229700:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229703:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229705:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229705:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229708:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.229710:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229713:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 3/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229718:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 1/0,0 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229721:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1111 lrc: 0/0,0 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229725:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229728:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.229729:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229732:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 3/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229735:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 1/0,0 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229738:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1118 lrc: 0/0,0 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229741:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229744:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946615424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (261us total) trans 30064894990 rc 0/0 00010000:00010000:0.0:1651529467.229744:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.229744:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229747:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154172 00010000:00010000:0.0:1651529467.229747:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 3/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229750:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 1/0,0 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229753:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c111f lrc: 0/0,0 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229878:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615872 00000100:00100000:0.0:1651529467.229886:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154173 00000100:00100000:0.0:1651529467.229888:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946615872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.229889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529467.229899:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178727 count 1 00000100:00100000:1.0:1651529467.229900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529467.229905:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229907:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 3/0,1 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229909:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.229918:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615936 00000100:00100000:1.0:1651529467.229927:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616064 00000100:00100000:1.0:1651529467.229933:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154174 00000100:00100000:1.0:1651529467.229935:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946615936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.229939:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229939:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.229940:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178803 count 1 00010000:00010000:0.0:1651529467.229940:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229944:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.229946:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229947:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 3/0,1 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229948:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229951:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229951:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229952:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229953:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229956:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229966:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229969:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229996:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946615872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 107us (141us total) trans 30064894991 rc 0/0 00000100:00100000:0.0:1651529467.229999:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154173 00000100:00100000:0.0:1651529467.230005:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616000 00000100:00100000:1.0:1651529467.230010:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946615936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (121us total) trans 30064894992 rc 0/0 00000100:00100000:1.0:1651529467.230013:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154174 00000100:00100000:1.0:1651529467.230019:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154175 00000100:00100000:1.0:1651529467.230020:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946616064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.230042:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178769 count 1 00000100:00100000:0.0:1651529467.230050:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154176 00000100:00100000:0.0:1651529467.230052:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946616000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.230056:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230057:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 3/0,1 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.230057:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178898 count 1 00010000:00010000:1.0:1651529467.230061:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230062:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230063:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.230063:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230065:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 3/0,1 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230066:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230068:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230069:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230069:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230070:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230072:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230074:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230077:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230086:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230114:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946616064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (213us total) trans 30064894993 rc 0/0 00000100:00100000:1.0:1651529467.230117:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154175 00010000:00010000:1.0:1651529467.230125:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230126:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946616000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (217us total) trans 30064894994 rc 0/0 00010000:00010000:1.0:1651529467.230128:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.230129:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230130:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154176 00010000:00010000:1.0:1651529467.230133:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 3/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230137:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 1/0,0 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230139:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230140:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1126 lrc: 0/0,0 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230143:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.230144:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230144:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230147:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.230147:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 3/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230148:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230151:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 3/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230152:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 1/0,0 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230154:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 1/0,0 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230155:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c112d lrc: 0/0,0 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230157:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1134 lrc: 0/0,0 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230159:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230162:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.230163:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230165:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 3/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230168:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 1/0,0 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230171:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c113b lrc: 0/0,0 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230189:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616512 00000100:00100000:1.0:1651529467.230194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230195:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154177 00000100:00100000:0.0:1651529467.230202:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946616512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.230206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529467.230207:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178929 count 1 00002000:00010000:0.0:1651529467.230217:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230219:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 3/0,1 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230222:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230223:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230224:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230227:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230230:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230232:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.230274:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230279:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946616512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (104us total) trans 30064894995 rc 0/0 00010000:00010000:1.0:1651529467.230282:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529467.230282:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154177 00010000:00010000:1.0:1651529467.230284:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230287:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 3/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230287:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616640 00000100:00100000:0.0:1651529467.230294:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616448 00010000:00010000:1.0:1651529467.230296:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 1/0,0 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230300:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616576 00010000:00010000:1.0:1651529467.230303:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1142 lrc: 0/0,0 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230312:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154178 00000100:00100000:1.0:1651529467.230314:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946616640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.230323:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154179 00002000:00080000:1.0:1651529467.230325:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178824 count 1 00000100:00100000:0.0:1651529467.230325:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946616448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.230330:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178711 count 1 00002000:00010000:1.0:1651529467.230332:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230333:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 3/0,1 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230337:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230338:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230339:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230342:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.230344:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230345:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230346:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 3/0,1 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230348:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230349:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230350:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230351:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230354:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230357:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230360:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230387:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946616640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (193us total) trans 30064894996 rc 0/0 00000100:00100000:1.0:1651529467.230390:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154178 00000100:00100000:1.0:1651529467.230395:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154180 00000100:00100000:1.0:1651529467.230396:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946616576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.230401:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178718 count 1 00002000:00010000:1.0:1651529467.230406:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230408:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 3/0,1 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230411:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230412:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230413:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230416:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230419:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230422:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230425:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946616448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (210us total) trans 30064894997 rc 0/0 00000100:00100000:0.0:1651529467.230429:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154179 00010000:00010000:0.0:1651529467.230439:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230445:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.230446:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230449:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 3/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230454:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 1/0,0 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230457:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1149 lrc: 0/0,0 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230460:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946616576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (220us total) trans 30064894998 rc 0/0 00010000:00010000:0.0:1651529467.230461:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230463:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154180 00010000:00010000:0.0:1651529467.230464:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.230465:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230467:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 3/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230470:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230470:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 1/0,0 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230474:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.230475:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230475:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1150 lrc: 0/0,0 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230477:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 3/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230482:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 1/0,0 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230485:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1157 lrc: 0/0,0 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230535:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616960 00000100:00100000:0.0:1651529467.230548:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154181 00000100:00100000:0.0:1651529467.230549:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d7c3719 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946616960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.230555:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178771 count 1 00002000:00010000:0.0:1651529467.230561:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230563:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 3/0,1 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230566:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230567:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230568:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230571:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230575:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230577:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230643:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d7c3719 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946616960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (115us total) trans 30064894999 rc 0/0 00000100:00100000:0.0:1651529467.230646:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154181 00010000:00010000:0.0:1651529467.230670:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230673:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.230674:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230677:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 3/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230682:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 1/0,0 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230685:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c115e lrc: 0/0,0 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230706:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230716:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616896 00000100:00100000:0.0:1651529467.230718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230727:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617088 00000100:00100000:1.0:1651529467.230732:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617024 00000100:00100000:1.0:1651529467.230738:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154182 00000100:00100000:1.0:1651529467.230744:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946616896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.230745:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154183 00000100:00100000:0.0:1651529467.230747:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946617024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.230750:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178861 count 1 00002000:00010000:1.0:1651529467.230756:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230758:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 3/0,1 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230761:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230762:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230768:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230773:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230776:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.230783:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178832 count 1 00010000:00010000:1.0:1651529467.230785:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.230789:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230791:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 3/0,1 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230795:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230796:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230797:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230800:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230827:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230830:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230864:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946616896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 119us (165us total) trans 30064895000 rc 0/0 00000100:00100000:1.0:1651529467.230868:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154182 00000100:00100000:1.0:1651529467.230873:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154184 00000100:00100000:1.0:1651529467.230875:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946617088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.230880:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178908 count 1 00002000:00010000:1.0:1651529467.230885:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2badc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230887:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 3/0,1 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230890:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230891:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230892:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230894:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946617024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 145us (175us total) trans 30064895001 rc 0/0 00010000:00010000:1.0:1651529467.230896:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230897:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154183 00010000:00010000:1.0:1651529467.230899:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230901:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230952:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946617088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (245us total) trans 30064895002 rc 0/0 00000100:00100000:1.0:1651529467.230955:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154184 00000100:00100000:1.0:1651529467.230960:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617536 00000100:00100000:0.0:1651529467.230964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230977:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617664 00000100:00100000:1.0:1651529467.230989:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617472 00000100:00100000:0.0:1651529467.230992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231001:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617600 00000100:00100000:1.0:1651529467.231005:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154185 00000100:00100000:1.0:1651529467.231007:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.231007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.231011:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178801 count 1 00000100:00100000:0.0:1651529467.231013:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617792 00002000:00010000:1.0:1651529467.231017:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231018:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 3/0,1 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231022:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231023:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231024:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231027:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231030:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231033:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231044:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154186 00000100:00100000:0.0:1651529467.231046:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946617664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.231051:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178804 count 1 00002000:00010000:0.0:1651529467.231057:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231059:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 3/0,1 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231063:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231063:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231064:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231068:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231072:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946617536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (141us total) trans 30064895003 rc 0/0 00000100:00100000:1.0:1651529467.231076:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154185 00010000:00010000:0.0:1651529467.231078:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231081:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154187 00010000:00010000:0.0:1651529467.231081:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231083:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946617472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.231087:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178906 count 1 00002000:00010000:1.0:1651529467.231092:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bada:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231094:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 3/0,1 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231097:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231098:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231099:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231102:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231105:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231108:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231142:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946617472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (178us total) trans 30064895005 rc 0/0 00000100:00100000:1.0:1651529467.231145:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154187 00000100:00100000:1.0:1651529467.231149:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154188 00000100:00100000:1.0:1651529467.231151:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946617600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.231153:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946617664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 106us (208us total) trans 30064895004 rc 0/0 00002000:00080000:1.0:1651529467.231154:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178921 count 1 00000100:00100000:0.0:1651529467.231156:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154186 00002000:00010000:1.0:1651529467.231159:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231161:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 3/0,1 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231161:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154189 00000100:00100000:0.0:1651529467.231163:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946617792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.231164:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231165:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231166:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.231168:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178939 count 1 00010000:00010000:1.0:1651529467.231169:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231172:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.231173:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bafb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231175:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231175:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 3/0,1 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231181:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231181:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231182:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231186:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231189:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231191:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231207:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:39029:x1731745946617600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (215us total) trans 30064895006 rc 0/0 00000100:00100000:1.0:1651529467.231210:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154188 00010000:00010000:1.0:1651529467.231222:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231225:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231227:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231227:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946617792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (220us total) trans 30064895007 rc 0/0 00010000:00010000:1.0:1651529467.231229:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 3/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231230:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154189 00010000:00010000:1.0:1651529467.231234:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 1/0,0 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231239:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1165 lrc: 0/0,0 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231239:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231242:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231243:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231243:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231246:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.231246:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 3/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231247:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231250:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 3/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231253:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 1/0,0 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231253:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 1/0,0 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231255:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1173 lrc: 0/0,0 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231256:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c116c lrc: 0/0,0 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231258:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231260:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231261:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231262:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231263:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.231264:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231267:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 3/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231267:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 3/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231270:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 1/0,0 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231270:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 1/0,0 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231273:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c117a lrc: 0/0,0 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231273:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1181 lrc: 0/0,0 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231276:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231276:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231278:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231279:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231279:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231280:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231282:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 3/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231282:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 3/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231285:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 1/0,0 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231286:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 1/0,0 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231288:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c118f lrc: 0/0,0 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231288:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1188 lrc: 0/0,0 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231291:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231294:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231295:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231297:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 3/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231300:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 1/0,0 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231303:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1196 lrc: 0/0,0 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231342:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231353:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617984 00000100:00100000:0.0:1651529467.231360:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154190 00000100:00100000:0.0:1651529467.231362:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946617984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.231367:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178750 count 1 00002000:00010000:0.0:1651529467.231373:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231374:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 3/0,1 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231377:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231378:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231379:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231383:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231388:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231391:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231452:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946617984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (110us total) trans 30064895008 rc 0/0 00000100:00100000:0.0:1651529467.231455:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154190 00010000:00010000:0.0:1651529467.231462:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231465:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.231466:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231469:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 3/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231474:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 1/0,0 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231477:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c119d lrc: 0/0,0 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231507:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618048 00000100:00100000:0.0:1651529467.231507:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618112 00000100:00100000:0.0:1651529467.231514:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154191 00000100:00100000:1.0:1651529467.231519:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154192 00000100:00100000:1.0:1651529467.231521:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946618048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.231521:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946618112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.231526:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178758 count 1 00002000:00080000:0.0:1651529467.231527:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178821 count 1 00002000:00010000:1.0:1651529467.231532:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231533:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 3/0,1 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.231533:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231534:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 3/0,1 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231537:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231537:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231538:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231538:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231539:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231539:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231542:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231543:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231545:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231548:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231565:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231586:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231615:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:39029:x1731745946618048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (124us total) trans 30064895009 rc 0/0 00000100:00100000:1.0:1651529467.231618:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154192 00010000:00010000:1.0:1651529467.231625:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231628:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231629:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231633:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 3/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231637:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 1/0,0 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231638:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946618112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 116us (139us total) trans 30064895010 rc 0/0 00010000:00010000:1.0:1651529467.231640:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c11a4 lrc: 0/0,0 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231644:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231647:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.231648:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231651:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 3/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231654:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 1/0,0 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231654:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154191 00010000:00010000:1.0:1651529467.231656:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c11ab lrc: 0/0,0 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231707:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618560 00000100:00100000:1.0:1651529467.231709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231720:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618624 00000100:00100000:1.0:1651529467.231723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231724:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618496 00000100:00100000:0.0:1651529467.231733:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618688 00000100:00100000:1.0:1651529467.231734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231741:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618752 00000100:00100000:0.0:1651529467.231747:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618880 00000100:00100000:0.0:1651529467.231752:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154193 00000100:00100000:0.0:1651529467.231753:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946618560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.231754:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154194 00000100:00100000:1.0:1651529467.231756:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946618624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.231758:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178910 count 1 00002000:00080000:1.0:1651529467.231761:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178787 count 1 00002000:00010000:0.0:1651529467.231764:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bade:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231765:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 3/0,1 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.231767:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231768:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 3/0,1 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231769:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231770:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231770:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231774:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231775:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231775:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231776:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231777:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231779:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231780:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231782:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231785:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231852:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5c3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946618560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (174us total) trans 30064895011 rc 0/0 00000100:00100000:0.0:1651529467.231856:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154193 00000100:00100000:1.0:1651529467.231858:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074b3cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946618624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 101us (158us total) trans 30064895012 rc 0/0 00000100:00100000:0.0:1651529467.231861:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154195 00000100:00100000:1.0:1651529467.231863:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154194 00000100:00100000:0.0:1651529467.231863:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946618496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.231867:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178815 count 1 00000100:00100000:1.0:1651529467.231869:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154196 00000100:00100000:1.0:1651529467.231871:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946618688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.231873:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231874:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 3/0,1 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.231875:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178710 count 1 00010000:00010000:0.0:1651529467.231878:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231879:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231880:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.231881:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231883:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 3/0,1 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231883:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231886:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231886:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231887:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231888:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231889:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231892:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231895:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231906:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231930:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a6dcda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946618496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (220us total) trans 30064895013 rc 0/0 00000100:00100000:0.0:1651529467.231933:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154195 00000100:00100000:0.0:1651529467.231938:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154197 00000100:00100000:0.0:1651529467.231939:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946618752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.231943:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005102690 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946618688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (225us total) trans 30064895014 rc 0/0 00002000:00080000:0.0:1651529467.231943:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178780 count 1 00000100:00100000:1.0:1651529467.231946:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154196 00002000:00010000:0.0:1651529467.231948:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231950:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 3/0,1 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231951:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154198 00000100:00100000:1.0:1651529467.231953:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946618880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.231953:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231954:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231955:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.231958:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178943 count 1 00010000:00010000:0.0:1651529467.231958:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231961:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.231963:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231964:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 3/0,1 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231964:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231968:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231968:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231969:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231973:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231978:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231981:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231996:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006675d893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946618752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (272us total) trans 30064895015 rc 0/0 00000100:00100000:0.0:1651529467.231999:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154197 00010000:00010000:0.0:1651529467.232009:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232012:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529467.232013:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006db75034 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946618880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (279us total) trans 30064895016 rc 0/0 00010000:00010000:0.0:1651529467.232013:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232016:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154198 00010000:00010000:0.0:1651529467.232016:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 3/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232023:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 1/0,0 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232024:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232026:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c11b2 lrc: 0/0,0 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232027:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232028:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232030:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232031:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 3/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232033:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000278eaea9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232033:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232035:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 1/0,0 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232036:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 3/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232038:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c11b9 lrc: 0/0,0 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232039:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 1/0,0 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232042:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232042:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c11c0 lrc: 0/0,0 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232045:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232045:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232046:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232048:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 3/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232048:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232049:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232051:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 1/0,0 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232052:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 3/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232054:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c11c7 lrc: 0/0,0 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232055:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 1/0,0 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232057:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232058:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c11ce lrc: 0/0,0 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232060:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232061:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232063:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 3/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232066:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 1/0,0 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232071:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c11d5 lrc: 0/0,0 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232369:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619456 00000100:00100000:0.0:1651529467.232381:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619392 00000100:00100000:1.0:1651529467.232383:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232386:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619584 00000100:00100000:0.0:1651529467.232393:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154199 00000100:00100000:0.0:1651529467.232395:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946619456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.232397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529467.232405:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178914 count 1 00000100:00100000:1.0:1651529467.232407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529467.232415:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232417:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 3/0,1 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.232425:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232425:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232431:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.232439:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232441:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619520 00010000:00010000:0.0:1651529467.232445:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232447:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619648 00010000:00010000:0.0:1651529467.232448:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232449:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619776 00000100:00100000:1.0:1651529467.232451:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619840 00000100:00100000:1.0:1651529467.232453:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619904 00000100:00100000:1.0:1651529467.232456:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154200 00000100:00100000:1.0:1651529467.232458:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946619392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.232463:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178902 count 1 00002000:00010000:1.0:1651529467.232469:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232471:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 3/0,1 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232475:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232475:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232476:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232482:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232485:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232488:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232489:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f973e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946619456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (147us total) trans 30064895017 rc 0/0 00000100:00100000:0.0:1651529467.232492:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154199 00000100:00100000:0.0:1651529467.232497:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154201 00000100:00100000:0.0:1651529467.232499:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946619584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.232503:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178885 count 1 00002000:00010000:0.0:1651529467.232508:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232509:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 3/0,1 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232513:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232513:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232514:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232518:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232520:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232526:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232529:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (165us total) trans 30064895018 rc 0/0 00000100:00100000:1.0:1651529467.232532:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154200 00000100:00100000:1.0:1651529467.232546:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154202 00000100:00100000:1.0:1651529467.232548:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.232553:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178746 count 1 00002000:00010000:1.0:1651529467.232558:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232560:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 3/0,1 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232564:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232564:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232565:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232567:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009710ff6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946619584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (189us total) trans 30064895019 rc 0/0 00010000:00010000:1.0:1651529467.232569:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232570:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154201 00010000:00010000:1.0:1651529467.232574:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232575:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154203 00000100:00100000:0.0:1651529467.232576:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946619648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.232577:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.232581:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178889 count 1 00002000:00010000:0.0:1651529467.232586:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232588:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 3/0,1 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232591:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232592:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232593:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232596:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232599:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232601:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232611:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d446d583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (220us total) trans 30064895020 rc 0/0 00000100:00100000:1.0:1651529467.232614:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154202 00000100:00100000:1.0:1651529467.232619:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154204 00000100:00100000:1.0:1651529467.232621:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.232625:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178950 count 1 00002000:00010000:1.0:1651529467.232630:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232632:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 3/0,1 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232635:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.232635:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bc637d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (228us total) trans 30064895021 rc 0/0 00010000:00010000:1.0:1651529467.232636:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232636:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232638:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154203 00010000:00010000:1.0:1651529467.232640:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232643:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232643:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154205 00000100:00100000:0.0:1651529467.232645:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946619840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.232648:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.232649:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178864 count 1 00002000:00010000:0.0:1651529467.232654:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232655:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 3/0,1 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232659:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232659:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232660:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232664:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232666:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232669:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232679:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000555ca74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (263us total) trans 30064895022 rc 0/0 00000100:00100000:1.0:1651529467.232682:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154204 00000100:00100000:1.0:1651529467.232687:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154206 00000100:00100000:1.0:1651529467.232688:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.232692:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178881 count 1 00002000:00010000:1.0:1651529467.232697:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232699:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 3/0,1 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232701:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e91d335b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946619840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (277us total) trans 30064895023 rc 0/0 00010000:00010000:1.0:1651529467.232702:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232703:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232704:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232706:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154205 00010000:00010000:1.0:1651529467.232707:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232710:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232713:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232716:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232720:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232721:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232724:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 3/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232728:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 1/0,0 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232731:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c11dc lrc: 0/0,0 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232735:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232738:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232739:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232741:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 3/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232746:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac948652 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946619904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (314us total) trans 30064895024 rc 0/0 00010000:00010000:0.0:1651529467.232747:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 1/0,0 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232749:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154206 00010000:00010000:0.0:1651529467.232750:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c11e3 lrc: 0/0,0 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232753:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232756:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e79ca9ff already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232756:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232757:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232759:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 3/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232760:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232761:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232762:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 1/0,0 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232764:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 3/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232764:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c11ea lrc: 0/0,0 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232768:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 1/0,0 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232768:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232770:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232771:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c11f1 lrc: 0/0,0 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232771:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232774:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 3/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232775:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232777:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 1/0,0 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232778:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232779:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232780:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c11f8 lrc: 0/0,0 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232783:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232784:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 3/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232786:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.232786:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232787:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 1/0,0 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232789:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 3/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232790:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c11ff lrc: 0/0,0 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232792:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 1/0,0 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232793:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232795:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1206 lrc: 0/0,0 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232796:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.232796:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232799:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 3/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232830:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 1/0,0 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232833:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c120d lrc: 0/0,0 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233123:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620480 00000100:00100000:1.0:1651529467.233131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233142:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620416 00000100:00100000:0.0:1651529467.233145:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620544 00000100:00100000:1.0:1651529467.233153:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154207 00000100:00100000:1.0:1651529467.233155:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946620480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.233160:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178923 count 1 00002000:00010000:1.0:1651529467.233171:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233173:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 3/0,1 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233176:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154208 00010000:00010000:1.0:1651529467.233177:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233177:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233178:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233179:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946620416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.233182:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.233184:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178825 count 1 00010000:00010000:1.0:1651529467.233185:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233188:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.233191:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233193:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 3/0,1 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233203:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233204:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233205:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233208:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233212:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233214:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233236:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946620480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (124us total) trans 30064895025 rc 0/0 00000100:00100000:1.0:1651529467.233239:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154207 00000100:00100000:1.0:1651529467.233245:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154209 00000100:00100000:1.0:1651529467.233247:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946620544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.233251:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178734 count 1 00002000:00010000:1.0:1651529467.233257:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233258:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 3/0,1 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233259:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946620416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (135us total) trans 30064895026 rc 0/0 00010000:00010000:1.0:1651529467.233262:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.233262:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154208 00010000:00010000:1.0:1651529467.233263:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233264:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233267:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233270:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233270:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233272:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233274:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233275:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233278:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 3/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233282:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 1/0,0 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233285:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1214 lrc: 0/0,0 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233290:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233292:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c90bba11 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233293:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233296:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 3/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233299:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 1/0,0 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233304:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c121b lrc: 0/0,0 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233307:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233309:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946620544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (178us total) trans 30064895027 rc 0/0 00010000:00010000:0.0:1651529467.233310:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233311:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233312:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154209 00010000:00010000:0.0:1651529467.233313:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 3/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233316:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 1/0,0 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233319:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1222 lrc: 0/0,0 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233408:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620672 00000100:00100000:1.0:1651529467.233409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233418:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154210 00000100:00100000:1.0:1651529467.233419:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233420:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b387ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946620672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.233425:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178739 count 1 00000100:00100000:1.0:1651529467.233427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233437:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620736 00000100:00100000:1.0:1651529467.233446:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620800 00000100:00100000:1.0:1651529467.233452:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620928 00000100:00100000:1.0:1651529467.233457:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620864 00000100:00100000:1.0:1651529467.233463:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154211 00000100:00100000:1.0:1651529467.233465:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946620736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.233466:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233468:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 3/0,1 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.233470:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178858 count 1 00010000:00010000:0.0:1651529467.233474:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233475:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233475:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.233476:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233477:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 3/0,1 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233479:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233481:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233482:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233482:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233483:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233485:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233486:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233489:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233499:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233530:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b387ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946620672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 109us (140us total) trans 30064895028 rc 0/0 00000100:00100000:0.0:1651529467.233534:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154210 00000100:00100000:1.0:1651529467.233539:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:39029:x1731745946620736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (140us total) trans 30064895029 rc 0/0 00000100:00100000:1.0:1651529467.233542:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154211 00000100:00100000:1.0:1651529467.233547:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154212 00000100:00100000:1.0:1651529467.233549:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946620800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.233551:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154213 00000100:00100000:0.0:1651529467.233552:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946620928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.233554:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178740 count 1 00002000:00080000:0.0:1651529467.233557:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178927 count 1 00002000:00010000:1.0:1651529467.233559:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233561:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 3/0,1 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.233563:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233564:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233565:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233565:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 3/0,1 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233566:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233568:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233569:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233569:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233570:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233572:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233573:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233574:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233576:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233579:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233630:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946620800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (221us total) trans 30064895030 rc 0/0 00000100:00100000:1.0:1651529467.233633:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154212 00000100:00100000:1.0:1651529467.233638:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154214 00000100:00100000:1.0:1651529467.233639:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:39029:x1731745946620864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.233644:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178735 count 1 00002000:00010000:1.0:1651529467.233649:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233651:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 3/0,1 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233653:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946620928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 99us (237us total) trans 30064895031 rc 0/0 00010000:00010000:1.0:1651529467.233654:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233655:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233656:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233656:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154213 00010000:00010000:1.0:1651529467.233660:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233663:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233665:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233666:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233670:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233671:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233674:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 3/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233678:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 1/0,0 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233681:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1229 lrc: 0/0,0 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233685:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233688:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233689:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233692:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 3/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233695:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 1/0,0 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233697:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1230 lrc: 0/0,0 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233698:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:39029:x1731745946620864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (271us total) trans 30064895032 rc 0/0 00000100:00100000:1.0:1651529467.233701:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154214 00010000:00010000:0.0:1651529467.233701:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233703:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233704:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233707:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 3/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233709:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233712:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a023b8c2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233712:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 1/0,0 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233713:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233715:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1237 lrc: 0/0,0 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233716:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 3/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233718:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233721:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.233721:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233723:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 1/0,0 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233724:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 3/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233726:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c123e lrc: 0/0,0 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233727:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 1/0,0 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233730:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1245 lrc: 0/0,0 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233766:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621504 00000100:00100000:1.0:1651529467.233773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233777:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621632 00000100:00100000:0.0:1651529467.233790:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621568 00000100:00100000:0.0:1651529467.233794:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154215 00000100:00100000:0.0:1651529467.233796:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946621504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.233797:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154216 00000100:00100000:1.0:1651529467.233799:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946621632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.233834:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178926 count 1 00002000:00080000:1.0:1651529467.233837:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178724 count 1 00002000:00010000:0.0:1651529467.233839:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233841:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 3/0,1 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.233843:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233845:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 3/0,1 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233845:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233845:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233846:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233849:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233849:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233850:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233850:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233853:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233854:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233856:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233857:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233869:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233896:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+71:39029:x1731745946621504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 99us (147us total) trans 30064895033 rc 0/0 00000100:00100000:0.0:1651529467.233899:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154215 00000100:00100000:0.0:1651529467.233904:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154217 00000100:00100000:0.0:1651529467.233906:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946621568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.233910:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946621632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 110us (143us total) trans 30064895034 rc 0/0 00002000:00080000:0.0:1651529467.233910:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178732 count 1 00000100:00100000:1.0:1651529467.233913:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154216 00002000:00010000:0.0:1651529467.233915:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233917:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 3/0,1 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233920:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233920:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233921:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233922:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233924:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.233925:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233925:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233928:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 3/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233928:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233931:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233932:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 1/0,0 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233935:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c124c lrc: 0/0,0 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233939:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233942:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.233943:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233946:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 3/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233949:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 1/0,0 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233952:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1253 lrc: 0/0,0 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233955:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233957:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.233958:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233961:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 3/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233964:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 1/0,0 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233966:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c125a lrc: 0/0,0 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233968:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946621568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (194us total) trans 30064895035 rc 0/0 00000100:00100000:0.0:1651529467.233971:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154217 00000100:00100000:1.0:1651529467.234277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234334:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234335:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621696 00000100:00100000:1.0:1651529467.234343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234348:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621824 00000100:00100000:1.0:1651529467.234349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234360:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621760 00000100:00100000:0.0:1651529467.234369:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621952 00000100:00100000:1.0:1651529467.234370:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622080 00000100:00100000:0.0:1651529467.234372:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622016 00000100:00100000:0.0:1651529467.234374:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621888 00000100:00100000:1.0:1651529467.234376:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622144 00000100:00100000:0.0:1651529467.234378:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154218 00000100:00100000:0.0:1651529467.234379:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946621696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.234380:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154219 00000100:00100000:1.0:1651529467.234382:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946621824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.234384:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178819 count 1 00002000:00080000:1.0:1651529467.234387:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178736 count 1 00002000:00010000:0.0:1651529467.234390:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234393:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 3/0,1 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234397:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234397:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234398:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.234402:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234402:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234403:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 3/0,1 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234405:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234407:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234408:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234408:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234409:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234412:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234415:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234426:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234448:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+79:39030:x1731745946621696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (171us total) trans 30064895036 rc 0/0 00000100:00100000:0.0:1651529467.234451:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154218 00000100:00100000:0.0:1651529467.234456:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154220 00000100:00100000:0.0:1651529467.234457:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946621760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.234461:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178772 count 1 00002000:00010000:0.0:1651529467.234467:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.234468:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946621824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (172us total) trans 30064895037 rc 0/0 00010000:00010000:0.0:1651529467.234468:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 3/0,1 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234471:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154219 00010000:00010000:0.0:1651529467.234472:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234472:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234473:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234476:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154221 00000100:00100000:1.0:1651529467.234477:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946621952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.234477:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234480:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.234482:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178937 count 1 00010000:00010000:0.0:1651529467.234482:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.234487:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234489:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 3/0,1 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234501:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234502:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234503:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234506:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234510:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234512:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234523:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946621760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (211us total) trans 30064895038 rc 0/0 00000100:00100000:0.0:1651529467.234526:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154220 00000100:00100000:0.0:1651529467.234531:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154222 00000100:00100000:0.0:1651529467.234532:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946622016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.234536:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178855 count 1 00002000:00010000:0.0:1651529467.234541:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234542:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 3/0,1 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234546:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234546:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234547:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234551:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234554:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234557:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234560:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946621952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (234us total) trans 30064895039 rc 0/0 00000100:00100000:1.0:1651529467.234563:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154221 00000100:00100000:1.0:1651529467.234568:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154223 00000100:00100000:1.0:1651529467.234570:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946622080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.234575:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178916 count 1 00002000:00010000:1.0:1651529467.234580:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234581:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 3/0,1 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234585:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234585:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234586:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234589:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946622016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (246us total) trans 30064895040 rc 0/0 00010000:00010000:1.0:1651529467.234590:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234592:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154222 00010000:00010000:1.0:1651529467.234593:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234595:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234597:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154224 00000100:00100000:0.0:1651529467.234598:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946621888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.234602:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178766 count 1 00002000:00010000:0.0:1651529467.234607:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234609:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 3/0,1 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234612:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234613:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234614:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234617:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234620:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234625:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234628:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946622080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (293us total) trans 30064895041 rc 0/0 00000100:00100000:1.0:1651529467.234641:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154223 00000100:00100000:1.0:1651529467.234646:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154225 00000100:00100000:1.0:1651529467.234647:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946622144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.234652:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178716 count 1 00002000:00010000:1.0:1651529467.234657:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.234657:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946621888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (308us total) trans 30064895042 rc 0/0 00010000:00010000:1.0:1651529467.234659:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 3/0,1 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234660:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154224 00010000:00010000:1.0:1651529467.234662:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234663:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234664:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234667:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234669:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234670:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234673:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234673:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c28d57aa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.234674:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234677:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 3/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234681:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 1/0,0 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234684:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1261 lrc: 0/0,0 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234688:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234691:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.234692:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234695:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 3/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234698:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 1/0,0 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234701:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1268 lrc: 0/0,0 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234704:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234706:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6dda103 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529467.234707:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946622144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (347us total) trans 30064895043 rc 0/0 00010000:00010000:0.0:1651529467.234707:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234710:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154225 00010000:00010000:0.0:1651529467.234710:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 3/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234713:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 1/0,0 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234715:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c126f lrc: 0/0,0 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234717:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234721:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234724:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001edcc069 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.234724:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234727:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 3/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234730:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 1/0,0 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234731:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.234732:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234732:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c127d lrc: 0/0,0 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234735:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 3/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234735:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234738:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.234739:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234740:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 1/0,0 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234741:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 3/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234742:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1276 lrc: 0/0,0 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234747:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234747:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 1/0,0 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234749:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.234750:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234750:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1284 lrc: 0/0,0 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234753:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 3/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234753:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234755:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.234756:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 1/0,0 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234756:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234759:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 3/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234762:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 1/0,0 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234764:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1292 lrc: 0/0,0 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234766:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c128b lrc: 0/0,0 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235153:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622720 00000100:00100000:1.0:1651529467.235159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235175:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622784 00000100:00100000:0.0:1651529467.235181:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622848 00000100:00100000:1.0:1651529467.235191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235197:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622976 00000100:00100000:1.0:1651529467.235200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235208:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623104 00000100:00100000:1.0:1651529467.235210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235212:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622912 00000100:00100000:0.0:1651529467.235215:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623040 00000100:00100000:1.0:1651529467.235218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235218:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154226 00000100:00100000:0.0:1651529467.235220:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946622720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.235224:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623168 00002000:00080000:0.0:1651529467.235225:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178920 count 1 00000100:00100000:1.0:1651529467.235231:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154227 00002000:00010000:0.0:1651529467.235231:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235232:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 3/0,1 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235233:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946622784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.235236:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235237:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.235238:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178848 count 1 00010000:00010000:0.0:1651529467.235238:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235241:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.235244:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235244:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235246:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 3/0,1 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235247:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235250:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235250:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235251:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235255:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235268:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235271:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235288:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946622720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (147us total) trans 30064895044 rc 0/0 00000100:00100000:0.0:1651529467.235291:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154226 00000100:00100000:0.0:1651529467.235296:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154228 00000100:00100000:0.0:1651529467.235298:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946622848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.235304:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178779 count 1 00002000:00010000:0.0:1651529467.235309:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235311:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 3/0,1 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235314:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946622784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (161us total) trans 30064895045 rc 0/0 00010000:00010000:0.0:1651529467.235314:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235315:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235316:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235317:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154227 00010000:00010000:0.0:1651529467.235319:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235322:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235323:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154229 00000100:00100000:1.0:1651529467.235325:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946622976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.235325:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.235329:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178823 count 1 00002000:00010000:1.0:1651529467.235342:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235344:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 3/0,1 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235348:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235349:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235350:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235353:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235356:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235366:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946622848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (206us total) trans 30064895046 rc 0/0 00010000:00010000:1.0:1651529467.235368:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235369:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154228 00000100:00100000:0.0:1651529467.235374:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154230 00000100:00100000:0.0:1651529467.235375:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946623104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.235379:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178867 count 1 00002000:00010000:0.0:1651529467.235384:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235386:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 3/0,1 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235389:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235390:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235391:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235394:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235397:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235400:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235404:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946622976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (231us total) trans 30064895047 rc 0/0 00000100:00100000:1.0:1651529467.235407:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154229 00000100:00100000:1.0:1651529467.235412:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154231 00000100:00100000:1.0:1651529467.235414:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946622912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.235419:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178899 count 1 00002000:00010000:1.0:1651529467.235424:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235425:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 3/0,1 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235429:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235429:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235430:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235432:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946623104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (244us total) trans 30064895048 rc 0/0 00010000:00010000:1.0:1651529467.235434:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235435:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154230 00010000:00010000:1.0:1651529467.235437:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235439:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235439:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154232 00000100:00100000:0.0:1651529467.235441:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946623040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.235445:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178705 count 1 00002000:00010000:0.0:1651529467.235450:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235452:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 3/0,1 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235455:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235456:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235457:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235460:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235463:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235466:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235484:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946622912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (284us total) trans 30064895049 rc 0/0 00000100:00100000:1.0:1651529467.235487:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154231 00000100:00100000:1.0:1651529467.235492:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154233 00000100:00100000:1.0:1651529467.235494:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946623168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.235497:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946623040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (287us total) trans 30064895050 rc 0/0 00002000:00080000:1.0:1651529467.235498:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178834 count 1 00000100:00100000:0.0:1651529467.235500:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154232 00002000:00010000:1.0:1651529467.235504:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235505:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 3/0,1 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235509:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235509:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235510:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235511:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235514:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235514:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235515:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235516:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235518:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 3/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235519:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235522:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 1/0,0 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235525:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1299 lrc: 0/0,0 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235529:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235532:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235533:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235536:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 3/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235539:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 1/0,0 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235541:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c12a0 lrc: 0/0,0 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235545:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235547:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001bf25d5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235548:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235550:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 3/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235551:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946623168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (333us total) trans 30064895051 rc 0/0 00010000:00010000:0.0:1651529467.235556:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 1/0,0 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235559:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c12a7 lrc: 0/0,0 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235562:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235563:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154233 00010000:00010000:0.0:1651529467.235564:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235565:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235568:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 3/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235571:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235571:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 1/0,0 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235573:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c12ae lrc: 0/0,0 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235575:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021305674 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.235576:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235577:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235579:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 3/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235579:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235580:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235583:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 3/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235584:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 1/0,0 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235586:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 1/0,0 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235587:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c12b5 lrc: 0/0,0 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235588:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c12bc lrc: 0/0,0 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235591:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235592:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235594:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000313829b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.235594:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.235595:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235595:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235598:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 3/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235598:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 3/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235601:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 1/0,0 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235603:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c12ca lrc: 0/0,0 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235609:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 1/0,0 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235612:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c12c3 lrc: 0/0,0 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.235935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235977:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623808 00000100:00100000:1.0:1651529467.235986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235996:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623744 00000100:00100000:0.0:1651529467.235997:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623872 00000100:00100000:1.0:1651529467.236005:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624000 00000100:00100000:1.0:1651529467.236008:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623936 00000100:00100000:1.0:1651529467.236010:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624128 00000100:00100000:0.0:1651529467.236011:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624064 00000100:00100000:1.0:1651529467.236012:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624192 00000100:00100000:0.0:1651529467.236015:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154234 00000100:00100000:1.0:1651529467.236017:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154235 00000100:00100000:0.0:1651529467.236017:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:39029:x1731745946623808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.236019:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946623744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.236022:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178814 count 1 00002000:00080000:1.0:1651529467.236024:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178818 count 1 00002000:00010000:0.0:1651529467.236028:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.236030:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.236030:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 3/0,1 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236032:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 3/0,1 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236033:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236034:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236035:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236036:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236038:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236042:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236044:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236044:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236045:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236049:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236052:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236055:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236085:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946623808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (150us total) trans 30064895052 rc 0/0 00000100:00100000:0.0:1651529467.236088:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154234 00000100:00100000:0.0:1651529467.236093:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154236 00000100:00100000:0.0:1651529467.236094:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946623872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.236097:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946623744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (153us total) trans 30064895053 rc 0/0 00002000:00080000:0.0:1651529467.236099:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178951 count 1 00000100:00100000:1.0:1651529467.236100:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154235 00002000:00010000:0.0:1651529467.236104:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.236105:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154237 00010000:00010000:0.0:1651529467.236105:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 3/0,1 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236107:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946624000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.236109:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236109:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236110:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.236111:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178948 count 1 00010000:00010000:0.0:1651529467.236114:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.236116:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.236117:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236118:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 3/0,1 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236119:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236122:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236122:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236123:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236135:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236138:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236141:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236160:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:39030:x1731745946623872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (210us total) trans 30064895054 rc 0/0 00000100:00100000:0.0:1651529467.236163:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154236 00000100:00100000:0.0:1651529467.236168:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154238 00000100:00100000:0.0:1651529467.236170:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946623936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.236174:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178800 count 1 00000100:00100000:1.0:1651529467.236176:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946624000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (222us total) trans 30064895055 rc 0/0 00000100:00100000:1.0:1651529467.236179:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154237 00002000:00010000:0.0:1651529467.236179:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.236180:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 3/0,1 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236184:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154239 00010000:00010000:0.0:1651529467.236184:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236184:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236185:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236186:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f4cf210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946624128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.236188:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.236190:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178723 count 1 00010000:00010000:0.0:1651529467.236191:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236194:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.236195:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236197:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 3/0,1 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236200:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236201:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236202:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236205:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236208:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236213:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236226:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946623936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (266us total) trans 30064895056 rc 0/0 00000100:00100000:0.0:1651529467.236229:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154238 00000100:00100000:0.0:1651529467.236234:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154240 00000100:00100000:0.0:1651529467.236236:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946624064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.236240:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178826 count 1 00002000:00010000:0.0:1651529467.236244:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.236246:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f4cf210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946624128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (279us total) trans 30064895057 rc 0/0 00010000:00010000:0.0:1651529467.236246:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 3/0,1 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236249:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154239 00010000:00010000:0.0:1651529467.236252:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236252:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236253:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236256:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236259:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236262:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236266:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154241 00000100:00100000:1.0:1651529467.236268:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946624192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.236272:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178837 count 1 00002000:00010000:1.0:1651529467.236287:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236289:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 3/0,1 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236293:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236293:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236294:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236295:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946624064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (317us total) trans 30064895058 rc 0/0 00000100:00100000:0.0:1651529467.236297:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154240 00010000:00010000:1.0:1651529467.236298:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236301:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236304:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236308:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236311:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080006241 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.236312:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236315:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 3/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236322:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 1/0,0 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236325:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c12d1 lrc: 0/0,0 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236329:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236332:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.236333:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236336:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 3/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236339:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 1/0,0 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236341:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946624192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (355us total) trans 30064895059 rc 0/0 00010000:00010000:0.0:1651529467.236341:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c12d8 lrc: 0/0,0 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236344:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154241 00010000:00010000:0.0:1651529467.236345:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236347:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.236348:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236351:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 3/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236352:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236354:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 1/0,0 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236356:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.236357:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236357:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c12df lrc: 0/0,0 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236360:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 3/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236360:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236362:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.236363:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236364:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 1/0,0 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236366:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 3/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236367:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c12e6 lrc: 0/0,0 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236369:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 1/0,0 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236371:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236371:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c12ed lrc: 0/0,0 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236374:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.236375:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236380:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 3/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236383:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 1/0,0 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236386:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c12f4 lrc: 0/0,0 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236387:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236389:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236390:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e79ca9ff already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.236391:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236392:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.236393:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236393:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 3/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236395:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 3/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236397:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 1/0,0 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236398:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 1/0,0 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236399:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c12fb lrc: 0/0,0 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236401:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1302 lrc: 0/0,0 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236708:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624832 00000100:00100000:1.0:1651529467.236714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236729:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624960 00000100:00100000:1.0:1651529467.236735:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236745:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624896 00000100:00100000:1.0:1651529467.236749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236757:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625024 00000100:00100000:1.0:1651529467.236760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236767:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625088 00000100:00100000:1.0:1651529467.236768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236778:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625152 00000100:00100000:0.0:1651529467.236781:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625280 00000100:00100000:0.0:1651529467.236783:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625216 00000100:00100000:1.0:1651529467.236785:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154242 00000100:00100000:1.0:1651529467.236787:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946624832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.236788:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154243 00000100:00100000:0.0:1651529467.236789:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946624960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.236793:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178957 count 1 00002000:00080000:0.0:1651529467.236794:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178789 count 1 00002000:00010000:1.0:1651529467.236799:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236826:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 3/0,1 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.236828:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236830:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236830:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 3/0,1 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236831:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236831:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236833:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236834:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236835:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236835:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236839:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236839:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236842:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236842:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236845:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236896:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:39029:x1731745946624832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 108us (210us total) trans 30064895060 rc 0/0 00000100:00100000:1.0:1651529467.236899:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154242 00000100:00100000:0.0:1651529467.236901:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+103:39029:x1731745946624960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 111us (202us total) trans 30064895061 rc 0/0 00000100:00100000:0.0:1651529467.236904:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154243 00000100:00100000:1.0:1651529467.236906:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154244 00000100:00100000:1.0:1651529467.236908:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:39030:x1731745946624896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.236910:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154245 00002000:00080000:1.0:1651529467.236912:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178953 count 1 00000100:00100000:0.0:1651529467.236912:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:39030:x1731745946625024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.236916:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178843 count 1 00002000:00010000:1.0:1651529467.236918:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236919:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 3/0,1 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.236921:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236923:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236923:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236923:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 3/0,1 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236924:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236928:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236931:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236934:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236938:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236938:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236939:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236943:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236946:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236949:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236970:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946624896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (256us total) trans 30064895062 rc 0/0 00000100:00100000:1.0:1651529467.236973:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154244 00000100:00100000:1.0:1651529467.236978:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154246 00000100:00100000:1.0:1651529467.236980:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946625088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.236984:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178845 count 1 00000100:00100000:0.0:1651529467.236985:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946625024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (250us total) trans 30064895063 rc 0/0 00000100:00100000:0.0:1651529467.236988:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154245 00002000:00010000:1.0:1651529467.236989:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236990:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 3/0,1 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236993:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154247 00010000:00010000:1.0:1651529467.236994:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236994:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236995:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236995:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:39030:x1731745946625152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.236998:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.236999:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178773 count 1 00010000:00010000:1.0:1651529467.237001:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237004:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.237004:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237005:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 3/0,1 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237009:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237009:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237010:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237022:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237025:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237028:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237036:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946625088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (287us total) trans 30064895064 rc 0/0 00000100:00100000:1.0:1651529467.237039:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154246 00000100:00100000:1.0:1651529467.237043:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154248 00000100:00100000:1.0:1651529467.237045:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946625280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.237049:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178890 count 1 00002000:00010000:1.0:1651529467.237053:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237055:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 3/0,1 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237058:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237059:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237060:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237063:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237063:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946625152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (303us total) trans 30064895065 rc 0/0 00010000:00010000:1.0:1651529467.237066:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237066:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154247 00010000:00010000:1.0:1651529467.237069:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237071:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154249 00000100:00100000:0.0:1651529467.237072:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946625216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.237076:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178776 count 1 00002000:00010000:0.0:1651529467.237081:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237083:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 3/0,1 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237086:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237087:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237088:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237091:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237097:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237099:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 2/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237100:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946625280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 54us (331us total) trans 30064895066 rc 0/0 00000100:00100000:1.0:1651529467.237103:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154248 00010000:00010000:1.0:1651529467.237113:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237116:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237117:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237120:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 3/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237127:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 1/0,0 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237130:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c1309 lrc: 0/0,0 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237131:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946625216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (353us total) trans 30064895067 rc 0/0 00010000:00010000:1.0:1651529467.237134:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237134:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154249 00010000:00010000:1.0:1651529467.237137:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237138:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237141:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 3/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237144:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 1/0,0 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237144:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237146:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1310 lrc: 0/0,0 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237148:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237149:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237150:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237152:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237152:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 3/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237153:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237156:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 3/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237156:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 1/0,0 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237159:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 1/0,0 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237159:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1317 lrc: 0/0,0 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237162:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c131e lrc: 0/0,0 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237164:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237165:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237167:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237168:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000278eaea9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237168:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237168:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237170:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 3/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237171:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 3/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237173:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 1/0,0 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237174:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 1/0,0 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237176:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1325 lrc: 0/0,0 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237177:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c132c lrc: 0/0,0 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237179:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237182:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 2/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237182:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237183:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237185:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237185:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 3/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237186:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 2/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237188:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 3/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237188:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 1/0,0 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237191:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 1/0,0 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237193:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c1333 lrc: 0/0,0 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237194:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c133a lrc: 0/0,0 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.237476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237484:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625856 00000100:00100000:1.0:1651529467.237491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237504:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625920 00000100:00100000:0.0:1651529467.237511:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625984 00000100:00100000:1.0:1651529467.237516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.237527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237536:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626112 00000100:00100000:0.0:1651529467.237541:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626048 00000100:00100000:0.0:1651529467.237546:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154250 00000100:00100000:1.0:1651529467.237547:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237547:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946625856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.237552:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178836 count 1 00002000:00010000:0.0:1651529467.237558:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237560:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 3/0,1 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.237564:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237565:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237565:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237567:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.237569:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237572:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237573:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626176 00010000:00010000:0.0:1651529467.237574:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237579:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626240 00000100:00100000:1.0:1651529467.237581:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626304 00000100:00100000:1.0:1651529467.237584:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154251 00000100:00100000:1.0:1651529467.237586:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946625920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.237591:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178817 count 1 00002000:00010000:1.0:1651529467.237596:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237598:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 3/0,1 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237602:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237602:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237603:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237607:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237610:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237613:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237616:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f7ea74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946625856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (158us total) trans 30064895068 rc 0/0 00000100:00100000:0.0:1651529467.237619:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154250 00000100:00100000:0.0:1651529467.237624:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154252 00000100:00100000:0.0:1651529467.237626:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946625984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.237630:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178876 count 1 00002000:00010000:0.0:1651529467.237635:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2babc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237637:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 3/0,1 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237640:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237641:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237642:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237645:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237648:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237651:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237653:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007604197e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946625920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (177us total) trans 30064895069 rc 0/0 00000100:00100000:1.0:1651529467.237656:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154251 00000100:00100000:1.0:1651529467.237669:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154253 00000100:00100000:1.0:1651529467.237671:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946626112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.237676:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178896 count 1 00002000:00010000:1.0:1651529467.237681:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237683:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 3/0,1 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237686:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237687:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237688:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237691:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237693:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d143e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946625984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (201us total) trans 30064895070 rc 0/0 00010000:00010000:1.0:1651529467.237694:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237697:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237706:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154252 00000100:00100000:0.0:1651529467.237711:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154254 00000100:00100000:0.0:1651529467.237713:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946626048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.237717:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178936 count 1 00002000:00010000:0.0:1651529467.237722:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237724:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 3/0,1 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237728:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237728:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237729:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237731:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634bab6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946626112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (215us total) trans 30064895071 rc 0/0 00010000:00010000:0.0:1651529467.237733:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237735:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154253 00010000:00010000:0.0:1651529467.237736:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237739:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237740:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154255 00000100:00100000:1.0:1651529467.237741:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946626176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.237745:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178738 count 1 00002000:00010000:1.0:1651529467.237750:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237752:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 3/0,1 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237758:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237758:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237759:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237762:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237765:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237768:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237772:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000410a3a4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946626048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (245us total) trans 30064895072 rc 0/0 00000100:00100000:0.0:1651529467.237775:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154254 00000100:00100000:0.0:1651529467.237779:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154256 00000100:00100000:0.0:1651529467.237781:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946626240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.237793:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178873 count 1 00002000:00010000:0.0:1651529467.237798:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237800:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 3/0,1 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237831:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000642e76ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946626176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (253us total) trans 30064895073 rc 0/0 00010000:00010000:0.0:1651529467.237831:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237832:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237833:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237834:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154255 00010000:00010000:0.0:1651529467.237837:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237839:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154257 00010000:00010000:0.0:1651529467.237840:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237841:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946626304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.237843:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237846:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178737 count 1 00002000:00010000:1.0:1651529467.237851:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237853:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 3/0,1 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237858:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237862:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237865:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237867:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237878:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bfd81f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946626240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (316us total) trans 30064895074 rc 0/0 00000100:00100000:0.0:1651529467.237881:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154256 00010000:00010000:0.0:1651529467.237891:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237894:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237895:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237902:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad940a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946626304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (334us total) trans 30064895075 rc 0/0 00000100:00100000:1.0:1651529467.237905:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154257 00010000:00010000:0.0:1651529467.237909:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 3/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237913:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237914:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 1/0,0 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237916:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237917:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237917:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1341 lrc: 0/0,0 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237920:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 3/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237921:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237924:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237925:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 1/0,0 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237925:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237928:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c1348 lrc: 0/0,0 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237928:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 3/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237931:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 1/0,0 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237932:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237933:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c134f lrc: 0/0,0 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237935:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237936:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237936:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237939:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 3/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237939:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237940:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237942:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 1/0,0 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237943:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 3/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237944:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1356 lrc: 0/0,0 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237946:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 1/0,0 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237947:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237949:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c135d lrc: 0/0,0 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237950:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237951:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237952:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237953:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 3/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237954:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.237955:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237958:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 3/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237959:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 1/0,0 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237961:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 1/0,0 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237962:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1364 lrc: 0/0,0 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237965:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237966:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c136b lrc: 0/0,0 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237967:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.237968:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237971:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 3/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237974:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 1/0,0 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237976:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1372 lrc: 0/0,0 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238291:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626944 00000100:00100000:0.0:1651529467.238302:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626880 00000100:00100000:1.0:1651529467.238303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238312:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627072 00000100:00100000:0.0:1651529467.238319:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154258 00000100:00100000:0.0:1651529467.238321:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946626944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.238324:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154259 00000100:00100000:1.0:1651529467.238326:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946626880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.238326:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178854 count 1 00002000:00010000:0.0:1651529467.238331:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.238333:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178883 count 1 00010000:00010000:0.0:1651529467.238333:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 3/0,1 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238337:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238337:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.238338:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238338:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238340:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 3/0,1 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238342:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238344:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238344:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238345:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238345:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238347:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238349:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238352:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238354:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238394:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d630823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (103us total) trans 30064895077 rc 0/0 00000100:00100000:1.0:1651529467.238397:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154259 00000100:00100000:1.0:1651529467.238404:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154260 00000100:00100000:0.0:1651529467.238409:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000886ebdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946626944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (129us total) trans 30064895076 rc 0/0 00000100:00100000:1.0:1651529467.238414:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946627072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.238419:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178715 count 1 00000100:00100000:0.0:1651529467.238421:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154258 00002000:00010000:1.0:1651529467.238424:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238425:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 3/0,1 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238429:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238429:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238430:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238430:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238433:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.238434:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238434:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238437:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238437:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 3/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238439:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238441:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 1/0,0 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238444:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c1379 lrc: 0/0,0 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238448:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238451:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.238452:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238457:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 3/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238471:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 1/0,0 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238474:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c1380 lrc: 0/0,0 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238475:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050af345b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946627072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (175us total) trans 30064895078 rc 0/0 00000100:00100000:1.0:1651529467.238478:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154260 00010000:00010000:0.0:1651529467.238479:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238481:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.238482:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238485:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 3/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238489:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 1/0,0 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238491:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c1387 lrc: 0/0,0 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238529:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627392 00000100:00100000:1.0:1651529467.238551:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154261 00000100:00100000:1.0:1651529467.238552:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+113:39029:x1731745946627392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.238558:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178717 count 1 00002000:00010000:1.0:1651529467.238563:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238565:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 3/0,1 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238569:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238578:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238579:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238583:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238586:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238589:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238632:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a77d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946627392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (110us total) trans 30064895079 rc 0/0 00000100:00100000:1.0:1651529467.238635:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154261 00010000:00010000:1.0:1651529467.238642:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238645:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.238646:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238649:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 3/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238663:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 1/0,0 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238676:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c138e lrc: 0/0,0 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238733:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238748:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627520 00000100:00100000:1.0:1651529467.238752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238762:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627456 00000100:00100000:0.0:1651529467.238764:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627584 00000100:00100000:1.0:1651529467.238771:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627648 00000100:00100000:1.0:1651529467.238775:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627968 00000100:00100000:1.0:1651529467.238777:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628096 00000100:00100000:0.0:1651529467.238777:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628032 00000100:00100000:1.0:1651529467.238780:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154262 00000100:00100000:1.0:1651529467.238782:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+120:39029:x1731745946627520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.238783:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154263 00000100:00100000:0.0:1651529467.238785:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946627456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.238787:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178782 count 1 00002000:00080000:0.0:1651529467.238790:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178894 count 1 00002000:00010000:1.0:1651529467.238792:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238794:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 3/0,1 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.238795:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bace:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238797:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 3/0,1 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238798:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238798:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238799:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238824:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238829:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238839:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238840:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238841:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238842:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238846:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238849:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238852:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238885:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf79521 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946627520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 102us (176us total) trans 30064895080 rc 0/0 00000100:00100000:1.0:1651529467.238888:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154262 00000100:00100000:1.0:1651529467.238893:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154264 00000100:00100000:0.0:1651529467.238893:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082eeec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946627456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 107us (175us total) trans 30064895081 rc 0/0 00000100:00100000:1.0:1651529467.238895:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946627584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.238896:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154263 00002000:00080000:1.0:1651529467.238899:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178887 count 1 00000100:00100000:0.0:1651529467.238902:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154265 00000100:00100000:0.0:1651529467.238903:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+120:39029:x1731745946627648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.238904:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238906:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 3/0,1 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.238909:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178730 count 1 00010000:00010000:1.0:1651529467.238910:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238910:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238911:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.238914:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238915:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238916:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 3/0,1 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238918:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238920:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238920:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238921:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238924:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238927:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238930:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238931:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238972:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946627648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (243us total) trans 30064895082 rc 0/0 00000100:00100000:0.0:1651529467.238975:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154265 00000100:00100000:1.0:1651529467.238978:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946627584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (255us total) trans 30064895083 rc 0/0 00000100:00100000:0.0:1651529467.238979:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154266 00000100:00100000:0.0:1651529467.238981:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946627968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.238982:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154264 00002000:00080000:0.0:1651529467.238985:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178785 count 1 00000100:00100000:1.0:1651529467.238987:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154267 00000100:00100000:1.0:1651529467.238988:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac1125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946628096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.238990:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238992:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 3/0,1 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.238993:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178913 count 1 00010000:00010000:0.0:1651529467.238996:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238996:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238997:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.238998:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238999:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 3/0,1 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239000:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239003:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239003:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239003:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239004:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239006:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239008:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239011:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239013:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239038:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946627968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (304us total) trans 30064895084 rc 0/0 00000100:00100000:0.0:1651529467.239041:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154266 00000100:00100000:0.0:1651529467.239045:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154268 00000100:00100000:0.0:1651529467.239047:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:39029:x1731745946628032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.239051:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178958 count 1 00002000:00010000:0.0:1651529467.239056:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239057:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 3/0,1 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239061:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac1125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946628096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (309us total) trans 30064895085 rc 0/0 00010000:00010000:0.0:1651529467.239061:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239061:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239062:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239064:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154267 00010000:00010000:0.0:1651529467.239066:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239068:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239071:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239076:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239079:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239080:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239083:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 3/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239088:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 1/0,0 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239091:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1395 lrc: 0/0,0 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239095:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239098:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239098:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239104:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:39029:x1731745946628032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (365us total) trans 30064895086 rc 0/0 00000100:00100000:0.0:1651529467.239107:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154268 00010000:00010000:1.0:1651529467.239111:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 3/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239115:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 1/0,0 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239117:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c139c lrc: 0/0,0 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239121:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239124:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239125:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239128:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 3/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239130:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239131:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 1/0,0 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239133:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c13aa lrc: 0/0,0 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239133:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.239134:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239137:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239137:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 3/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239142:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 1/0,0 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239144:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239145:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239145:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c13a3 lrc: 0/0,0 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239147:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 3/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239149:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239151:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 1/0,0 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239152:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239153:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c13b1 lrc: 0/0,0 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239153:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239156:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 3/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239157:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239159:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 1/0,0 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239160:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239160:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239161:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c13b8 lrc: 0/0,0 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239163:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 3/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239166:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 1/0,0 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239175:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c13bf lrc: 0/0,0 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239196:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628160 00000100:00100000:0.0:1651529467.239213:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154269 00000100:00100000:0.0:1651529467.239215:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+121:39029:x1731745946628160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.239220:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178904 count 1 00002000:00010000:0.0:1651529467.239225:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239227:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 3/0,1 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239230:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239231:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239231:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239235:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239238:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239241:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239307:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946628160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (93us total) trans 30064895087 rc 0/0 00000100:00100000:0.0:1651529467.239312:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154269 00010000:00010000:0.0:1651529467.239322:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239337:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.239338:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239341:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 3/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239346:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 1/0,0 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239351:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c13c6 lrc: 0/0,0 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239464:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628800 00000100:00100000:1.0:1651529467.239472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239486:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628736 00000100:00100000:0.0:1651529467.239495:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154270 00000100:00100000:0.0:1651529467.239497:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946628800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.239498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529467.239501:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178712 count 1 00000100:00100000:1.0:1651529467.239505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239525:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628928 00002000:00010000:0.0:1651529467.239529:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239531:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 3/0,1 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239534:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628864 00000100:00100000:1.0:1651529467.239540:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628992 00000100:00100000:1.0:1651529467.239547:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154271 00010000:00010000:0.0:1651529467.239548:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.239549:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946628736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.239549:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239550:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.239554:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178794 count 1 00010000:00010000:0.0:1651529467.239554:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239557:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.239560:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239560:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239561:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 3/0,1 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239572:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239572:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239573:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239577:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239581:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239584:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239606:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946628800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 108us (153us total) trans 30064895088 rc 0/0 00000100:00100000:0.0:1651529467.239609:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154270 00000100:00100000:0.0:1651529467.239615:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154272 00000100:00100000:0.0:1651529467.239617:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+127:39029:x1731745946628928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.239621:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178796 count 1 00002000:00010000:0.0:1651529467.239626:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239628:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 3/0,1 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239631:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (158us total) trans 30064895089 rc 0/0 00010000:00010000:0.0:1651529467.239631:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239632:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239632:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239634:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154271 00010000:00010000:0.0:1651529467.239636:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239639:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154273 00010000:00010000:0.0:1651529467.239639:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239641:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946628864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.239641:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.239645:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178813 count 1 00002000:00010000:1.0:1651529467.239650:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239652:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 3/0,1 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239656:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239656:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239657:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239661:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239663:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239666:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239678:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+127:39029:x1731745946628928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (186us total) trans 30064895090 rc 0/0 00000100:00100000:0.0:1651529467.239681:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154272 00000100:00100000:0.0:1651529467.239686:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154274 00000100:00100000:0.0:1651529467.239688:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.239692:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178928 count 1 00002000:00010000:0.0:1651529467.239697:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239698:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 3/0,1 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239702:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (196us total) trans 30064895091 rc 0/0 00010000:00010000:0.0:1651529467.239702:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239702:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239703:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239705:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154273 00010000:00010000:0.0:1651529467.239707:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239709:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239712:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239712:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239716:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239717:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239720:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 3/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239724:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 1/0,0 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239727:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c13cd lrc: 0/0,0 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239731:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239734:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239735:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239740:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 3/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239743:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 1/0,0 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239744:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (228us total) trans 30064895092 rc 0/0 00010000:00010000:1.0:1651529467.239746:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c13d4 lrc: 0/0,0 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239747:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154274 00010000:00010000:1.0:1651529467.239749:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239752:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239752:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239755:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 3/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239758:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 1/0,0 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239760:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c13db lrc: 0/0,0 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239764:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239767:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239767:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239770:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 3/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239773:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 1/0,0 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.239786:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c13e2 lrc: 0/0,0 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239790:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239792:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239793:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239796:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 3/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239799:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 1/0,0 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.239832:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c13e9 lrc: 0/0,0 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239842:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629120 00000100:00100000:0.0:1651529467.239842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239852:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629056 00000100:00100000:1.0:1651529467.239857:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629184 00000100:00100000:1.0:1651529467.239863:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154275 00000100:00100000:1.0:1651529467.239864:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+129:39030:x1731745946629120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.239869:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178835 count 1 00000100:00100000:0.0:1651529467.239879:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154276 00000100:00100000:0.0:1651529467.239881:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+129:39030:x1731745946629056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.239889:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178952 count 1 00002000:00010000:0.0:1651529467.239895:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239896:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 3/0,1 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.239899:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239900:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239901:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 3/0,1 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239901:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239902:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239905:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239905:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239906:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239907:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239908:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239910:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239911:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239913:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239916:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239969:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946629120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (191us total) trans 30064895093 rc 0/0 00000100:00100000:1.0:1651529467.239972:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154275 00000100:00100000:1.0:1651529467.239977:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154277 00000100:00100000:0.0:1651529467.239978:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946629056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (179us total) trans 30064895094 rc 0/0 00000100:00100000:1.0:1651529467.239979:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946629184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.239981:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154276 00002000:00080000:1.0:1651529467.239983:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178768 count 1 00002000:00010000:1.0:1651529467.239989:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239990:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 3/0,1 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239991:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239994:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239994:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.239995:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239995:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239996:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239999:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240001:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 3/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240002:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240005:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240006:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 1/0,0 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240009:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c13f7 lrc: 0/0,0 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240013:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240016:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.240017:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240019:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 3/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240023:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 1/0,0 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240025:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c13f0 lrc: 0/0,0 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240039:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946629184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (197us total) trans 30064895095 rc 0/0 00000100:00100000:1.0:1651529467.240043:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154277 00010000:00010000:0.0:1651529467.240044:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240048:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.240049:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240052:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 3/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240055:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 1/0,0 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240058:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c13fe lrc: 0/0,0 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240069:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629632 00000100:00100000:1.0:1651529467.240082:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154278 00000100:00100000:1.0:1651529467.240084:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946629632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.240089:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178764 count 1 00002000:00010000:1.0:1651529467.240095:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240097:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 3/0,1 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240100:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240101:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240102:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240105:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240117:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240120:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240164:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946629632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (101us total) trans 30064895096 rc 0/0 00000100:00100000:1.0:1651529467.240167:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154278 00010000:00010000:1.0:1651529467.240174:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240178:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240179:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240182:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 3/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240194:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 1/0,0 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240197:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1405 lrc: 0/0,0 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240234:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629568 00000100:00100000:1.0:1651529467.240235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240244:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629696 00000100:00100000:0.0:1651529467.240250:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629760 00000100:00100000:1.0:1651529467.240255:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629824 00000100:00100000:0.0:1651529467.240256:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154279 00000100:00100000:0.0:1651529467.240258:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+134:39029:x1731745946629568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.240263:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154280 00000100:00100000:1.0:1651529467.240265:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+134:39029:x1731745946629696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.240268:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178708 count 1 00002000:00080000:1.0:1651529467.240270:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178770 count 1 00002000:00010000:0.0:1651529467.240274:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.240275:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240275:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 3/0,1 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240277:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 3/0,1 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240279:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240279:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240280:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240283:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240284:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240285:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240286:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240288:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240289:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240291:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240292:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240293:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240350:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946629696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (130us total) trans 30064895098 rc 0/0 00000100:00100000:1.0:1651529467.240353:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154280 00000100:00100000:1.0:1651529467.240358:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154281 00000100:00100000:1.0:1651529467.240366:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946629760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.240369:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946629568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 110us (156us total) trans 30064895097 rc 0/0 00002000:00080000:1.0:1651529467.240370:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178865 count 1 00000100:00100000:0.0:1651529467.240373:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154279 00002000:00010000:1.0:1651529467.240376:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240377:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 3/0,1 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240378:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154282 00000100:00100000:0.0:1651529467.240380:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+134:39029:x1731745946629824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.240381:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240381:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240382:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.240385:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178799 count 1 00010000:00010000:1.0:1651529467.240386:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240389:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.240390:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240392:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240392:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 3/0,1 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240395:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240396:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240397:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240400:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240406:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240408:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240428:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (203us total) trans 30064895099 rc 0/0 00000100:00100000:1.0:1651529467.240431:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154281 00010000:00010000:1.0:1651529467.240438:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240442:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240443:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240443:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946629824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (207us total) trans 30064895100 rc 0/0 00010000:00010000:1.0:1651529467.240446:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 3/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240446:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154282 00010000:00010000:1.0:1651529467.240450:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 1/0,0 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240453:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c140c lrc: 0/0,0 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240455:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240457:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240458:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.240459:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240460:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240461:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240462:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 3/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240464:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 3/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240467:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 1/0,0 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240467:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 1/0,0 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240469:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c141a lrc: 0/0,0 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240470:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1413 lrc: 0/0,0 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240472:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240475:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240476:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240478:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 3/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240484:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 1/0,0 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240487:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1421 lrc: 0/0,0 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240517:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629952 00000100:00100000:0.0:1651529467.240525:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240537:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630080 00000100:00100000:1.0:1651529467.240544:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629888 00000100:00100000:0.0:1651529467.240548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240551:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154283 00000100:00100000:1.0:1651529467.240552:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+137:39029:x1731745946629952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.240561:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178809 count 1 00000100:00100000:0.0:1651529467.240562:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630016 00002000:00010000:1.0:1651529467.240567:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240568:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 3/0,1 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240569:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154284 00000100:00100000:0.0:1651529467.240571:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+138:39029:x1731745946630080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.240572:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240573:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240574:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.240576:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178870 count 1 00010000:00010000:1.0:1651529467.240577:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240580:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240585:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.240590:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240597:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 3/0,1 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240601:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240602:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240603:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240606:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240610:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240612:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240632:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946629952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (134us total) trans 30064895101 rc 0/0 00000100:00100000:1.0:1651529467.240635:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154283 00000100:00100000:1.0:1651529467.240640:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154285 00000100:00100000:1.0:1651529467.240642:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946629888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.240646:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178752 count 1 00002000:00010000:1.0:1651529467.240651:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240653:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 3/0,1 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240655:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946630080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (130us total) trans 30064895102 rc 0/0 00010000:00010000:1.0:1651529467.240656:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240657:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240658:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240658:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154284 00010000:00010000:1.0:1651529467.240661:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240664:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240664:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154286 00000100:00100000:0.0:1651529467.240665:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+138:39030:x1731745946630016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.240667:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.240670:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178838 count 1 00002000:00010000:0.0:1651529467.240675:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240676:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 3/0,1 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240680:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240680:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240681:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240685:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240687:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240690:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240706:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+140:39030:x1731745946629888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (172us total) trans 30064895103 rc 0/0 00000100:00100000:1.0:1651529467.240709:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154285 00010000:00010000:1.0:1651529467.240716:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240719:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240720:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240723:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 3/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240723:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946630016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (180us total) trans 30064895104 rc 0/0 00000100:00100000:0.0:1651529467.240726:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154286 00010000:00010000:1.0:1651529467.240728:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 1/0,0 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240730:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1428 lrc: 0/0,0 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240734:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240734:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240737:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.240737:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240738:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240738:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240741:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 3/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240743:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 3/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240746:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 1/0,0 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240746:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 1/0,0 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240749:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1436 lrc: 0/0,0 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240749:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c142f lrc: 0/0,0 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240752:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240755:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.240755:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240758:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 3/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240761:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 1/0,0 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240764:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c143d lrc: 0/0,0 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241149:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630656 00000100:00100000:1.0:1651529467.241157:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154287 00000100:00100000:1.0:1651529467.241159:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946630656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.241164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.241178:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178706 count 1 00002000:00010000:1.0:1651529467.241184:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241186:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 3/0,1 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241190:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241190:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241191:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.241195:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241198:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241200:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241253:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+140:39030:x1731745946630656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (124us total) trans 30064895105 rc 0/0 00000100:00100000:1.0:1651529467.241256:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154287 00000100:00100000:1.0:1651529467.241261:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630720 00000100:00100000:1.0:1651529467.241270:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630848 00000100:00100000:0.0:1651529467.241280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241281:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630976 00000100:00100000:1.0:1651529467.241285:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631104 00000100:00100000:1.0:1651529467.241288:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630784 00000100:00100000:0.0:1651529467.241288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241294:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630912 00000100:00100000:1.0:1651529467.241300:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631040 00000100:00100000:0.0:1651529467.241301:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154288 00000100:00100000:0.0:1651529467.241303:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946630720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.241304:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154289 00000100:00100000:1.0:1651529467.241305:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946630848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.241308:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178852 count 1 00002000:00080000:1.0:1651529467.241310:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178907 count 1 00002000:00010000:0.0:1651529467.241314:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.241316:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2badb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.241316:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 3/0,1 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241318:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 3/0,1 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241322:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241322:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241322:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241323:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241323:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241323:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241327:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241327:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241330:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241330:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241332:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241333:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241383:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946630848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (208us total) trans 30064895106 rc 0/0 00000100:00100000:1.0:1651529467.241386:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154289 00000100:00100000:1.0:1651529467.241391:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154290 00000100:00100000:1.0:1651529467.241393:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946630976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.241397:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178827 count 1 00000100:00100000:0.0:1651529467.241403:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946630720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 99us (238us total) trans 30064895107 rc 0/0 00000100:00100000:0.0:1651529467.241406:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154288 00002000:00010000:1.0:1651529467.241409:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241411:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 3/0,1 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241412:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154291 00000100:00100000:0.0:1651529467.241413:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946631104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.241415:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241415:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241416:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.241418:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178888 count 1 00010000:00010000:1.0:1651529467.241420:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241423:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.241423:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.241424:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 3/0,1 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241426:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241428:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241429:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241429:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241433:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241436:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241439:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241461:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946630976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (268us total) trans 30064895108 rc 0/0 00000100:00100000:1.0:1651529467.241464:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154290 00000100:00100000:1.0:1651529467.241469:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154292 00000100:00100000:1.0:1651529467.241470:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946630912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.241474:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178857 count 1 00000100:00100000:0.0:1651529467.241474:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946631104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (251us total) trans 30064895109 rc 0/0 00000100:00100000:0.0:1651529467.241477:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154291 00002000:00010000:1.0:1651529467.241479:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241481:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 3/0,1 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241482:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154293 00000100:00100000:0.0:1651529467.241484:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946630784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.241488:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178709 count 1 00002000:00010000:0.0:1651529467.241493:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241494:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241494:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 3/0,1 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241495:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241496:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241498:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241498:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241499:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241499:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241502:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241503:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241505:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241508:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241510:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241558:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946630784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (305us total) trans 30064895111 rc 0/0 00000100:00100000:0.0:1651529467.241560:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154293 00000100:00100000:1.0:1651529467.241561:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946630912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (280us total) trans 30064895110 rc 0/0 00000100:00100000:1.0:1651529467.241564:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154292 00000100:00100000:0.0:1651529467.241566:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154294 00000100:00100000:0.0:1651529467.241567:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946631040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.241571:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178922 count 1 00002000:00010000:0.0:1651529467.241576:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.241577:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 3/0,1 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241581:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241581:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241582:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241585:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241588:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241593:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241626:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946631040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (337us total) trans 30064895112 rc 0/0 00000100:00100000:0.0:1651529467.241628:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154294 00010000:00010000:0.0:1651529467.241637:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241641:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241642:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241645:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 3/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241649:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 1/0,0 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1651529467.241650:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064894970 is committed 00010000:00010000:0.0:1651529467.241652:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1444 lrc: 0/0,0 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241656:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241659:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241659:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241660:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241663:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241663:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 3/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241664:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241666:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 1/0,0 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241667:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 3/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241668:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1452 lrc: 0/0,0 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241672:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241675:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241675:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241678:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 3/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241681:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 1/0,0 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241684:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 1/0,0 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241684:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c1459 lrc: 0/0,0 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241687:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c144b lrc: 0/0,0 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241689:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241691:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241692:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241693:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241694:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.241695:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241695:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 3/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241698:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 3/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241699:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 1/0,0 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241701:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 1/0,0 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241701:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1460 lrc: 0/0,0 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241704:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c1467 lrc: 0/0,0 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241704:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241707:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241707:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e79ca9ff already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241708:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241710:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241710:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 3/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241711:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241713:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 3/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241716:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 1/0,0 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241717:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 1/0,0 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241719:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1475 lrc: 0/0,0 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241719:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c146e lrc: 0/0,0 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241754:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631680 00000100:00100000:1.0:1651529467.241766:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154295 00000100:00100000:1.0:1651529467.241768:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946631680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.241773:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178774 count 1 00002000:00010000:1.0:1651529467.241778:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241780:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 3/0,1 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241783:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241784:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241784:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241788:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241791:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241794:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241835:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241839:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.241840:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241843:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 3/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241847:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 1/0,0 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241850:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c147c lrc: 0/0,0 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241869:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+148:39030:x1731745946631680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 100us (121us total) trans 30064895113 rc 0/0 00000100:00100000:1.0:1651529467.241872:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154295 00000100:00100000:0.0:1651529467.242191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242221:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632320 00000100:00100000:0.0:1651529467.242222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242228:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242235:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632256 00000100:00100000:0.0:1651529467.242237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242240:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632448 00000100:00100000:0.0:1651529467.242244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242247:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632384 00000100:00100000:1.0:1651529467.242258:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632512 00000100:00100000:1.0:1651529467.242263:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632576 00000100:00100000:0.0:1651529467.242264:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242266:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632704 00000100:00100000:1.0:1651529467.242269:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154296 00000100:00100000:0.0:1651529467.242269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242271:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+154:39030:x1731745946632320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.242275:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632640 00002000:00080000:1.0:1651529467.242276:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178856 count 1 00002000:00010000:1.0:1651529467.242282:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.242282:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154297 00010000:00010000:1.0:1651529467.242283:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 3/0,1 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242284:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+155:39029:x1731745946632256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.242287:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242288:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242289:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.242289:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178844 count 1 00010000:00010000:1.0:1651529467.242292:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.242294:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242296:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 3/0,1 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242298:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242300:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242300:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242300:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242301:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242305:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242308:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242311:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242348:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946632320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (165us total) trans 30064895114 rc 0/0 00000100:00100000:1.0:1651529467.242351:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154296 00000100:00100000:1.0:1651529467.242356:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154298 00000100:00100000:0.0:1651529467.242356:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946632256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (142us total) trans 30064895115 rc 0/0 00000100:00100000:1.0:1651529467.242357:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946632448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.242360:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154297 00002000:00080000:1.0:1651529467.242362:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178874 count 1 00002000:00010000:1.0:1651529467.242367:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242368:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 3/0,1 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242372:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242373:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242374:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242377:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242378:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154299 00000100:00100000:0.0:1651529467.242379:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+155:39029:x1731745946632384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.242380:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.242383:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178833 count 1 00010000:00010000:1.0:1651529467.242385:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.242388:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242390:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 3/0,1 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242402:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242402:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242403:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242407:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242410:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242413:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242426:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946632448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (203us total) trans 30064895116 rc 0/0 00000100:00100000:1.0:1651529467.242429:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154298 00000100:00100000:1.0:1651529467.242434:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154300 00000100:00100000:1.0:1651529467.242435:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946632512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.242440:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178897 count 1 00002000:00010000:1.0:1651529467.242444:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242446:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 3/0,1 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242448:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946632384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (220us total) trans 30064895117 rc 0/0 00010000:00010000:1.0:1651529467.242449:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242450:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242451:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242451:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154299 00010000:00010000:1.0:1651529467.242454:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242456:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154301 00010000:00010000:1.0:1651529467.242457:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242458:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946632576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.242460:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.242472:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178828 count 1 00002000:00010000:0.0:1651529467.242477:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242479:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 3/0,1 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242483:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242483:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242484:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242488:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242491:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242493:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242494:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946632512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (257us total) trans 30064895118 rc 0/0 00000100:00100000:1.0:1651529467.242497:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154300 00000100:00100000:1.0:1651529467.242502:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154302 00000100:00100000:1.0:1651529467.242504:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946632704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.242509:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178880 count 1 00002000:00010000:1.0:1651529467.242513:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242514:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 3/0,1 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242518:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242518:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242519:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242523:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242526:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242528:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242528:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946632576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (283us total) trans 30064895119 rc 0/0 00000100:00100000:0.0:1651529467.242531:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154301 00000100:00100000:0.0:1651529467.242536:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154303 00000100:00100000:0.0:1651529467.242537:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946632640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.242541:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178938 count 1 00002000:00010000:0.0:1651529467.242546:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bafa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242547:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 3/0,1 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242559:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242559:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.242560:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946632704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (296us total) trans 30064895120 rc 0/0 00010000:00010000:0.0:1651529467.242560:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242564:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242565:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154302 00010000:00010000:0.0:1651529467.242567:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242570:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242572:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242576:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242577:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242580:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 3/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242584:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 1/0,0 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242587:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1483 lrc: 0/0,0 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242591:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242594:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242595:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242598:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 3/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242603:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 1/0,0 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242605:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946632640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (335us total) trans 30064895121 rc 0/0 00010000:00010000:1.0:1651529467.242606:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c148a lrc: 0/0,0 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242607:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154303 00010000:00010000:1.0:1651529467.242609:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242612:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242612:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242615:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 3/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242617:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242618:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 1/0,0 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242620:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1491 lrc: 0/0,0 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242620:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.242621:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242623:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242624:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 3/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242626:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242627:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242630:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 3/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242633:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 1/0,0 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242636:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c149f lrc: 0/0,0 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242639:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242639:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 1/0,0 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242641:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242642:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242642:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c1498 lrc: 0/0,0 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242644:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 3/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242646:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242648:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 1/0,0 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242649:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242650:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c14a6 lrc: 0/0,0 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242650:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242653:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 3/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242656:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242656:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 1/0,0 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242658:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.242659:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242659:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c14ad lrc: 0/0,0 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242662:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 3/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242665:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 1/0,0 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242667:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c14b4 lrc: 0/0,0 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243028:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633280 00000100:00100000:1.0:1651529467.243037:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154304 00000100:00100000:1.0:1651529467.243038:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946633280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.243048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.243060:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178805 count 1 00002000:00010000:1.0:1651529467.243067:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243069:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 3/0,1 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243072:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243073:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243074:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243077:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243081:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.243094:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243095:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243122:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243128:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243140:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+157:39029:x1731745946633280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 100us (129us total) trans 30064895122 rc 0/0 00000100:00100000:1.0:1651529467.243143:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154304 00000100:00100000:1.0:1651529467.243148:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633344 00000100:00100000:0.0:1651529467.243164:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633408 00000100:00100000:1.0:1651529467.243165:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633536 00000100:00100000:1.0:1651529467.243169:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633472 00000100:00100000:0.0:1651529467.243170:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633664 00000100:00100000:1.0:1651529467.243172:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633600 00000100:00100000:0.0:1651529467.243173:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633728 00000100:00100000:1.0:1651529467.243176:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154305 00000100:00100000:1.0:1651529467.243177:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946633344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.243178:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154306 00000100:00100000:0.0:1651529467.243179:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39029:x1731745946633536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.243182:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178912 count 1 00002000:00080000:0.0:1651529467.243185:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178932 count 1 00002000:00010000:1.0:1651529467.243187:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243189:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 3/0,1 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.243191:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243192:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 3/0,1 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243193:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243193:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243194:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243196:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243197:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243198:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243198:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243201:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243201:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243203:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243204:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243207:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243254:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+165:39030:x1731745946633344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (205us total) trans 30064895123 rc 0/0 00000100:00100000:1.0:1651529467.243257:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154305 00000100:00100000:0.0:1651529467.243259:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946633536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (164us total) trans 30064895124 rc 0/0 00000100:00100000:1.0:1651529467.243262:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154307 00000100:00100000:1.0:1651529467.243264:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946633408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.243264:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154306 00002000:00080000:1.0:1651529467.243268:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178775 count 1 00000100:00100000:0.0:1651529467.243270:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154308 00000100:00100000:0.0:1651529467.243272:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946633472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.243274:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243275:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 3/0,1 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.243276:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178816 count 1 00010000:00010000:1.0:1651529467.243279:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243279:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243280:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.243281:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243283:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 3/0,1 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243284:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243286:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243287:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243288:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243289:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243291:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243292:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243295:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243297:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243325:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+165:39029:x1731745946633408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (239us total) trans 30064895125 rc 0/0 00000100:00100000:1.0:1651529467.243328:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154307 00000100:00100000:0.0:1651529467.243331:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946633472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (228us total) trans 30064895126 rc 0/0 00000100:00100000:1.0:1651529467.243333:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154309 00000100:00100000:1.0:1651529467.243334:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946633664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.243334:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154308 00002000:00080000:1.0:1651529467.243339:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178944 count 1 00000100:00100000:0.0:1651529467.243339:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154310 00000100:00100000:0.0:1651529467.243341:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946633600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.243343:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243345:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 3/0,1 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243348:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243349:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243350:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243353:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243356:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243361:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.243362:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178760 count 1 00002000:00010000:0.0:1651529467.243368:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243369:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 3/0,1 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243373:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243374:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243375:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243378:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243381:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243384:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243392:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946633664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (269us total) trans 30064895127 rc 0/0 00000100:00100000:1.0:1651529467.243394:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154309 00000100:00100000:1.0:1651529467.243399:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154311 00000100:00100000:1.0:1651529467.243401:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946633728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.243405:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178859 count 1 00002000:00010000:1.0:1651529467.243409:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243411:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 3/0,1 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243414:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243415:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243415:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243418:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946633600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (289us total) trans 30064895128 rc 0/0 00010000:00010000:1.0:1651529467.243419:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243421:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154310 00010000:00010000:1.0:1651529467.243422:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243424:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243431:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243435:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.243436:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243441:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 3/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243446:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 1/0,0 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243449:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c14bb lrc: 0/0,0 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243453:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243456:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.243457:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243458:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946633728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (322us total) trans 30064895129 rc 0/0 00010000:00010000:0.0:1651529467.243459:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 3/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243461:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154311 00010000:00010000:0.0:1651529467.243462:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 1/0,0 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243465:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c14c2 lrc: 0/0,0 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243468:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243469:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243471:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.243472:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.243472:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243473:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243474:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 3/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243476:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 3/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243478:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 1/0,0 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243480:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c14c9 lrc: 0/0,0 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243481:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 1/0,0 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243483:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c14d0 lrc: 0/0,0 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243483:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243486:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.243487:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243487:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243489:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 3/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243490:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.243491:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243492:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 1/0,0 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243496:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 3/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243499:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 1/0,0 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243502:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c14de lrc: 0/0,0 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243505:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243507:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c14d7 lrc: 0/0,0 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243508:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.243508:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243511:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 3/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243511:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243514:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 1/0,0 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243514:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.243515:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243517:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c14e5 lrc: 0/0,0 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243518:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 3/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243521:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 1/0,0 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243524:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c14ec lrc: 0/0,0 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243549:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634048 00000100:00100000:1.0:1651529467.243565:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154312 00000100:00100000:1.0:1651529467.243567:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946634048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.243572:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178703 count 1 00002000:00010000:1.0:1651529467.243578:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243584:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 3/0,1 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243588:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243589:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243590:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243612:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243621:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243624:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243669:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+165:39030:x1731745946634048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 101us (128us total) trans 30064895130 rc 0/0 00000100:00100000:1.0:1651529467.243672:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154312 00010000:00010000:1.0:1651529467.243679:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243685:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.243686:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243697:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 3/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243702:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 1/0,0 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243704:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c14f3 lrc: 0/0,0 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243828:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243840:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634432 00000100:00100000:1.0:1651529467.243848:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634496 00000100:00100000:1.0:1651529467.243852:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634368 00000100:00100000:0.0:1651529467.243855:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243856:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154313 00000100:00100000:1.0:1651529467.243857:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946634432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.243868:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178925 count 1 00002000:00010000:1.0:1651529467.243874:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243876:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 3/0,1 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243880:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243880:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243881:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243887:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243890:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.243900:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243929:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634560 00000100:00100000:0.0:1651529467.243934:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634688 00000100:00100000:0.0:1651529467.243937:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634624 00000100:00100000:0.0:1651529467.243938:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634816 00000100:00100000:0.0:1651529467.243940:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634752 00000100:00100000:1.0:1651529467.243942:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946634432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (146us total) trans 30064895131 rc 0/0 00000100:00100000:0.0:1651529467.243943:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154314 00000100:00100000:1.0:1651529467.243945:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154313 00000100:00100000:0.0:1651529467.243945:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.243950:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178763 count 1 00000100:00100000:1.0:1651529467.243951:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154315 00000100:00100000:1.0:1651529467.243952:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946634368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.243956:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.243957:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178847 count 1 00010000:00010000:0.0:1651529467.243957:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 3/0,1 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243961:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.243962:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243962:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243963:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243964:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 3/0,1 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243967:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243967:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243968:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243969:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243970:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243973:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243973:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243978:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243980:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244012:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+174:39030:x1731745946634496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (183us total) trans 30064895132 rc 0/0 00000100:00100000:1.0:1651529467.244016:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+174:39029:x1731745946634368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (180us total) trans 30064895133 rc 0/0 00000100:00100000:1.0:1651529467.244019:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154315 00000100:00100000:1.0:1651529467.244024:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154316 00000100:00100000:1.0:1651529467.244025:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946634560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.244026:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154314 00002000:00080000:1.0:1651529467.244030:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178956 count 1 00000100:00100000:0.0:1651529467.244031:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154317 00000100:00100000:0.0:1651529467.244033:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946634688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.244034:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244035:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 3/0,1 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.244037:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178781 count 1 00010000:00010000:1.0:1651529467.244039:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244039:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244040:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.244043:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244044:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244044:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 3/0,1 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244047:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244048:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244049:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244050:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244051:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244053:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244056:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244059:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244082:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+174:39029:x1731745946634560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (227us total) trans 30064895134 rc 0/0 00000100:00100000:1.0:1651529467.244085:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154316 00000100:00100000:1.0:1651529467.244090:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154318 00000100:00100000:1.0:1651529467.244092:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.244093:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946634688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (200us total) trans 30064895135 rc 0/0 00002000:00080000:1.0:1651529467.244096:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178901 count 1 00000100:00100000:0.0:1651529467.244096:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154317 00002000:00010000:1.0:1651529467.244100:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.244101:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154319 00010000:00010000:1.0:1651529467.244102:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 3/0,1 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244103:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946634816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.244105:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244106:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244106:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244110:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244113:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244115:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.244115:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178871 count 1 00002000:00010000:0.0:1651529467.244120:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244122:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 3/0,1 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244125:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244126:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244127:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244130:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244133:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244136:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244163:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+174:39030:x1731745946634624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (261us total) trans 30064895136 rc 0/0 00000100:00100000:1.0:1651529467.244166:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154318 00000100:00100000:1.0:1651529467.244171:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154320 00000100:00100000:0.0:1651529467.244171:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946634816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (264us total) trans 30064895137 rc 0/0 00000100:00100000:1.0:1651529467.244173:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.244174:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154319 00002000:00080000:1.0:1651529467.244177:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178862 count 1 00002000:00010000:1.0:1651529467.244182:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244183:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244184:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 3/0,1 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244187:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244187:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.244188:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244188:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244189:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244192:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244193:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 3/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244195:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244197:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 1/0,0 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244198:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244200:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c14fa lrc: 0/0,0 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244205:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244207:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244208:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244211:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 3/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244214:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 1/0,0 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244217:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1501 lrc: 0/0,0 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244220:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244223:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244223:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244226:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 3/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244229:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (307us total) trans 30064895138 rc 0/0 00010000:00010000:0.0:1651529467.244229:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 1/0,0 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244232:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1508 lrc: 0/0,0 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244235:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244237:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244238:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244241:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 3/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244242:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154320 00010000:00010000:0.0:1651529467.244244:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 1/0,0 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244249:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c150f lrc: 0/0,0 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244250:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244252:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244253:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000278eaea9 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.244255:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244255:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244255:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244257:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 3/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244258:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 3/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244261:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 1/0,0 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244262:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 1/0,0 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244263:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c151d lrc: 0/0,0 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244265:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c1516 lrc: 0/0,0 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244267:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244269:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244269:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244270:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244272:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.244273:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244275:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 3/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244276:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 3/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244278:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 1/0,0 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244281:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1524 lrc: 0/0,0 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244287:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 1/0,0 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244290:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c152b lrc: 0/0,0 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.244529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.244535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.244545:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635456 00000100:00100000:1.0:1651529467.244553:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635392 00000100:00100000:0.0:1651529467.244553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.244563:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635584 00000100:00100000:1.0:1651529467.244567:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635520 00000100:00100000:1.0:1651529467.244573:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154321 00000100:00100000:1.0:1651529467.244575:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+176:39029:x1731745946635456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.244579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.244580:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178868 count 1 00002000:00010000:1.0:1651529467.244585:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244587:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 3/0,1 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244591:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244591:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244592:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.244604:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.244608:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.244618:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635648 00010000:00010000:1.0:1651529467.244620:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244623:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635776 00000100:00100000:0.0:1651529467.244625:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635712 00000100:00100000:0.0:1651529467.244634:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635840 00000100:00100000:0.0:1651529467.244637:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154322 00000100:00100000:0.0:1651529467.244639:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+180:39030:x1731745946635392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.244644:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178756 count 1 00002000:00010000:0.0:1651529467.244650:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244652:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 3/0,1 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244663:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39029:x1731745946635456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (145us total) trans 30064895139 rc 0/0 00010000:00010000:0.0:1651529467.244664:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244665:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.244666:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154321 00010000:00010000:0.0:1651529467.244666:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244670:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244671:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154323 00000100:00100000:1.0:1651529467.244673:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+180:39029:x1731745946635584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.244673:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244676:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.244677:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178788 count 1 00002000:00010000:1.0:1651529467.244689:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244691:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 3/0,1 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244695:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244696:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244697:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244700:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244703:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244706:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244717:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946635392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (187us total) trans 30064895140 rc 0/0 00000100:00100000:0.0:1651529467.244720:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154322 00000100:00100000:0.0:1651529467.244725:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154324 00000100:00100000:0.0:1651529467.244726:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946635520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.244731:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178829 count 1 00002000:00010000:0.0:1651529467.244736:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244738:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 3/0,1 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244741:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244742:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244743:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244744:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39029:x1731745946635584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (209us total) trans 30064895141 rc 0/0 00000100:00100000:1.0:1651529467.244748:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154323 00000100:00100000:1.0:1651529467.244753:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154325 00000100:00100000:1.0:1651529467.244754:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+180:39030:x1731745946635648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.244755:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244758:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.244759:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178947 count 1 00010000:00010000:0.0:1651529467.244761:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.244764:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244765:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 3/0,1 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244769:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244769:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244770:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244774:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244776:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244779:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244796:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946635520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (243us total) trans 30064895142 rc 0/0 00000100:00100000:0.0:1651529467.244799:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154324 00000100:00100000:0.0:1651529467.244831:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154326 00000100:00100000:0.0:1651529467.244833:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946635776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.244838:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178761 count 1 00000100:00100000:1.0:1651529467.244840:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946635648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (278us total) trans 30064895143 rc 0/0 00002000:00010000:0.0:1651529467.244843:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.244845:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154325 00010000:00010000:0.0:1651529467.244845:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 3/0,1 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244849:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244849:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.244850:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154327 00010000:00010000:0.0:1651529467.244850:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244852:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+180:39029:x1731745946635712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.244854:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.244856:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178822 count 1 00002000:00010000:1.0:1651529467.244861:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244863:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 3/0,1 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244866:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244867:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244867:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244868:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244869:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244871:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244874:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244877:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244905:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946635776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (307us total) trans 30064895144 rc 0/0 00000100:00100000:0.0:1651529467.244908:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154326 00000100:00100000:1.0:1651529467.244911:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39029:x1731745946635712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (305us total) trans 30064895145 rc 0/0 00000100:00100000:1.0:1651529467.244914:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154327 00000100:00100000:1.0:1651529467.244919:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154328 00000100:00100000:1.0:1651529467.244920:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+180:39029:x1731745946635840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.244924:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178866 count 1 00002000:00010000:1.0:1651529467.244929:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244930:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 3/0,1 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244930:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244933:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244933:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.244934:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244934:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244935:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244937:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 3/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244938:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244941:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244942:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 1/0,0 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244944:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244945:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1532 lrc: 0/0,0 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244949:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244960:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244961:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244963:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 3/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244967:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 1/0,0 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244969:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1539 lrc: 0/0,0 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244973:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244974:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39029:x1731745946635840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 53us (361us total) trans 30064895146 rc 0/0 00010000:00010000:0.0:1651529467.244976:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244976:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244977:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154328 00010000:00010000:0.0:1651529467.244979:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 3/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244982:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 1/0,0 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244984:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244987:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080006241 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244987:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1540 lrc: 0/0,0 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244988:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244991:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244993:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 3/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244993:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.244994:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244997:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 3/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244998:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 1/0,0 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245000:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 1/0,0 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245001:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c1547 lrc: 0/0,0 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245002:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c154e lrc: 0/0,0 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245005:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245005:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245008:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001bf25d5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.245008:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245009:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245009:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245012:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 3/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245014:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 3/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245015:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 1/0,0 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245017:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1555 lrc: 0/0,0 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245017:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 1/0,0 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245020:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c155c lrc: 0/0,0 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245021:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245032:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245033:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245036:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 3/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245039:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 1/0,0 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245042:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1563 lrc: 0/0,0 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245242:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636416 00000100:00100000:1.0:1651529467.245250:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154329 00000100:00100000:1.0:1651529467.245252:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946636416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.245257:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178720 count 1 00002000:00010000:1.0:1651529467.245263:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245264:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 3/0,1 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245268:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245268:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245269:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245273:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245285:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245287:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245308:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245320:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.245321:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245324:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 3/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.245341:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946636416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (109us total) trans 30064895147 rc 0/0 00000100:00100000:1.0:1651529467.245344:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154329 00010000:00010000:0.0:1651529467.245351:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 1/0,0 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245354:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c156a lrc: 0/0,0 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.245402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245421:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245437:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636480 00000100:00100000:1.0:1651529467.245447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245458:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636544 00000100:00100000:0.0:1651529467.245463:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636608 00000100:00100000:1.0:1651529467.245464:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636672 00000100:00100000:0.0:1651529467.245466:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636736 00000100:00100000:1.0:1651529467.245474:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636800 00000100:00100000:1.0:1651529467.245477:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636864 00000100:00100000:0.0:1651529467.245480:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154330 00000100:00100000:1.0:1651529467.245482:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154331 00000100:00100000:0.0:1651529467.245482:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946636480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.245483:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946636544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.245487:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178882 count 1 00002000:00080000:1.0:1651529467.245489:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178886 count 1 00002000:00010000:0.0:1651529467.245492:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.245494:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bac6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245494:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 3/0,1 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245496:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 3/0,1 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245498:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245498:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245509:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245510:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245511:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245515:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245515:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245518:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245520:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245521:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245523:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245526:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.245569:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946636544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (158us total) trans 30064895148 rc 0/0 00000100:00100000:0.0:1651529467.245571:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+190:39029:x1731745946636480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (169us total) trans 30064895149 rc 0/0 00000100:00100000:1.0:1651529467.245572:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154331 00000100:00100000:0.0:1651529467.245574:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154330 00000100:00100000:1.0:1651529467.245577:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154332 00000100:00100000:1.0:1651529467.245579:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946636608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.245579:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154333 00000100:00100000:0.0:1651529467.245581:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946636672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.245584:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178806 count 1 00002000:00080000:0.0:1651529467.245586:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178725 count 1 00002000:00010000:1.0:1651529467.245589:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245590:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 3/0,1 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.245591:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245592:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 3/0,1 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245594:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245595:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245595:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245596:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245597:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245598:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245601:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245604:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245607:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245608:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245612:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245614:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245641:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946636672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (219us total) trans 30064895150 rc 0/0 00000100:00100000:0.0:1651529467.245644:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154333 00000100:00100000:0.0:1651529467.245649:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154334 00000100:00100000:1.0:1651529467.245650:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946636608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (233us total) trans 30064895151 rc 0/0 00000100:00100000:0.0:1651529467.245651:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946636736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.245653:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154332 00002000:00080000:0.0:1651529467.245655:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178745 count 1 00000100:00100000:1.0:1651529467.245658:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154335 00000100:00100000:1.0:1651529467.245659:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946636800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.245659:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245661:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 3/0,1 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.245664:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178942 count 1 00010000:00010000:0.0:1651529467.245665:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245665:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245666:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.245669:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bafe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245669:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245670:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 3/0,1 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245672:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245674:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245674:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245675:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245675:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245679:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245684:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245687:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245706:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+190:39029:x1731745946636736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 54us (278us total) trans 30064895152 rc 0/0 00000100:00100000:0.0:1651529467.245709:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154334 00000100:00100000:0.0:1651529467.245713:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154336 00000100:00100000:0.0:1651529467.245715:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946636864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.245718:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+189:39030:x1731745946636800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (281us total) trans 30064895153 rc 0/0 00002000:00080000:0.0:1651529467.245719:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178933 count 1 00000100:00100000:1.0:1651529467.245721:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154335 00002000:00010000:0.0:1651529467.245724:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245725:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 3/0,1 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245729:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245729:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245729:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245730:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245732:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245733:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245734:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245736:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 3/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245737:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245739:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245740:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 1/0,0 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245743:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1578 lrc: 0/0,0 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245747:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245750:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245751:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245754:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 3/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245757:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 1/0,0 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245760:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c1571 lrc: 0/0,0 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245763:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245766:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000313829b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245766:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245769:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 3/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245770:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946636864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 54us (323us total) trans 30064895154 rc 0/0 00010000:00010000:1.0:1651529467.245772:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 1/0,0 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245772:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154336 00010000:00010000:1.0:1651529467.245777:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1586 lrc: 0/0,0 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245780:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245782:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245783:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245784:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245786:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 3/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245786:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021305674 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.245787:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245789:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 1/0,0 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245789:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 3/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245792:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c157f lrc: 0/0,0 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245794:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 1/0,0 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245795:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245797:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c158d lrc: 0/0,0 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245798:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.245798:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245826:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245828:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 3/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245830:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.245831:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245833:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 1/0,0 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245834:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 3/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245836:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1594 lrc: 0/0,0 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245838:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 1/0,0 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245840:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c159b lrc: 0/0,0 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.245875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245882:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636928 00000100:00100000:1.0:1651529467.245889:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154337 00000100:00100000:1.0:1651529467.245891:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+189:39030:x1731745946636928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.245906:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178842 count 1 00002000:00010000:1.0:1651529467.245912:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245933:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 3/0,1 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245947:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245948:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245949:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245953:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245956:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245959:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246005:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946636928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 113us (130us total) trans 30064895155 rc 0/0 00000100:00100000:1.0:1651529467.246008:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154337 00010000:00010000:1.0:1651529467.246015:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246019:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.246020:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246030:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 3/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246035:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 1/0,0 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246038:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c15a2 lrc: 0/0,0 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246189:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246214:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637568 00000100:00100000:0.0:1651529467.246216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246227:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637504 00000100:00100000:0.0:1651529467.246230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246250:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637632 00000100:00100000:1.0:1651529467.246256:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637696 00000100:00100000:1.0:1651529467.246261:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637760 00000100:00100000:1.0:1651529467.246265:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637824 00000100:00100000:1.0:1651529467.246268:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154338 00000100:00100000:1.0:1651529467.246270:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946637568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.246274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.246281:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178767 count 1 00000100:00100000:0.0:1651529467.246281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.246287:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.246287:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637952 00010000:00010000:1.0:1651529467.246289:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 3/0,1 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246293:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246293:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.246293:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638016 00010000:00010000:1.0:1651529467.246294:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246296:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154339 00010000:00010000:1.0:1651529467.246298:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246298:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946637504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.246301:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246303:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.246303:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178877 count 1 00002000:00010000:0.0:1651529467.246308:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2babd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246310:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 3/0,1 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246314:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246314:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246315:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246319:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246322:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246325:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246344:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946637568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (155us total) trans 30064895156 rc 0/0 00000100:00100000:1.0:1651529467.246347:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154338 00000100:00100000:1.0:1651529467.246352:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154340 00000100:00100000:1.0:1651529467.246354:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946637632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.246358:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178915 count 1 00002000:00010000:1.0:1651529467.246363:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.246364:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946637504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (163us total) trans 30064895157 rc 0/0 00010000:00010000:1.0:1651529467.246365:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 3/0,1 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246367:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154339 00010000:00010000:1.0:1651529467.246368:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246369:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246369:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246372:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154341 00010000:00010000:1.0:1651529467.246373:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246374:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946637696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.246376:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246378:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.246378:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178924 count 1 00002000:00010000:0.0:1651529467.246382:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246393:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 3/0,1 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246397:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246397:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246398:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246402:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246405:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246408:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246413:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946637632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (203us total) trans 30064895158 rc 0/0 00000100:00100000:1.0:1651529467.246416:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154340 00000100:00100000:1.0:1651529467.246420:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154342 00000100:00100000:1.0:1651529467.246422:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946637760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.246427:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178839 count 1 00002000:00010000:1.0:1651529467.246431:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246432:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 3/0,1 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246438:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246439:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246440:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246443:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246443:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946637696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (226us total) trans 30064895159 rc 0/0 00010000:00010000:1.0:1651529467.246446:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246446:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154341 00010000:00010000:1.0:1651529467.246449:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246451:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154343 00000100:00100000:0.0:1651529467.246452:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946637824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.246456:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178783 count 1 00002000:00010000:0.0:1651529467.246461:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246463:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 3/0,1 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246466:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246474:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246475:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246479:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246481:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946637760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (256us total) trans 30064895160 rc 0/0 00010000:00010000:0.0:1651529467.246482:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246483:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154342 00010000:00010000:0.0:1651529467.246485:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246488:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154344 00000100:00100000:1.0:1651529467.246490:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946637952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.246494:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178853 count 1 00002000:00010000:1.0:1651529467.246499:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246500:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 3/0,1 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246504:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246504:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246505:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246509:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246512:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246514:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246519:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946637824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (288us total) trans 30064895161 rc 0/0 00000100:00100000:0.0:1651529467.246522:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154343 00000100:00100000:0.0:1651529467.246527:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154345 00000100:00100000:0.0:1651529467.246529:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946638016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.246533:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178719 count 1 00002000:00010000:0.0:1651529467.246538:0:161133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246540:0:161133:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 3/0,1 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246543:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246544:0:161133:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246544:0:161133:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246546:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946637952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (272us total) trans 30064895162 rc 0/0 00010000:00010000:0.0:1651529467.246548:0:161133:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246549:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154344 00010000:00010000:1.0:1651529467.246556:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246559:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.246559:0:161133:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246560:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246562:0:161133:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246563:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 3/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246568:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 1/0,0 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246571:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c15a9 lrc: 0/0,0 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246575:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246578:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.246579:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246581:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 3/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246584:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 1/0,0 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246587:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c15b0 lrc: 0/0,0 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246590:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246593:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.246593:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246596:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 3/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246596:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946638016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (314us total) trans 30064895163 rc 0/0 00000100:00100000:0.0:1651529467.246599:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154345 00010000:00010000:1.0:1651529467.246602:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 1/0,0 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246604:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c15b7 lrc: 0/0,0 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246607:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246609:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246610:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.246611:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246613:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 3/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246613:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.246614:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246616:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 1/0,0 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246616:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 3/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246619:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c15be lrc: 0/0,0 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246621:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 1/0,0 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246622:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246624:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001edcc069 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.246624:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c15c5 lrc: 0/0,0 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246625:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246628:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 3/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246628:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246631:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 1/0,0 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246634:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c15cc lrc: 0/0,0 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246637:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246639:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.246640:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6dda103 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.246640:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246641:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246643:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 3/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246643:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 3/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246646:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 1/0,0 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246646:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 1/0,0 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246649:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c15da lrc: 0/0,0 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 161133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246649:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c15d3 lrc: 0/0,0 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246856:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638592 00000100:00100000:1.0:1651529467.246865:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154346 00000100:00100000:1.0:1651529467.246866:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946638592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.246872:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178919 count 1 00002000:00010000:1.0:1651529467.246877:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246879:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 3/0,1 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246882:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246883:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246884:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246888:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246891:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246893:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246905:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246909:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.246910:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246913:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 3/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246941:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 1/0,0 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246948:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946638592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (102us total) trans 30064895164 rc 0/0 00000100:00100000:1.0:1651529467.246951:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154346 00010000:00010000:0.0:1651529467.246966:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c15e1 lrc: 0/0,0 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247000:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638656 00000100:00100000:1.0:1651529467.247007:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154347 00000100:00100000:1.0:1651529467.247008:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946638656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247026:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178812 count 1 00002000:00010000:1.0:1651529467.247031:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247033:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 3/0,1 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247037:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247038:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247039:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247042:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247045:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247048:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247093:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946638656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (100us total) trans 30064895165 rc 0/0 00000100:00100000:1.0:1651529467.247096:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154347 00010000:00010000:1.0:1651529467.247103:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247116:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247118:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247121:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 3/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247125:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 1/0,0 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247128:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c15e8 lrc: 0/0,0 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247160:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247176:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638784 00000100:00100000:1.0:1651529467.247177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247195:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638912 00000100:00100000:1.0:1651529467.247196:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639040 00000100:00100000:0.0:1651529467.247199:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638720 00000100:00100000:1.0:1651529467.247205:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154348 00000100:00100000:1.0:1651529467.247207:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+203:39029:x1731745946638784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.247213:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638848 00000100:00100000:0.0:1651529467.247216:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638976 00002000:00080000:1.0:1651529467.247218:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178791 count 1 00000100:00100000:0.0:1651529467.247219:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154349 00000100:00100000:0.0:1651529467.247221:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946638912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.247223:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247225:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 3/0,1 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.247226:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178892 count 1 00010000:00010000:1.0:1651529467.247231:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247231:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247232:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.247232:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bacc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247233:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 3/0,1 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247236:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247237:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247238:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247238:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247239:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247241:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247242:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247245:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247248:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 2/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247285:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (143us total) trans 30064895166 rc 0/0 00000100:00100000:1.0:1651529467.247288:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154348 00000100:00100000:1.0:1651529467.247300:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154350 00000100:00100000:1.0:1651529467.247302:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946639040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247306:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178935 count 1 00002000:00010000:1.0:1651529467.247312:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247313:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 3/0,1 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247317:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247317:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247318:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247320:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (165us total) trans 30064895167 rc 0/0 00010000:00010000:1.0:1651529467.247322:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247324:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154349 00010000:00010000:1.0:1651529467.247325:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247328:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247329:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154351 00000100:00100000:0.0:1651529467.247330:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946638720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.247335:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178733 count 1 00002000:00010000:0.0:1651529467.247341:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247342:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 3/0,1 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247346:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247346:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247347:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247351:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247354:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247364:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946639040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (203us total) trans 30064895168 rc 0/0 00000100:00100000:1.0:1651529467.247367:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154350 00000100:00100000:1.0:1651529467.247372:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154352 00000100:00100000:1.0:1651529467.247374:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946638848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247378:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178917 count 1 00010000:00010000:0.0:1651529467.247382:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.247393:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bae5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247395:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 3/0,1 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247398:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247399:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247400:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247403:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247409:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247411:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247420:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (254us total) trans 30064895169 rc 0/0 00000100:00100000:0.0:1651529467.247433:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154351 00000100:00100000:0.0:1651529467.247439:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154353 00000100:00100000:0.0:1651529467.247440:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.247445:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (268us total) trans 30064895170 rc 0/0 00002000:00080000:0.0:1651529467.247445:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178790 count 1 00000100:00100000:1.0:1651529467.247448:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154352 00002000:00010000:0.0:1651529467.247450:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247452:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 3/0,1 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247455:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247456:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247456:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247457:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247459:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247460:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247460:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247462:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 3/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247464:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247466:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247467:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 1/0,0 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247470:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c15ef lrc: 0/0,0 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247474:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 2/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247477:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c28d57aa already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247478:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 2/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247481:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 3/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247484:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 1/0,0 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247486:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c15f6 lrc: 0/0,0 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247490:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247492:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247493:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247495:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 3/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247498:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 1/0,0 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247499:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946638976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (312us total) trans 30064895171 rc 0/0 00000100:00100000:0.0:1651529467.247502:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154353 00010000:00010000:1.0:1651529467.247504:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c15fd lrc: 0/0,0 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247507:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247509:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a023b8c2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247510:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247513:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 3/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247513:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247516:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 1/0,0 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247518:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1604 lrc: 0/0,0 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247521:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247524:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247525:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247527:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.247528:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247530:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 3/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247531:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 3/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247533:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 1/0,0 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247535:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1612 lrc: 0/0,0 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247536:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 1/0,0 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247539:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c160b lrc: 0/0,0 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247557:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247563:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639488 00000100:00100000:1.0:1651529467.247569:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154354 00000100:00100000:1.0:1651529467.247584:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946639488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247589:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178757 count 1 00002000:00010000:1.0:1651529467.247601:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247603:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 3/0,1 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247606:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247607:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247608:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247612:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247614:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247618:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247660:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946639488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (103us total) trans 30064895172 rc 0/0 00000100:00100000:1.0:1651529467.247663:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154354 00010000:00010000:1.0:1651529467.247670:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247674:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.247675:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247685:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 3/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247690:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 1/0,0 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247693:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1619 lrc: 0/0,0 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247716:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639616 00000100:00100000:1.0:1651529467.247722:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154355 00000100:00100000:1.0:1651529467.247724:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8b6fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946639616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247729:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178851 count 1 00002000:00010000:1.0:1651529467.247734:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247736:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 3/0,1 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247739:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247740:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247741:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247744:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247747:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247750:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247789:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8b6fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946639616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (80us total) trans 30064895173 rc 0/0 00000100:00100000:1.0:1651529467.247792:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154355 00000100:00100000:0.0:1651529467.247838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247849:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639808 00000100:00100000:1.0:1651529467.247859:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154356 00000100:00100000:1.0:1651529467.247867:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946639808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247872:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178810 count 1 00002000:00010000:1.0:1651529467.247877:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247880:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 3/0,1 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.247883:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247884:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247885:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.247889:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247892:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247893:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.247894:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247929:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639872 00000100:00100000:0.0:1651529467.247935:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639744 00000100:00100000:0.0:1651529467.247937:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640000 00000100:00100000:0.0:1651529467.247939:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639936 00000100:00100000:0.0:1651529467.247942:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640064 00000100:00100000:1.0:1651529467.247946:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946639808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (108us total) trans 30064895174 rc 0/0 00000100:00100000:1.0:1651529467.247949:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154356 00000100:00100000:0.0:1651529467.247952:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640128 00000100:00100000:1.0:1651529467.247955:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154357 00000100:00100000:1.0:1651529467.247956:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+214:39030:x1731745946639872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.247957:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154358 00000100:00100000:0.0:1651529467.247959:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946639744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.247961:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178875 count 1 00002000:00080000:0.0:1651529467.247965:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178846 count 1 00002000:00010000:1.0:1651529467.247966:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2babb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247967:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 3/0,1 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.247970:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247971:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247972:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247972:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 3/0,1 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247973:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247976:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247976:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247976:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247977:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247979:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247981:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247982:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247984:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247987:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248018:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946639872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (137us total) trans 30064895175 rc 0/0 00000100:00100000:1.0:1651529467.248020:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154357 00000100:00100000:1.0:1651529467.248035:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154359 00000100:00100000:1.0:1651529467.248036:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946640000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.248041:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178802 count 1 00002000:00010000:1.0:1651529467.248046:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248047:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 3/0,1 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248051:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248051:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.248051:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946639744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (163us total) trans 30064895176 rc 0/0 00010000:00010000:1.0:1651529467.248052:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248054:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154358 00010000:00010000:1.0:1651529467.248056:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248059:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248059:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154360 00000100:00100000:0.0:1651529467.248061:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946639936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.248062:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.248065:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178744 count 1 00002000:00010000:0.0:1651529467.248071:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248072:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 3/0,1 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248076:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248077:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248078:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248081:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248084:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248087:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248095:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946640000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (201us total) trans 30064895177 rc 0/0 00000100:00100000:1.0:1651529467.248098:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154359 00000100:00100000:1.0:1651529467.248103:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154361 00000100:00100000:1.0:1651529467.248105:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946640064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.248109:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178811 count 1 00002000:00010000:1.0:1651529467.248113:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248115:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 3/0,1 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248119:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248119:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.248119:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946639936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (220us total) trans 30064895178 rc 0/0 00010000:00010000:1.0:1651529467.248120:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248122:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154360 00010000:00010000:1.0:1651529467.248123:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248126:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248127:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154362 00000100:00100000:0.0:1651529467.248129:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+214:39030:x1731745946640128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.248133:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178955 count 1 00002000:00010000:0.0:1651529467.248138:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248139:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 3/0,1 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248141:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248142:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248143:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248144:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248148:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248150:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248153:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248176:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946640064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (265us total) trans 30064895179 rc 0/0 00000100:00100000:1.0:1651529467.248179:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154361 00000100:00100000:0.0:1651529467.248186:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946640128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (267us total) trans 30064895180 rc 0/0 00010000:00010000:1.0:1651529467.248189:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248189:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154362 00010000:00010000:1.0:1651529467.248193:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.248194:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248197:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 3/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248199:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248201:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 1/0,0 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248202:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248203:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248204:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1620 lrc: 0/0,0 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248206:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 3/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248208:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248210:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 1/0,0 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248211:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248213:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c1627 lrc: 0/0,0 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248218:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248220:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248221:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c90bba11 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248222:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248223:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 3/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248224:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 3/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248227:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 1/0,0 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248227:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 1/0,0 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248229:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c162e lrc: 0/0,0 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248230:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c1635 lrc: 0/0,0 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248233:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248233:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248236:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248236:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.248237:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248237:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248239:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 3/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248239:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 3/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248242:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 1/0,0 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248245:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c163c lrc: 0/0,0 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248245:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 1/0,0 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248248:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c1643 lrc: 0/0,0 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248251:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248253:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248254:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248255:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248257:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 3/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248258:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.248259:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248260:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 1/0,0 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248262:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 3/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248262:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c164a lrc: 0/0,0 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248265:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 1/0,0 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248268:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c1651 lrc: 0/0,0 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248276:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248287:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640704 00000100:00100000:0.0:1651529467.248303:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154363 00000100:00100000:0.0:1651529467.248305:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946640704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.248311:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178762 count 1 00002000:00010000:0.0:1651529467.248316:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248318:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 3/0,1 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248321:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248322:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248323:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248326:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248329:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248332:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248393:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946640704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (116us total) trans 30064895181 rc 0/0 00000100:00100000:0.0:1651529467.248396:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154363 00010000:00010000:0.0:1651529467.248403:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248406:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.248407:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248426:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 3/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248431:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 1/0,0 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248433:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c1658 lrc: 0/0,0 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248490:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640832 00000100:00100000:0.0:1651529467.248500:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154364 00000100:00100000:0.0:1651529467.248502:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946640832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.248507:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178721 count 1 00002000:00010000:0.0:1651529467.248513:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248514:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 3/0,1 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248518:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248519:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248520:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248523:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248526:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248529:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248539:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248543:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.248544:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248546:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 3/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248561:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 1/0,0 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248564:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c165f lrc: 0/0,0 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248617:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946640832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 114us (138us total) trans 30064895182 rc 0/0 00000100:00100000:0.0:1651529467.248621:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154364 00000100:00100000:1.0:1651529467.248675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248685:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640960 00000100:00100000:1.0:1651529467.248686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248695:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640896 00000100:00100000:1.0:1651529467.248697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248706:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641088 00000100:00100000:1.0:1651529467.248711:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248711:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154365 00000100:00100000:0.0:1651529467.248712:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+219:39029:x1731745946640960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.248720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529467.248727:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178704 count 1 00000100:00100000:1.0:1651529467.248729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529467.248737:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.248738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.248738:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 3/0,1 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248747:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641024 00010000:00010000:0.0:1651529467.248747:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248747:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248748:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248752:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248754:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641216 00010000:00010000:0.0:1651529467.248755:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248756:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641152 00000100:00100000:1.0:1651529467.248758:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641280 00000100:00100000:1.0:1651529467.248761:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154366 00010000:00010000:0.0:1651529467.248761:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248763:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946640896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.248774:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178784 count 1 00002000:00010000:1.0:1651529467.248780:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248781:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 3/0,1 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248785:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248786:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248786:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248790:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248793:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248796:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248857:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 143us (181us total) trans 30064895183 rc 0/0 00000100:00100000:0.0:1651529467.248860:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154365 00000100:00100000:0.0:1651529467.248865:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154367 00000100:00100000:0.0:1651529467.248867:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946641088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.248872:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178777 count 1 00000100:00100000:1.0:1651529467.248873:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946640896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 109us (186us total) trans 30064895184 rc 0/0 00000100:00100000:1.0:1651529467.248876:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154366 00002000:00010000:0.0:1651529467.248877:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248879:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 3/0,1 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248882:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154368 00010000:00010000:0.0:1651529467.248882:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248883:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.248884:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946641024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.248884:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.248888:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178872 count 1 00010000:00010000:0.0:1651529467.248888:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248890:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.248893:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248893:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248895:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 3/0,1 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248898:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248899:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248900:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248912:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248918:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248920:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248936:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946641088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (238us total) trans 30064895185 rc 0/0 00000100:00100000:0.0:1651529467.248939:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154367 00000100:00100000:0.0:1651529467.248943:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154369 00000100:00100000:0.0:1651529467.248945:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946641216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.248950:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178731 count 1 00000100:00100000:1.0:1651529467.248955:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946641024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (244us total) trans 30064895186 rc 0/0 00002000:00010000:0.0:1651529467.248955:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248956:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 3/0,1 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248958:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154368 00010000:00010000:0.0:1651529467.248960:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248960:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248961:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248963:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154370 00000100:00100000:1.0:1651529467.248965:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946641152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.248965:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248968:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.248969:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178729 count 1 00010000:00010000:0.0:1651529467.248970:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.248974:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248975:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 3/0,1 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248979:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248979:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248980:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248984:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248987:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248992:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249003:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946641216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (282us total) trans 30064895187 rc 0/0 00000100:00100000:0.0:1651529467.249007:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154369 00000100:00100000:0.0:1651529467.249012:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154371 00000100:00100000:0.0:1651529467.249014:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946641280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.249018:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178863 count 1 00002000:00010000:0.0:1651529467.249022:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.249024:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946641152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (295us total) trans 30064895188 rc 0/0 00010000:00010000:0.0:1651529467.249024:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 3/0,1 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249027:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154370 00010000:00010000:0.0:1651529467.249027:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249028:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249029:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249032:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249035:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249035:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249038:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249038:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249039:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249042:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 3/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249047:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 1/0,0 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249050:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c1666 lrc: 0/0,0 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249054:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249057:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249058:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249061:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 3/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249064:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 1/0,0 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249066:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c166d lrc: 0/0,0 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249069:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249069:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946641280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 54us (330us total) trans 30064895189 rc 0/0 00010000:00010000:1.0:1651529467.249072:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529467.249072:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154371 00010000:00010000:1.0:1651529467.249073:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249075:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 3/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249078:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 1/0,0 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249081:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c1674 lrc: 0/0,0 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249083:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249087:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249089:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249089:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249090:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249090:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249093:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 3/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249093:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 3/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249096:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 1/0,0 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249098:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c1682 lrc: 0/0,0 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249098:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 1/0,0 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249100:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c167b lrc: 0/0,0 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249101:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249104:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249104:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249105:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249107:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 3/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249107:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249108:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249111:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 3/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249113:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 1/0,0 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249114:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 1/0,0 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249116:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1689 lrc: 0/0,0 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249119:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c1690 lrc: 0/0,0 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249162:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641664 00000100:00100000:1.0:1651529467.249182:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154372 00000100:00100000:1.0:1651529467.249184:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946641664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.249208:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178707 count 1 00002000:00010000:1.0:1651529467.249220:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249222:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 3/0,1 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249226:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249226:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249227:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249230:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249233:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249236:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249282:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946641664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 97us (126us total) trans 30064895190 rc 0/0 00000100:00100000:1.0:1651529467.249285:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154372 00010000:00010000:1.0:1651529467.249293:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249296:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249297:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249308:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 3/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249313:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 1/0,0 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249315:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c1697 lrc: 0/0,0 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249393:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641920 00000100:00100000:1.0:1651529467.249400:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154373 00000100:00100000:1.0:1651529467.249401:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946641920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.249411:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178749 count 1 00002000:00010000:1.0:1651529467.249417:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249418:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 3/0,1 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249422:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249423:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249423:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249427:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249430:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249432:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249475:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946641920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (92us total) trans 30064895191 rc 0/0 00000100:00100000:1.0:1651529467.249478:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154373 00010000:00010000:1.0:1651529467.249485:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249496:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249497:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.249500:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 3/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249518:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 1/0,0 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.249531:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c169e lrc: 0/0,0 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.249541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249545:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642048 00000100:00100000:0.0:1651529467.249548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249559:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642176 00000100:00100000:1.0:1651529467.249565:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642304 00000100:00100000:1.0:1651529467.249568:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641984 00000100:00100000:0.0:1651529467.249570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249580:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642112 00000100:00100000:1.0:1651529467.249583:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642240 00000100:00100000:0.0:1651529467.249585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249586:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154374 00000100:00100000:1.0:1651529467.249588:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+231:39030:x1731745946642048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.249591:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642368 00002000:00080000:1.0:1651529467.249593:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178722 count 1 00002000:00010000:1.0:1651529467.249598:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.249598:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154375 00010000:00010000:1.0:1651529467.249599:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 3/0,1 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249600:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946642176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.249603:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249603:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249604:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.249605:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178900 count 1 00010000:00010000:1.0:1651529467.249607:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249610:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.249610:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249612:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 3/0,1 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249613:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249616:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249616:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249617:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249628:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249634:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249637:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249665:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946642048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (167us total) trans 30064895192 rc 0/0 00000100:00100000:1.0:1651529467.249668:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154374 00000100:00100000:1.0:1651529467.249673:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154376 00000100:00100000:1.0:1651529467.249675:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946642304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.249679:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178807 count 1 00002000:00010000:1.0:1651529467.249684:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249686:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 3/0,1 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249686:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946642176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 85us (162us total) trans 30064895193 rc 0/0 00010000:00010000:1.0:1651529467.249689:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.249689:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154375 00010000:00010000:1.0:1651529467.249690:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249691:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249694:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249694:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154377 00000100:00100000:0.0:1651529467.249696:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946641984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.249697:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249700:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.249700:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178714 count 1 00002000:00010000:0.0:1651529467.249721:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249723:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 3/0,1 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249727:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249727:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249728:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249732:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249735:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249739:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946642304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (206us total) trans 30064895194 rc 0/0 00010000:00010000:0.0:1651529467.249740:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249742:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154376 00000100:00100000:1.0:1651529467.249747:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154378 00000100:00100000:1.0:1651529467.249748:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946642112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.249752:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178765 count 1 00002000:00010000:1.0:1651529467.249757:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249759:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 3/0,1 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249762:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249763:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249764:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249767:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249770:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249773:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249775:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946641984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (233us total) trans 30064895195 rc 0/0 00000100:00100000:0.0:1651529467.249778:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154377 00000100:00100000:0.0:1651529467.249783:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154379 00000100:00100000:0.0:1651529467.249784:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946642240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.249790:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178905 count 1 00002000:00010000:0.0:1651529467.249794:0:127523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249796:0:127523:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 3/0,1 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249799:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249800:0:127523:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249826:0:127523:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249830:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946642112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (276us total) trans 30064895196 rc 0/0 00010000:00010000:0.0:1651529467.249831:0:127523:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249834:0:127523:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249835:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154378 00010000:00010000:0.0:1651529467.249837:0:127523:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249840:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154380 00000100:00100000:1.0:1651529467.249842:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+232:39029:x1731745946642368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.249846:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178940 count 1 00002000:00010000:1.0:1651529467.249851:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bafc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249853:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 3/0,1 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249857:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249858:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249862:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249865:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249868:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249874:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946642240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (310us total) trans 30064895197 rc 0/0 00000100:00100000:0.0:1651529467.249877:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154379 00010000:00010000:0.0:1651529467.249888:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249891:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249892:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249895:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 3/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249900:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 1/0,0 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249901:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946642368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (316us total) trans 30064895198 rc 0/0 00010000:00010000:0.0:1651529467.249903:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c16a5 lrc: 0/0,0 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249904:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154380 00010000:00010000:0.0:1651529467.249907:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249910:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249910:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249914:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249916:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 3/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249919:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 1/0,0 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249920:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003044d8ef already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249921:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249922:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c16ac lrc: 0/0,0 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249923:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 3/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249925:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249927:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249928:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 1/0,0 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249928:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249931:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c16b3 lrc: 0/0,0 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249931:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 3/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249934:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249934:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 1/0,0 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249936:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c16ba lrc: 0/0,0 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249937:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdac3b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249938:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249939:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249941:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 3/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249942:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.249943:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249944:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 1/0,0 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249946:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 3/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249949:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c16c1 lrc: 0/0,0 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249949:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 1/0,0 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249951:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c16c8 lrc: 0/0,0 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249952:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249955:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e7621 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.249956:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249958:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 3/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249961:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 1/0,0 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249964:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c16cf lrc: 0/0,0 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249981:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642944 00000100:00100000:1.0:1651529467.249991:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154381 00000100:00100000:1.0:1651529467.249992:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946642944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.250004:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178778 count 1 00002000:00010000:1.0:1651529467.250010:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250011:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 3/0,1 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250039:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250040:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250041:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250045:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250048:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250051:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250078:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250082:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000962f47d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.250083:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250086:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 3/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250091:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 1/0,0 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250096:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946642944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (131us total) trans 30064895199 rc 0/0 00000100:00100000:1.0:1651529467.250099:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154381 00010000:00010000:0.0:1651529467.250102:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c16d6 lrc: 0/0,0 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250294:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250309:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643136 00000100:00100000:1.0:1651529467.250315:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643264 00000100:00100000:1.0:1651529467.250319:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154382 00000100:00100000:1.0:1651529467.250320:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+235:39029:x1731745946643136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.250325:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178755 count 1 00002000:00010000:1.0:1651529467.250331:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250332:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 3/0,1 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250336:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250337:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250338:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250341:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250344:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250347:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250399:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643072 00000100:00100000:0.0:1651529467.250406:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643392 00000100:00100000:1.0:1651529467.250409:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+238:39029:x1731745946643136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (115us total) trans 30064895200 rc 0/0 00000100:00100000:0.0:1651529467.250409:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643200 00000100:00100000:0.0:1651529467.250411:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643328 00000100:00100000:1.0:1651529467.250412:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154382 00000100:00100000:0.0:1651529467.250414:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643456 00000100:00100000:0.0:1651529467.250417:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154383 00000100:00100000:1.0:1651529467.250419:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154384 00000100:00100000:0.0:1651529467.250419:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+240:39029:x1731745946643264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.250421:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d97b23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946643072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.250424:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178830 count 1 00002000:00080000:1.0:1651529467.250426:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178895 count 1 00002000:00010000:0.0:1651529467.250429:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.250431:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bacf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250431:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 3/0,1 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250433:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 3/0,1 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250435:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250435:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250436:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250436:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250437:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250438:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250440:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250441:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250444:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250445:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250447:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250448:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250481:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d97b23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (128us total) trans 30064895201 rc 0/0 00000100:00100000:1.0:1651529467.250484:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154384 00000100:00100000:1.0:1651529467.250489:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154385 00000100:00100000:1.0:1651529467.250490:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946643392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.250494:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178949 count 1 00002000:00010000:1.0:1651529467.250499:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250500:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 3/0,1 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250504:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250504:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250505:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250508:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946643264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (206us total) trans 30064895202 rc 0/0 00010000:00010000:1.0:1651529467.250509:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250511:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154383 00010000:00010000:1.0:1651529467.250514:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250516:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250529:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154386 00000100:00100000:0.0:1651529467.250530:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.250535:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178911 count 1 00002000:00010000:0.0:1651529467.250540:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2badf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250542:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 3/0,1 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250545:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250546:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.250547:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ff3bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946643392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (173us total) trans 30064895203 rc 0/0 00010000:00010000:0.0:1651529467.250547:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250550:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154385 00010000:00010000:0.0:1651529467.250551:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250554:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250555:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154387 00000100:00100000:1.0:1651529467.250556:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946643328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529467.250559:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.250560:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178893 count 1 00002000:00010000:1.0:1651529467.250565:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bacd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250566:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 3/0,1 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250570:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250570:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250571:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250574:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250577:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250582:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250593:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b31d3513 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (211us total) trans 30064895204 rc 0/0 00000100:00100000:0.0:1651529467.250596:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154386 00000100:00100000:0.0:1651529467.250601:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154388 00000100:00100000:0.0:1651529467.250602:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.250606:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178795 count 1 00002000:00010000:0.0:1651529467.250611:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250612:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 3/0,1 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250613:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c06969 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (226us total) trans 30064895205 rc 0/0 00000100:00100000:1.0:1651529467.250616:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154387 00010000:00010000:0.0:1651529467.250616:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250616:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250617:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250621:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250623:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250624:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250626:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f016294 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.250626:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250627:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250630:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 3/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250635:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 1/0,0 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250638:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c16dd lrc: 0/0,0 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250642:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250645:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079f5db30 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.250646:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250648:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 3/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250651:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 1/0,0 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250654:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c16eb lrc: 0/0,0 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250657:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250660:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e79ca9ff already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.250660:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250660:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000956bf807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (268us total) trans 30064895206 rc 0/0 00010000:00010000:1.0:1651529467.250663:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 3/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250663:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154388 00010000:00010000:1.0:1651529467.250666:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 1/0,0 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250669:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c16e4 lrc: 0/0,0 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250674:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250675:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250677:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000278eaea9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.250677:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044c25a68 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.250678:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250678:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250681:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 3/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250681:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 3/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250684:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 1/0,0 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250686:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c16f9 lrc: 0/0,0 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250686:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 1/0,0 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250689:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250689:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c16f2 lrc: 0/0,0 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250692:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000313829b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.250693:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250693:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250695:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 3/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250696:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.250697:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250701:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 1/0,0 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250702:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 3/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250704:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c1700 lrc: 0/0,0 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250705:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 1/0,0 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250708:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203d678c/0xa29a79078f3c1707 lrc: 0/0,0 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250797:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250851:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643712 00000100:00100000:0.0:1651529467.250862:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154389 00000100:00100000:0.0:1651529467.250863:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946643712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.250868:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178934 count 1 00002000:00010000:0.0:1651529467.250874:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250875:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 3/0,1 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250879:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250879:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250880:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250884:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250887:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250890:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250900:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250904:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.250905:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250908:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 3/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250912:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 1/0,0 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250915:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c170e lrc: 0/0,0 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250934:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+242:39030:x1731745946643712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (136us total) trans 30064895207 rc 0/0 00000100:00100000:0.0:1651529467.250937:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154389 00000100:00100000:1.0:1651529467.251025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251035:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644288 00000100:00100000:1.0:1651529467.251036:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251051:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644416 00000100:00100000:1.0:1651529467.251059:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154390 00000100:00100000:1.0:1651529467.251060:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946644288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529467.251064:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154391 00002000:00080000:1.0:1651529467.251066:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178808 count 1 00000100:00100000:0.0:1651529467.251067:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946644416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529467.251071:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1651529467.251072:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178878 count 1 00010000:00010000:1.0:1651529467.251073:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 3/0,1 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251076:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251077:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251078:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.251078:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2babe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251080:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 3/0,1 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251081:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251084:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251084:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251084:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251085:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251087:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251089:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251092:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251095:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251127:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946644288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (102us total) trans 30064895208 rc 0/0 00000100:00100000:1.0:1651529467.251130:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154390 00010000:00010000:1.0:1651529467.251137:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251140:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251141:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251144:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 3/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251146:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+244:39029:x1731745946644416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (110us total) trans 30064895209 rc 0/0 00010000:00010000:1.0:1651529467.251149:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 1/0,0 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251150:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154391 00010000:00010000:1.0:1651529467.251151:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c1715 lrc: 0/0,0 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251155:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251158:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251159:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251162:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 3/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251165:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 1/0,0 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251167:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c171c lrc: 0/0,0 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251194:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644544 00000100:00100000:0.0:1651529467.251194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251200:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644672 00000100:00100000:1.0:1651529467.251204:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154392 00000100:00100000:1.0:1651529467.251206:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946644544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.251211:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178869 count 1 00000100:00100000:0.0:1651529467.251214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.251223:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bab5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251225:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 3/0,1 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.251228:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251229:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251229:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251233:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.251236:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251238:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251240:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644352 00000100:00100000:0.0:1651529467.251246:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644480 00000100:00100000:0.0:1651529467.251253:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644608 00000100:00100000:0.0:1651529467.251255:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644736 00000100:00100000:0.0:1651529467.251259:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154393 00000100:00100000:0.0:1651529467.251260:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946644672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.251266:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178841 count 1 00002000:00010000:0.0:1651529467.251272:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251274:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 3/0,1 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251277:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251278:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251279:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251283:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251288:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057488d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946644544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (110us total) trans 30064895210 rc 0/0 00000100:00100000:1.0:1651529467.251291:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154392 00010000:00010000:0.0:1651529467.251295:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251297:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154394 00010000:00010000:0.0:1651529467.251298:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251299:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946644352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.251303:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178751 count 1 00002000:00010000:1.0:1651529467.251308:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251310:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 3/0,1 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251314:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251314:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251315:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251319:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251321:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251324:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251352:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000659cfc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946644672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (158us total) trans 30064895211 rc 0/0 00000100:00100000:0.0:1651529467.251355:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154393 00000100:00100000:1.0:1651529467.251361:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6988550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946644352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (146us total) trans 30064895212 rc 0/0 00000100:00100000:0.0:1651529467.251361:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154395 00000100:00100000:0.0:1651529467.251362:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946644480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.251364:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154394 00002000:00080000:0.0:1651529467.251367:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178748 count 1 00000100:00100000:1.0:1651529467.251369:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154396 00000100:00100000:1.0:1651529467.251371:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946644608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.251372:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251374:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 3/0,1 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.251375:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178849 count 1 00010000:00010000:0.0:1651529467.251377:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251378:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251379:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.251380:0:144528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251382:0:144528:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 3/0,1 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251382:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251385:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251385:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251386:0:144528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251386:0:144528:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251390:0:144528:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251390:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251393:0:144528:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251395:0:144528:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251424:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c4d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946644480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (202us total) trans 30064895213 rc 0/0 00000100:00100000:0.0:1651529467.251426:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154395 00000100:00100000:1.0:1651529467.251427:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009aa874ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946644608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (200us total) trans 30064895214 rc 0/0 00000100:00100000:1.0:1651529467.251430:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154396 00000100:00100000:0.0:1651529467.251431:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154397 00000100:00100000:0.0:1651529467.251433:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+249:39030:x1731745946644736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.251437:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.251437:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178903 count 1 00010000:00010000:1.0:1651529467.251440:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a023b8c2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251441:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.251441:0:142995:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bad7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251443:0:142995:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 3/0,1 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251444:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 3/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251446:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251447:0:142995:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251448:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 1/0,0 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251448:0:142995:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251451:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c1723 lrc: 0/0,0 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251451:0:142995:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251454:0:142995:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251455:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251457:0:142995:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251458:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251458:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251461:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 3/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251464:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 1/0,0 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251467:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c172a lrc: 0/0,0 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251470:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251473:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c28d57aa already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251474:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251477:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 3/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251480:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 1/0,0 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251482:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c1731 lrc: 0/0,0 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251485:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251488:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251489:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251490:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ebd06bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946644736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (256us total) trans 30064895215 rc 0/0 00010000:00010000:1.0:1651529467.251491:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 3/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251493:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154397 00010000:00010000:1.0:1651529467.251494:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 1/0,0 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251497:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c1738 lrc: 0/0,0 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251502:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251503:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251505:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6dda103 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251506:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251507:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251508:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 3/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251508:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251510:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 3/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251511:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 1/0,0 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251514:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c173f lrc: 0/0,0 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251515:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 1/0,0 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251518:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c1746 lrc: 0/0,0 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251565:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644864 00000100:00100000:1.0:1651529467.251571:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644800 00000100:00100000:0.0:1651529467.251576:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154398 00000100:00100000:0.0:1651529467.251578:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946644864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.251583:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154399 00002000:00080000:0.0:1651529467.251583:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178860 count 1 00000100:00100000:1.0:1651529467.251584:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946644800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.251588:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.251589:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178850 count 1 00010000:00010000:0.0:1651529467.251589:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 3/0,1 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251593:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251594:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.251595:0:127525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251595:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251596:0:127525:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 3/0,1 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251598:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251601:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251602:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251602:0:127525:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251603:0:127525:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251604:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251607:0:127525:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251615:0:127525:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251619:0:127525:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251643:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946644864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (97us total) trans 30064895216 rc 0/0 00000100:00100000:0.0:1651529467.251646:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154398 00000100:00100000:1.0:1651529467.251665:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946644800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (100us total) trans 30064895217 rc 0/0 00000100:00100000:1.0:1651529467.251668:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154399 00010000:00010000:1.0:1651529467.251684:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251707:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251708:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251716:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 3/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251724:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 1/0,0 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251727:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c174d lrc: 0/0,0 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251731:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251734:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001edcc069 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.251735:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251737:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 3/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251740:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 1/0,0 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251743:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c1754 lrc: 0/0,0 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251953:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251963:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645440 00000100:00100000:1.0:1651529467.251964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251976:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645568 00000100:00100000:1.0:1651529467.251985:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645376 00000100:00100000:1.0:1651529467.251990:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645696 00000100:00100000:1.0:1651529467.251993:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645504 00000100:00100000:0.0:1651529467.252004:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154400 00000100:00100000:1.0:1651529467.252006:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154401 00000100:00100000:0.0:1651529467.252006:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+256:39029:x1731745946645440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.252008:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+256:39029:x1731745946645568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.252011:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178742 count 1 00002000:00080000:1.0:1651529467.252013:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178941 count 1 00002000:00010000:0.0:1651529467.252017:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.252018:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 3/0,1 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.252019:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bafd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.252021:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 3/0,1 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252022:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252023:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252024:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252024:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252025:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252026:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252028:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252030:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252031:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252033:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252033:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252035:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252079:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+258:39029:x1731745946645440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (167us total) trans 30064895218 rc 0/0 00000100:00100000:0.0:1651529467.252082:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154400 00000100:00100000:1.0:1651529467.252084:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+257:39029:x1731745946645568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (152us total) trans 30064895219 rc 0/0 00000100:00100000:0.0:1651529467.252087:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154402 00000100:00100000:1.0:1651529467.252089:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154401 00000100:00100000:0.0:1651529467.252089:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+257:39030:x1731745946645376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.252093:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178713 count 1 00000100:00100000:1.0:1651529467.252094:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154403 00000100:00100000:1.0:1651529467.252096:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+256:39029:x1731745946645696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529467.252098:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.252100:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 3/0,1 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.252101:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178753 count 1 00010000:00010000:0.0:1651529467.252104:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252104:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252105:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.252106:0:128009:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.252108:0:128009:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 3/0,1 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252109:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252111:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252112:0:128009:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252112:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252113:0:128009:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252114:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252116:0:128009:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252119:0:128009:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252129:0:128009:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252153:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946645376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 64us (205us total) trans 30064895220 rc 0/0 00000100:00100000:0.0:1651529467.252156:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154402 00000100:00100000:0.0:1651529467.252161:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154404 00000100:00100000:1.0:1651529467.252163:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+257:39029:x1731745946645696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (210us total) trans 30064895221 rc 0/0 00000100:00100000:0.0:1651529467.252163:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+257:39030:x1731745946645504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.252166:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154403 00002000:00080000:0.0:1651529467.252167:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178820 count 1 00002000:00010000:0.0:1651529467.252171:0:142993:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.252173:0:142993:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 3/0,1 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252174:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252176:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252177:0:142993:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252178:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.252178:0:142993:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252179:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252181:0:142993:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252182:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 3/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252184:0:142993:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252187:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 1/0,0 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252189:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c175b lrc: 0/0,0 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252189:0:142993:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252194:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252196:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252197:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252200:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 3/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252203:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 1/0,0 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252206:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c1762 lrc: 0/0,0 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252209:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252212:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252213:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252215:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 3/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252218:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 1/0,0 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252221:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c1769 lrc: 0/0,0 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252221:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+257:39030:x1731745946645504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (257us total) trans 30064895222 rc 0/0 00010000:00010000:1.0:1651529467.252224:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252224:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154404 00010000:00010000:1.0:1651529467.252226:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252227:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252230:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 3/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252233:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 1/0,0 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252235:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252238:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c1770 lrc: 0/0,0 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 128009 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252238:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.252239:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252242:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 3/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252246:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 1/0,0 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252249:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c1777 lrc: 0/0,0 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.252253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.252259:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645824 00000100:00100000:1.0:1651529467.252277:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154405 00000100:00100000:1.0:1651529467.252279:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+257:39029:x1731745946645824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.252284:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178930 count 1 00002000:00010000:1.0:1651529467.252290:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2baf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.252291:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 3/0,1 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252315:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252316:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252322:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252326:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252329:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252332:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.252377:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+258:39029:x1731745946645824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 97us (124us total) trans 30064895223 rc 0/0 00000100:00100000:1.0:1651529467.252381:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154405 00010000:00010000:1.0:1651529467.252388:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252391:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252392:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252403:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 3/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252408:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 1/0,0 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252411:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c177e lrc: 0/0,0 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.252425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.252432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.252442:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645632 00000100:00100000:1.0:1651529467.252443:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645760 00000100:00100000:1.0:1651529467.252452:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154406 00000100:00100000:1.0:1651529467.252454:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946645760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529467.252459:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178743 count 1 00002000:00010000:1.0:1651529467.252464:0:144527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.252466:0:144527:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 3/0,1 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252472:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252472:0:144527:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252473:0:144527:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252473:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154407 00000100:00100000:0.0:1651529467.252475:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946645632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529467.252476:0:144527:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252479:0:144527:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.252481:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178741 count 1 00010000:00010000:1.0:1651529467.252482:0:144527:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.252487:0:142994:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.252489:0:142994:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 3/0,1 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252492:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252493:0:142994:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252494:0:142994:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252497:0:142994:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252500:0:142994:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252503:0:142994:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.252523:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+261:39030:x1731745946645760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (89us total) trans 30064895224 rc 0/0 00000100:00100000:1.0:1651529467.252526:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154406 00010000:00010000:1.0:1651529467.252532:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252536:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001bf25d5b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252537:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252539:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 3/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252542:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946645632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (117us total) trans 30064895225 rc 0/0 00000100:00100000:0.0:1651529467.252545:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154407 00010000:00010000:1.0:1651529467.252546:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 1/0,0 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252549:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c1785 lrc: 0/0,0 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 144527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252553:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252555:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529467.252556:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252559:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 3/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252562:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 1/0,0 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.252565:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c178c lrc: 0/0,0 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252575:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645888 00000100:00100000:1.0:1651529467.252584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.252593:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645952 00000100:00100000:0.0:1651529467.252597:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154408 00000100:00100000:0.0:1651529467.252599:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+261:39030:x1731745946645888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529467.252601:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154409 00000100:00100000:1.0:1651529467.252603:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+261:39029:x1731745946645952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529467.252604:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178831 count 1 00002000:00010000:0.0:1651529467.252609:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2ba8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.252610:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178959 count 1 00010000:00010000:0.0:1651529467.252611:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 3/0,1 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.252615:0:142996:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb0f:0x0] initial LVB size: 1376256, mtime: 0x627056f9, atime: 0x0, ctime: 0x627056f9, blocks: 0xa80 00010000:00010000:0.0:1651529467.252615:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252615:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252616:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252617:0:142996:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 3/0,1 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252620:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.252620:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252621:0:142996:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.252622:0:142996:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252622:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252625:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252626:0:142996:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252628:0:142996:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.252631:0:142996:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.252673:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000514c4ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946645888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (109us total) trans 30064895226 rc 0/0 00000100:00100000:0.0:1651529467.252676:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154408 00010000:00010000:0.0:1651529467.252684:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252688:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.252689:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252692:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 3/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252698:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 1/0,0 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252701:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c1793 lrc: 0/0,0 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252705:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252708:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080006241 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529467.252709:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252712:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 3/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252715:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 1/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.252717:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c179a lrc: 0/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 142996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.252867:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946645952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 262us (281us total) trans 30064895227 rc 0/0 00000100:00100000:1.0:1651529467.252870:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154409 00000400:00000080:0.0:1651529467.819568:0:173198:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529467.819571:0:173198:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133f: Check reads/writes of client lustre proc files with bad area io ========================================================== 22:11:07 (1651529467) 00000100:00100000:0.0:1651529467.909412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529467.909432:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397055936 00000100:00100000:0.0:1651529467.909454:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 332 00000100:00100000:0.0:1651529467.909457:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397055936:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651529467.909475:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 352234304 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529467.909513:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b78f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397055936:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529467.909517:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 332 00000100:00100000:0.0:1651529467.913276:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.913306:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056192 00000100:00100000:1.0:1651529467.913322:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 42 00000100:00100000:1.0:1651529467.913325:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056192:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.913344:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056192:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 19us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.913349:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 42 00000100:00100000:0.0:1651529467.920772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.920797:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056384 00000100:00100000:1.0:1651529467.920830:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 43 00000100:00100000:1.0:1651529467.920831:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056384:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.920846:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056384:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 14us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.920849:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 43 00000100:00100000:0.0:1651529467.927036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.927060:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056704 00000100:00100000:1.0:1651529467.927070:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44 00000100:00100000:1.0:1651529467.927072:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056704:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.927084:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056704:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.927087:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44 00000100:00100000:0.0:1651529467.929242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.929266:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056832 00000100:00100000:1.0:1651529467.929275:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 45 00000100:00100000:1.0:1651529467.929276:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056832:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.929289:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056832:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.929291:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 45 00000100:00100000:0.0:1651529467.931399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.931423:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056960 00000100:00100000:1.0:1651529467.931432:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 46 00000100:00100000:1.0:1651529467.931434:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056960:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.931446:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397056960:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.931451:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 46 00000100:00100000:0.0:1651529467.937869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.937893:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057408 00000100:00100000:1.0:1651529467.937902:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 47 00000100:00100000:1.0:1651529467.937904:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057408:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.937916:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057408:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.937919:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 47 00000100:00100000:0.0:1651529467.940186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.940209:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057536 00000100:00100000:1.0:1651529467.940218:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 48 00000100:00100000:1.0:1651529467.940220:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057536:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.940233:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057536:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.940235:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 48 00000100:00100000:0.0:1651529467.942365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.942389:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057664 00000100:00100000:1.0:1651529467.942398:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 49 00000100:00100000:1.0:1651529467.942399:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028a0b830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057664:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.942412:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028a0b830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057664:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.942414:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 49 00000100:00100000:0.0:1651529467.962331:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.962355:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057856 00000100:00100000:1.0:1651529467.962364:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 50 00000100:00100000:1.0:1651529467.962366:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057856:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.962378:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000505fb1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397057856:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.962383:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 50 00000100:00100000:0.0:1651529467.967046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.967069:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058048 00000100:00100000:1.0:1651529467.967078:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:1.0:1651529467.967080:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058048:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.967092:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a825ad07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058048:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.967095:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:0.0:1651529467.973240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.973264:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058368 00000100:00100000:1.0:1651529467.973273:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 52 00000100:00100000:1.0:1651529467.973275:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058368:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.973287:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ceea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058368:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.973290:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 52 00000100:00100000:0.0:1651529467.975401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.975425:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058496 00000100:00100000:1.0:1651529467.975433:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:1.0:1651529467.975435:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058496:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.975447:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008317202e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058496:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.975450:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:0.0:1651529467.977562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.977585:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058624 00000100:00100000:1.0:1651529467.977594:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 54 00000100:00100000:1.0:1651529467.977596:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058624:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.977609:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003039dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397058624:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.977613:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 54 00000100:00100000:0.0:1651529467.983623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.983649:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059072 00000100:00100000:1.0:1651529467.983659:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 55 00000100:00100000:1.0:1651529467.983660:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059072:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.983673:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013e5dc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059072:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.983676:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 55 00000100:00100000:0.0:1651529467.985744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.985768:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059200 00000100:00100000:1.0:1651529467.985777:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 56 00000100:00100000:1.0:1651529467.985779:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059200:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.985791:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001e4ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059200:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.985794:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 56 00000100:00100000:0.0:1651529467.987903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.987929:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059328 00000100:00100000:1.0:1651529467.987939:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 57 00000100:00100000:1.0:1651529467.987940:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059328:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.987954:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b95db0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059328:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 13us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.987956:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 57 00000100:00100000:0.0:1651529467.994005:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.994029:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059648 00000100:00100000:1.0:1651529467.994039:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 58 00000100:00100000:1.0:1651529467.994040:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059648:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.994053:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000405f9b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059648:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.994068:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 58 00000100:00100000:0.0:1651529467.996163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.996196:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059776 00000100:00100000:1.0:1651529467.996206:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 59 00000100:00100000:1.0:1651529467.996208:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059776:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.996222:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6c44b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059776:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 14us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.996225:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 59 00000100:00100000:0.0:1651529467.998323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.998347:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059904 00000100:00100000:1.0:1651529467.998356:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 60 00000100:00100000:1.0:1651529467.998358:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059904:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.998371:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c46dda81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397059904:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.998373:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 60 00000100:00100000:0.0:1651529468.003278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.003302:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060224 00000100:00100000:1.0:1651529468.003311:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 61 00000100:00100000:1.0:1651529468.003313:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060224:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.003325:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6ca5abf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060224:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.003328:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 61 00000100:00100000:0.0:1651529468.005435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.005459:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060352 00000100:00100000:1.0:1651529468.005468:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 62 00000100:00100000:1.0:1651529468.005469:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060352:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.005482:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017410901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060352:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.005495:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 62 00000100:00100000:0.0:1651529468.007615:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.007648:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060480 00000100:00100000:1.0:1651529468.007657:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 63 00000100:00100000:1.0:1651529468.007659:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060480:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.007672:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387179e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:433543:x1731746397060480:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.007675:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 63 00000100:00100000:0.0:1651529469.549474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529469.549504:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946646400 00000100:00100000:1.0:1651529469.549527:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154410 00000100:00100000:1.0:1651529469.549530:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+262:204180:x1731745946646400:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651529469.549579:0:127525:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f2beb44 00000100:00080000:1.0:1651529469.549582:0:127525:0:(import.c:85:import_set_state_nolock()) 00000000737576db ýÒŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529469.549663:0:127525:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064895227 00000100:00100000:1.0:1651529469.549741:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017071f3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:204180:x1731745946646400:12345-10.240.43.61@tcp:9:umount.0 Request processed in 210us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529469.549745:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154410 00000001:00100000:1.0:1651529473.377901:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1651529473.377906:0:127511:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 30064895227 is committed 00000020:00000080:1.0:1651529473.377994:0:127511:0:(genops.c:985:class_export_put()) final put 000000005fff442d/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529473.378002:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 000000005fff442d/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1651529473.378025:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000737576db for lustre-OST0000 00000100:00100000:0.0:1651529490.211685:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.211722:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647232 00000100:00100000:1.0:1651529490.211743:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154411 00000100:00100000:1.0:1651529490.211746:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:39028:x1731745946647232:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651529490.211770:0:144527:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000002beaa81 cur 13089 last 0 00000020:00000080:1.0:1651529490.211794:0:144527:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa29a79078f3c17a1 00002000:00100000:1.0:1651529490.211799:0:144527:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/00000000d6c104de ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1651529490.211801:0:144527:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1651529490.211802:0:144527:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651529490.211871:0:144527:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000446a0d93 00002000:00080000:1.0:1651529490.211876:0:144527:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529490.211892:0:144527:0:(import.c:85:import_set_state_nolock()) 000000007b7c240b ýÒŽÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529490.211921:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000979380ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946647232:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 174us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529490.211925:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154411 00000100:00100000:0.0:1651529490.212232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.212243:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647296 00000100:00100000:0.0:1651529490.212256:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 333 00000100:00100000:0.0:1651529490.212258:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946647296:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529490.212269:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 352234304 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529490.212291:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a129331c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946647296:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 32us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529490.212294:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 333 00000100:00100000:0.0:1651529490.212377:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.212413:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647360 00000100:00100000:0.0:1651529490.212417:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.212434:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647488 00000100:00100000:1.0:1651529490.212443:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154412 00000100:00100000:1.0:1651529490.212445:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946647360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.212445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.212454:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178954 count 1 00000100:00100000:0.0:1651529490.212473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.212482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.212489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.212497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.212499:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d33ef30e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946647360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 53us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.212503:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154412 00000100:00100000:1.0:1651529490.212508:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647616 00000100:00100000:1.0:1651529490.212514:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647744 00000100:00100000:0.0:1651529490.212522:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.212526:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647424 00000100:00100000:1.0:1651529490.212530:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647680 00000100:00100000:0.0:1651529490.212530:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647552 00000100:00100000:1.0:1651529490.212532:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647808 00000100:00100000:1.0:1651529490.212537:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154413 00000100:00100000:1.0:1651529490.212538:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946647488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.212539:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154414 00000100:00100000:0.0:1651529490.212541:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946647616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.212544:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178879 count 1 00002000:00080000:0.0:1651529490.212547:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178726 count 1 00000100:00100000:1.0:1651529490.212567:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002245d7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946647488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.212577:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154413 00000100:00100000:0.0:1651529490.212579:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030d201c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946647616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 37us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.212582:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154415 00000100:00100000:1.0:1651529490.212584:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946647744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.212584:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154414 00002000:00080000:1.0:1651529490.212589:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178792 count 1 00000100:00100000:0.0:1651529490.212590:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154416 00000100:00100000:0.0:1651529490.212591:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ff1d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946647424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.212605:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b516a660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946647744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 20us (132us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.212606:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178840 count 1 00000100:00100000:1.0:1651529490.212608:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154415 00000100:00100000:1.0:1651529490.212612:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154417 00000100:00100000:1.0:1651529490.212613:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c8c9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946647680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.212617:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178946 count 1 00000100:00100000:0.0:1651529490.212624:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ff1d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946647424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 31us (141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.212627:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154416 00000100:00100000:1.0:1651529490.212630:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c8c9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946647680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (133us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.212631:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154418 00000100:00100000:1.0:1651529490.212633:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154417 00000100:00100000:0.0:1651529490.212633:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f394ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946647552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.212637:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178793 count 1 00000100:00100000:1.0:1651529490.212638:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154419 00000100:00100000:1.0:1651529490.212639:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e5d6dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946647808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.212643:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178945 count 1 00000100:00100000:0.0:1651529490.212650:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f394ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946647552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (161us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.212653:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154418 00000100:00100000:1.0:1651529490.212655:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e5d6dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946647808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.212658:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154419 00000100:00100000:1.0:1651529490.212894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.212902:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647872 00000100:00100000:1.0:1651529490.212910:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154420 00000100:00100000:1.0:1651529490.212912:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946647872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.212917:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178891 count 1 00000100:00100000:1.0:1651529490.212941:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090c9d293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946647872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (47us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.212944:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154420 00000100:00100000:1.0:1651529490.213110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213157:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.213168:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946647936 00000100:00100000:1.0:1651529490.213176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213185:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648064 00000100:00100000:1.0:1651529490.213192:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648192 00000100:00100000:1.0:1651529490.213199:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648000 00000100:00100000:0.0:1651529490.213202:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648320 00000100:00100000:1.0:1651529490.213204:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648128 00000100:00100000:1.0:1651529490.213207:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648256 00000100:00100000:1.0:1651529490.213210:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154421 00000100:00100000:1.0:1651529490.213212:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946648064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.213213:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154422 00000100:00100000:0.0:1651529490.213214:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946647936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.213217:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178786 count 1 00002000:00080000:0.0:1651529490.213220:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178918 count 1 00000100:00100000:1.0:1651529490.213236:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8621713 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946648064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213238:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052db3370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946647936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213239:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154421 00000100:00100000:0.0:1651529490.213241:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154422 00000100:00100000:1.0:1651529490.213244:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154423 00000100:00100000:1.0:1651529490.213245:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946648192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.213246:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154424 00000100:00100000:0.0:1651529490.213248:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946648000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.213249:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178931 count 1 00002000:00080000:0.0:1651529490.213252:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178798 count 1 00000100:00100000:1.0:1651529490.213263:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000809be23f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946648192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (118us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213264:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cd207e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946648000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213265:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154423 00000100:00100000:0.0:1651529490.213267:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154424 00000100:00100000:1.0:1651529490.213270:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154425 00000100:00100000:1.0:1651529490.213271:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946648128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.213272:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154426 00002000:00080000:1.0:1651529490.213275:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178884 count 1 00000100:00100000:0.0:1651529490.213283:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946648256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.213287:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0a453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946648128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (121us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.213287:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178759 count 1 00000100:00100000:1.0:1651529490.213290:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154425 00000100:00100000:1.0:1651529490.213294:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154427 00000100:00100000:1.0:1651529490.213295:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946648320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.213300:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178797 count 1 00000100:00100000:0.0:1651529490.213303:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cdeb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946648256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 20us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213306:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154426 00000100:00100000:1.0:1651529490.213311:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023180596 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946648320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213314:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154427 00000100:00100000:0.0:1651529490.213325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.213347:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648384 00000100:00100000:0.0:1651529490.213363:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154428 00000100:00100000:0.0:1651529490.213365:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e809618d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946648384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.213370:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178754 count 1 00000100:00100000:0.0:1651529490.213388:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e809618d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946648384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (63us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213391:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154428 00000100:00100000:1.0:1651529490.213720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213742:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.213784:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648640 00000100:00100000:1.0:1651529490.213790:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.213802:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648768 00000100:00100000:0.0:1651529490.213806:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648896 00000100:00100000:1.0:1651529490.213828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.213829:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649024 00000100:00100000:0.0:1651529490.213837:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648576 00000100:00100000:1.0:1651529490.213839:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648704 00000100:00100000:0.0:1651529490.213841:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648832 00000100:00100000:1.0:1651529490.213845:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648960 00000100:00100000:1.0:1651529490.213848:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154429 00000100:00100000:1.0:1651529490.213850:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946648640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.213855:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178909 count 1 00000100:00100000:0.0:1651529490.213855:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154430 00000100:00100000:0.0:1651529490.213857:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946648768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.213862:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178727 count 1 00000100:00100000:1.0:1651529490.213877:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd10e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946648640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (162us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213880:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154429 00000100:00100000:1.0:1651529490.213885:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154431 00000100:00100000:0.0:1651529490.213886:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029859a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946648768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (145us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213887:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946648896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.213889:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154430 00002000:00080000:1.0:1651529490.213891:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178898 count 1 00000100:00100000:0.0:1651529490.213894:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154432 00000100:00100000:0.0:1651529490.213896:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946649024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.213904:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a2b06f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946648896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (155us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213907:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154431 00002000:00080000:0.0:1651529490.213908:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178711 count 1 00000100:00100000:1.0:1651529490.213911:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154433 00000100:00100000:1.0:1651529490.213913:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ad16ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946648576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.213916:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178747 count 1 00000100:00100000:0.0:1651529490.213924:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000690d5269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946649024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 27us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213927:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154432 00000100:00100000:1.0:1651529490.213929:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ad16ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946648576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (162us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213931:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154433 00000100:00100000:0.0:1651529490.213933:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154434 00000100:00100000:0.0:1651529490.213935:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946648704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.213938:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178728 count 1 00000100:00100000:0.0:1651529490.213950:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b12a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946648704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (177us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213953:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154434 00000100:00100000:0.0:1651529490.213957:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154435 00000100:00100000:1.0:1651529490.213959:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154436 00000100:00100000:0.0:1651529490.213959:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946648960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.213961:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946648832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.213962:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178769 count 1 00002000:00080000:1.0:1651529490.213965:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178803 count 1 00000100:00100000:0.0:1651529490.213973:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946648960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.213976:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154435 00000100:00100000:1.0:1651529490.213977:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c55989b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946648832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.213980:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154436 00000100:00100000:1.0:1651529490.214470:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214543:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649792 00000100:00100000:1.0:1651529490.214550:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649920 00000100:00100000:0.0:1651529490.214562:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650048 00000100:00100000:1.0:1651529490.214563:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650176 00000100:00100000:1.0:1651529490.214569:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649728 00000100:00100000:1.0:1651529490.214577:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154437 00000100:00100000:1.0:1651529490.214579:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.214579:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649856 00002000:00080000:1.0:1651529490.214584:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178718 count 1 00000100:00100000:0.0:1651529490.214584:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154438 00000100:00100000:0.0:1651529490.214585:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946649920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.214591:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178861 count 1 00000100:00100000:1.0:1651529490.214605:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946649792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214607:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154437 00000100:00100000:0.0:1651529490.214608:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946649920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214611:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154438 00000100:00100000:1.0:1651529490.214613:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154439 00000100:00100000:1.0:1651529490.214615:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946650176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.214616:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154440 00002000:00080000:1.0:1651529490.214618:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178906 count 1 00000100:00100000:0.0:1651529490.214618:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946650048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.214622:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178832 count 1 00000100:00100000:1.0:1651529490.214631:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946650176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214634:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154439 00000100:00100000:0.0:1651529490.214634:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946650048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (128us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214637:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154440 00000100:00100000:1.0:1651529490.214638:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154441 00000100:00100000:1.0:1651529490.214640:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.214641:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154442 00002000:00080000:1.0:1651529490.214643:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178929 count 1 00000100:00100000:0.0:1651529490.214643:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.214646:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178824 count 1 00000100:00100000:1.0:1651529490.214654:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214657:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154441 00000100:00100000:0.0:1651529490.214657:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214659:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154442 00000100:00100000:1.0:1651529490.214670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214692:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649984 00000100:00100000:1.0:1651529490.214699:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650112 00000100:00100000:1.0:1651529490.214705:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154443 00000100:00100000:1.0:1651529490.214727:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.214732:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154444 00000100:00100000:0.0:1651529490.214734:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946650112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.214737:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178771 count 1 00002000:00080000:0.0:1651529490.214740:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178908 count 1 00000100:00100000:1.0:1651529490.214758:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 31us (87us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214761:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154443 00000100:00100000:0.0:1651529490.214764:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946650112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (80us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214767:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154444 00000100:00100000:0.0:1651529490.215259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215338:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650560 00000100:00100000:0.0:1651529490.215339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215356:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650688 00000100:00100000:0.0:1651529490.215358:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650816 00000100:00100000:1.0:1651529490.215363:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650944 00000100:00100000:1.0:1651529490.215367:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650624 00000100:00100000:1.0:1651529490.215370:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650880 00000100:00100000:0.0:1651529490.215370:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650752 00000100:00100000:0.0:1651529490.215373:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651008 00000100:00100000:1.0:1651529490.215374:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154445 00000100:00100000:1.0:1651529490.215376:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034dde0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946650560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.215377:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154446 00000100:00100000:0.0:1651529490.215379:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946650688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.215381:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178801 count 1 00002000:00080000:0.0:1651529490.215384:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178804 count 1 00000100:00100000:1.0:1651529490.215400:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034dde0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946650560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215401:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077faa899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946650688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (112us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215403:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154445 00000100:00100000:0.0:1651529490.215404:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154446 00000100:00100000:1.0:1651529490.215407:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154447 00000100:00100000:1.0:1651529490.215409:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946650944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.215409:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154448 00000100:00100000:0.0:1651529490.215411:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946650816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.215413:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178821 count 1 00002000:00080000:0.0:1651529490.215415:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178750 count 1 00000100:00100000:1.0:1651529490.215426:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2acff34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946650944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215427:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d32c1c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946650816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215429:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154447 00000100:00100000:0.0:1651529490.215430:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154448 00000100:00100000:1.0:1651529490.215433:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154449 00000100:00100000:1.0:1651529490.215435:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946650624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.215435:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154450 00000100:00100000:0.0:1651529490.215436:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946650752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.215439:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178921 count 1 00002000:00080000:0.0:1651529490.215440:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178939 count 1 00000100:00100000:1.0:1651529490.215451:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec734a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946650624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215452:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51eb8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946650752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215454:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154449 00000100:00100000:0.0:1651529490.215455:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154450 00000100:00100000:1.0:1651529490.215458:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154451 00000100:00100000:1.0:1651529490.215459:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946650880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.215459:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154452 00000100:00100000:0.0:1651529490.215461:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ff1d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.215463:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178758 count 1 00002000:00080000:0.0:1651529490.215464:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178815 count 1 00000100:00100000:1.0:1651529490.215474:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179b834 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946650880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215476:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154451 00000100:00100000:0.0:1651529490.215476:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ff1d826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215480:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154452 00000100:00100000:0.0:1651529490.215868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215893:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215938:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651840 00000100:00100000:0.0:1651529490.215942:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651968 00000100:00100000:1.0:1651529490.215945:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652096 00000100:00100000:0.0:1651529490.215952:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652224 00000100:00100000:0.0:1651529490.215955:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651776 00000100:00100000:1.0:1651529490.215957:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652032 00000100:00100000:0.0:1651529490.215957:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651904 00000100:00100000:0.0:1651529490.215960:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154453 00000100:00100000:1.0:1651529490.215961:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652160 00000100:00100000:0.0:1651529490.215961:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c8c9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946651840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.215965:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154454 00000100:00100000:1.0:1651529490.215966:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f394ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946651968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.215967:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178787 count 1 00002000:00080000:1.0:1651529490.215972:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178780 count 1 00000100:00100000:0.0:1651529490.215989:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c8c9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946651840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215992:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154453 00000100:00100000:1.0:1651529490.215996:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f394ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946651968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215996:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154455 00000100:00100000:0.0:1651529490.215998:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e5d6dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946652096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.215999:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154454 00002000:00080000:0.0:1651529490.216002:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178902 count 1 00000100:00100000:1.0:1651529490.216005:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154456 00000100:00100000:1.0:1651529490.216006:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e809618d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946652224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.216010:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178746 count 1 00000100:00100000:0.0:1651529490.216015:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e5d6dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946652096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (122us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216018:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154455 00000100:00100000:0.0:1651529490.216022:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154457 00000100:00100000:1.0:1651529490.216023:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e809618d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946652224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (122us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216024:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000048bc7601 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946651776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.216027:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154456 00002000:00080000:0.0:1651529490.216028:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178910 count 1 00000100:00100000:1.0:1651529490.216032:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154458 00000100:00100000:1.0:1651529490.216033:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000161ed009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946651904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.216037:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178710 count 1 00000100:00100000:0.0:1651529490.216038:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000048bc7601 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946651776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216040:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154457 00000100:00100000:0.0:1651529490.216044:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154459 00000100:00100000:0.0:1651529490.216046:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079a2d220 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946652032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.216049:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000161ed009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946651904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (135us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.216049:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178943 count 1 00000100:00100000:1.0:1651529490.216051:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154458 00000100:00100000:1.0:1651529490.216055:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154460 00000100:00100000:1.0:1651529490.216057:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb36b220 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946652160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.216059:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079a2d220 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946652032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12us (133us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.216061:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178914 count 1 00000100:00100000:0.0:1651529490.216061:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154459 00000100:00100000:1.0:1651529490.216071:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb36b220 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946652160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (136us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216074:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154460 00000100:00100000:0.0:1651529490.216715:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216732:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652992 00000100:00100000:0.0:1651529490.216737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.216750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216757:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653120 00000100:00100000:0.0:1651529490.216758:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216771:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653248 00000100:00100000:0.0:1651529490.216772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216779:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653376 00000100:00100000:1.0:1651529490.216784:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653056 00000100:00100000:1.0:1651529490.216790:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154461 00000100:00100000:1.0:1651529490.216793:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ca985ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946652992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.216793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.216797:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178885 count 1 00000100:00100000:0.0:1651529490.216800:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.216831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216838:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ca985ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946652992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 45us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216841:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154461 00000100:00100000:1.0:1651529490.216846:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653184 00000100:00100000:1.0:1651529490.216849:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653312 00000100:00100000:1.0:1651529490.216852:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653440 00000100:00100000:1.0:1651529490.216863:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154462 00000100:00100000:1.0:1651529490.216865:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f15d981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946653120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.216866:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154463 00000100:00100000:0.0:1651529490.216868:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946653248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.216869:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178950 count 1 00002000:00080000:0.0:1651529490.216873:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178881 count 1 00000100:00100000:1.0:1651529490.216888:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f15d981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946653120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216891:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154462 00000100:00100000:0.0:1651529490.216897:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4126e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946653248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216900:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154463 00000100:00100000:0.0:1651529490.216905:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154464 00000100:00100000:0.0:1651529490.216907:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946653376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.216908:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154465 00000100:00100000:1.0:1651529490.216909:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946653056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.216911:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178923 count 1 00002000:00080000:1.0:1651529490.216913:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178889 count 1 00000100:00100000:0.0:1651529490.216923:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d486ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946653376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (165us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216926:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007378f4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946653056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (159us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216926:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154464 00000100:00100000:1.0:1651529490.216929:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154465 00000100:00100000:0.0:1651529490.216930:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154466 00000100:00100000:0.0:1651529490.216932:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.216933:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154467 00000100:00100000:1.0:1651529490.216934:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.216936:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178864 count 1 00002000:00080000:1.0:1651529490.216938:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178825 count 1 00000100:00100000:0.0:1651529490.216947:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216949:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (149us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216950:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154466 00000100:00100000:1.0:1651529490.216952:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154467 00000100:00100000:0.0:1651529490.216954:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154468 00000100:00100000:0.0:1651529490.216955:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946653440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.216959:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178734 count 1 00000100:00100000:0.0:1651529490.216970:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946653440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216973:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154468 00000100:00100000:0.0:1651529490.218769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218789:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218801:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.218840:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654400 00000100:00100000:0.0:1651529490.218842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.218851:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654528 00000100:00100000:1.0:1651529490.218852:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654656 00000100:00100000:1.0:1651529490.218856:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654784 00000100:00100000:0.0:1651529490.218860:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654336 00000100:00100000:1.0:1651529490.218864:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654592 00000100:00100000:0.0:1651529490.218864:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654464 00000100:00100000:0.0:1651529490.218866:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654720 00000100:00100000:1.0:1651529490.218868:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154469 00000100:00100000:1.0:1651529490.218870:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946654400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.218871:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154470 00000100:00100000:0.0:1651529490.218873:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946654656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.218876:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178858 count 1 00002000:00080000:0.0:1651529490.218878:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178926 count 1 00000100:00100000:1.0:1651529490.218896:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946654400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.218896:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946654656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (112us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.218898:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154469 00000100:00100000:0.0:1651529490.218900:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154470 00000100:00100000:1.0:1651529490.218903:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154471 00000100:00100000:1.0:1651529490.218905:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946654528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.218905:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154472 00000100:00100000:0.0:1651529490.218907:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946654784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.218909:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178735 count 1 00002000:00080000:0.0:1651529490.218910:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178724 count 1 00000100:00100000:1.0:1651529490.218921:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946654528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (144us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.218922:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946654784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.218924:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154471 00000100:00100000:0.0:1651529490.218926:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154472 00000100:00100000:1.0:1651529490.218928:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154473 00000100:00100000:1.0:1651529490.218930:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946654336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.218930:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154474 00000100:00100000:0.0:1651529490.218932:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d655840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946654464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.218934:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178739 count 1 00002000:00080000:0.0:1651529490.218936:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178740 count 1 00000100:00100000:1.0:1651529490.218945:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946654336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.218947:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154473 00000100:00100000:0.0:1651529490.218947:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d655840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946654464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (145us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.218949:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154474 00000100:00100000:1.0:1651529490.218951:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154475 00000100:00100000:1.0:1651529490.218953:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000735a0523 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946654592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.218953:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154476 00000100:00100000:0.0:1651529490.218955:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005312ef41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946654720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.218956:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178927 count 1 00002000:00080000:0.0:1651529490.218958:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178732 count 1 00000100:00100000:1.0:1651529490.218967:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000735a0523 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946654592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.218969:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154475 00000100:00100000:0.0:1651529490.218970:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005312ef41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946654720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (128us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.218972:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154476 00000100:00100000:0.0:1651529490.222237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222251:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222262:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222268:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655936 00000100:00100000:0.0:1651529490.222268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222285:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656064 00000100:00100000:0.0:1651529490.222286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222299:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656192 00000100:00100000:0.0:1651529490.222300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222310:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656320 00000100:00100000:1.0:1651529490.222311:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656000 00000100:00100000:1.0:1651529490.222315:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656128 00000100:00100000:0.0:1651529490.222316:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656256 00000100:00100000:1.0:1651529490.222318:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656384 00000100:00100000:0.0:1651529490.222319:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154477 00000100:00100000:0.0:1651529490.222321:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9cea80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946655936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.222322:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154478 00000100:00100000:1.0:1651529490.222324:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002166c9ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946656064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.222326:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178819 count 1 00002000:00080000:1.0:1651529490.222329:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178736 count 1 00000100:00100000:0.0:1651529490.222348:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9cea80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946655936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222351:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154477 00000100:00100000:1.0:1651529490.222353:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002166c9ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946656064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222356:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154479 00000100:00100000:1.0:1651529490.222358:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154478 00000100:00100000:0.0:1651529490.222358:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946656192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.222361:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178937 count 1 00000100:00100000:1.0:1651529490.222363:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154480 00000100:00100000:1.0:1651529490.222365:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946656320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.222368:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178916 count 1 00000100:00100000:0.0:1651529490.222375:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008278e0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946656192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222377:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154479 00000100:00100000:1.0:1651529490.222381:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7be67e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946656320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222381:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154481 00000100:00100000:0.0:1651529490.222383:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946656000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.222384:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154480 00000100:00100000:1.0:1651529490.222388:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154482 00002000:00080000:0.0:1651529490.222388:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178772 count 1 00000100:00100000:1.0:1651529490.222389:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946656128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.222393:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178766 count 1 00000100:00100000:0.0:1651529490.222398:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080862d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946656000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222401:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154481 00000100:00100000:1.0:1651529490.222404:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946656128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222405:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154483 00000100:00100000:1.0:1651529490.222406:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154482 00000100:00100000:0.0:1651529490.222406:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946656256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.222410:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154484 00002000:00080000:0.0:1651529490.222410:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178855 count 1 00000100:00100000:1.0:1651529490.222412:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946656384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.222415:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178716 count 1 00000100:00100000:0.0:1651529490.222420:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946656256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222423:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154483 00000100:00100000:1.0:1651529490.222426:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946656384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222429:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154484 00000100:00100000:0.0:1651529490.222973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222990:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223028:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657024 00000100:00100000:1.0:1651529490.223030:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657152 00000100:00100000:0.0:1651529490.223037:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656960 00000100:00100000:1.0:1651529490.223045:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657088 00000100:00100000:0.0:1651529490.223052:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154485 00000100:00100000:0.0:1651529490.223054:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946657024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.223059:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154486 00000100:00100000:1.0:1651529490.223060:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946657152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.223064:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178848 count 1 00002000:00080000:1.0:1651529490.223066:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178899 count 1 00000100:00100000:0.0:1651529490.223087:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946657024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 33us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223090:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154485 00000100:00100000:1.0:1651529490.223091:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946657152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 30us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.223094:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154486 00000100:00100000:0.0:1651529490.223096:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154487 00000100:00100000:0.0:1651529490.223098:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946656960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.223099:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154488 00000100:00100000:1.0:1651529490.223101:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946657088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.223102:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178920 count 1 00002000:00080000:1.0:1651529490.223104:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178779 count 1 00000100:00100000:0.0:1651529490.223115:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946656960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223117:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154487 00000100:00100000:1.0:1651529490.223118:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946657088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (97us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.223120:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154488 00000100:00100000:0.0:1651529490.223524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223543:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657280 00000100:00100000:0.0:1651529490.223548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223559:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657408 00000100:00100000:0.0:1651529490.223562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223572:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657344 00000100:00100000:1.0:1651529490.223577:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154489 00000100:00100000:0.0:1651529490.223577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223579:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946657280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.223584:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178823 count 1 00000100:00100000:0.0:1651529490.223584:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657472 00000100:00100000:0.0:1651529490.223591:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154490 00000100:00100000:0.0:1651529490.223593:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.223598:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178867 count 1 00000100:00100000:1.0:1651529490.223602:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (87us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.223605:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154489 00000100:00100000:1.0:1651529490.223609:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154491 00000100:00100000:1.0:1651529490.223611:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b3db7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946657344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.223615:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178705 count 1 00000100:00100000:0.0:1651529490.223615:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946657408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (67us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223618:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154490 00000100:00100000:0.0:1651529490.223622:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154492 00000100:00100000:0.0:1651529490.223624:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946657472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.223627:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b3db7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946657344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (65us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.223627:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178834 count 1 00000100:00100000:1.0:1651529490.223629:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154491 00000100:00100000:0.0:1651529490.223639:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946657472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (61us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223641:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154492 00000100:00100000:0.0:1651529490.223849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223875:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658112 00000100:00100000:0.0:1651529490.223886:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658240 00000100:00100000:0.0:1651529490.223890:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658176 00000100:00100000:0.0:1651529490.223893:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658304 00000100:00100000:1.0:1651529490.223896:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154493 00000100:00100000:1.0:1651529490.223899:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946658112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.223903:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154494 00000100:00100000:0.0:1651529490.223904:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946658240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.223909:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178818 count 1 00002000:00080000:0.0:1651529490.223910:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178951 count 1 00000100:00100000:0.0:1651529490.223929:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946658240:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (72us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223932:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154494 00000100:00100000:1.0:1651529490.223934:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946658112:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 35us (85us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223937:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154495 00000100:00100000:1.0:1651529490.223938:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154493 00000100:00100000:0.0:1651529490.223939:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946658176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.223942:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178814 count 1 00000100:00100000:1.0:1651529490.223944:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154496 00000100:00100000:1.0:1651529490.223946:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946658304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.223950:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178800 count 1 00000100:00100000:0.0:1651529490.223954:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946658176:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (91us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223957:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154495 00000100:00100000:1.0:1651529490.223962:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946658304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.223964:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154496 00000100:00100000:0.0:1651529490.224052:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224062:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658432 00000100:00100000:0.0:1651529490.224062:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224075:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658560 00000100:00100000:0.0:1651529490.224079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224083:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658368 00000100:00100000:1.0:1651529490.224093:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658496 00000100:00100000:0.0:1651529490.224102:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154497 00000100:00100000:1.0:1651529490.224105:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154498 00000100:00100000:0.0:1651529490.224105:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.224107:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.224110:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178826 count 1 00002000:00080000:1.0:1651529490.224112:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178837 count 1 00000100:00100000:0.0:1651529490.224132:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 27us (80us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224135:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154497 00000100:00100000:1.0:1651529490.224136:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (74us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224140:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154498 00000100:00100000:0.0:1651529490.224142:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154499 00000100:00100000:0.0:1651529490.224143:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.224145:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154500 00000100:00100000:1.0:1651529490.224146:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.224148:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178948 count 1 00002000:00080000:1.0:1651529490.224151:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178723 count 1 00000100:00100000:0.0:1651529490.224161:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (90us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224164:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (84us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224164:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154499 00000100:00100000:1.0:1651529490.224166:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154500 00000100:00100000:0.0:1651529490.224793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224848:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658752 00000100:00100000:0.0:1651529490.224854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224862:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658880 00000100:00100000:1.0:1651529490.224868:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658688 00000100:00100000:1.0:1651529490.224872:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658816 00000100:00100000:0.0:1651529490.224874:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154501 00000100:00100000:0.0:1651529490.224876:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.224880:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154502 00000100:00100000:1.0:1651529490.224882:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.224886:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178953 count 1 00002000:00080000:1.0:1651529490.224887:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178843 count 1 00000100:00100000:1.0:1651529490.224927:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 44us (92us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224930:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154502 00000100:00100000:1.0:1651529490.224935:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154503 00000100:00100000:1.0:1651529490.224937:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946658688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.224941:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178957 count 1 00000100:00100000:0.0:1651529490.224944:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946658752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (151us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224948:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154501 00000100:00100000:0.0:1651529490.224953:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154504 00000100:00100000:0.0:1651529490.224955:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.224959:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178789 count 1 00000100:00100000:1.0:1651529490.224962:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946658688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224965:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154503 00000100:00100000:0.0:1651529490.224974:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946658816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224976:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154504 00000100:00100000:1.0:1651529490.224980:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224994:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659520 00000100:00100000:1.0:1651529490.224998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.225010:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659648 00000100:00100000:0.0:1651529490.225016:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154505 00000100:00100000:0.0:1651529490.225018:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.225022:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178773 count 1 00000100:00100000:1.0:1651529490.225023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.225042:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (62us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225045:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154505 00000100:00100000:0.0:1651529490.225049:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659456 00000100:00100000:0.0:1651529490.225055:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154506 00000100:00100000:1.0:1651529490.225056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.225056:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.225066:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178890 count 1 00000100:00100000:0.0:1651529490.225083:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (85us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225086:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154506 00000100:00100000:0.0:1651529490.225090:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659584 00000100:00100000:1.0:1651529490.225092:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154507 00000100:00100000:1.0:1651529490.225094:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.225095:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154508 00000100:00100000:0.0:1651529490.225096:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.225100:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178845 count 1 00002000:00080000:0.0:1651529490.225100:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178776 count 1 00000100:00100000:0.0:1651529490.225113:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (57us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225115:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154508 00000100:00100000:1.0:1651529490.225116:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.225119:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154507 00000100:00100000:1.0:1651529490.226253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.226295:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659840 00000100:00100000:1.0:1651529490.226296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.226315:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659968 00000100:00100000:0.0:1651529490.226320:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660096 00000100:00100000:1.0:1651529490.226321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.226330:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660224 00000100:00100000:1.0:1651529490.226332:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659904 00000100:00100000:0.0:1651529490.226333:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660032 00000100:00100000:0.0:1651529490.226335:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660160 00000100:00100000:1.0:1651529490.226337:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660288 00000100:00100000:0.0:1651529490.226339:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154509 00000100:00100000:0.0:1651529490.226341:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946659840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.226342:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154510 00000100:00100000:1.0:1651529490.226343:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946659968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.226346:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178836 count 1 00002000:00080000:1.0:1651529490.226348:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178876 count 1 00000100:00100000:0.0:1651529490.226364:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946659840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226365:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946659968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226368:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154509 00000100:00100000:1.0:1651529490.226369:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154510 00000100:00100000:0.0:1651529490.226372:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154511 00000100:00100000:1.0:1651529490.226374:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154512 00000100:00100000:0.0:1651529490.226374:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946660096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.226376:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946660224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.226378:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178896 count 1 00002000:00080000:1.0:1651529490.226381:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178873 count 1 00000100:00100000:0.0:1651529490.226390:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946660096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226392:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946660224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226392:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154511 00000100:00100000:1.0:1651529490.226394:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154512 00000100:00100000:0.0:1651529490.226396:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154513 00000100:00100000:0.0:1651529490.226398:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946660032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.226399:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154514 00000100:00100000:1.0:1651529490.226400:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946659904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.226401:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178936 count 1 00002000:00080000:1.0:1651529490.226403:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178817 count 1 00000100:00100000:0.0:1651529490.226411:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946660032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226414:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946659904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226414:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154513 00000100:00100000:1.0:1651529490.226417:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154514 00000100:00100000:0.0:1651529490.226418:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154515 00000100:00100000:0.0:1651529490.226420:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.226421:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154516 00000100:00100000:1.0:1651529490.226422:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.226423:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178738 count 1 00002000:00080000:1.0:1651529490.226426:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178737 count 1 00000100:00100000:0.0:1651529490.226434:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226436:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226437:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154515 00000100:00100000:1.0:1651529490.226439:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154516 00000100:00100000:1.0:1651529490.226983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227004:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660992 00000100:00100000:1.0:1651529490.227010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227029:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661120 00000100:00100000:1.0:1651529490.227033:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227036:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661248 00000100:00100000:0.0:1651529490.227046:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661376 00000100:00100000:1.0:1651529490.227049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227050:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154517 00000100:00100000:1.0:1651529490.227057:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227057:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946660992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.227062:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178854 count 1 00000100:00100000:1.0:1651529490.227063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227073:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227080:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660928 00000100:00100000:1.0:1651529490.227085:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661056 00000100:00100000:0.0:1651529490.227086:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946660992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227087:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661184 00000100:00100000:0.0:1651529490.227089:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154517 00000100:00100000:1.0:1651529490.227090:0:144528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661312 00000100:00100000:1.0:1651529490.227093:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154518 00000100:00100000:1.0:1651529490.227095:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946661120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227095:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154519 00000100:00100000:0.0:1651529490.227097:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946661248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227100:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178717 count 1 00002000:00080000:0.0:1651529490.227101:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178782 count 1 00000100:00100000:0.0:1651529490.227112:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946661248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227115:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946661120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 19us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227115:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154519 00000100:00100000:1.0:1651529490.227118:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154518 00000100:00100000:0.0:1651529490.227120:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154520 00000100:00100000:0.0:1651529490.227122:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000353c57a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946661376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.227123:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154521 00000100:00100000:1.0:1651529490.227125:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946660928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.227125:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178730 count 1 00002000:00080000:1.0:1651529490.227128:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178883 count 1 00000100:00100000:0.0:1651529490.227135:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000353c57a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946661376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227138:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154520 00000100:00100000:1.0:1651529490.227140:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946660928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (91us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227142:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154521 00000100:00100000:1.0:1651529490.227146:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154522 00000100:00100000:1.0:1651529490.227148:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946661056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227151:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178715 count 1 00000100:00100000:0.0:1651529490.227153:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154523 00000100:00100000:0.0:1651529490.227155:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946661184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.227159:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178894 count 1 00000100:00100000:1.0:1651529490.227161:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946661056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12us (104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227163:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154522 00000100:00100000:1.0:1651529490.227167:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154524 00000100:00100000:1.0:1651529490.227168:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030a1e89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227171:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (107us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.227172:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178887 count 1 00000100:00100000:0.0:1651529490.227173:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154523 00000100:00100000:1.0:1651529490.227182:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030a1e89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946661312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227185:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154524 00000100:00100000:1.0:1651529490.227673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227696:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227710:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227737:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662080 00000100:00100000:1.0:1651529490.227738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227754:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662208 00000100:00100000:1.0:1651529490.227755:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662336 00000100:00100000:0.0:1651529490.227758:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662464 00000100:00100000:1.0:1651529490.227764:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662016 00000100:00100000:1.0:1651529490.227767:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662144 00000100:00100000:1.0:1651529490.227769:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662400 00000100:00100000:0.0:1651529490.227769:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662272 00000100:00100000:1.0:1651529490.227772:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154525 00000100:00100000:1.0:1651529490.227774:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946662080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227775:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154526 00000100:00100000:0.0:1651529490.227777:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946662208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227779:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178958 count 1 00002000:00080000:0.0:1651529490.227782:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178904 count 1 00000100:00100000:1.0:1651529490.227799:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946662080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227822:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154525 00000100:00100000:0.0:1651529490.227822:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946662208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 37us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227825:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154526 00000100:00100000:1.0:1651529490.227828:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154527 00000100:00100000:1.0:1651529490.227829:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023ff581a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946662336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227830:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154528 00000100:00100000:0.0:1651529490.227832:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946662464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227834:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178712 count 1 00002000:00080000:0.0:1651529490.227837:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178796 count 1 00000100:00100000:1.0:1651529490.227849:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023ff581a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946662336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 19us (145us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227851:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946662464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227852:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154527 00000100:00100000:0.0:1651529490.227854:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154528 00000100:00100000:1.0:1651529490.227856:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154529 00000100:00100000:1.0:1651529490.227857:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227858:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154530 00000100:00100000:0.0:1651529490.227859:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227861:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178785 count 1 00002000:00080000:0.0:1651529490.227863:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178913 count 1 00000100:00100000:1.0:1651529490.227871:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227874:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154529 00000100:00100000:0.0:1651529490.227875:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (145us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227877:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154530 00000100:00100000:1.0:1651529490.227879:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154531 00000100:00100000:1.0:1651529490.227880:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.227881:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154532 00000100:00100000:0.0:1651529490.227883:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.227884:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178813 count 1 00002000:00080000:0.0:1651529490.227886:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178794 count 1 00000100:00100000:1.0:1651529490.227894:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227896:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (158us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227897:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154531 00000100:00100000:0.0:1651529490.227899:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154532 00000100:00100000:1.0:1651529490.228322:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228360:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228377:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228393:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663040 00000100:00100000:1.0:1651529490.228395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228404:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663168 00000100:00100000:0.0:1651529490.228408:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663296 00000100:00100000:1.0:1651529490.228410:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663424 00000100:00100000:0.0:1651529490.228414:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663104 00000100:00100000:0.0:1651529490.228416:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663232 00000100:00100000:0.0:1651529490.228419:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663360 00000100:00100000:1.0:1651529490.228420:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663488 00000100:00100000:0.0:1651529490.228422:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154533 00000100:00100000:0.0:1651529490.228424:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946663040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.228425:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154534 00000100:00100000:1.0:1651529490.228427:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071700544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946663168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.228429:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178928 count 1 00002000:00080000:1.0:1651529490.228432:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178835 count 1 00000100:00100000:1.0:1651529490.228448:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071700544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946663168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228448:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946663040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228451:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154533 00000100:00100000:1.0:1651529490.228453:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154534 00000100:00100000:0.0:1651529490.228456:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154535 00000100:00100000:1.0:1651529490.228458:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154536 00000100:00100000:0.0:1651529490.228458:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946663296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.228460:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946663104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.228462:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178708 count 1 00002000:00080000:1.0:1651529490.228463:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178952 count 1 00000100:00100000:0.0:1651529490.228474:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946663296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228475:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946663104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228476:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154535 00000100:00100000:1.0:1651529490.228478:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154536 00000100:00100000:0.0:1651529490.228481:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154537 00000100:00100000:0.0:1651529490.228482:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.228483:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154538 00000100:00100000:1.0:1651529490.228484:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.228486:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178770 count 1 00002000:00080000:1.0:1651529490.228488:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178768 count 1 00000100:00100000:0.0:1651529490.228497:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228499:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228499:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154537 00000100:00100000:1.0:1651529490.228501:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154538 00000100:00100000:0.0:1651529490.228503:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154539 00000100:00100000:1.0:1651529490.228505:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154540 00000100:00100000:0.0:1651529490.228505:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.228507:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.228510:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178865 count 1 00002000:00080000:0.0:1651529490.228510:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178764 count 1 00000100:00100000:0.0:1651529490.228520:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228521:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228523:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154539 00000100:00100000:1.0:1651529490.228524:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154540 00000100:00100000:1.0:1651529490.229074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229152:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664256 00000100:00100000:0.0:1651529490.229152:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664128 00000100:00100000:0.0:1651529490.229159:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664384 00000100:00100000:1.0:1651529490.229160:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664512 00000100:00100000:1.0:1651529490.229163:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664192 00000100:00100000:0.0:1651529490.229163:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664064 00000100:00100000:1.0:1651529490.229166:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664448 00000100:00100000:0.0:1651529490.229166:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664320 00000100:00100000:1.0:1651529490.229169:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154541 00000100:00100000:1.0:1651529490.229171:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.229171:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154542 00000100:00100000:0.0:1651529490.229173:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.229176:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178752 count 1 00002000:00080000:0.0:1651529490.229178:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178838 count 1 00000100:00100000:1.0:1651529490.229198:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229201:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154541 00000100:00100000:0.0:1651529490.229203:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.229206:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154542 00000100:00100000:1.0:1651529490.229208:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154543 00000100:00100000:1.0:1651529490.229209:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.229211:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154544 00000100:00100000:0.0:1651529490.229212:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b8ab07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.229213:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178706 count 1 00002000:00080000:0.0:1651529490.229216:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178709 count 1 00000100:00100000:1.0:1651529490.229226:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229228:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154543 00000100:00100000:0.0:1651529490.229230:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b8ab07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (118us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.229232:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154544 00000100:00100000:1.0:1651529490.229234:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154545 00000100:00100000:1.0:1651529490.229236:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aa474e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.229237:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154546 00000100:00100000:0.0:1651529490.229238:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.229239:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178799 count 1 00002000:00080000:0.0:1651529490.229242:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178809 count 1 00000100:00100000:1.0:1651529490.229249:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aa474e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229252:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154545 00000100:00100000:0.0:1651529490.229253:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229256:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154547 00000100:00100000:1.0:1651529490.229258:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946664448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.229258:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154546 00002000:00080000:1.0:1651529490.229261:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178852 count 1 00000100:00100000:0.0:1651529490.229262:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154548 00000100:00100000:0.0:1651529490.229264:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946664320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.229267:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178870 count 1 00000100:00100000:1.0:1651529490.229271:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946664448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229274:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154547 00000100:00100000:0.0:1651529490.229277:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946664320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (149us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.229280:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154548 00000100:00100000:1.0:1651529490.230096:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230108:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665280 00000100:00100000:0.0:1651529490.230117:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154549 00000100:00100000:0.0:1651529490.230118:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072f60e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946665280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230123:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178907 count 1 00000100:00100000:1.0:1651529490.230129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230140:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230152:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072f60e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946665280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 33us (56us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.230154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230155:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154549 00000100:00100000:0.0:1651529490.230171:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665408 00000100:00100000:0.0:1651529490.230180:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665536 00000100:00100000:0.0:1651529490.230184:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665664 00000100:00100000:0.0:1651529490.230190:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154550 00000100:00100000:0.0:1651529490.230191:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946665408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230196:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178827 count 1 00000100:00100000:1.0:1651529490.230199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230210:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946665408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (82us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.230213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230213:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154550 00000100:00100000:0.0:1651529490.230217:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665344 00000100:00100000:0.0:1651529490.230220:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665472 00000100:00100000:0.0:1651529490.230222:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665600 00000100:00100000:0.0:1651529490.230225:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154551 00000100:00100000:0.0:1651529490.230226:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946665536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230230:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178888 count 1 00000100:00100000:1.0:1651529490.230241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230241:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946665536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (101us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230244:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154551 00000100:00100000:0.0:1651529490.230247:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665728 00000100:00100000:0.0:1651529490.230250:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154552 00000100:00100000:0.0:1651529490.230252:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946665664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230255:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178844 count 1 00000100:00100000:1.0:1651529490.230268:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154553 00000100:00100000:1.0:1651529490.230271:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946665344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.230276:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178857 count 1 00000100:00100000:0.0:1651529490.230286:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946665664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 33us (132us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230290:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154552 00000100:00100000:0.0:1651529490.230294:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154554 00000100:00100000:0.0:1651529490.230296:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946665472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.230300:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946665344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (101us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.230300:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178922 count 1 00000100:00100000:1.0:1651529490.230303:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154553 00000100:00100000:1.0:1651529490.230308:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154555 00000100:00100000:1.0:1651529490.230310:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946665600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.230313:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178774 count 1 00000100:00100000:0.0:1651529490.230314:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946665472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230317:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154554 00000100:00100000:0.0:1651529490.230321:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154556 00000100:00100000:0.0:1651529490.230322:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946665728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.230325:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946665600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (113us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.230326:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178856 count 1 00000100:00100000:1.0:1651529490.230328:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154555 00000100:00100000:0.0:1651529490.230335:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946665728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (95us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230339:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154556 00000100:00100000:0.0:1651529490.230774:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230791:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666560 00000100:00100000:0.0:1651529490.230797:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666688 00000100:00100000:0.0:1651529490.230801:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154557 00000100:00100000:0.0:1651529490.230848:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946666560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230862:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178874 count 1 00000100:00100000:1.0:1651529490.230865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230900:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946666560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230903:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154557 00000100:00100000:0.0:1651529490.230908:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666816 00000100:00100000:1.0:1651529490.230913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230922:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666944 00000100:00100000:0.0:1651529490.230928:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666496 00000100:00100000:0.0:1651529490.230930:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666624 00000100:00100000:0.0:1651529490.230932:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666752 00000100:00100000:0.0:1651529490.230935:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154558 00000100:00100000:0.0:1651529490.230937:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946666688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230941:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178828 count 1 00000100:00100000:1.0:1651529490.230954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230955:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946666688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230958:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154558 00000100:00100000:0.0:1651529490.230962:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666880 00000100:00100000:0.0:1651529490.230966:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154559 00000100:00100000:0.0:1651529490.230967:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946666816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230971:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178880 count 1 00000100:00100000:1.0:1651529490.230982:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154560 00000100:00100000:0.0:1651529490.230987:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946666816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 19us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.230988:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946666944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.230990:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154559 00002000:00080000:1.0:1651529490.230994:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178912 count 1 00000100:00100000:0.0:1651529490.230994:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154561 00000100:00100000:0.0:1651529490.230995:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946666496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.230999:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178833 count 1 00000100:00100000:1.0:1651529490.231011:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946666944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (136us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.231011:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946666496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231014:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154560 00000100:00100000:0.0:1651529490.231015:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154561 00000100:00100000:1.0:1651529490.231019:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154562 00000100:00100000:1.0:1651529490.231021:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946666624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.231021:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154563 00000100:00100000:0.0:1651529490.231022:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946666752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231024:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178897 count 1 00002000:00080000:0.0:1651529490.231025:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178938 count 1 00000100:00100000:1.0:1651529490.231035:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946666624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.231036:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946666752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231037:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154562 00000100:00100000:0.0:1651529490.231039:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154563 00000100:00100000:1.0:1651529490.231042:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154564 00000100:00100000:1.0:1651529490.231043:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946666880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231047:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178805 count 1 00000100:00100000:1.0:1651529490.231057:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946666880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231060:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154564 00000100:00100000:1.0:1651529490.231228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231243:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667072 00000100:00100000:1.0:1651529490.231250:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667008 00000100:00100000:1.0:1651529490.231254:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154565 00000100:00100000:1.0:1651529490.231255:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946667072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231260:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178816 count 1 00000100:00100000:1.0:1651529490.231283:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946667072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (55us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231285:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154565 00000100:00100000:1.0:1651529490.231290:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154566 00000100:00100000:1.0:1651529490.231291:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946667008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231295:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178775 count 1 00000100:00100000:1.0:1651529490.231321:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946667008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231324:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154566 00000100:00100000:0.0:1651529490.231464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.231477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231478:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667200 00000100:00100000:0.0:1651529490.231485:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.231493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231502:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667328 00000100:00100000:0.0:1651529490.231502:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231512:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667456 00000100:00100000:1.0:1651529490.231519:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667136 00000100:00100000:1.0:1651529490.231525:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667264 00000100:00100000:1.0:1651529490.231531:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154567 00000100:00100000:1.0:1651529490.231533:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.231533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.231538:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178760 count 1 00000100:00100000:0.0:1651529490.231541:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667392 00000100:00100000:1.0:1651529490.231556:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946667200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231559:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154567 00000100:00100000:1.0:1651529490.231563:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154568 00000100:00100000:0.0:1651529490.231569:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154569 00000100:00100000:0.0:1651529490.231571:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.231573:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.231576:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178847 count 1 00002000:00080000:1.0:1651529490.231579:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178859 count 1 00000100:00100000:1.0:1651529490.231592:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.231593:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231594:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154568 00000100:00100000:0.0:1651529490.231596:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154569 00000100:00100000:1.0:1651529490.231598:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154570 00000100:00100000:1.0:1651529490.231600:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946667136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.231601:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154571 00002000:00080000:1.0:1651529490.231603:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178932 count 1 00000100:00100000:0.0:1651529490.231603:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946667264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.231606:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178944 count 1 00000100:00100000:1.0:1651529490.231614:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946667136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231617:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154570 00000100:00100000:0.0:1651529490.231617:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946667264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.231620:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154571 00000100:00100000:1.0:1651529490.231621:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154572 00000100:00100000:1.0:1651529490.231623:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946667392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231626:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178703 count 1 00000100:00100000:0.0:1651529490.231635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231637:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946667392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231639:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154572 00000100:00100000:1.0:1651529490.231643:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667520 00000100:00100000:0.0:1651529490.231649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.231653:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154573 00000100:00100000:1.0:1651529490.231655:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946667520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231659:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178925 count 1 00000100:00100000:1.0:1651529490.231671:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946667520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (36us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231674:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154573 00000100:00100000:1.0:1651529490.231678:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667584 00000100:00100000:1.0:1651529490.231692:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154574 00000100:00100000:1.0:1651529490.231697:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946667584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.231701:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178763 count 1 00000100:00100000:1.0:1651529490.231729:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946667584:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 30us (79us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.231732:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154574 00000100:00100000:1.0:1651529490.232196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232259:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232271:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667648 00000100:00100000:0.0:1651529490.232276:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667712 00000100:00100000:1.0:1651529490.232280:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668288 00000100:00100000:1.0:1651529490.232285:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668416 00000100:00100000:1.0:1651529490.232291:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668544 00000100:00100000:1.0:1651529490.232294:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668352 00000100:00100000:1.0:1651529490.232296:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668608 00000100:00100000:0.0:1651529490.232296:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668480 00000100:00100000:0.0:1651529490.232300:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154575 00000100:00100000:0.0:1651529490.232302:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946667648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.232303:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154576 00000100:00100000:1.0:1651529490.232305:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946668288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.232307:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178956 count 1 00002000:00080000:1.0:1651529490.232310:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178781 count 1 00000100:00100000:0.0:1651529490.232326:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946667648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232327:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946668288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (98us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.232328:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154575 00000100:00100000:1.0:1651529490.232330:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154576 00000100:00100000:0.0:1651529490.232333:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154577 00000100:00100000:1.0:1651529490.232335:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154578 00000100:00100000:0.0:1651529490.232335:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946668416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.232337:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946667712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.232339:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178871 count 1 00002000:00080000:1.0:1651529490.232342:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178901 count 1 00000100:00100000:0.0:1651529490.232350:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a67e904 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946668416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232353:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946667712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.232353:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154577 00000100:00100000:1.0:1651529490.232355:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154578 00000100:00100000:0.0:1651529490.232357:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154579 00000100:00100000:0.0:1651529490.232359:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946668544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.232362:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178868 count 1 00000100:00100000:1.0:1651529490.232371:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154580 00000100:00100000:1.0:1651529490.232373:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946668352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.232373:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946668544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.232375:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154579 00002000:00080000:1.0:1651529490.232377:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178862 count 1 00000100:00100000:0.0:1651529490.232379:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154581 00000100:00100000:0.0:1651529490.232381:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946668480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.232384:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178756 count 1 00000100:00100000:1.0:1651529490.232388:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946668352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232391:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154580 00000100:00100000:0.0:1651529490.232394:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946668480:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (142us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232395:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154582 00000100:00100000:1.0:1651529490.232396:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946668608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.232397:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154581 00002000:00080000:1.0:1651529490.232399:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178829 count 1 00000100:00100000:1.0:1651529490.232410:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946668608:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232412:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154582 00000100:00100000:1.0:1651529490.233063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233134:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668736 00000100:00100000:0.0:1651529490.233139:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668864 00000100:00100000:1.0:1651529490.233143:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668992 00000100:00100000:1.0:1651529490.233148:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669120 00000100:00100000:1.0:1651529490.233154:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668672 00000100:00100000:1.0:1651529490.233156:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668800 00000100:00100000:1.0:1651529490.233159:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669056 00000100:00100000:0.0:1651529490.233159:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668928 00000100:00100000:1.0:1651529490.233162:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154583 00000100:00100000:1.0:1651529490.233163:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946668736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233165:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154584 00000100:00100000:0.0:1651529490.233166:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946668992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.233168:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178947 count 1 00002000:00080000:0.0:1651529490.233171:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178720 count 1 00000100:00100000:1.0:1651529490.233189:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946668736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233192:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154583 00000100:00100000:0.0:1651529490.233195:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946668992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 27us (101us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233197:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154585 00000100:00100000:1.0:1651529490.233198:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233198:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154584 00002000:00080000:1.0:1651529490.233202:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178886 count 1 00000100:00100000:0.0:1651529490.233203:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154586 00000100:00100000:0.0:1651529490.233205:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946668672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233209:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178788 count 1 00000100:00100000:1.0:1651529490.233214:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946669120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233217:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154585 00000100:00100000:1.0:1651529490.233221:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154587 00000100:00100000:0.0:1651529490.233221:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946668672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233222:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946668864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233223:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154586 00002000:00080000:1.0:1651529490.233226:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178761 count 1 00000100:00100000:0.0:1651529490.233228:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154588 00000100:00100000:0.0:1651529490.233229:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946668800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233233:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178822 count 1 00000100:00100000:1.0:1651529490.233236:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946668864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (156us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233239:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154587 00000100:00100000:1.0:1651529490.233243:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154589 00000100:00100000:0.0:1651529490.233243:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946668800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233245:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946669056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233246:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154588 00002000:00080000:1.0:1651529490.233248:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178882 count 1 00000100:00100000:0.0:1651529490.233250:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154590 00000100:00100000:0.0:1651529490.233252:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946668928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233255:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178866 count 1 00000100:00100000:1.0:1651529490.233259:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946669056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233261:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154589 00000100:00100000:0.0:1651529490.233265:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946668928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (149us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.233268:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154590 00000100:00100000:1.0:1651529490.233755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233789:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670208 00000100:00100000:0.0:1651529490.233796:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670336 00000100:00100000:1.0:1651529490.233797:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233813:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670464 00000100:00100000:0.0:1651529490.233830:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154591 00000100:00100000:0.0:1651529490.233832:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233837:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178806 count 1 00000100:00100000:1.0:1651529490.233846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233856:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (101us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.233859:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154591 00000100:00100000:0.0:1651529490.233863:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670592 00000100:00100000:0.0:1651529490.233871:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670272 00000100:00100000:0.0:1651529490.233876:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670400 00000100:00100000:0.0:1651529490.233880:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154592 00000100:00100000:0.0:1651529490.233881:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946670336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233885:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178745 count 1 00000100:00100000:1.0:1651529490.233892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233899:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946670336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.233901:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154592 00000100:00100000:0.0:1651529490.233905:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670528 00000100:00100000:0.0:1651529490.233908:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670656 00000100:00100000:0.0:1651529490.233911:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154593 00000100:00100000:0.0:1651529490.233912:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946670464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233916:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178933 count 1 00000100:00100000:1.0:1651529490.233926:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154594 00000100:00100000:0.0:1651529490.233931:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946670464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233933:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946670592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233934:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154593 00000100:00100000:0.0:1651529490.233938:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154595 00002000:00080000:1.0:1651529490.233939:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178877 count 1 00000100:00100000:0.0:1651529490.233940:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946670272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.233943:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178725 count 1 00000100:00100000:1.0:1651529490.233954:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946670592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.233955:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946670272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (110us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233957:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154594 00000100:00100000:0.0:1651529490.233959:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154595 00000100:00100000:1.0:1651529490.233962:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154596 00000100:00100000:1.0:1651529490.233964:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.233964:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154597 00000100:00100000:0.0:1651529490.233966:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.233968:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178942 count 1 00002000:00080000:0.0:1651529490.233969:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178842 count 1 00000100:00100000:1.0:1651529490.233979:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.233980:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946670528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (88us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233982:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154596 00000100:00100000:0.0:1651529490.233983:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154597 00000100:00100000:1.0:1651529490.233986:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154598 00000100:00100000:1.0:1651529490.233987:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.233991:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178767 count 1 00000100:00100000:1.0:1651529490.234001:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234004:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154598 00000100:00100000:1.0:1651529490.234101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234114:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670720 00000100:00100000:1.0:1651529490.234120:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670784 00000100:00100000:1.0:1651529490.234124:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154599 00000100:00100000:1.0:1651529490.234126:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946670720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234130:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178915 count 1 00000100:00100000:1.0:1651529490.234151:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946670720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (50us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234153:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154599 00000100:00100000:1.0:1651529490.234158:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154600 00000100:00100000:1.0:1651529490.234159:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234163:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178924 count 1 00000100:00100000:1.0:1651529490.234190:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 30us (81us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234193:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154600 00000100:00100000:1.0:1651529490.234202:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670848 00000100:00100000:1.0:1651529490.234208:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154601 00000100:00100000:1.0:1651529490.234209:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234220:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178839 count 1 00000100:00100000:1.0:1651529490.234239:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (48us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234242:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154601 00000100:00100000:1.0:1651529490.234363:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234376:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670976 00000100:00100000:1.0:1651529490.234381:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671104 00000100:00100000:1.0:1651529490.234385:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154602 00000100:00100000:1.0:1651529490.234387:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946670976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234391:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178853 count 1 00000100:00100000:1.0:1651529490.234413:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946670976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (50us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234421:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154602 00000100:00100000:1.0:1651529490.234425:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154603 00000100:00100000:1.0:1651529490.234427:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946671104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234431:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178919 count 1 00000100:00100000:0.0:1651529490.234442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234457:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946671104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 29us (86us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234460:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154603 00000100:00100000:1.0:1651529490.234464:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670912 00000100:00100000:1.0:1651529490.234470:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154604 00000100:00100000:1.0:1651529490.234471:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.234479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.234487:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178783 count 1 00000100:00100000:0.0:1651529490.234503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234508:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946670912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 36us (67us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234511:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154604 00000100:00100000:1.0:1651529490.234515:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671040 00000100:00100000:1.0:1651529490.234530:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671168 00000100:00100000:0.0:1651529490.234531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234542:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671232 00000100:00100000:1.0:1651529490.234546:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154605 00000100:00100000:1.0:1651529490.234547:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.234548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.234552:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178719 count 1 00000100:00100000:1.0:1651529490.234565:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (87us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234568:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154605 00000100:00100000:1.0:1651529490.234572:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671360 00000100:00100000:1.0:1651529490.234574:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671296 00000100:00100000:1.0:1651529490.234577:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154606 00000100:00100000:1.0:1651529490.234578:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946671168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234582:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178812 count 1 00000100:00100000:0.0:1651529490.234587:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154607 00000100:00100000:0.0:1651529490.234590:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946671232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.234595:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178733 count 1 00000100:00100000:1.0:1651529490.234608:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946671168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 28us (105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234611:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154606 00000100:00100000:1.0:1651529490.234615:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154608 00000100:00100000:1.0:1651529490.234617:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234621:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178917 count 1 00000100:00100000:0.0:1651529490.234632:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075308f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 42us (101us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234633:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (85us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234635:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154607 00000100:00100000:1.0:1651529490.234637:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154608 00000100:00100000:1.0:1651529490.234641:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154609 00000100:00100000:1.0:1651529490.234643:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946671296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234646:0:127526:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178791 count 1 00000100:00100000:1.0:1651529490.234656:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946671296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12us (103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234660:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154609 00000100:00100000:1.0:1651529490.234853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234876:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672000 00000100:00100000:1.0:1651529490.234882:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672128 00000100:00100000:1.0:1651529490.234886:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671936 00000100:00100000:1.0:1651529490.234889:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154610 00000100:00100000:1.0:1651529490.234899:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946672000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.234900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.234909:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178790 count 1 00000100:00100000:1.0:1651529490.234927:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946672000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 35us (75us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234930:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154610 00000100:00100000:1.0:1651529490.234934:0:127523:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672064 00000100:00100000:1.0:1651529490.234944:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154611 00000100:00100000:1.0:1651529490.234945:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946672128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.234947:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154612 00000100:00100000:0.0:1651529490.234949:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946671936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.234950:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178757 count 1 00002000:00080000:0.0:1651529490.234955:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178892 count 1 00000100:00100000:1.0:1651529490.234962:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946672128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (98us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234965:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154611 00000100:00100000:1.0:1651529490.234969:0:127523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154613 00000100:00100000:1.0:1651529490.234970:0:127523:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.234971:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946671936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (101us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.234974:0:127523:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178935 count 1 00000100:00100000:0.0:1651529490.234974:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154612 00000100:00100000:1.0:1651529490.234984:0:127523:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (85us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234988:0:127523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154613 00000100:00100000:0.0:1651529490.235085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235095:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672256 00000100:00100000:1.0:1651529490.235102:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154614 00000100:00100000:1.0:1651529490.235104:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.235108:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178846 count 1 00000100:00100000:0.0:1651529490.235108:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.235119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235138:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 33us (53us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235140:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154614 00000100:00100000:1.0:1651529490.235145:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672192 00000100:00100000:1.0:1651529490.235149:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672320 00000100:00100000:1.0:1651529490.235153:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154615 00000100:00100000:1.0:1651529490.235154:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.235158:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178851 count 1 00000100:00100000:1.0:1651529490.235170:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (62us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235172:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154615 00000100:00100000:1.0:1651529490.235176:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154616 00000100:00100000:1.0:1651529490.235177:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.235181:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178810 count 1 00000100:00100000:1.0:1651529490.235190:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12us (71us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235192:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154616 00000100:00100000:0.0:1651529490.243429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243438:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243452:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243467:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675904 00000100:00100000:0.0:1651529490.243468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243480:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676032 00000100:00100000:1.0:1651529490.243487:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676160 00000100:00100000:0.0:1651529490.243490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243498:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675968 00000100:00100000:1.0:1651529490.243501:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676288 00000100:00100000:1.0:1651529490.243503:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676224 00000100:00100000:0.0:1651529490.243503:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676096 00000100:00100000:1.0:1651529490.243505:0:142993:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676352 00000100:00100000:1.0:1651529490.243509:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154617 00000100:00100000:1.0:1651529490.243511:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946675904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.243511:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154618 00000100:00100000:0.0:1651529490.243513:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946676032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.243516:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178875 count 1 00002000:00080000:0.0:1651529490.243519:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178802 count 1 00000100:00100000:1.0:1651529490.243535:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946675904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.243535:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946676032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (97us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243538:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154617 00000100:00100000:0.0:1651529490.243540:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154618 00000100:00100000:1.0:1651529490.243543:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154619 00000100:00100000:1.0:1651529490.243544:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946676160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.243545:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154620 00000100:00100000:0.0:1651529490.243546:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946675968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.243548:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178955 count 1 00002000:00080000:0.0:1651529490.243550:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178744 count 1 00000100:00100000:1.0:1651529490.243560:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946676160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.243561:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946675968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243563:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154619 00000100:00100000:0.0:1651529490.243564:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154620 00000100:00100000:1.0:1651529490.243567:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154621 00000100:00100000:1.0:1651529490.243569:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.243569:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154622 00000100:00100000:0.0:1651529490.243570:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.243572:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178721 count 1 00002000:00080000:0.0:1651529490.243574:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178762 count 1 00000100:00100000:1.0:1651529490.243582:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243585:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154621 00000100:00100000:0.0:1651529490.243585:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.243587:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154622 00000100:00100000:1.0:1651529490.243589:0:142993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154623 00000100:00100000:1.0:1651529490.243591:0:142993:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.243592:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154624 00000100:00100000:0.0:1651529490.243593:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.243595:0:142993:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178811 count 1 00002000:00080000:0.0:1651529490.243596:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178784 count 1 00000100:00100000:1.0:1651529490.243605:0:142993:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (137us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.243607:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243608:0:142993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154623 00000100:00100000:0.0:1651529490.243611:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154624 00000100:00100000:0.0:1651529490.243987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243995:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244015:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676544 00000100:00100000:1.0:1651529490.244016:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676672 00000100:00100000:0.0:1651529490.244024:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676800 00000100:00100000:0.0:1651529490.244028:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676736 00000100:00100000:1.0:1651529490.244032:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154625 00000100:00100000:1.0:1651529490.244034:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.244035:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154626 00000100:00100000:0.0:1651529490.244037:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.244039:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178704 count 1 00002000:00080000:0.0:1651529490.244042:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178872 count 1 00000100:00100000:1.0:1651529490.244058:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676544:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (72us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244059:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946676672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (64us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244061:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154625 00000100:00100000:0.0:1651529490.244062:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154626 00000100:00100000:1.0:1651529490.244066:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154627 00000100:00100000:1.0:1651529490.244067:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946676800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.244067:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154628 00000100:00100000:0.0:1651529490.244069:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.244071:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178729 count 1 00002000:00080000:0.0:1651529490.244073:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178777 count 1 00000100:00100000:1.0:1651529490.244084:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946676800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (83us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244085:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (78us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244086:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154627 00000100:00100000:0.0:1651529490.244088:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154628 00000100:00100000:0.0:1651529490.244150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244181:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676864 00000100:00100000:0.0:1651529490.244190:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676928 00000100:00100000:1.0:1651529490.244191:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676992 00000100:00100000:1.0:1651529490.244199:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677056 00000100:00100000:1.0:1651529490.244207:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154629 00000100:00100000:1.0:1651529490.244208:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.244213:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178731 count 1 00000100:00100000:0.0:1651529490.244218:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154630 00000100:00100000:0.0:1651529490.244220:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.244225:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178707 count 1 00000100:00100000:1.0:1651529490.244236:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 27us (86us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244239:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154629 00000100:00100000:0.0:1651529490.244241:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946676992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244244:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154631 00000100:00100000:1.0:1651529490.244245:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946677056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.244245:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154630 00002000:00080000:1.0:1651529490.244250:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178749 count 1 00000100:00100000:0.0:1651529490.244250:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154632 00000100:00100000:0.0:1651529490.244252:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.244255:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178863 count 1 00000100:00100000:1.0:1651529490.244262:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946677056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 16us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244265:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154631 00000100:00100000:0.0:1651529490.244266:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244269:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154632 00000100:00100000:0.0:1651529490.244412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244483:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677632 00000100:00100000:0.0:1651529490.244483:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677696 00000100:00100000:0.0:1651529490.244492:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677824 00000100:00100000:0.0:1651529490.244496:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677760 00000100:00100000:0.0:1651529490.244502:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154633 00000100:00100000:1.0:1651529490.244503:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677888 00000100:00100000:0.0:1651529490.244503:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946677696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.244508:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178722 count 1 00000100:00100000:1.0:1651529490.244509:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154634 00000100:00100000:1.0:1651529490.244510:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946677632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.244515:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178714 count 1 00000100:00100000:0.0:1651529490.244529:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946677696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 24us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244531:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154633 00000100:00100000:0.0:1651529490.244536:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154635 00000100:00100000:1.0:1651529490.244537:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946677632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 26us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244538:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946677824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.244540:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154634 00002000:00080000:0.0:1651529490.244542:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178900 count 1 00000100:00100000:1.0:1651529490.244545:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154636 00000100:00100000:1.0:1651529490.244547:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946677760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.244551:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178765 count 1 00000100:00100000:0.0:1651529490.244554:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946677824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (98us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244557:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154635 00000100:00100000:0.0:1651529490.244561:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154637 00000100:00100000:0.0:1651529490.244562:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030a1e89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946677888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.244563:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d1d852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946677760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (97us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244565:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154636 00002000:00080000:0.0:1651529490.244566:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178905 count 1 00000100:00100000:0.0:1651529490.244603:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030a1e89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946677888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 39us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244606:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154637 00000100:00100000:1.0:1651529490.244626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244633:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677952 00000100:00100000:1.0:1651529490.244634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244645:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678080 00000100:00100000:0.0:1651529490.244649:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154638 00000100:00100000:0.0:1651529490.244650:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946677952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.244655:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178807 count 1 00000100:00100000:0.0:1651529490.244697:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946677952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 45us (70us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244700:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154638 00000100:00100000:1.0:1651529490.244704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244704:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154639 00000100:00100000:0.0:1651529490.244706:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946678080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.244710:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178778 count 1 00000100:00100000:1.0:1651529490.244711:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678016 00000100:00100000:1.0:1651529490.244718:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154640 00000100:00100000:1.0:1651529490.244719:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946678016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.244722:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946678080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (88us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.244724:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178940 count 1 00000100:00100000:0.0:1651529490.244726:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154639 00000100:00100000:1.0:1651529490.244750:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946678016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 30us (46us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244753:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154640 00000100:00100000:1.0:1651529490.245051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245077:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678720 00000100:00100000:1.0:1651529490.245085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245096:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678656 00000100:00100000:1.0:1651529490.245099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245108:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678848 00000100:00100000:0.0:1651529490.245114:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678784 00000100:00100000:0.0:1651529490.245119:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678976 00000100:00100000:0.0:1651529490.245122:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678912 00000100:00100000:1.0:1651529490.245123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245124:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679104 00000100:00100000:0.0:1651529490.245126:0:142996:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679040 00000100:00100000:0.0:1651529490.245130:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154641 00000100:00100000:0.0:1651529490.245131:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946678720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.245132:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154642 00000100:00100000:1.0:1651529490.245134:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946678656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.245136:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178755 count 1 00002000:00080000:1.0:1651529490.245139:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178895 count 1 00000100:00100000:1.0:1651529490.245156:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946678656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (95us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245156:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946678720:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 23us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245159:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154642 00000100:00100000:0.0:1651529490.245160:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154641 00000100:00100000:1.0:1651529490.245164:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154643 00000100:00100000:1.0:1651529490.245166:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946678848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.245166:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154644 00000100:00100000:0.0:1651529490.245168:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946678784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.245169:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178830 count 1 00002000:00080000:0.0:1651529490.245171:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178911 count 1 00000100:00100000:1.0:1651529490.245180:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946678848:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245182:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154643 00000100:00100000:0.0:1651529490.245183:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946678784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245186:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154644 00000100:00100000:1.0:1651529490.245187:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154645 00000100:00100000:1.0:1651529490.245189:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946678976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.245190:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154646 00000100:00100000:0.0:1651529490.245191:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946678912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.245192:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178949 count 1 00002000:00080000:0.0:1651529490.245195:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178893 count 1 00000100:00100000:0.0:1651529490.245204:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946678912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12us (112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245208:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154646 00000100:00100000:0.0:1651529490.245212:0:142996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154647 00000100:00100000:0.0:1651529490.245213:0:142996:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946679104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.245215:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946678976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 25us (130us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.245217:0:142996:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178934 count 1 00000100:00100000:1.0:1651529490.245218:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154645 00000100:00100000:1.0:1651529490.245223:0:144528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154648 00000100:00100000:1.0:1651529490.245224:0:144528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946679040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.245227:0:142996:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946679104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (128us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.245228:0:144528:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178795 count 1 00000100:00100000:0.0:1651529490.245230:0:142996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154647 00000100:00100000:1.0:1651529490.245239:0:144528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946679040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245241:0:144528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154648 00000100:00100000:1.0:1651529490.245538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245547:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245570:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245576:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245582:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679744 00000100:00100000:1.0:1651529490.245592:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679872 00000100:00100000:0.0:1651529490.245596:0:128009:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680000 00000100:00100000:1.0:1651529490.245598:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680128 00000100:00100000:1.0:1651529490.245604:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679680 00000100:00100000:1.0:1651529490.245609:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679808 00000100:00100000:1.0:1651529490.245611:0:142994:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679936 00000100:00100000:1.0:1651529490.245615:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154649 00000100:00100000:1.0:1651529490.245616:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.245617:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154650 00002000:00080000:1.0:1651529490.245621:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178751 count 1 00000100:00100000:0.0:1651529490.245638:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.245644:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178748 count 1 00000100:00100000:1.0:1651529490.245649:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 32us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245652:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154649 00000100:00100000:0.0:1651529490.245660:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679872:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 41us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245663:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154650 00000100:00100000:1.0:1651529490.245665:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154651 00000100:00100000:1.0:1651529490.245667:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946680128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.245668:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154652 00000100:00100000:0.0:1651529490.245670:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946679680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.245671:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178903 count 1 00002000:00080000:0.0:1651529490.245674:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178808 count 1 00000100:00100000:0.0:1651529490.245685:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946679680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245687:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946680128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 19us (128us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245687:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154652 00000100:00100000:1.0:1651529490.245689:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154651 00000100:00100000:0.0:1651529490.245691:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154653 00000100:00100000:0.0:1651529490.245692:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946679808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.245694:0:142994:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154654 00000100:00100000:1.0:1651529490.245695:0:142994:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946680000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.245696:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178878 count 1 00002000:00080000:1.0:1651529490.245699:0:142994:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178849 count 1 00000100:00100000:0.0:1651529490.245706:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946679808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (136us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245708:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154653 00000100:00100000:1.0:1651529490.245710:0:142994:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946680000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245712:0:128009:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154655 00000100:00100000:1.0:1651529490.245714:0:142994:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154654 00000100:00100000:0.0:1651529490.245714:0:128009:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946679936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.245717:0:128009:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178869 count 1 00000100:00100000:0.0:1651529490.245727:0:128009:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946679936:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (152us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245730:0:128009:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154655 00000100:00100000:1.0:1651529490.245733:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245746:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680064 00000100:00100000:0.0:1651529490.245756:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154656 00000100:00100000:0.0:1651529490.245757:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946680064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.245762:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178841 count 1 00000100:00100000:0.0:1651529490.245775:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946680064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 17us (43us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245778:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154656 00000100:00100000:0.0:1651529490.246098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.246112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246119:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680704 00000100:00100000:0.0:1651529490.246119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.246125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246134:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680768 00000100:00100000:1.0:1651529490.246138:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680832 00000100:00100000:0.0:1651529490.246139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.246148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246155:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680896 00000100:00100000:0.0:1651529490.246157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246165:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681024 00000100:00100000:1.0:1651529490.246168:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681152 00000100:00100000:1.0:1651529490.246170:0:144527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680960 00000100:00100000:1.0:1651529490.246173:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154657 00000100:00100000:1.0:1651529490.246175:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946680704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.246176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.246183:0:142995:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681088 00002000:00080000:1.0:1651529490.246187:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178850 count 1 00000100:00100000:0.0:1651529490.246189:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154658 00000100:00100000:0.0:1651529490.246190:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946680768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.246197:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178860 count 1 00000100:00100000:1.0:1651529490.246206:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946680704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 31us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246209:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154657 00000100:00100000:0.0:1651529490.246213:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946680768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 22us (101us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246214:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154659 00000100:00100000:1.0:1651529490.246224:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023ff581a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946680832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.246224:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154658 00002000:00080000:1.0:1651529490.246228:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178713 count 1 00000100:00100000:0.0:1651529490.246229:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154660 00000100:00100000:0.0:1651529490.246231:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946680896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.246235:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178742 count 1 00000100:00100000:1.0:1651529490.246243:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023ff581a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946680832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 18us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246245:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154659 00000100:00100000:0.0:1651529490.246246:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946680896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 15us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246249:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154660 00000100:00100000:1.0:1651529490.246250:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154661 00000100:00100000:1.0:1651529490.246252:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.246253:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154662 00000100:00100000:0.0:1651529490.246254:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.246255:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178941 count 1 00002000:00080000:0.0:1651529490.246258:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178753 count 1 00000100:00100000:1.0:1651529490.246266:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246269:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154661 00000100:00100000:0.0:1651529490.246269:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 14us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246271:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154662 00000100:00100000:1.0:1651529490.246273:0:144527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154663 00000100:00100000:1.0:1651529490.246275:0:144527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946680960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.246275:0:142995:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154664 00000100:00100000:0.0:1651529490.246277:0:142995:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946681088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.246278:0:144527:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178820 count 1 00002000:00080000:0.0:1651529490.246280:0:142995:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178741 count 1 00000100:00100000:1.0:1651529490.246289:0:144527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946680960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246291:0:144527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154663 00000100:00100000:0.0:1651529490.246291:0:142995:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946681088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246293:0:142995:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154664 00000100:00100000:0.0:1651529490.246605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.246623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246642:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681536 00000100:00100000:1.0:1651529490.246653:0:127525:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681664 00000100:00100000:0.0:1651529490.246662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246664:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154665 00000100:00100000:1.0:1651529490.246666:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096b262e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946681536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529490.246669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.246671:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178743 count 1 00000100:00100000:0.0:1651529490.246679:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681600 00000100:00100000:0.0:1651529490.246688:0:161133:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681728 00000100:00100000:0.0:1651529490.246694:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154666 00000100:00100000:0.0:1651529490.246696:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529490.246701:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178831 count 1 00000100:00100000:1.0:1651529490.246702:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096b262e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946681536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 35us (97us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246705:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154665 00000100:00100000:0.0:1651529490.246717:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946681664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 21us (94us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246720:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154666 00000100:00100000:0.0:1651529490.246725:0:161133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154667 00000100:00100000:0.0:1651529490.246726:0:161133:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071700544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946681600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529490.246729:0:127525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154668 00002000:00080000:0.0:1651529490.246730:0:161133:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178930 count 1 00000100:00100000:1.0:1651529490.246731:0:127525:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946681728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529490.246735:0:127525:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:178959 count 1 00000100:00100000:0.0:1651529490.246740:0:161133:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071700544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946681600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 13us (79us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246743:0:161133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154667 00000100:00100000:1.0:1651529490.246750:0:127525:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946681728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 19us (81us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246753:0:127525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154668 00000100:00100000:1.0:1651529491.644882:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037c77544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966721984:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529491.644890:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046898db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966722048:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00080000:1.0:1651529491.645255:0:39027:0:(recover.c:232:ptlrpc_request_handle_notconn()) import MGC10.240.43.61@tcp of MGS@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651529491.645257:0:39027:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from FULL to DISCONN 00000100:00080000:0.0:1651529491.645257:0:39028:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:02020000:1.0:1651529491.645259:0:39027:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1651529491.645259:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1651529491.645261:0:39028:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1651529491.645275:0:39027:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1651529491.645276:0:39027:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529491.645278:0:39027:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000037c77544 x1731745966721984/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 0 dl 1651529498 ref 1 fl Rpc:RNQU/0/0 rc 0/-107 job:'kworker/u4:1.0' 10000000:01000000:1.0:1651529491.645300:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1651529491.645302:0:39027:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1651529491.645302:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1651529491.645307:0:39027:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529491.645313:0:39027:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 11424 00000100:00080000:1.0:1651529491.645316:0:39027:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000007b8a8aed using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529491.645326:0:39027:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095b887a5 x1731745966722112/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651529491.645340:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037c77544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966721984:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529491.648832:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095b887a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39026:1731745966722112:10.240.43.61@tcp:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1651529491.650977:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529491.650980:0:39028:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 11424 00000100:00080000:0.0:1651529491.650983:0:39028:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000016ad0705 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529491.650998:0:39028:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005fd3081b x1731745966722176/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529491.651011:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046898db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966722048:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529491.651022:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fd3081b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966722176:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00010000:00080000:1.0:1651529491.651331:0:39026:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@000000005fd3081b x1731745966722176/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529497 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_01.0' 00000100:00080000:1.0:1651529491.651345:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00080000:1.0:1651529491.654139:0:39026:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@000000005fd3081b x1731745966722176/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529497 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_01.0' 00000100:00080000:1.0:1651529491.654144:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1651529491.654146:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1651529491.654147:0:39026:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651529491.656113:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fd3081b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966722176:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1651529491.656121:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:1.0:1651529491.656123:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1651529491.656124:0:39026:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b1585523c153e to 0x7e7b158553dd5e85 00000100:00080000:1.0:1651529491.658450:0:39026:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1651529491.658452:0:39026:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:1.0:1651529491.658562:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095b887a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39026:1731745966722112:10.240.43.61@tcp:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1651529491.658951:0:173202:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:1.0:1651529491.658954:0:173202:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651529491.658955:0:173202:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1651529491.658962:0:173202:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000f5a7e2c7/0xa29a79078f2beb28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523c154c expref: -99 pid: 127509 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529491.658981:0:173202:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000f5a7e2c7/0xa29a79078f2beb28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523c154c expref: -99 pid: 127509 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529491.658988:0:173202:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1651529491.659009:0:173202:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651529491.659016:0:173202:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000f5a7e2c7/0xa29a79078f2beb28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523c154c expref: -99 pid: 127509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529491.659022:0:173202:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000008eb1ac92/0xa29a79078f2c092e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e56c5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529491.659025:0:173202:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000008eb1ac92/0xa29a79078f2c092e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e56c5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529491.659027:0:173202:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651529491.659033:0:173202:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651529491.659034:0:173202:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000008eb1ac92/0xa29a79078f2c092e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e56c5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529491.659037:0:173202:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000008ed2ca19/0xa29a79078f2c0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e56cc expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529491.659039:0:173202:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000008ed2ca19/0xa29a79078f2c0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e56cc expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529491.659041:0:173202:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651529491.659045:0:173202:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651529491.659046:0:173202:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000008ed2ca19/0xa29a79078f2c0935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e56cc expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529491.659049:0:173202:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000002c8d59f/0xa29a79078f2c093c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e56d3 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529491.659051:0:173202:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000002c8d59f/0xa29a79078f2c093c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e56d3 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529491.659053:0:173202:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651529491.659056:0:173202:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651529491.659061:0:173202:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000002c8d59f/0xa29a79078f2c093c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e56d3 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529491.659065:0:173202:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ffaad856/0xa29a79078f2c15bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523f3893 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529491.659068:0:173202:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ffaad856/0xa29a79078f2c15bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523f3893 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529491.659070:0:173202:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651529491.659076:0:173202:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651529491.659077:0:173202:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ffaad856/0xa29a79078f2c15bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523f3893 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529491.659081:0:173202:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1651529491.659082:0:173202:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1651529491.659083:0:173202:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651529491.659086:0:173202:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1651529491.659088:0:173202:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651529493.186754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529493.186773:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060800 00000100:00100000:1.0:1651529493.186794:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154669 00000100:00100000:1.0:1651529493.186797:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41277:x1731746397060800:12345-10.240.43.64@tcp:9:kworker/u4:1.0 00000020:00000080:1.0:1651529493.186840:0:127526:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3a7610 00000100:00080000:1.0:1651529493.186845:0:127526:0:(import.c:85:import_set_state_nolock()) 00000000706f2434 ýÒŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529493.186865:0:127526:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064895227 00000100:00100000:1.0:1651529493.186935:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2:41277:x1731746397060800:12345-10.240.43.64@tcp:9:kworker/u4:1.0 Request processed in 137us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.186939:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154669 00000100:00100000:1.0:1651529493.240472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529493.240480:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397061248 00000100:00100000:1.0:1651529493.240493:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154670 00000100:00100000:1.0:1651529493.240495:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:41277:x1731746397061248:12345-10.240.43.64@tcp:8:lfs.0 00010000:00080000:1.0:1651529493.240504:0:127526:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13092 last 0 00000020:00000080:1.0:1651529493.240515:0:127526:0:(genops.c:1359:class_connect()) connect: client a5e20e05-95ba-4d6f-a195-0604c0c0ff53, cookie 0xa29a79078f3c17a8 00002000:00100000:1.0:1651529493.240518:0:127526:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli a5e20e05-95ba-4d6f-a195-0604c0c0ff53/000000006c1c5ea1 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 352092160 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529493.240525:0:127526:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529493.240536:0:127526:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000446a0d93 00002000:00080000:1.0:1651529493.240539:0:127526:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529493.240548:0:127526:0:(import.c:85:import_set_state_nolock()) 00000000dd188e16 ýÒŽÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529493.240567:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41277:x1731746397061248:12345-10.240.43.64@tcp:8:lfs.0 Request processed in 71us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.240570:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154670 00000100:00100000:1.0:1651529493.240764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529493.240782:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397061312 00000100:00100000:0.0:1651529493.240797:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 334 00000100:00100000:0.0:1651529493.240799:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434248:x1731746397061312:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529493.240827:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8579904 pending 0 free 81208983552 avail 77038272512 00000100:00100000:0.0:1651529493.240848:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434248:x1731746397061312:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529493.240851:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 334 00000100:00100000:1.0:1651529493.257892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529493.257902:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682112 00000100:00100000:1.0:1651529493.257919:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154671 00000100:00100000:1.0:1651529493.257921:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:205177:x1731745946682112:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529493.257932:0:127526:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179009 -> diff = -50 00002000:02000040:1.0:1651529493.257943:0:127526:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:178960 to 0x0:179009 00002000:00010000:1.0:1651529493.259835:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259840:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 3/0,1 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259847:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259848:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259851:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259858:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259862:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259865:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259897:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259904:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001bf25d5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.259905:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259910:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 3/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259919:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 1/0,0 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259922:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf25d5b/0xa29a79078f3c17af lrc: 0/0,0 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259947:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259949:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 3/0,1 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259952:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259953:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259953:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259957:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259960:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259962:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259984:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259989:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044216735 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.259990:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259992:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 3/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259997:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 1/0,0 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259998:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.259999:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044216735/0xa29a79078f3c17b6 lrc: 0/0,0 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260000:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 3/0,1 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260003:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260004:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260005:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260008:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260011:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260014:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260053:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260055:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 3/0,1 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260059:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260059:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260060:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260065:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260070:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260072:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260093:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260097:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017268066 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260098:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260101:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 3/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260106:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 1/0,0 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260107:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260109:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 3/0,1 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260111:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017268066/0xa29a79078f3c17bd lrc: 0/0,0 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260112:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260113:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260114:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260116:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260117:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260118:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000061446d72 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260119:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260120:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260122:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260122:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 3/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260125:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 1/0,0 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260128:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061446d72/0xa29a79078f3c17c4 lrc: 0/0,0 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260138:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260140:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001edcc069 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260141:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260147:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 3/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260150:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 1/0,0 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260152:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260153:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 3/0,1 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260153:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edcc069/0xa29a79078f3c17cb lrc: 0/0,0 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260159:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260160:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260161:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260164:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260167:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260169:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260179:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260182:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6dda103 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260183:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260185:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 3/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260189:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 1/0,0 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260192:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6dda103/0xa29a79078f3c17d2 lrc: 0/0,0 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260196:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260197:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 3/0,1 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260200:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260201:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260202:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260205:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260208:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260213:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260222:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260225:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c28d57aa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260226:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260229:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 3/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260233:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 1/0,0 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260235:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28d57aa/0xa29a79078f3c17d9 lrc: 0/0,0 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260239:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260241:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 3/0,1 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260244:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260245:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260245:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260249:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260251:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260254:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260263:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260266:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a023b8c2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260266:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260269:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 3/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260272:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 1/0,0 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260278:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a023b8c2/0xa29a79078f3c17e0 lrc: 0/0,0 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260280:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260282:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 3/0,1 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260285:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260285:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260286:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260289:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260292:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260295:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260304:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260307:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb48a81e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260308:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260310:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 3/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260314:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 1/0,0 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260316:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb48a81e/0xa29a79078f3c17e7 lrc: 0/0,0 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260320:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260322:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 3/0,1 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260325:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260325:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260326:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260329:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260332:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260335:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260368:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260371:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000313829b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260372:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260377:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 3/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260382:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 1/0,0 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260384:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000313829b/0xa29a79078f3c17ee lrc: 0/0,0 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260387:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260388:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 3/0,1 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260392:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260393:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260393:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260397:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260400:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260402:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260412:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260415:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080006241 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260416:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260419:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 3/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260422:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 1/0,0 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260425:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080006241/0xa29a79078f3c17f5 lrc: 0/0,0 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260429:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260431:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 3/0,1 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260434:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260435:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260435:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260438:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260449:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260451:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260461:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260464:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c90bba11 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260465:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260468:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 3/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260471:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 1/0,0 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260474:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90bba11/0xa29a79078f3c17fc lrc: 0/0,0 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260479:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260480:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 3/0,1 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260484:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260484:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260485:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260488:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260490:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260493:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260502:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260505:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec101cd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260506:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260508:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 3/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260512:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 1/0,0 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260517:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec101cd/0xa29a79078f3c1803 lrc: 0/0,0 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260520:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260522:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 3/0,1 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260533:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260534:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260535:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260538:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260541:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260544:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260552:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260555:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021305674 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260556:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260559:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 3/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260563:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 1/0,0 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260565:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021305674/0xa29a79078f3c180a lrc: 0/0,0 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260571:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260573:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 3/0,1 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260576:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260576:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260577:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260580:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260583:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260588:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260597:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260600:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079f5db30 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260601:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260606:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 3/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260610:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 1/0,0 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260612:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f5db30/0xa29a79078f3c1811 lrc: 0/0,0 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260615:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260617:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 3/0,1 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260620:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260620:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260621:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260624:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260627:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260629:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260638:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260641:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f016294 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260642:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260645:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 3/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260648:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 1/0,0 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260651:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f016294/0xa29a79078f3c1818 lrc: 0/0,0 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260655:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260657:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 3/0,1 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260660:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260660:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260661:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260664:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260667:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260670:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260678:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260682:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000044c25a68 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260683:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260685:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 3/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260689:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 1/0,0 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260692:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c25a68/0xa29a79078f3c181f lrc: 0/0,0 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260695:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260696:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 3/0,1 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260699:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260700:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260701:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260704:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260707:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260709:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260720:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260723:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000580e7621 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260724:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260727:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 3/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260730:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 1/0,0 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260736:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580e7621/0xa29a79078f3c1826 lrc: 0/0,0 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260737:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260738:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 3/0,1 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260742:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260742:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260743:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260746:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260749:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260752:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260760:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260764:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdac3b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260764:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260767:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 3/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260771:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 1/0,0 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260773:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdac3b1/0xa29a79078f3c182d lrc: 0/0,0 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260777:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260779:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 3/0,1 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260782:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260783:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260783:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260786:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260789:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260792:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260801:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260827:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003044d8ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.260828:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260833:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 3/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260837:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 1/0,0 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260840:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003044d8ef/0xa29a79078f3c1834 lrc: 0/0,0 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260844:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260846:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 3/0,1 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260849:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260850:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260850:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260854:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260857:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260859:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260889:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260890:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 3/0,1 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260903:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260904:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260905:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260908:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260911:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260914:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260941:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260942:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 3/0,1 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260945:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260946:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260947:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260950:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260952:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260964:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260991:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260992:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 3/0,1 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260996:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260996:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260997:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261000:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261003:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261005:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261026:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261027:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 3/0,1 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261030:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261031:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529493.261034:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261038:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261039:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000962f47d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261040:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261041:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261043:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 3/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261044:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261047:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261048:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 1/0,0 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261051:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962f47d8/0xa29a79078f3c183b lrc: 0/0,0 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261055:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261059:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92e1902 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261060:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261062:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 3/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261065:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 1/0,0 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261068:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92e1902/0xa29a79078f3c1842 lrc: 0/0,0 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261070:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261071:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261072:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 3/0,1 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261074:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c3416be already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261074:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261075:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261075:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261076:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261077:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 3/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261079:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261080:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 1/0,0 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261082:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261084:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261085:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3416be/0xa29a79078f3c1849 lrc: 0/0,0 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261088:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261091:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000382fc22 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261092:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261094:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 3/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261097:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 1/0,0 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261100:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000382fc22/0xa29a79078f3c1850 lrc: 0/0,0 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261103:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261106:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000255305c8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261106:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261111:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 3/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261115:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261115:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 1/0,0 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261117:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 3/0,1 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261117:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255305c8/0xa29a79078f3c1857 lrc: 0/0,0 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261120:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261120:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529493.261120:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261121:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261123:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e24de61 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529493.261124:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261124:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261126:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 3/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261127:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261129:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261129:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 1/0,0 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261132:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e24de61/0xa29a79078f3c185e lrc: 0/0,0 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261135:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261138:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfa79ad3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261139:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261142:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 3/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261145:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 1/0,0 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261147:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfa79ad3/0xa29a79078f3c1865 lrc: 0/0,0 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261150:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261151:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 3/0,1 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261154:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261155:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261155:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261158:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261168:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261171:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261182:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261185:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f6d9bc0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261186:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261189:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 3/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261193:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 1/0,0 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261198:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261198:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6d9bc0/0xa29a79078f3c186c lrc: 0/0,0 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261199:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 3/0,1 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261202:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261203:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261204:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261207:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261210:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261212:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261222:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261225:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffaad856 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261226:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261229:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 3/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261232:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 1/0,0 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261235:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c1873 lrc: 0/0,0 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261239:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261241:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 3/0,1 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261252:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261253:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261254:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261257:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261260:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261262:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261271:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261274:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000278eaea9 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261275:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261280:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 3/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261284:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 1/0,0 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261286:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278eaea9/0xa29a79078f3c187a lrc: 0/0,0 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261289:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261291:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 3/0,1 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261294:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261294:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261295:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261298:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261301:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261312:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261321:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261324:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e79ca9ff already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261325:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261328:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 3/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261331:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 1/0,0 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261334:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e79ca9ff/0xa29a79078f3c1881 lrc: 0/0,0 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261339:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261341:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 3/0,1 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261344:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261344:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261345:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261349:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261351:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261354:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261363:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261366:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261367:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261370:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 3/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261374:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 1/0,0 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261376:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c1888 lrc: 0/0,0 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261379:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261380:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 3/0,1 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261384:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261384:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261391:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261395:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261398:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261401:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261410:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261413:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a493a1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261413:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261416:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 3/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261420:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 1/0,0 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261425:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a493a1/0xa29a79078f3c188f lrc: 0/0,0 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261427:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261428:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 3/0,1 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261431:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261432:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261432:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261436:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261439:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261441:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261453:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261456:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261456:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261459:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 3/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261463:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 1/0,0 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261465:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c1896 lrc: 0/0,0 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261467:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261468:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 3/0,1 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261472:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261472:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261473:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261476:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261479:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261481:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261490:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261493:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000372ca287 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261494:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261499:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 3/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261503:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 1/0,0 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261504:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261505:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372ca287/0xa29a79078f3c189d lrc: 0/0,0 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261506:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 3/0,1 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261509:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261510:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261510:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261514:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261517:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261519:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261528:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261531:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261532:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261534:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 3/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261538:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 1/0,0 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261541:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c18a4 lrc: 0/0,0 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261543:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261545:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 3/0,1 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261548:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261548:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261549:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261552:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261555:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261557:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261566:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261570:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261570:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261573:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 3/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261577:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 1/0,0 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261579:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c18ab lrc: 0/0,0 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261582:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261584:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 3/0,1 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261589:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261589:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261590:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261593:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261596:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261598:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261607:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261610:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261611:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261613:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 3/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261617:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 1/0,0 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261622:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261622:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c18b2 lrc: 0/0,0 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261624:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 3/0,1 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261627:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261627:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261628:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261631:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261634:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261638:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261647:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261650:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261651:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261654:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 3/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261658:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 1/0,0 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261660:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c18b9 lrc: 0/0,0 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261662:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261664:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 3/0,1 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261667:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261667:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261668:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261671:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261674:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261677:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261685:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261688:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e66e6d31 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261689:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261694:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 3/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261698:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 1/0,0 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261701:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261701:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e6d31/0xa29a79078f3c18c0 lrc: 0/0,0 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261702:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 3/0,1 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261706:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261706:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261713:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261717:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261720:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261723:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261732:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261735:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261736:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261738:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 3/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261742:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 1/0,0 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261745:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c18c7 lrc: 0/0,0 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261748:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261750:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 3/0,1 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261753:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261753:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261754:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261757:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261760:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261762:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261780:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261792:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064deda1c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261793:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261796:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 3/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261797:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261799:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 3/0,1 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261800:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 1/0,0 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261812:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064deda1c/0xa29a79078f3c18ce lrc: 0/0,0 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261814:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261814:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261815:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261826:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261829:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261832:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261842:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261845:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261846:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261849:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 3/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261853:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 1/0,0 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261860:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261862:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 3/0,1 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261864:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c18d5 lrc: 0/0,0 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261865:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261865:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261866:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261869:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261879:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261882:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261892:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261895:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261896:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261899:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 3/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261903:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 1/0,0 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261905:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c18dc lrc: 0/0,0 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261908:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261910:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 3/0,1 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261913:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261913:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261914:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261917:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261920:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261923:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261931:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261934:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261935:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261946:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 3/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261948:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261949:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 3/0,1 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261949:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 1/0,0 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261952:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c18e3 lrc: 0/0,0 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261961:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261961:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261962:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261965:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261968:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261971:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261980:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261983:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.261984:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261987:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 3/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261990:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 1/0,0 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261993:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c18ea lrc: 0/0,0 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261997:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261998:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 3/0,1 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262001:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262002:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262003:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262006:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262008:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262013:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262022:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262031:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.262032:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262034:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 3/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262038:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.262038:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 1/0,0 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262039:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 3/0,1 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262041:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c18f1 lrc: 0/0,0 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262042:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262043:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262044:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262047:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262050:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262052:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262061:0:130841:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262065:0:130841:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.262065:0:130841:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262068:0:130841:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 3/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262072:0:130841:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 1/0,0 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262076:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262077:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 3/0,1 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262080:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262081:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262081:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262083:0:130841:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c18f8 lrc: 0/0,0 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262085:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262087:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262090:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262099:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262102:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.262103:0:127518:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262105:0:127518:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 3/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262109:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 1/0,0 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262112:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c18ff lrc: 0/0,0 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262113:0:127526:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262114:0:127526:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 3/0,1 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262117:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262118:0:127526:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262118:0:127526:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262121:0:127526:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262124:0:127526:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262126:0:127526:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262138:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262141:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529493.262141:0:127519:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529493.262150:0:127526:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:178959 00010000:00010000:0.0:1651529493.262152:0:127519:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 3/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262156:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 1/0,0 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262158:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1906 lrc: 0/0,0 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 127526 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529493.262174:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:205177:x1731745946682112:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 4251us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.262177:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154671 00000100:00100000:1.0:1651529493.262397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529493.262405:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682176 00000100:00100000:1.0:1651529493.262418:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154672 00000100:00100000:1.0:1651529493.262420:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:205177:x1731745946682176:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529493.262430:0:127526:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 179010 00000100:00100000:1.0:1651529493.262927:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:205177:x1731745946682176:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 506us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.262930:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154672 10000000:01000000:0.0:1651529493.500836:0:127522:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1651529493.500848:0:127522:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8e16b538a000 from 205 10000000:01000000:0.0:1651529493.500850:0:127522:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651529493.500881:0:127522:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.500887:0:127522:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.500892:0:127522:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.500905:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722240:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.500942:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe65a760 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.501293:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722240:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529493.501309:0:127522:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.501313:0:127522:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.501369:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722304:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.501385:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe65a760 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.501614:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722304:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.501633:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722368:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.501656:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe65a760 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.501904:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722368:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529493.502252:0:173203:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:0.0:1651529493.502309:0:127522:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:0.0:1651529493.502318:0:127522:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651529493.502320:0:127522:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.502324:0:127522:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529493.502328:0:127522:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1651529493.502329:0:127522:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1651529493.502329:0:127522:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1651529493.502335:0:127522:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.502338:0:127522:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.502341:0:127522:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.502354:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722432:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.502367:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.502589:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722432:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529493.502594:0:127522:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.502597:0:127522:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.502612:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722496:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.502622:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.502850:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722496:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.502859:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722560:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.502871:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ae1f74ec going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.503347:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722560:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529493.503643:0:173204:0:(llog.c:768:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 8 00000020:01000000:0.0:1651529493.503675:0:127522:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-7 (rc=0) 10000000:01000000:0.0:1651529493.503680:0:127522:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1651529493.503682:0:127522:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.503686:0:127522:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529493.503699:0:127522:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651529493.503700:0:127522:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16b538a000 from 13 10000000:01000000:0.0:1651529493.503701:0:127522:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529493.503706:0:127522:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.503709:0:127522:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.503712:0:127522:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.503717:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722624:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.503729:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc78b1f going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.503951:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722624:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529493.503955:0:127522:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.503959:0:127522:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.503973:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722688:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.503982:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc78b1f going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.504168:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722688:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.504177:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722752:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.504188:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 000000001bc78b1f going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.504398:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722752:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529493.504680:0:173205:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 13 00000020:01000000:0.0:1651529493.504707:0:127522:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1651529493.504711:0:127522:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529493.504713:0:127522:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.504716:0:127522:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529493.504719:0:127522:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:0.0:1651529493.504720:0:127522:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff8e16ab2e4820 from 1 10000000:01000000:0.0:1651529493.504721:0:127522:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651529493.504726:0:127522:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.504729:0:127522:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.504732:0:127522:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.504737:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722816:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.504747:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fda8f271 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.504942:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722816:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529493.504947:0:127522:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.504950:0:127522:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.505035:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722880:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.505054:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000002cbe70 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.505475:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722880:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:0.0:1651529493.505927:0:127522:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0000: index object [0x200000003:0x13:0x0] (8/32) registered 10000000:01000000:0.0:1651529493.505991:0:127522:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651529493.505993:0:127522:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.505997:0:127522:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529493.506000:0:127522:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1651529493.506001:0:127522:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8e16ab2e4820 from 1 10000000:01000000:0.0:1651529493.506001:0:127522:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651529493.506007:0:127522:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.506010:0:127522:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.506013:0:127522:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.506018:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722944:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.506030:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe65a760 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.506226:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966722944:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529493.506230:0:127522:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.506243:0:127522:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.506257:0:127522:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966723008:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529493.506268:0:127522:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe65a760 going to sleep for 6 seconds 00000100:00100000:0.0:1651529493.506433:0:127522:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bcb1416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f56ada1-3627-4726-8ac3-1a2a89264ecf:127522:1731745966723008:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1651529493.506441:0:127522:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651529493.506442:0:127522:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.506445:0:127522:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529494.337539:0:173311:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529494.337541:0:173311:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm5.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000400:00000080:0.0:1651529494.652191:0:173365:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529494.652193:0:173365:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1651529495.264213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529495.264242:0:127528:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682304 00000100:00100000:1.0:1651529495.264263:0:127528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 335 00000100:00100000:1.0:1651529495.264266:0:127528:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946682304:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529495.264283:0:127528:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 81208983552 avail 77038272512 00000100:00100000:1.0:1651529495.264316:0:127528:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946682304:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529495.264320:0:127528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 335 00000100:00100000:0.0:1651529495.848231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529495.848270:0:127527:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397062208 00000100:00100000:1.0:1651529495.848295:0:127527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 336 00000100:00100000:1.0:1651529495.848298:0:127527:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434782:x1731746397062208:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529495.848311:0:127527:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 81208983552 avail 77038272512 00000100:00100000:1.0:1651529495.848349:0:127527:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434782:x1731746397062208:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529495.848353:0:127527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 336 00000100:00100000:0.0:1651529496.083505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529496.083536:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397062592 00000100:00100000:1.0:1651529496.083564:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154673 00000100:00100000:1.0:1651529496.083567:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434796:x1731746397062592:12345-10.240.43.64@tcp:9:umount.0 00000020:00000080:1.0:1651529496.083585:0:127526:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c17a8 00000100:00080000:1.0:1651529496.083589:0:127526:0:(import.c:85:import_set_state_nolock()) 00000000dd188e16 ýÒŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529496.083616:0:127526:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064895227 00000100:00100000:1.0:1651529496.083691:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+3:434796:x1731746397062592:12345-10.240.43.64@tcp:9:umount.0 Request processed in 123us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529496.083694:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154673 00000001:00100000:1.0:1651529496.192571:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192590:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:1.0:1651529496.192591:0:127511:0:(genops.c:985:class_export_put()) final put 000000006c1c5ea1/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192602:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:1.0:1651529496.192603:0:127511:0:(genops.c:985:class_export_put()) final put 00000000740eec44/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192605:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651529496.192624:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 000000006c1c5ea1/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 for lustre-OST0000 00000020:00000080:0.0:1651529496.192647:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000740eec44/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 for lustre-OST0000 00000020:00000080:0.0:1651529496.192696:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000dd188e16 for lustre-OST0000 00000020:00000080:0.0:1651529496.192698:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000706f2434 for lustre-OST0000 00000100:00100000:0.0:1651529496.492233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529496.492258:0:127526:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682816 00000100:00100000:1.0:1651529496.492280:0:127526:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 154674 00000100:00100000:1.0:1651529496.492283:0:127526:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:205981:x1731745946682816:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651529496.492295:0:127526:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c17a1 00000100:00080000:1.0:1651529496.492298:0:127526:0:(import.c:85:import_set_state_nolock()) 000000007b7c240b ýÒŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529496.492315:0:127526:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064895227 00000100:00100000:1.0:1651529496.492372:0:127526:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:205981:x1731745946682816:12345-10.240.43.61@tcp:9:umount.0 Request processed in 88us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529496.492375:0:127526:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 154674 00000001:00100000:1.0:1651529502.628632:0:127511:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529502.628634:0:127511:0:(genops.c:985:class_export_put()) final put 00000000d6c104de/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651529502.628659:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000d6c104de/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1651529502.628686:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000007b7c240b for lustre-OST0000 00000100:00100000:1.0:1651529516.732892:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723072:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529516.732897:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb128d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966723136:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00080000:0.0:1651529516.733192:0:39028:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1651529516.733194:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1651529516.733197:0:39028:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1651529516.736297:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529516.736300:0:39028:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 13091 00000100:00080000:0.0:1651529516.736303:0:39028:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000016ad0705 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529516.736313:0:39028:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005dc282c7 x1731745966723200/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529516.736327:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb128d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966723136:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529516.736342:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dc282c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966723200:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1651529516.739865:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651529516.739870:0:39026:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:1.0:1651529516.739872:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dc282c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966723200:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000020:01000004:1.0:1651529519.310263:0:173474:0:(obd_mount_server.c:1699:server_umount_begin()) umount -f 00000020:01000004:1.0:1651529519.313897:0:173474:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1651529519.313926:0:173474:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.313934:0:173474:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.313937:0:173474:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.313940:0:173474:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529519.313953:0:173474:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1651529519.313965:0:127518:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529519.313966:0:173474:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529519.313968:0:173474:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1651529519.313971:0:173474:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1651529519.313971:0:127518:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000edc3646f) 10000000:00010000:0.0:1651529519.313973:0:127518:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.313977:0:127518:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529519.313980:0:127518:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529519.313983:0:127518:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1651529519.313984:0:173474:0:(import.c:85:import_set_state_nolock()) 0000000016ad0705 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:01000000:0.0:1651529519.313984:0:127518:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:1.0:1651529519.313985:0:173474:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:0.0:1651529519.313985:0:127518:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1651529519.313986:0:173474:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1651529519.313987:0:173474:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00010000:00010000:0.0:1651529519.314006:0:127518:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.314009:0:127518:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1651529519.314021:0:127518:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.314024:0:127518:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c190d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ed9 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529519.314031:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529519.314042:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39028:1731745966723328:10.240.43.61@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529519.315723:0:173474:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315727:0:173474:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315730:0:173474:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315732:0:173474:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315744:0:173474:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315746:0:173474:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315749:0:173474:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.315751:0:173474:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315753:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529519.315757:0:173474:0:(mgc_request.c:544:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1651529519.315769:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000edc3646f) 00000020:01000004:1.0:1651529519.315770:0:173474:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-OST0000 10000000:00010000:0.0:1651529519.315770:0:127519:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315773:0:127519:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000020:01000000:1.0:1651529519.315775:0:173474:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:0.0:1651529519.315775:0:127519:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529519.315777:0:127519:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1651529519.315778:0:127519:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1651529519.315779:0:127519:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1651529519.315789:0:127519:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1651529519.315791:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1651529519.315792:0:127519:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1651529519.315796:0:173474:0:(obd_config.c:877:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/0 00010000:00010000:0.0:1651529519.315796:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1651529519.315798:0:173474:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (000000002d3518b9) has no exports 00010000:00010000:0.0:1651529519.315816:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c1914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee0 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315820:0:127519:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315823:0:127519:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000edc3646f) 10000000:00010000:0.0:1651529519.315824:0:127519:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315826:0:127519:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529519.315829:0:127519:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529519.315831:0:127519:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1651529519.315831:0:127519:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1651529519.315832:0:127519:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:0.0:1651529519.315844:0:127519:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315847:0:127519:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1651529519.315849:0:127519:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529519.315851:0:127519:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c191b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ee7 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529519.315860:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3b8ab07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723456:10.240.43.61@tcp:103:ldlm_bl_02.0 00000020:00080000:1.0:1651529519.315876:0:173474:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (000000002d3518b9) has no exports 00000100:00100000:0.0:1651529519.315884:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1651529519.315887:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5991ea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723392:10.240.43.61@tcp:103:ldlm_bl_02.0 00000020:01000000:1.0:1651529519.320657:0:173474:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 000000001701f335 - data 000000003f20e376/000000005aa73cbd 00000020:01000000:1.0:1651529519.320667:0:173474:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 0000000062b6e016 - data 00000000da24a250/0000000091a6b5d7 00000020:00020000:1.0:1651529519.320719:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328281:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328284:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328285:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328287:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328288:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529519.328290:0:173474:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00100000:10000000:1.0:1651529519.328451:0:173474:0:(lfsck_layout.c:764:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1651529519.350551:0:173474:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f2beb3d 00000020:00000080:1.0:1651529519.350554:0:173474:0:(genops.c:985:class_export_put()) final put 0000000097a4b9fb/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1651529519.350562:0:173474:0:(obd_mount_server.c:201:server_put_mount()) put mount 000000006c1e030e from lustre-OST0000, refs=2 00000020:01000004:1.0:1651529519.350571:0:173474:0:(obd_mount.c:668:lustre_put_lsi()) put 000000006c1e030e 2 00000020:01000004:1.0:1651529519.350572:0:173474:0:(obd_mount_server.c:135:server_deregister_mount()) deregister mount 000000006c1e030e from lustre-OST0000 00000020:00000080:1.0:1651529519.350590:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529519.350596:0:173474:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1651529519.350597:0:173474:0:(genops.c:985:class_export_put()) final put 00000000bc769de4/lustre-OST0000_UUID 00000020:00000080:1.0:1651529519.350598:0:173474:0:(genops.c:944:class_export_destroy()) destroying export 00000000bc769de4/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1651529519.350604:0:173474:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000000:1.0:1651529519.350664:0:173474:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1651529519.350665:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529519.350667:0:173474:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/2 00000020:00080000:1.0:1651529519.350669:0:173474:0:(genops.c:1752:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE 0000000091cb4538 lustre-MDT0000-lwp-OST0000 10.240.43.61@tcp 3 (0 0 0) 0 0 0 0: 0000000002beaa81 0 stale:0 00000020:00080000:1.0:1651529519.350672:0:173474:0:(genops.c:1525:class_disconnect_exports()) OBD device 4 (00000000433f472d) has exports, disconnecting them 00000020:00080000:1.0:1651529519.350673:0:173474:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 10.240.43.61@tcp (0000000091cb4538), last request at 1651527825 00000020:00000080:1.0:1651529519.350675:0:173474:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f2beb67 00000020:00080000:1.0:1651529519.350678:0:173474:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 10.240.43.61@tcp (0000000091cb4538): rc 0 00000020:00000080:1.0:1651529519.350688:0:173474:0:(genops.c:985:class_export_put()) final put 0000000091cb4538/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1651529519.350832:0:170153:0:(genops.c:944:class_export_destroy()) destroying export 0000000097a4b9fb/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1651529519.350841:0:170153:0:(genops.c:944:class_export_destroy()) destroying export 0000000091cb4538/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1651529519.351601:0:173474:0:(obd_class.h:647:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1651529519.351603:0:173474:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529519.351605:0:173474:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1651529519.351606:0:173474:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00000020:00000080:0.0:1651529519.351624:0:170153:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000016ad0705 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1651529519.351668:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529519.351669:0:173474:0:(obd_config.c:805:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1651529519.351670:0:173474:0:(genops.c:985:class_export_put()) final put 00000000ee218981/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1651529519.351671:0:173474:0:(genops.c:944:class_export_destroy()) destroying export 00000000ee218981/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1651529519.351673:0:173474:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1651529519.351682:0:173474:0:(obd_mount.c:926:lustre_common_put_super()) dropping sb 000000006c1e030e 00000100:00080000:1.0:1651529519.351689:0:173474:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import 4f56ada1-3627-4726-8ac3-1a2a89264ecf->MGS 00010000:00010000:1.0:1651529519.351695:0:173474:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529519.351699:0:173474:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529519.351702:0:173474:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1651529519.351703:0:173474:0:(mgc_request.c:1053:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1651529519.351704:0:173474:0:(mgc_request.c:153:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1651529519.351712:0:173474:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.351714:0:173474:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1651529519.351719:0:173474:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 0 seconds 00000100:00100000:1.0:1651529519.351723:0:173474:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd130bac pname:cluuid:pid:xid:nid:opc:job umount:4f56ada1-3627-4726-8ac3-1a2a89264ecf:173474:1731745966723520:10.240.43.61@tcp:103:umount.0 00010000:00010000:1.0:1651529519.351726:0:173474:0:(ldlm_request.c:1401:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:1.0:1651529519.351728:0:173474:0:(ldlm_request.c:2159:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:1.0:1651529519.351729:0:173474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1922 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5eee expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.351734:0:173474:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529519.351745:0:173474:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529519.351747:0:173474:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529519.351748:0:173474:0:(mgc_request.c:1053:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1651529519.351748:0:173474:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1651529519.351753:0:173474:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529519.351755:0:173474:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1651529519.351757:0:173474:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 0 seconds 00000100:00100000:1.0:1651529519.351758:0:173474:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd130bac pname:cluuid:pid:xid:nid:opc:job umount:4f56ada1-3627-4726-8ac3-1a2a89264ecf:173474:1731745966723584:10.240.43.61@tcp:103:umount.0 00010000:00010000:1.0:1651529519.351760:0:173474:0:(ldlm_request.c:1401:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:1.0:1651529519.351761:0:173474:0:(ldlm_request.c:2159:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:1.0:1651529519.351762:0:173474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c1929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ef5 expref: -99 pid: 127522 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529519.351768:0:173474:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1651529519.351771:0:173474:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd130bac pname:cluuid:pid:xid:nid:opc:job umount:4f56ada1-3627-4726-8ac3-1a2a89264ecf:173474:1731745966723648:10.240.43.61@tcp:251:umount.0 00000100:00100000:1.0:1651529519.351796:0:173474:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 5 seconds 00000100:00000400:0.0:1651529523.388943:0:39027:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529516/real 1651529516] req@000000001c302487 x1731745966723072/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529523 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00100000:0.0:1651529523.394555:0:39027:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=FULL (now=CONNECTING) req@000000001c302487 x1731745966723072/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529523 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00100000:0.0:1651529523.394563:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c302487 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723072:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529524.412851:0:173474:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 1 seconds 00000100:00000400:1.0:1651529525.436867:0:173474:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529519/real 1651529519] req@00000000dd130bac x1731745966723648/t0(0) o251->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529525 ref 2 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'umount.0' 00000100:00100000:1.0:1651529525.442285:0:173474:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000dd130bac x1731745966723648/t0(0) o251->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529525 ref 2 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'umount.0' 00000100:00100000:1.0:1651529525.442289:0:173474:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce3aca1a going to sleep for 0 seconds 00000100:00100000:1.0:1651529525.442292:0:173474:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd130bac pname:cluuid:pid:xid:nid:opc:job umount:4f56ada1-3627-4726-8ac3-1a2a89264ecf:173474:1731745966723648:10.240.43.61@tcp:251:umount.0 00000100:00080000:1.0:1651529525.442306:0:173474:0:(import.c:85:import_set_state_nolock()) 000000007b8a8aed MGS: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529525.442308:0:173474:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529525.442309:0:173474:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000008c9f0a92 x1731745966723328/t0(0) o103->MGC10.240.43.61@tcp@10.240.43.61@tcp:17/18 lens 328/224 e 0 to 0 dl 1651529526 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'ldlm_bl_01.0' 00000100:00100000:1.0:1651529525.442320:0:173474:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000b3b8ab07 x1731745966723456/t0(0) o103->MGC10.240.43.61@tcp@10.240.43.61@tcp:17/18 lens 328/224 e 0 to 0 dl 1651529526 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'ldlm_bl_02.0' 00000100:00100000:1.0:1651529525.442324:0:173474:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000f5991ea1 x1731745966723392/t0(0) o103->MGC10.240.43.61@tcp@10.240.43.61@tcp:17/18 lens 328/224 e 0 to 0 dl 1651529526 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'ldlm_bl_02.0' 10000000:01000000:1.0:1651529525.442327:0:173474:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529525.442328:0:173474:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1651529525.442339:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39028:1731745966723328:10.240.43.61@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529525.442342:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5991ea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723392:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529525.442354:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3b8ab07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f56ada1-3627-4726-8ac3-1a2a89264ecf:39027:1731745966723456:10.240.43.61@tcp:103:ldlm_bl_02.0 10000000:01000000:1.0:1651529525.442363:0:173474:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1651529525.442368:0:173474:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f2beb13 00000020:00000080:1.0:1651529525.442370:0:173474:0:(genops.c:985:class_export_put()) final put 000000001ce25792/4f56ada1-3627-4726-8ac3-1a2a89264ecf 00000020:01000000:1.0:1651529525.442379:0:173474:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of MGC10.240.43.61@tcp (flags='') 00000020:00000080:1.0:1651529525.442381:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529525.442383:0:173474:0:(obd_config.c:877:class_cleanup()) MGC10.240.43.61@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1651529525.442384:0:173474:0:(genops.c:1530:class_disconnect_exports()) OBD device 1 (000000003fd86c22) has no exports 10000000:01000000:0.0:1651529525.442395:0:127522:0:(mgc_request.c:704:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1651529525.442401:0:173474:0:(obd_class.h:647:obd_cleanup_client_import()) MGC10.240.43.61@tcp: client import never connected 00000100:00080000:1.0:1651529525.442402:0:173474:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1651529525.442402:0:173474:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529525.442403:0:173474:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651529525.442404:0:173474:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1651529525.442426:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529525.442427:0:173474:0:(obd_config.c:805:class_detach()) detach on obd MGC10.240.43.61@tcp (uuid 4f56ada1-3627-4726-8ac3-1a2a89264ecf) 00000020:00000080:1.0:1651529525.442430:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf006 00000020:00000080:1.0:1651529525.442430:0:173474:0:(obd_config.c:1377:class_process_config()) removing mappings for uuid MGC10.240.43.61@tcp_0 00000020:01000004:1.0:1651529525.442441:0:173474:0:(obd_mount.c:668:lustre_put_lsi()) put 000000006c1e030e 1 00000020:00000080:1.0:1651529525.442447:0:173474:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f2beb05 00000020:00000080:1.0:1651529525.442448:0:173474:0:(genops.c:985:class_export_put()) final put 0000000065913e4f/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1651529525.442449:0:173474:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1651529525.442450:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529525.442451:0:173474:0:(obd_config.c:877:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1651529525.442452:0:173474:0:(genops.c:1530:class_disconnect_exports()) OBD device 0 (00000000af78932b) has no exports 00000020:00000080:0.0:1651529525.442452:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 000000001ce25792/4f56ada1-3627-4726-8ac3-1a2a89264ecf for MGC10.240.43.61@tcp 00000020:00000080:0.0:1651529525.442456:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000007b8a8aed for MGC10.240.43.61@tcp 00000020:00000080:0.0:1651529525.442458:0:139617:0:(genops.c:985:class_export_put()) final put 0000000031c92e69/4f56ada1-3627-4726-8ac3-1a2a89264ecf 00000020:00000080:0.0:1651529525.442458:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 0000000031c92e69/4f56ada1-3627-4726-8ac3-1a2a89264ecf for MGC10.240.43.61@tcp 00000020:01000000:0.0:1651529525.442459:0:139617:0:(genops.c:447:class_free_dev()) finishing cleanup of obd MGC10.240.43.61@tcp (4f56ada1-3627-4726-8ac3-1a2a89264ecf) 00000100:00100000:0.0:1651529525.442880:0:127514:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_001: service thread [00000000c950e0b6:127514] 1 exiting: rc = 0 00000100:00100000:0.0:1651529525.442941:0:131770:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_002: service thread [00000000b7058dc9:131770] 2 exiting: rc = 0 00000100:00100000:0.0:1651529525.443140:0:127513:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_000: service thread [00000000dfd5db2f:127513] 0 exiting: rc = 1 00000100:00100000:0.0:1651529525.443218:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443225:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443446:0:127517:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_002: service thread [000000005f72e0a9:127517] 2 exiting: rc = 0 00000100:00100000:1.0:1651529525.443452:0:142556:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_003: service thread [00000000e72bb53d:142556] 3 exiting: rc = 0 00000100:00100000:0.0:1651529525.443518:0:127516:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_001: service thread [0000000061dda655:127516] 1 exiting: rc = 0 00000100:00100000:1.0:1651529525.443527:0:127515:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_000: service thread [00000000ba9dd0c8:127515] 0 exiting: rc = 1 00000100:00100000:0.0:1651529525.443588:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443591:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443593:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443595:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443598:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443600:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443603:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443605:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443607:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443609:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443611:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443614:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443616:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443619:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443621:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443624:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443626:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443629:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443631:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443633:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443635:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443638:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443640:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443642:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443644:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443646:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443649:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443651:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443653:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443656:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443658:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443660:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443662:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443665:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443667:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443669:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443672:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443674:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443677:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443679:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443681:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443683:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443685:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443688:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443689:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443691:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443693:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443696:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443698:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443700:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443702:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443704:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443707:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443709:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443711:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443713:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443715:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443718:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443726:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443729:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443731:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443733:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443735:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.443738:0:139617:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1651529525.443922:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529525.443924:0:173474:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1651529525.444240:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 0000000065913e4f/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1651529525.444242:0:139617:0:(genops.c:985:class_export_put()) final put 000000004bcba0dd/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1651529525.444243:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 000000004bcba0dd/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1651529525.444244:0:139617:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1651529525.446554:0:173474:0:(obd_mount.c:608:lustre_free_lsi()) Freeing lsi 00000000a0b186d3 00000020:01000000:1.0:1651529525.446581:0:173474:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1651529525.446583:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529525.446588:0:173474:0:(obd_config.c:877:class_cleanup()) OSS: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529525.446589:0:173474:0:(genops.c:1530:class_disconnect_exports()) OBD device 2 (0000000012670da7) has no exports 00000020:00000080:1.0:1651529525.446605:0:173474:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529525.446606:0:173474:0:(obd_config.c:805:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1651529525.446607:0:173474:0:(genops.c:985:class_export_put()) final put 00000000eb84f799/OSS_uuid 00000020:00000080:1.0:1651529525.446608:0:173474:0:(genops.c:944:class_export_destroy()) destroying export 00000000eb84f799/OSS_uuid for OSS 00000020:01000000:1.0:1651529525.446610:0:173474:0:(genops.c:447:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1651529525.446642:0:127536:0:(pinger.c:538:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1651529525.446663:0:142995:0:(service.c:2915:ptlrpc_main()) ll_ost00_006: service thread [000000007db26792:142995] 6 exiting: rc = 0 00000100:00100000:1.0:1651529525.446699:0:127526:0:(service.c:2915:ptlrpc_main()) ll_ost00_002: service thread [0000000083531485:127526] 2 exiting: rc = 0 00000100:00100000:0.0:1651529525.446711:0:161133:0:(service.c:2915:ptlrpc_main()) ll_ost00_010: service thread [000000000f5089a5:161133] 10 exiting: rc = 0 00000100:00100000:1.0:1651529525.446740:0:142994:0:(service.c:2915:ptlrpc_main()) ll_ost00_005: service thread [00000000531af22c:142994] 5 exiting: rc = 0 00000100:00100000:0.0:1651529525.446754:0:142996:0:(service.c:2915:ptlrpc_main()) ll_ost00_007: service thread [000000001c3b5a9b:142996] 7 exiting: rc = 0 00000100:00100000:1.0:1651529525.446784:0:127523:0:(service.c:2915:ptlrpc_main()) ll_ost00_000: service thread [00000000a162cdde:127523] 0 exiting: rc = 1 00000100:00100000:0.0:1651529525.446799:0:128009:0:(service.c:2915:ptlrpc_main()) ll_ost00_003: service thread [00000000817b57ad:128009] 3 exiting: rc = 0 00000100:00100000:1.0:1651529525.446844:0:127525:0:(service.c:2915:ptlrpc_main()) ll_ost00_001: service thread [0000000055c0f771:127525] 1 exiting: rc = 0 00000100:00100000:0.0:1651529525.446859:0:142993:0:(service.c:2915:ptlrpc_main()) ll_ost00_004: service thread [00000000221d902d:142993] 4 exiting: rc = 0 00000100:00100000:1.0:1651529525.446884:0:144528:0:(service.c:2915:ptlrpc_main()) ll_ost00_009: service thread [00000000f552789c:144528] 9 exiting: rc = 0 00000100:00100000:1.0:1651529525.446931:0:144527:0:(service.c:2915:ptlrpc_main()) ll_ost00_008: service thread [0000000066e4a5f5:144527] 8 exiting: rc = 0 00000100:00100000:1.0:1651529525.447095:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447098:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447100:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447102:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447104:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447106:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447114:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447116:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447118:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447120:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447123:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447125:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447128:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447130:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447132:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447135:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447137:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447140:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447142:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447145:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447147:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447149:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447152:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447154:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447156:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447158:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447160:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447162:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447164:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447166:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447168:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447170:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447173:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447175:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447177:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447179:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447181:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447183:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447185:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447187:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447190:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447192:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447194:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447197:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447199:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447201:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447203:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447206:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447208:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447210:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447215:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447218:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447220:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447222:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447224:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447227:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447229:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447232:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447234:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447236:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447239:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447241:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447244:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.447246:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.448854:0:127528:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_001: service thread [00000000551bf774:127528] 1 exiting: rc = 0 00000100:00100000:1.0:1651529525.448909:0:127527:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_000: service thread [00000000caac4608:127527] 0 exiting: rc = 1 00000100:00100000:1.0:1651529525.449010:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449017:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449027:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449033:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449041:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449043:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449045:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449051:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449053:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449059:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449062:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449069:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449075:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449077:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449084:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449090:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449096:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449098:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449104:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449110:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449116:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449119:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449125:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449127:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449132:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449134:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449136:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449138:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449140:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449142:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449149:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449155:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449161:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449167:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449174:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449180:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449182:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449184:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449190:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449192:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449198:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449200:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449202:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449204:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449206:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449208:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449214:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449221:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449227:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449233:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449235:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449242:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449248:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449250:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449251:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449253:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449259:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449261:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449267:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449269:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449271:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449273:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449279:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.449281:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.452637:0:144088:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_010: service thread [000000008fa16b53:144088] 10 exiting: rc = 0 00000100:00100000:0.0:1651529525.452697:0:144087:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_009: service thread [0000000024d620dd:144087] 9 exiting: rc = 0 00000100:00100000:1.0:1651529525.453754:0:144086:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_008: service thread [00000000f9fadbf7:144086] 8 exiting: rc = 0 00000100:00100000:0.0:1651529525.453774:0:144085:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_007: service thread [0000000020c381c8:144085] 7 exiting: rc = 0 00000100:00100000:1.0:1651529525.454793:0:144084:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_006: service thread [00000000852f9483:144084] 6 exiting: rc = 0 00000100:00100000:0.0:1651529525.454816:0:127531:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_002: service thread [00000000ff1f10d1:127531] 2 exiting: rc = 0 00000100:00100000:0.0:1651529525.455843:0:141357:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_004: service thread [00000000166b2725:141357] 4 exiting: rc = 0 00000100:00100000:1.0:1651529525.455873:0:127529:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_000: service thread [00000000be055447:127529] 0 exiting: rc = 1 00000100:00100000:0.0:1651529525.456889:0:144083:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_005: service thread [000000008f7c96e9:144083] 5 exiting: rc = 0 00000100:00100000:1.0:1651529525.456934:0:127530:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_001: service thread [00000000a6f1a7f8:127530] 1 exiting: rc = 0 00000100:00100000:0.0:1651529525.457945:0:144089:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_011: service thread [000000003ddbdd69:144089] 11 exiting: rc = 0 00000100:00100000:1.0:1651529525.457996:0:132211:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_003: service thread [000000007cd957d6:132211] 3 exiting: rc = 0 00000100:00100000:1.0:1651529525.458168:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458171:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458183:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458190:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458193:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458199:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458202:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458204:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458211:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458217:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458224:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458230:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458236:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458243:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458249:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458259:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458261:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458269:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458279:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458285:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458292:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458295:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458297:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458299:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458306:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458312:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458319:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458329:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458336:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458350:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458353:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458356:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458362:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458365:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458371:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458373:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458376:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458378:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458380:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458382:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458389:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458395:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458401:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458408:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458410:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458416:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458422:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458428:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458435:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458437:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458439:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458441:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458443:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458445:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458447:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458449:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458451:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458453:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458459:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458461:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458468:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458470:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458472:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.458474:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.492482:0:127532:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_000: service thread [00000000f7877d8b:127532] 0 exiting: rc = 1 00000100:00100000:1.0:1651529525.492550:0:127533:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_001: service thread [000000006366b01a:127533] 1 exiting: rc = 0 00000100:00100000:0.0:1651529525.492645:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492654:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492656:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492658:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492660:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492662:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492668:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492670:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492672:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492674:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492681:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492687:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492693:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492699:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492701:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492707:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492713:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492719:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492725:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492727:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492729:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492731:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492734:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492736:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492738:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492740:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492747:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492753:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492759:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492765:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492767:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492769:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492775:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492777:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492783:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492785:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492791:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492793:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492799:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492801:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492813:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492816:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492823:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492832:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492847:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492853:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492860:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492866:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492872:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492874:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492880:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492883:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492885:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492887:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492888:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492891:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492893:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492895:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492902:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492909:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492911:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492917:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492923:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.492930:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529525.495221:0:127534:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_000: service thread [00000000cda4c0ef:127534] 0 exiting: rc = 1 00000100:00100000:0.0:1651529525.495232:0:127535:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_001: service thread [00000000e2df16e3:127535] 1 exiting: rc = 0 00000100:00100000:0.0:1651529525.495299:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495309:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495317:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495326:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495332:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495339:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495345:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495352:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495358:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495364:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495376:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495386:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495395:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495409:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495418:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495435:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495448:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495457:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495467:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495474:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495480:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495486:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495494:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495500:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495507:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495513:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495523:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495532:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495542:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495548:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495558:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495568:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495574:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495580:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495591:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495601:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495607:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495617:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495624:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495630:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495636:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495643:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495653:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495662:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495672:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495682:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495689:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495699:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495709:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495718:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495728:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495734:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495740:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495747:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495753:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495759:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495766:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495772:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495784:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495793:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495799:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495830:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495846:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529525.495856:0:173474:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1651529525.562771:0:173474:0:(obd_mount_server.c:1687:server_put_super()) server umount lustre-OST0000 complete 00000400:00000100:0.0:1651529536.984305:0:39022:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946683776 offset 0 length 520: 4 00000080:01200004:0.0:1651529541.819362:0:174484:0:(super25.c:114:lustre_fill_super()) VFS Op: sb 00000000c0f4914e 00000020:01000004:0.0:1651529541.819388:0:174484:0:(obd_mount.c:952:lmd_print()) mount data: 00000020:01000004:0.0:1651529541.819389:0:174484:0:(obd_mount.c:955:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1651529541.819390:0:174484:0:(obd_mount.c:956:lmd_print()) flags: 0 00000020:01000004:0.0:1651529541.819390:0:174484:0:(obd_mount.c:959:lmd_print()) options: errors=remount-ro 00000020:01000004:0.0:1651529541.819401:0:174484:0:(obd_mount_server.c:1916:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1651529541.819433:0:174484:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1651529541.819435:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529541.819442:0:174484:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0000-osd (00000000af78932b) 00000020:00000080:0.0:1651529541.819472:0:174484:0:(obd_config.c:648:class_attach()) OBD: dev 0 attached type osd-ldiskfs with refcount 1 00000020:00000080:0.0:1651529541.819474:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00100000:10000000:0.0:1651529541.846329:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1651529541.846744:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1651529541.846825:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1651529541.846977:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1651529541.847053:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1651529541.847129:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1651529541.847209:0:174484:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1651529541.847823:0:174484:0:(osd_lproc.c:834:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1651529541.847901:0:174484:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1651529541.847904:0:174484:0:(osd_handler.c:8440:osd_obd_connect()) connect #0 00000020:00000080:0.0:1651529541.847910:0:174484:0:(genops.c:1359:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa29a79078f3c1937 00000020:01000004:0.0:1651529541.847913:0:174484:0:(obd_mount_server.c:1999:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1651529541.847973:0:174484:0:(obd_mount.c:340:lustre_start_mgc()) Start MGC 'MGC10.240.43.61@tcp' 00000020:01000004:0.0:1651529541.847974:0:174484:0:(obd_mount.c:347:lustre_start_mgc()) mgs NIDs 10.240.43.61@tcp. 00000020:00000080:0.0:1651529541.847976:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1651529541.847978:0:174484:0:(obd_config.c:1368:class_process_config()) adding mapping from uuid MGC10.240.43.61@tcp_0 to nid 0x200000af02b3d (10.240.43.61@tcp) 00000020:01000004:0.0:1651529541.847993:0:174484:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD MGC10.240.43.61@tcp (typ=mgc) 00000020:00000080:0.0:1651529541.847994:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529541.847998:0:174484:0:(genops.c:417:class_newdev()) Allocate new device MGC10.240.43.61@tcp (000000003fd86c22) 00000020:00000080:0.0:1651529541.848027:0:174484:0:(obd_config.c:648:class_attach()) OBD: dev 1 attached type mgc with refcount 1 00000020:00000080:0.0:1651529541.848028:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1651529541.848102:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1651529541.848167:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 40 00000100:00100000:0.0:1651529541.848174:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1651529541.848279:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 40 00000100:00100000:0.0:1651529541.848281:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1651529541.848839:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.848890:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 40 00000100:00100000:0.0:1651529541.848892:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1651529541.849054:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 40 00000100:00100000:0.0:1651529541.849056:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1651529541.849266:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 40 00000100:00100000:0.0:1651529541.849268:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00080000:0.0:1651529541.850342:0:174484:0:(ldlm_lib.c:115:import_set_conn()) imp 0000000050241750@MGC10.240.43.61@tcp: add connection MGC10.240.43.61@tcp_0 at head 00010000:00010000:0.0:1651529541.850387:0:174484:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-MGC10.240.43.61@tcp-0 is initialized 00000040:01000000:0.0:1651529541.850398:0:174484:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 1 is initialized 10000000:01000000:1.0:1651529541.851779:0:174496:0:(mgc_request.c:628:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1651529541.851888:0:174484:0:(obd_config.c:752:class_setup()) finished setup of obd MGC10.240.43.61@tcp (uuid 047aa495-7059-4dea-a0a8-a98005327d33) 00000020:00000080:0.0:1651529541.851910:0:174484:0:(genops.c:1359:class_connect()) connect: client 047aa495-7059-4dea-a0a8-a98005327d33, cookie 0xa29a79078f3c1945 00000100:00080000:0.0:1651529541.851915:0:174484:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:0.0:1651529541.851917:0:174484:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 0000000050241750 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:0.0:1651529541.851935:0:174484:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008c9f0a92 x1731745966723712/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651529541.851951:0:174484:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import 047aa495-7059-4dea-a0a8-a98005327d33->MGS 00000020:01000004:0.0:1651529541.851964:0:174484:0:(obd_mount_server.c:1354:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1651529541.851989:0:174484:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1651529541.851991:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529541.851999:0:174484:0:(genops.c:417:class_newdev()) Allocate new device OSS (0000000012670da7) 00000020:00000080:0.0:1651529541.852028:0:174484:0:(obd_config.c:648:class_attach()) OBD: dev 2 attached type ost with refcount 1 00000020:00000080:0.0:1651529541.852029:0:174484:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529541.852081:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:047aa495-7059-4dea-a0a8-a98005327d33:39026:1731745966723712:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:0.0:1651529541.852694:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.852743:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 0 min 3 max 80 00000100:00100000:0.0:1651529541.852745:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1651529541.853115:0:39026:0:(client.c:2892:ptlrpc_free_committed()) MGC10.240.43.61@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1651529541.853119:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 00000100:00080000:1.0:1651529541.853122:0:39026:0:(import.c:933:ptlrpc_connect_set_flags()) MGC10.240.43.61@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002020 10000000:01000000:1.0:1651529541.853124:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1651529541.853125:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000050241750 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1651529541.853127:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651529541.853130:0:39026:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1651529541.853132:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:047aa495-7059-4dea-a0a8-a98005327d33:39026:1731745966723712:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:0.0:1651529541.854219:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 1 min 3 max 80 00000100:00100000:0.0:1651529541.854223:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1651529541.854634:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 2 min 3 max 80 00000100:00100000:0.0:1651529541.854637:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1651529541.855921:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.855959:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529541.855961:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1651529541.856346:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529541.856348:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1651529541.864343:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.864448:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 80 00000100:00100000:0.0:1651529541.864450:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1651529541.865739:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 80 00000100:00100000:0.0:1651529541.865742:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1651529541.866327:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 80 00000100:00100000:0.0:1651529541.866329:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1651529541.867450:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.867496:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529541.867497:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1651529541.867925:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529541.867928:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1651529541.880860:0:174484:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529541.880946:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529541.880948:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1651529541.881771:0:174484:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529541.881774:0:174484:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1651529541.882251:0:174484:0:(obd_config.c:752:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1651529541.882270:0:174484:0:(obd_mount_server.c:294:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 00000100:00080000:1.0:1651529541.882478:0:174511:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:0.0:1651529541.883496:0:174484:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 0 is initialized 00000020:01000004:0.0:1651529541.883505:0:174484:0:(obd_mount_server.c:1245:server_register_target()) Registration lustre-OST0000, fs=lustre, 10.240.43.62@tcp, index=0000, flags=0x2 10000000:01000000:0.0:1651529541.883515:0:174484:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0000 0x10000002 10000000:01000000:0.0:1651529541.883528:0:174484:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1651529541.883537:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723776:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:0.0:1651529541.883573:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000000ba4db76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.898527:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723776:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:0.0:1651529541.898532:0:174484:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1651529541.898546:0:174484:0:(obd_mount_server.c:116:server_register_mount()) register mount 00000000c0f4914e from lustre-OST0000 10000000:01000000:0.0:1651529541.898549:0:174484:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1651529541.898550:0:174484:0:(mgc_request.c:334:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1651529541.898552:0:174484:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e16ab2e4820 10000000:01000000:0.0:1651529541.898554:0:174484:0:(mgc_request.c:90:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529541.898556:0:174484:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8e16ab2e4820 from 1 10000000:01000000:0.0:1651529541.898558:0:174484:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651529541.898570:0:174484:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.898575:0:174484:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.898580:0:174484:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.898585:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723840:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529541.898603:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2399cc4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.898836:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723840:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529541.898843:0:174484:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.898857:0:174484:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.898879:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723904:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529541.898896:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2399cc4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.899104:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723904:10.240.43.61@tcp:501:mount.lustre.0 10000000:01000000:0.0:1651529541.899115:0:174484:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651529541.899117:0:174484:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.899120:0:174484:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529541.899123:0:174484:0:(mgc_request.c:215:do_config_log_add()) do adding config log nodemap-ffff8e16ab2e4820 10000000:01000000:0.0:1651529541.899125:0:174484:0:(mgc_request.c:90:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1651529541.899126:0:174484:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff8e16ab2e4820 from 1 10000000:01000000:0.0:1651529541.899127:0:174484:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651529541.899131:0:174484:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.899134:0:174484:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.899137:0:174484:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.899141:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723968:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529541.899157:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2399cc4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.899359:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966723968:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529541.899364:0:174484:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.899367:0:174484:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.899512:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724032:10.240.43.61@tcp:256:mount.lustre.0 00000100:00100000:0.0:1651529541.899531:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000be539c74 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.900032:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724032:10.240.43.61@tcp:256:mount.lustre.0 10000000:01000000:0.0:1651529541.900118:0:174484:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651529541.900120:0:174484:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.900123:0:174484:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529541.900126:0:174484:0:(mgc_request.c:215:do_config_log_add()) do adding config log params-ffff8e16bbdd6800 10000000:01000000:0.0:1651529541.900128:0:174484:0:(mgc_request.c:90:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1651529541.900129:0:174484:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1651529541.900130:0:174484:0:(mgc_request.c:90:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529541.900131:0:174484:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1651529541.900132:0:174484:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1651529541.900137:0:174484:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.900140:0:174484:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.900143:0:174484:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.900148:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724096:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529541.900161:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000be539c74 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.900372:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724096:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529541.900377:0:174484:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.900380:0:174484:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1651529541.901589:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1651529541.907222:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:0.0:1651529541.907233:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 128 off8544 00000040:00080000:0.0:1651529541.907238:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 112 off8656 00000040:00080000:0.0:1651529541.907242:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8880 00000040:00080000:0.0:1651529541.907246:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9104 00000040:00080000:0.0:1651529541.907250:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9224 00000040:00080000:0.0:1651529541.907257:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 224 off9448 00000040:00080000:0.0:1651529541.907259:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x24:10:0 index 8 count 8 00000100:00100000:0.0:1651529541.907272:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724160:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529541.907287:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000be539c74 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.907513:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724160:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529541.907523:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724224:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:0.0:1651529541.907539:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000be539c74 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.908011:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724224:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:0.0:1651529541.908173:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1651529541.908189:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724288:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529541.908205:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b99682e1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.908531:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724288:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529541.908616:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:0.0:1651529541.908625:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 128 off8544 00000040:00080000:0.0:1651529541.908629:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 112 off8656 00000040:00080000:0.0:1651529541.908633:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8880 00000040:00080000:0.0:1651529541.908638:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9104 00000040:00080000:0.0:1651529541.908642:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9224 00000100:00100000:0.0:1651529541.908649:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724352:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529541.908664:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b99682e1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.908886:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724352:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529541.908902:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 224 off9448 00000040:00080000:0.0:1651529541.908904:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x8:10:0 index 8 count 8 00000020:01000000:0.0:1651529541.909055:0:174512:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1651529541.909058:0:174512:0:(obd_mount.c:991:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1651529541.909065:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529541.909066:0:174512:0:(obd_config.c:1432:class_process_config()) marker 8 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1651529541.909068:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529541.909073:0:174512:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0000 (00000000433f472d) 00000020:00000080:0.0:1651529541.909105:0:174512:0:(obd_config.c:648:class_attach()) OBD: dev 3 attached type obdfilter with refcount 1 00000020:00000080:0.0:1651529541.909107:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1651529541.909136:0:174512:0:(obd_mount_server.c:167:server_get_mount()) get mount 00000000c0f4914e from lustre-OST0000, refs=2 00080000:01000000:0.0:1651529541.909139:0:174512:0:(osd_handler.c:8440:osd_obd_connect()) connect #1 00000020:00000080:0.0:1651529541.909142:0:174512:0:(genops.c:1359:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa29a79078f3c196f 00010000:00010000:0.0:1651529541.913781:0:174512:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-0 is initialized 00000001:00000004:0.0:1651529541.913926:0:174512:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 30064895227 00080000:10000000:0.0:1651529541.914437:0:174512:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0000: index object [0x200000003:0x14:0x0] (8/32) registered 00000020:00000080:0.0:1651529541.916350:0:174512:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1651529541.916352:0:174512:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529541.916354:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529541.916355:0:174512:0:(obd_config.c:1432:class_process_config()) marker 8 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1651529541.916357:0:174512:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529541.916358:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529541.916359:0:174512:0:(obd_config.c:1432:class_process_config()) marker 15 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1651529541.916360:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1651529541.916367:0:174512:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529541.916368:0:174512:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529541.916368:0:174512:0:(obd_config.c:1432:class_process_config()) marker 15 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1651529541.916369:0:174512:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2a:10:0 index 8 count 8 00000020:01000000:0.0:1651529541.916402:0:174484:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1651529541.916410:0:174484:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1651529541.916412:0:174484:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.916416:0:174484:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529541.916420:0:174484:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16bbdd6800 from 1 10000000:01000000:0.0:1651529541.916421:0:174484:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529541.916428:0:174484:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.916431:0:174484:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.916434:0:174484:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.916441:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724416:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529541.916456:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ab65b2f going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.916679:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724416:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529541.916684:0:174484:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.916688:0:174484:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1651529541.916945:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1651529541.917073:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:0.0:1651529541.917086:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:0.0:1651529541.917092:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:0.0:1651529541.917094:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x26:10:0 index 4 count 4 00000100:00100000:0.0:1651529541.917105:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724480:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529541.917118:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ab65b2f going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.917324:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724480:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529541.917334:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724544:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:0.0:1651529541.917349:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ab65b2f going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.917564:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724544:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:0.0:1651529541.917644:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1651529541.917652:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724608:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529541.917666:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ab65b2f going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.917880:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724608:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529541.917927:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:0.0:1651529541.917934:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:0.0:1651529541.917938:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:0.0:1651529541.917942:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:0.0:1651529541.917946:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000040:00080000:0.0:1651529541.917950:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:0.0:1651529541.917955:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 224 off9536 00000040:00080000:0.0:1651529541.917959:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 112 off9648 00000040:00080000:0.0:1651529541.917963:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9872 00000040:00080000:0.0:1651529541.917967:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10096 00000040:00080000:0.0:1651529541.917970:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 112 off10208 00000100:00100000:0.0:1651529541.917977:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724672:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529541.917991:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ab65b2f going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.918189:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724672:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529541.918204:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 224 off10432 00000040:00080000:0.0:1651529541.918206:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 13 count 13 00000020:01000000:1.0:1651529541.918575:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529541.918578:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.918579:0:174515:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1651529541.918581:0:174515:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e16bbdd6800 00000020:00000080:1.0:1651529541.918582:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:1.0:1651529541.920930:0:174515:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2344us 00000020:01000000:1.0:1651529541.920934:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529541.920936:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.920937:0:174515:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1651529541.920938:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529541.920939:0:174515:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1651529541.920939:0:174515:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529541.920940:0:174515:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529541.920941:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529541.920941:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.920942:0:174515:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529541.920943:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529541.920944:0:174515:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1651529541.920944:0:174515:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529541.920945:0:174515:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529541.920945:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529541.920946:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.920946:0:174515:0:(obd_config.c:1432:class_process_config()) marker 3 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529541.920947:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529541.920948:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.920949:0:174515:0:(obd_config.c:1432:class_process_config()) marker 4 (0x1) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529541.920950:0:174515:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e16bbdd6800 00000020:00000080:1.0:1651529541.920951:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1651529541.920972:0:174515:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529541.920973:0:174515:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529541.920974:0:174515:0:(obd_config.c:1432:class_process_config()) marker 4 (0x2) lustre osc.lustre*.checksums 00000040:00080000:1.0:1651529541.920975:0:174515:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2c:10:0 index 13 count 13 00000020:01000000:0.0:1651529541.921003:0:174484:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1651529541.921012:0:174484:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529541.921014:0:174484:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.921019:0:174484:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529541.921025:0:174484:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1651529541.921026:0:174484:0:(mgc_request.c:334:config_log_add()) add config log lustre-client-ffff8e16bbdd6800 10000000:01000000:0.0:1651529541.921027:0:174484:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-client-ffff8e16bbdd6800 10000000:01000000:0.0:1651529541.921028:0:174484:0:(mgc_request.c:90:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529541.921030:0:174484:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8e16bbdd6800 from 1 10000000:01000000:0.0:1651529541.921030:0:174484:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651529541.921045:0:174484:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.921048:0:174484:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.921052:0:174484:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529541.921058:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724736:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529541.921072:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b99682e1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.921736:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724736:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529541.921742:0:174484:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529541.921747:0:174484:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529541.922033:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529541.940581:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:1.0:1651529541.940591:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 120 off8536 00000040:00080000:1.0:1651529541.940595:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 168 off8704 00000040:00080000:1.0:1651529541.940599:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8928 00000040:00080000:1.0:1651529541.940603:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 224 off9152 00000040:00080000:1.0:1651529541.940608:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 120 off9272 00000040:00080000:1.0:1651529541.940612:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 168 off9440 00000040:00080000:1.0:1651529541.940616:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 224 off9664 00000040:00080000:1.0:1651529541.940621:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:1.0:1651529541.940624:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 88 off9976 00000040:00080000:1.0:1651529541.940628:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 128 off10104 00000040:00080000:1.0:1651529541.940632:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 144 off10248 00000040:00080000:1.0:1651529541.940636:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].13, 160 off10408 00000040:00080000:1.0:1651529541.940640:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].14, 224 off10632 00000040:00080000:1.0:1651529541.940644:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].15, 224 off10856 00000040:00080000:1.0:1651529541.940648:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].16, 120 off10976 00000040:00080000:1.0:1651529541.940652:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].17, 224 off11200 00000040:00080000:1.0:1651529541.940656:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].18, 224 off11424 00000040:00080000:1.0:1651529541.940659:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].19, 88 off11512 00000040:00080000:1.0:1651529541.940663:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].20, 128 off11640 00000040:00080000:1.0:1651529541.940667:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].21, 144 off11784 00000040:00080000:1.0:1651529541.940671:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].22, 128 off11912 00000040:00080000:1.0:1651529541.940675:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].23, 224 off12136 00000040:00080000:1.0:1651529541.940696:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].24, 224 off12360 00000040:00080000:1.0:1651529541.940702:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].25, 88 off12448 00000040:00080000:1.0:1651529541.940706:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].26, 128 off12576 00000040:00080000:1.0:1651529541.940710:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].27, 144 off12720 00000040:00080000:1.0:1651529541.940714:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].28, 128 off12848 00000040:00080000:1.0:1651529541.940719:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].29, 224 off13072 00000040:00080000:1.0:1651529541.940723:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].30, 224 off13296 00000040:00080000:1.0:1651529541.940727:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].31, 120 off13416 00000040:00080000:1.0:1651529541.940731:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].32, 224 off13640 00000040:00080000:1.0:1651529541.940734:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].33, 224 off13864 00000040:00080000:1.0:1651529541.940738:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].34, 112 off13976 00000040:00080000:1.0:1651529541.940742:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].35, 224 off14200 00000040:00080000:1.0:1651529541.940746:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].36, 224 off14424 00000040:00080000:1.0:1651529541.940750:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].37, 136 off14560 00000040:00080000:1.0:1651529541.940754:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].38, 224 off14784 00000040:00080000:1.0:1651529541.940757:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].39, 224 off15008 00000040:00080000:1.0:1651529541.940761:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].40, 136 off15144 00000040:00080000:1.0:1651529541.940765:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].41, 224 off15368 00000040:00080000:1.0:1651529541.940769:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].42, 224 off15592 00000040:00080000:1.0:1651529541.940772:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].43, 112 off15704 00000040:00080000:1.0:1651529541.940776:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].44, 224 off15928 00000040:00080000:1.0:1651529541.940780:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].45, 224 off16152 00000040:00080000:1.0:1651529541.940784:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].46, 112 off16264 00000040:00080000:1.0:1651529541.940987:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].48, 224 off16608 00000040:00080000:1.0:1651529541.940994:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].49, 224 off16832 00000040:00080000:1.0:1651529541.940998:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].50, 136 off16968 00000040:00080000:1.0:1651529541.941002:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].51, 224 off17192 00000040:00080000:1.0:1651529541.941006:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].52, 224 off17416 00000040:00080000:1.0:1651529541.941010:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].53, 136 off17552 00000040:00080000:1.0:1651529541.941015:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].54, 224 off17776 00000040:00080000:1.0:1651529541.941019:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].55, 224 off18000 00000040:00080000:1.0:1651529541.941022:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].56, 136 off18136 00000040:00080000:1.0:1651529541.941037:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].57, 224 off18360 00000040:00080000:1.0:1651529541.941041:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].58, 224 off18584 00000040:00080000:1.0:1651529541.941045:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].59, 136 off18720 00000040:00080000:1.0:1651529541.941049:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].60, 224 off18944 00000040:00080000:1.0:1651529541.941053:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].61, 224 off19168 00000040:00080000:1.0:1651529541.941057:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].62, 112 off19280 00000040:00080000:1.0:1651529541.941060:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].63, 224 off19504 00000040:00080000:1.0:1651529541.941064:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].64, 224 off19728 00000040:00080000:1.0:1651529541.941068:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].65, 112 off19840 00000040:00080000:1.0:1651529541.941071:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].66, 224 off20064 00000040:00080000:1.0:1651529541.941075:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].67, 224 off20288 00000040:00080000:1.0:1651529541.941080:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].68, 136 off20424 00000040:00080000:1.0:1651529541.941102:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].69, 224 off20648 00000040:00080000:1.0:1651529541.941108:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].70, 224 off20872 00000040:00080000:1.0:1651529541.941112:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].71, 136 off21008 00000040:00080000:1.0:1651529541.941116:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].72, 224 off21232 00000040:00080000:1.0:1651529541.941120:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].73, 224 off21456 00000040:00080000:1.0:1651529541.941123:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].74, 112 off21568 00000040:00080000:1.0:1651529541.941127:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].75, 224 off21792 00000040:00080000:1.0:1651529541.941131:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].76, 224 off22016 00000040:00080000:1.0:1651529541.941134:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].77, 112 off22128 00000040:00080000:1.0:1651529541.941138:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].78, 224 off22352 00000040:00080000:1.0:1651529541.941142:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].79, 224 off22576 00000040:00080000:1.0:1651529541.941146:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].80, 136 off22712 00000040:00080000:1.0:1651529541.941149:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].81, 224 off22936 00000040:00080000:1.0:1651529541.941153:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].82, 224 off23160 00000040:00080000:1.0:1651529541.941157:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].83, 136 off23296 00000040:00080000:1.0:1651529541.941161:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].84, 224 off23520 00000040:00080000:1.0:1651529541.941165:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].85, 224 off23744 00000040:00080000:1.0:1651529541.941169:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].86, 112 off23856 00000040:00080000:1.0:1651529541.941173:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].87, 224 off24080 00000040:00080000:1.0:1651529541.941176:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].88, 224 off24304 00000040:00080000:1.0:1651529541.941189:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].89, 112 off24416 00000040:00080000:1.0:1651529541.941391:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].91, 224 off24800 00000040:00080000:1.0:1651529541.941398:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].92, 224 off25024 00000040:00080000:1.0:1651529541.941403:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].93, 112 off25136 00000040:00080000:1.0:1651529541.941406:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].94, 224 off25360 00000040:00080000:1.0:1651529541.941410:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].95, 224 off25584 00000040:00080000:1.0:1651529541.941414:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].96, 112 off25696 00000040:00080000:1.0:1651529541.941418:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].97, 224 off25920 00000040:00080000:1.0:1651529541.941422:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].98, 224 off26144 00000040:00080000:1.0:1651529541.941426:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].99, 136 off26280 00000040:00080000:1.0:1651529541.941430:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].100, 224 off26504 00000040:00080000:1.0:1651529541.941434:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].101, 224 off26728 00000040:00080000:1.0:1651529541.941438:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].102, 136 off26864 00000040:00080000:1.0:1651529541.941442:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].103, 224 off27088 00000040:00080000:1.0:1651529541.941446:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].104, 224 off27312 00000040:00080000:1.0:1651529541.941450:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].105, 136 off27448 00000040:00080000:1.0:1651529541.941453:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].106, 224 off27672 00000040:00080000:1.0:1651529541.941457:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].107, 224 off27896 00000040:00080000:1.0:1651529541.941461:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].108, 136 off28032 00000040:00080000:1.0:1651529541.941465:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].109, 224 off28256 00000040:00080000:1.0:1651529541.941469:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].110, 224 off28480 00000040:00080000:1.0:1651529541.941472:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].111, 112 off28592 00000040:00080000:1.0:1651529541.941493:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].112, 224 off28816 00000040:00080000:1.0:1651529541.941499:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].113, 224 off29040 00000040:00080000:1.0:1651529541.941504:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].114, 112 off29152 00000040:00080000:1.0:1651529541.941508:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].115, 224 off29376 00000040:00080000:1.0:1651529541.941512:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].116, 224 off29600 00000040:00080000:1.0:1651529541.941516:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].117, 136 off29736 00000040:00080000:1.0:1651529541.941520:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].118, 224 off29960 00000040:00080000:1.0:1651529541.941524:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].119, 224 off30184 00000040:00080000:1.0:1651529541.941527:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].120, 136 off30320 00000040:00080000:1.0:1651529541.941531:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].121, 224 off30544 00000040:00080000:1.0:1651529541.941545:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].122, 224 off30768 00000040:00080000:1.0:1651529541.941550:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].123, 112 off30880 00000040:00080000:1.0:1651529541.941554:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].124, 224 off31104 00000040:00080000:1.0:1651529541.941558:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].125, 224 off31328 00000040:00080000:1.0:1651529541.941562:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].126, 112 off31440 00000040:00080000:1.0:1651529541.941565:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].127, 224 off31664 00000040:00080000:1.0:1651529541.941569:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].128, 224 off31888 00000040:00080000:1.0:1651529541.941573:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].129, 136 off32024 00000040:00080000:1.0:1651529541.941576:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].130, 224 off32248 00000040:00080000:1.0:1651529541.941581:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].131, 224 off32472 00000040:00080000:1.0:1651529541.941584:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].132, 112 off32584 00000040:00080000:1.0:1651529541.941763:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].134, 224 off32992 00000040:00080000:1.0:1651529541.941770:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].135, 224 off33216 00000040:00080000:1.0:1651529541.941774:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].136, 136 off33352 00000040:00080000:1.0:1651529541.941779:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].137, 224 off33576 00000040:00080000:1.0:1651529541.941782:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].138, 224 off33800 00000040:00080000:1.0:1651529541.941786:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].139, 112 off33912 00000040:00080000:1.0:1651529541.941790:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].140, 224 off34136 00000040:00080000:1.0:1651529541.941794:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].141, 224 off34360 00000040:00080000:1.0:1651529541.941798:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].142, 136 off34496 00000040:00080000:1.0:1651529541.941801:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].143, 224 off34720 00000040:00080000:1.0:1651529541.941821:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].144, 224 off34944 00000040:00080000:1.0:1651529541.941825:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].145, 136 off35080 00000040:00080000:1.0:1651529541.941829:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].146, 224 off35304 00000040:00080000:1.0:1651529541.941833:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].147, 224 off35528 00000040:00080000:1.0:1651529541.941837:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].148, 136 off35664 00000040:00080000:1.0:1651529541.941841:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].149, 224 off35888 00000040:00080000:1.0:1651529541.941855:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].150, 224 off36112 00000040:00080000:1.0:1651529541.941860:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].151, 112 off36224 00000040:00080000:1.0:1651529541.941864:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].152, 224 off36448 00000040:00080000:1.0:1651529541.941868:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].153, 224 off36672 00000040:00080000:1.0:1651529541.941872:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].154, 136 off36808 00000040:00080000:1.0:1651529541.941905:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].155, 224 off37032 00000040:00080000:1.0:1651529541.941911:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].156, 224 off37256 00000040:00080000:1.0:1651529541.941915:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].157, 112 off37368 00000040:00080000:1.0:1651529541.941919:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].158, 224 off37592 00000040:00080000:1.0:1651529541.941923:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].159, 224 off37816 00000040:00080000:1.0:1651529541.941927:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].160, 136 off37952 00000040:00080000:1.0:1651529541.941931:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].161, 224 off38176 00000040:00080000:1.0:1651529541.941935:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].162, 224 off38400 00000040:00080000:1.0:1651529541.941939:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].163, 136 off38536 00000040:00080000:1.0:1651529541.941943:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].164, 224 off38760 00000040:00080000:1.0:1651529541.941947:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].165, 224 off38984 00000040:00080000:1.0:1651529541.941951:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].166, 112 off39096 00000040:00080000:1.0:1651529541.941955:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].167, 224 off39320 00000040:00080000:1.0:1651529541.941958:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].168, 224 off39544 00000040:00080000:1.0:1651529541.941962:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].169, 112 off39656 00000040:00080000:1.0:1651529541.941966:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].170, 224 off39880 00000040:00080000:1.0:1651529541.941969:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].171, 224 off40104 00000040:00080000:1.0:1651529541.941973:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].172, 136 off40240 00000040:00080000:1.0:1651529541.941977:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].173, 224 off40464 00000040:00080000:1.0:1651529541.941981:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].174, 224 off40688 00000040:00080000:1.0:1651529541.941984:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].175, 136 off40824 00000040:00080000:1.0:1651529541.942098:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].177, 224 off41184 00000040:00080000:1.0:1651529541.942105:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].178, 224 off41408 00000040:00080000:1.0:1651529541.942110:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].179, 136 off41544 00000040:00080000:1.0:1651529541.942114:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].180, 224 off41768 00000040:00080000:1.0:1651529541.942118:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].181, 224 off41992 00000040:00080000:1.0:1651529541.942121:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].182, 136 off42128 00000040:00080000:1.0:1651529541.942125:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].183, 224 off42352 00000040:00080000:1.0:1651529541.942129:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].184, 224 off42576 00000040:00080000:1.0:1651529541.942133:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].185, 112 off42688 00000040:00080000:1.0:1651529541.942139:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2d:0x0].186, 224 off42912 00000040:00080000:1.0:1651529541.942140:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x28:10:0 index 187 count 183 00000100:00100000:1.0:1651529541.942163:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724800:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529541.942183:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.942406:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724800:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529541.942417:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724864:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529541.942435:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.942662:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724864:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529541.942770:0:174484:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529541.942779:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724928:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.942800:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.943050:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724928:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.943117:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:1.0:1651529541.943125:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 120 off8536 00000040:00080000:1.0:1651529541.943129:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 168 off8704 00000040:00080000:1.0:1651529541.943133:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8928 00000040:00080000:1.0:1651529541.943138:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 224 off9152 00000040:00080000:1.0:1651529541.943142:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 120 off9272 00000040:00080000:1.0:1651529541.943147:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 168 off9440 00000040:00080000:1.0:1651529541.943151:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 224 off9664 00000040:00080000:1.0:1651529541.943155:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:1.0:1651529541.943159:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 88 off9976 00000040:00080000:1.0:1651529541.943163:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 128 off10104 00000040:00080000:1.0:1651529541.943167:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 144 off10248 00000040:00080000:1.0:1651529541.943170:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].13, 160 off10408 00000040:00080000:1.0:1651529541.943176:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].14, 224 off10632 00000040:00080000:1.0:1651529541.943180:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].15, 224 off10856 00000040:00080000:1.0:1651529541.943184:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].16, 120 off10976 00000040:00080000:1.0:1651529541.943200:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].17, 224 off11200 00000040:00080000:1.0:1651529541.943204:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].18, 224 off11424 00000040:00080000:1.0:1651529541.943208:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].19, 88 off11512 00000040:00080000:1.0:1651529541.943211:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].20, 128 off11640 00000040:00080000:1.0:1651529541.943215:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].21, 144 off11784 00000040:00080000:1.0:1651529541.943219:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].22, 128 off11912 00000040:00080000:1.0:1651529541.943222:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].23, 224 off12136 00000040:00080000:1.0:1651529541.943244:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].24, 224 off12360 00000040:00080000:1.0:1651529541.943250:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].25, 88 off12448 00000040:00080000:1.0:1651529541.943254:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].26, 128 off12576 00000040:00080000:1.0:1651529541.943258:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].27, 144 off12720 00000040:00080000:1.0:1651529541.943262:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].28, 128 off12848 00000040:00080000:1.0:1651529541.943267:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].29, 224 off13072 00000040:00080000:1.0:1651529541.943270:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].30, 224 off13296 00000040:00080000:1.0:1651529541.943274:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].31, 120 off13416 00000040:00080000:1.0:1651529541.943278:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].32, 224 off13640 00000040:00080000:1.0:1651529541.943282:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].33, 224 off13864 00000040:00080000:1.0:1651529541.943286:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].34, 112 off13976 00000040:00080000:1.0:1651529541.943289:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].35, 224 off14200 00000040:00080000:1.0:1651529541.943293:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].36, 224 off14424 00000040:00080000:1.0:1651529541.943297:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].37, 136 off14560 00000040:00080000:1.0:1651529541.943300:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].38, 224 off14784 00000040:00080000:1.0:1651529541.943304:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].39, 224 off15008 00000040:00080000:1.0:1651529541.943308:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].40, 136 off15144 00000040:00080000:1.0:1651529541.943311:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].41, 224 off15368 00000040:00080000:1.0:1651529541.943315:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].42, 224 off15592 00000040:00080000:1.0:1651529541.943319:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].43, 112 off15704 00000040:00080000:1.0:1651529541.943323:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].44, 224 off15928 00000040:00080000:1.0:1651529541.943327:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].45, 224 off16152 00000040:00080000:1.0:1651529541.943331:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].46, 112 off16264 00000100:00100000:1.0:1651529541.943338:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724992:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.943358:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.943568:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966724992:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.943603:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].48, 224 off16608 00000040:00080000:1.0:1651529541.943610:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].49, 224 off16832 00000040:00080000:1.0:1651529541.943614:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].50, 136 off16968 00000040:00080000:1.0:1651529541.943618:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].51, 224 off17192 00000040:00080000:1.0:1651529541.943622:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].52, 224 off17416 00000040:00080000:1.0:1651529541.943626:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].53, 136 off17552 00000040:00080000:1.0:1651529541.943630:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].54, 224 off17776 00000040:00080000:1.0:1651529541.943634:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].55, 224 off18000 00000040:00080000:1.0:1651529541.943637:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].56, 136 off18136 00000040:00080000:1.0:1651529541.943641:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].57, 224 off18360 00000040:00080000:1.0:1651529541.943645:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].58, 224 off18584 00000040:00080000:1.0:1651529541.943649:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].59, 136 off18720 00000040:00080000:1.0:1651529541.943653:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].60, 224 off18944 00000040:00080000:1.0:1651529541.943656:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].61, 224 off19168 00000040:00080000:1.0:1651529541.943661:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].62, 112 off19280 00000040:00080000:1.0:1651529541.943664:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].63, 224 off19504 00000040:00080000:1.0:1651529541.943668:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].64, 224 off19728 00000040:00080000:1.0:1651529541.943672:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].65, 112 off19840 00000040:00080000:1.0:1651529541.943676:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].66, 224 off20064 00000040:00080000:1.0:1651529541.943680:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].67, 224 off20288 00000040:00080000:1.0:1651529541.943683:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].68, 136 off20424 00000040:00080000:1.0:1651529541.943703:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].69, 224 off20648 00000040:00080000:1.0:1651529541.943709:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].70, 224 off20872 00000040:00080000:1.0:1651529541.943713:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].71, 136 off21008 00000040:00080000:1.0:1651529541.943717:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].72, 224 off21232 00000040:00080000:1.0:1651529541.943721:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].73, 224 off21456 00000040:00080000:1.0:1651529541.943725:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].74, 112 off21568 00000040:00080000:1.0:1651529541.943729:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].75, 224 off21792 00000040:00080000:1.0:1651529541.943733:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].76, 224 off22016 00000040:00080000:1.0:1651529541.943737:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].77, 112 off22128 00000040:00080000:1.0:1651529541.943752:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].78, 224 off22352 00000040:00080000:1.0:1651529541.943756:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].79, 224 off22576 00000040:00080000:1.0:1651529541.943760:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].80, 136 off22712 00000040:00080000:1.0:1651529541.943764:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].81, 224 off22936 00000040:00080000:1.0:1651529541.943767:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].82, 224 off23160 00000040:00080000:1.0:1651529541.943771:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].83, 136 off23296 00000040:00080000:1.0:1651529541.943775:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].84, 224 off23520 00000040:00080000:1.0:1651529541.943779:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].85, 224 off23744 00000040:00080000:1.0:1651529541.943782:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].86, 112 off23856 00000040:00080000:1.0:1651529541.943786:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].87, 224 off24080 00000040:00080000:1.0:1651529541.943790:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].88, 224 off24304 00000040:00080000:1.0:1651529541.943794:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].89, 112 off24416 00000100:00100000:1.0:1651529541.943801:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725056:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.943832:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.944061:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725056:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.944097:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].91, 224 off24800 00000040:00080000:1.0:1651529541.944104:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].92, 224 off25024 00000040:00080000:1.0:1651529541.944108:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].93, 112 off25136 00000040:00080000:1.0:1651529541.944112:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].94, 224 off25360 00000040:00080000:1.0:1651529541.944116:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].95, 224 off25584 00000040:00080000:1.0:1651529541.944120:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].96, 112 off25696 00000040:00080000:1.0:1651529541.944124:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].97, 224 off25920 00000040:00080000:1.0:1651529541.944128:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].98, 224 off26144 00000040:00080000:1.0:1651529541.944131:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].99, 136 off26280 00000040:00080000:1.0:1651529541.944135:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].100, 224 off26504 00000040:00080000:1.0:1651529541.944139:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].101, 224 off26728 00000040:00080000:1.0:1651529541.944142:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].102, 136 off26864 00000040:00080000:1.0:1651529541.944147:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].103, 224 off27088 00000040:00080000:1.0:1651529541.944151:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].104, 224 off27312 00000040:00080000:1.0:1651529541.944155:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].105, 136 off27448 00000040:00080000:1.0:1651529541.944170:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].106, 224 off27672 00000040:00080000:1.0:1651529541.944174:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].107, 224 off27896 00000040:00080000:1.0:1651529541.944178:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].108, 136 off28032 00000040:00080000:1.0:1651529541.944182:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].109, 224 off28256 00000040:00080000:1.0:1651529541.944186:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].110, 224 off28480 00000040:00080000:1.0:1651529541.944190:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].111, 112 off28592 00000040:00080000:1.0:1651529541.944212:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].112, 224 off28816 00000040:00080000:1.0:1651529541.944218:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].113, 224 off29040 00000040:00080000:1.0:1651529541.944223:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].114, 112 off29152 00000040:00080000:1.0:1651529541.944227:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].115, 224 off29376 00000040:00080000:1.0:1651529541.944231:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].116, 224 off29600 00000040:00080000:1.0:1651529541.944234:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].117, 136 off29736 00000040:00080000:1.0:1651529541.944238:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].118, 224 off29960 00000040:00080000:1.0:1651529541.944242:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].119, 224 off30184 00000040:00080000:1.0:1651529541.944246:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].120, 136 off30320 00000040:00080000:1.0:1651529541.944250:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].121, 224 off30544 00000040:00080000:1.0:1651529541.944253:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].122, 224 off30768 00000040:00080000:1.0:1651529541.944257:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].123, 112 off30880 00000040:00080000:1.0:1651529541.944261:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].124, 224 off31104 00000040:00080000:1.0:1651529541.944265:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].125, 224 off31328 00000040:00080000:1.0:1651529541.944269:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].126, 112 off31440 00000040:00080000:1.0:1651529541.944273:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].127, 224 off31664 00000040:00080000:1.0:1651529541.944277:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].128, 224 off31888 00000040:00080000:1.0:1651529541.944281:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].129, 136 off32024 00000040:00080000:1.0:1651529541.944285:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].130, 224 off32248 00000040:00080000:1.0:1651529541.944289:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].131, 224 off32472 00000040:00080000:1.0:1651529541.944293:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].132, 112 off32584 00000100:00100000:1.0:1651529541.944300:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725120:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.944319:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.944523:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725120:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.944567:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].134, 224 off32992 00000040:00080000:1.0:1651529541.944574:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].135, 224 off33216 00000040:00080000:1.0:1651529541.944578:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].136, 136 off33352 00000040:00080000:1.0:1651529541.944582:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].137, 224 off33576 00000040:00080000:1.0:1651529541.944586:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].138, 224 off33800 00000040:00080000:1.0:1651529541.944589:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].139, 112 off33912 00000040:00080000:1.0:1651529541.944593:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].140, 224 off34136 00000040:00080000:1.0:1651529541.944597:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].141, 224 off34360 00000040:00080000:1.0:1651529541.944601:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].142, 136 off34496 00000040:00080000:1.0:1651529541.944606:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].143, 224 off34720 00000040:00080000:1.0:1651529541.944610:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].144, 224 off34944 00000040:00080000:1.0:1651529541.944613:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].145, 136 off35080 00000040:00080000:1.0:1651529541.944617:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].146, 224 off35304 00000040:00080000:1.0:1651529541.944621:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].147, 224 off35528 00000040:00080000:1.0:1651529541.944625:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].148, 136 off35664 00000040:00080000:1.0:1651529541.944629:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].149, 224 off35888 00000040:00080000:1.0:1651529541.944632:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].150, 224 off36112 00000040:00080000:1.0:1651529541.944636:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].151, 112 off36224 00000040:00080000:1.0:1651529541.944640:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].152, 224 off36448 00000040:00080000:1.0:1651529541.944643:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].153, 224 off36672 00000040:00080000:1.0:1651529541.944647:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].154, 136 off36808 00000040:00080000:1.0:1651529541.944668:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].155, 224 off37032 00000040:00080000:1.0:1651529541.944674:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].156, 224 off37256 00000040:00080000:1.0:1651529541.944678:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].157, 112 off37368 00000040:00080000:1.0:1651529541.944682:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].158, 224 off37592 00000040:00080000:1.0:1651529541.944686:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].159, 224 off37816 00000040:00080000:1.0:1651529541.944689:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].160, 136 off37952 00000040:00080000:1.0:1651529541.944696:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].161, 224 off38176 00000040:00080000:1.0:1651529541.944700:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].162, 224 off38400 00000040:00080000:1.0:1651529541.944704:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].163, 136 off38536 00000040:00080000:1.0:1651529541.944707:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].164, 224 off38760 00000040:00080000:1.0:1651529541.944720:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].165, 224 off38984 00000040:00080000:1.0:1651529541.944724:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].166, 112 off39096 00000040:00080000:1.0:1651529541.944728:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].167, 224 off39320 00000040:00080000:1.0:1651529541.944732:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].168, 224 off39544 00000040:00080000:1.0:1651529541.944735:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].169, 112 off39656 00000040:00080000:1.0:1651529541.944739:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].170, 224 off39880 00000040:00080000:1.0:1651529541.944743:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].171, 224 off40104 00000040:00080000:1.0:1651529541.944746:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].172, 136 off40240 00000040:00080000:1.0:1651529541.944750:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].173, 224 off40464 00000040:00080000:1.0:1651529541.944753:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].174, 224 off40688 00000040:00080000:1.0:1651529541.944757:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].175, 136 off40824 00000100:00100000:1.0:1651529541.944764:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725184:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.944782:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.945006:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725184:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.945042:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].177, 224 off41184 00000040:00080000:1.0:1651529541.945062:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].178, 224 off41408 00000040:00080000:1.0:1651529541.945066:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].179, 136 off41544 00000040:00080000:1.0:1651529541.945070:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].180, 224 off41768 00000040:00080000:1.0:1651529541.945074:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].181, 224 off41992 00000040:00080000:1.0:1651529541.945078:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].182, 136 off42128 00000040:00080000:1.0:1651529541.945082:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].183, 224 off42352 00000040:00080000:1.0:1651529541.945085:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].184, 224 off42576 00000040:00080000:1.0:1651529541.945089:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].185, 112 off42688 00000040:00080000:1.0:1651529541.945093:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].186, 224 off42912 00000040:00080000:1.0:1651529541.945096:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].187, 224 off43136 00000040:00080000:1.0:1651529541.945100:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].188, 112 off43248 00000040:00080000:1.0:1651529541.945104:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].189, 224 off43472 00000040:00080000:1.0:1651529541.945107:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].190, 224 off43696 00000040:00080000:1.0:1651529541.945111:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].191, 136 off43832 00000040:00080000:1.0:1651529541.945115:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].192, 224 off44056 00000040:00080000:1.0:1651529541.945125:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].193, 224 off44280 00000040:00080000:1.0:1651529541.945137:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].194, 136 off44416 00000040:00080000:1.0:1651529541.945141:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].195, 224 off44640 00000040:00080000:1.0:1651529541.945145:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].196, 224 off44864 00000040:00080000:1.0:1651529541.945149:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].197, 136 off45000 00000040:00080000:1.0:1651529541.945171:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].198, 224 off45224 00000040:00080000:1.0:1651529541.945177:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].199, 224 off45448 00000040:00080000:1.0:1651529541.945181:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].200, 136 off45584 00000040:00080000:1.0:1651529541.945185:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].201, 224 off45808 00000040:00080000:1.0:1651529541.945189:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].202, 224 off46032 00000040:00080000:1.0:1651529541.945193:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].203, 112 off46144 00000100:00100000:1.0:1651529541.945200:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725248:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529541.945219:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ec66518 going to sleep for 6 seconds 00000100:00100000:1.0:1651529541.945425:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000065a6ca6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725248:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529541.945438:0:174484:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2e:0x0].204, 224 off46368 00000040:00080000:1.0:1651529541.945441:0:174484:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 205 count 201 00000020:01000004:0.0:1651529541.945648:0:174519:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1651529541.945650:0:174519:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529541.945659:0:174519:0:(genops.c:417:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (00000000f2874c42) 00000020:00000080:0.0:1651529541.945688:0:174519:0:(obd_config.c:648:class_attach()) OBD: dev 4 attached type lwp with refcount 1 00000020:00000080:0.0:1651529541.945690:0:174519:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00010000:00080000:0.0:1651529541.945746:0:174519:0:(ldlm_lib.c:115:import_set_conn()) imp 0000000061c4bb06@lustre-MDT0000-lwp-OST0000: add connection 10.240.43.61@tcp at head 00010000:00010000:0.0:1651529541.947656:0:174519:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-1 is initialized 00000020:00000080:0.0:1651529541.947675:0:174519:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1651529541.947692:0:174519:0:(lwp_dev.c:495:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1651529541.947696:0:174519:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa29a79078f3c198b 00000100:00080000:0.0:1651529541.947699:0:174519:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:0.0:1651529541.947701:0:174519:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000061c4bb06 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529541.947710:0:174519:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090d075b5 x1731745966725312/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651529541.947721:0:174519:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1651529541.947801:0:174519:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2e:10:0 index 205 count 201 00000020:01000000:0.0:1651529541.947892:0:174484:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 1-204 (rc=0) 10000000:01000000:0.0:1651529541.947901:0:174484:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651529541.947903:0:174484:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529541.947907:0:174484:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529541.947915:0:174484:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0000 0x40000002 10000000:01000000:0.0:1651529541.947921:0:174484:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1651529541.947925:0:174484:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725376:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:0.0:1651529541.947940:0:174484:0:(client.c:2492:ptlrpc_set_wait()) set 000000000ba4db76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529541.948074:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090d075b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966725312:10.240.43.61@tcp:38:llog_process_th.0 00010000:00080000:0.0:1651529541.948390:0:39026:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@0000000090d075b5 x1731745966725312/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529546 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'llog_process_th.0' 00000100:00100000:0.0:1651529541.948395:0:39026:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1651529541.948397:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:0.0:1651529541.948400:0:39026:0:(import.c:933:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1651529541.948401:0:39026:0:(import.c:1158:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1651529541.948402:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000061c4bb06 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1651529541.948404:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090d075b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966725312:10.240.43.61@tcp:38:llog_process_th.0 00000100:00100000:0.0:1651529541.998830:0:174484:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:047aa495-7059-4dea-a0a8-a98005327d33:174484:1731745966725376:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:0.0:1651529541.998835:0:174484:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:02000000:0.0:1651529541.998838:0:174484:0:(obd_mount_server.c:2104:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 300-900 00000001:00000004:0.0:1651529542.001412:0:174484:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738368 00002000:00080000:0.0:1651529542.063978:0:174484:0:(ofd_obd.c:544:ofd_postrecov()) lustre-OST0000: recovery is over 00000020:01000004:0.0:1651529542.063995:0:174484:0:(obd_mount_server.c:312:server_mgc_clear_fs()) Unassign mgc disk 00000020:01000004:0.0:1651529542.064009:0:174484:0:(obd_mount_server.c:1875:server_fill_super_common()) Server sb, dev=51 00000080:00000004:0.0:1651529542.064014:0:174484:0:(super25.c:179:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:1.0:1651529542.369439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529542.369458:0:174501:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946685760 00000100:00100000:1.0:1651529542.369470:0:174501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529542.369473:0:174501:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:39028:x1731745946685760:12345-10.240.43.61@tcp:8:kworker/u4:2.0 00010000:00080000:1.0:1651529542.369485:0:174501:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000002beaa81 cur 13142 last 0 00000020:00000080:1.0:1651529542.369496:0:174501:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa29a79078f3c1992 00002000:00100000:1.0:1651529542.369500:0:174501:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/0000000061587afd ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1651529542.369502:0:174501:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1651529542.369503:0:174501:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651529542.369531:0:174501:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 000000009c1f9b58 00002000:00080000:1.0:1651529542.369543:0:174501:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529542.369555:0:174501:0:(import.c:85:import_set_state_nolock()) 0000000014207b18 .«Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529542.369585:0:174501:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946685760:12345-10.240.43.61@tcp:8:kworker/u4:2.0 Request processed in 111us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529542.369588:0:174501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529542.370263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529542.370274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529542.370286:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946685952 00000100:00100000:1.0:1651529542.370296:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529542.370298:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946685952:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529542.370305:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 81208983552 avail 77038272512 00000100:00100000:1.0:1651529542.370323:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946685952:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529542.370326:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529542.370336:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686016 00000100:00100000:1.0:1651529542.370342:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529542.370344:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:207094:x1731745946686016:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529542.371145:0:174500:0:(ofd_fs.c:445:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1651529542.371148:0:174500:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179041 -> diff = -82 00002000:02000040:1.0:1651529542.371150:0:174500:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:178960 to 0x0:179041 00002000:00010000:1.0:1651529542.373233:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.373236:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 3/0,1 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373244:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.373245:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.373247:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373257:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373261:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373264:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373974:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373979:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.373980:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373984:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 3/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.373992:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 1/0,0 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374008:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1999 lrc: 0/0,0 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.374029:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.374031:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 3/0,1 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374035:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374035:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374036:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374040:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374043:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374046:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374112:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374118:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.374120:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374124:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 3/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374132:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 1/0,0 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374141:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c19a0 lrc: 0/0,0 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.374350:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.374352:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 3/0,1 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374356:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374357:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374358:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374362:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374365:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374368:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374424:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374428:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.374429:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374435:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 3/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374440:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 1/0,0 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374443:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c19a7 lrc: 0/0,0 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.374618:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.374620:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 3/0,1 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374624:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374625:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374626:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374630:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374632:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374635:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374693:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374697:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.374698:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374701:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 3/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374706:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 1/0,0 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374708:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c19ae lrc: 0/0,0 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.374875:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.374878:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 3/0,1 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374882:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374882:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.374883:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374887:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374892:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374895:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374948:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374952:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.374953:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374956:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 3/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374961:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 1/0,0 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.374963:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c19b5 lrc: 0/0,0 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.375114:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.375116:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 3/0,1 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375120:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375120:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375121:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375125:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375128:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375130:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375182:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375186:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.375188:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375193:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 3/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375200:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 1/0,0 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375205:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c19bc lrc: 0/0,0 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.375365:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.375368:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 3/0,1 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375372:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375372:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375373:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375377:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375380:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375382:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375434:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375438:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.375439:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375442:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 3/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375450:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 1/0,0 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375452:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c19c3 lrc: 0/0,0 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.375618:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.375620:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 3/0,1 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375624:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375624:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375625:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375629:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375632:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375634:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375686:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375693:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.375694:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375696:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 3/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375701:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 1/0,0 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375704:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c19ca lrc: 0/0,0 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.375872:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.375875:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 3/0,1 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375879:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375879:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.375880:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375884:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375887:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375892:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375945:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375949:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.375950:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375953:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 3/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375957:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 1/0,0 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.375960:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c19d1 lrc: 0/0,0 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.376109:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.376111:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 3/0,1 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376115:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376115:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376116:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376131:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376135:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376137:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376190:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376194:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.376195:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376200:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 3/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376208:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 1/0,0 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376213:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c19d8 lrc: 0/0,0 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.376364:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.376374:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 3/0,1 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376378:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376379:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376380:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376383:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376387:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376389:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376441:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376445:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.376446:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376449:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 3/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376454:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 1/0,0 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376466:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c19df lrc: 0/0,0 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.376626:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.376629:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 3/0,1 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376634:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376635:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376637:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376642:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376646:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376649:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376713:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376717:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.376718:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376723:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 3/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376728:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 1/0,0 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376731:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c19e6 lrc: 0/0,0 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.376916:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.376919:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 3/0,1 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376923:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376923:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.376924:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376928:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376931:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376934:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.376995:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377001:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.377003:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377007:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 3/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377012:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 1/0,0 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377015:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c19ed lrc: 0/0,0 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.377168:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.377170:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 3/0,1 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377174:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377175:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377175:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377179:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377184:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377187:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377242:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377248:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f821ef24 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.377249:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377254:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 3/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377262:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 1/0,0 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377266:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f821ef24/0xa29a79078f3c19f4 lrc: 0/0,0 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.377440:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.377442:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 3/0,1 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377446:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377447:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377448:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377451:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377454:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377457:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 2/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377510:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 2/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377514:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.377515:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 2/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377518:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 3/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377522:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 1/0,0 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377525:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c19fb lrc: 0/0,0 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.377693:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.377695:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 3/0,1 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377699:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377700:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.377701:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377704:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377707:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377710:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377762:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377766:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.377767:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377770:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 3/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377777:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 1/0,0 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.377780:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1a02 lrc: 0/0,0 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.378004:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.378006:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 3/0,1 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378010:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378011:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378012:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378015:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378018:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378021:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378077:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378084:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.378085:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378088:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 3/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378093:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 1/0,0 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378096:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1a09 lrc: 0/0,0 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.378247:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.378249:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 3/0,1 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378253:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378254:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378255:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378258:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378261:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378266:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378327:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378333:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.378334:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378337:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 3/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378342:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 1/0,0 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378345:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1a10 lrc: 0/0,0 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.378492:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.378494:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 3/0,1 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378498:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378499:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378499:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378505:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378508:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378511:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378563:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378566:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.378567:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378570:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 3/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378575:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 1/0,0 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378577:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1a17 lrc: 0/0,0 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.378721:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.378723:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 3/0,1 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378727:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378727:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378728:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378732:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378734:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378737:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378789:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378793:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.378794:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378797:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 3/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378801:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 1/0,0 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378826:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1a1e lrc: 0/0,0 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.378978:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.378980:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 3/0,1 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378984:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378985:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.378985:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378989:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378992:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.378994:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379045:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379049:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.379050:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379055:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 3/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379060:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 1/0,0 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379062:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1a25 lrc: 0/0,0 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.379213:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.379215:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 3/0,1 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379219:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379219:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379220:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379224:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379227:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379230:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379294:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379298:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.379299:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379302:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 3/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379307:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 1/0,0 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379310:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1a2c lrc: 0/0,0 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.379453:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.379455:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 3/0,1 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379459:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379460:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379461:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379464:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379478:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379481:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379533:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379537:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.379538:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379540:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 3/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379545:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 1/0,0 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379548:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1a33 lrc: 0/0,0 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.379709:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.379711:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 3/0,1 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379715:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379721:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379722:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379726:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379729:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379732:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379783:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379787:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.379787:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379790:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 3/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379795:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 1/0,0 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379798:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1a3a lrc: 0/0,0 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.379985:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.379988:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 3/0,1 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379991:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379992:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.379993:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379996:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.379999:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380002:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380053:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380057:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.380058:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380061:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 3/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380068:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 1/0,0 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380071:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1a41 lrc: 0/0,0 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.380214:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.380216:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 3/0,1 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380220:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380221:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380221:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380225:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380228:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380231:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380281:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380287:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.380288:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380291:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 3/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380295:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 1/0,0 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380298:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1a48 lrc: 0/0,0 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.380440:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.380442:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 3/0,1 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380446:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380446:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380447:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380451:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380454:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380459:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380509:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380512:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.380513:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380516:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 3/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380521:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 1/0,0 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380524:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1a4f lrc: 0/0,0 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.380666:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.380668:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 3/0,1 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380672:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380673:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380674:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380680:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380682:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380685:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380735:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380738:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.380739:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380742:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 3/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380747:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 1/0,0 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380749:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1a56 lrc: 0/0,0 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.380908:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.380910:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 3/0,1 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380914:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380915:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.380916:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380919:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380922:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380925:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380976:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380980:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.380981:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380984:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 3/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380989:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 1/0,0 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.380994:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1a5d lrc: 0/0,0 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.381135:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.381137:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 3/0,1 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381141:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381141:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381142:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381146:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381149:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381151:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381202:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381206:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008e74d38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.381207:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381213:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 3/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381217:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 1/0,0 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381220:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e74d38/0xa29a79078f3c1a64 lrc: 0/0,0 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.381364:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.381366:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 3/0,1 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381370:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381370:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381371:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381375:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381378:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381381:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381434:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381438:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1af0c60 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.381439:0:174494:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381442:0:174494:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 3/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381447:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 1/0,0 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381450:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1af0c60/0xa29a79078f3c1a6b lrc: 0/0,0 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529542.381600:0:174500:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529542.381602:0:174500:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 3/0,1 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381605:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381606:0:174500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529542.381607:0:174500:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381610:0:174500:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381616:0:174500:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381618:0:174500:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381670:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381674:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b415eb38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529542.381675:0:174493:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381678:0:174493:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 3/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381682:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 1/0,0 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529542.381685:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b415eb38/0xa29a79078f3c1a72 lrc: 0/0,0 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 174500 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529542.384084:0:174500:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:178959 00000100:00100000:1.0:1651529542.384103:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:207094:x1731745946686016:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 13758us (13841us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529542.384108:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529542.384354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529542.384362:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686080 00000100:00100000:1.0:1651529542.384371:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529542.384374:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:207094:x1731745946686080:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529542.384386:0:174500:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 179042 00000100:00100000:1.0:1651529542.386400:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:207094:x1731745946686080:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 2026us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529542.386404:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000400:00000080:0.0:1651529543.158976:0:174866:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529543.158979:0:174866:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm3.trevis.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 48 00000100:00100000:1.0:1651529547.488123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529547.488144:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686528 00000100:00100000:1.0:1651529547.488163:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529547.488166:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946686528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529547.488182:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529547.488203:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946686528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529547.488207:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529548.501761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529548.501773:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229499328 00000100:00100000:1.0:1651529548.501784:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529548.501786:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:435372:x1731754229499328:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:1.0:1651529548.501796:0:174500:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from eacddb3a-cb08-4c6c-a06f-c475ab7fdef0@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13148 last 0 00000020:00000080:1.0:1651529548.501825:0:174500:0:(genops.c:1359:class_connect()) connect: client eacddb3a-cb08-4c6c-a06f-c475ab7fdef0, cookie 0xa29a79078f3c1a79 00002000:00100000:1.0:1651529548.501830:0:174500:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli eacddb3a-cb08-4c6c-a06f-c475ab7fdef0/00000000d2548d32 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529548.501834:0:174500:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529548.501876:0:174500:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 000000009c1f9b58 00002000:00080000:1.0:1651529548.501891:0:174500:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529548.501902:0:174500:0:(import.c:85:import_set_state_nolock()) 000000005772487b .«Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529548.501919:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:435372:x1731754229499328:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 131us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529548.501922:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00000001:00100000:0.0:1651529548.540991:0:174486:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1651529550.985291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529550.985313:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229499712 00000100:00100000:1.0:1651529550.985336:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529550.985339:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:436455:x1731754229499712:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529550.985357:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529550.985390:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:436455:x1731754229499712:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529550.985393:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000400:00000080:0.0:1651529551.518188:0:175035:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529551.518191:0:175035:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=100 00000100:00100000:1.0:1651529552.250316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529552.250348:0:174489:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686720 00000100:00100000:0.0:1651529552.250369:0:174489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:0.0:1651529552.250371:0:174489:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:047aa495-7059-4dea-a0a8-a98005327d33+3:207847:x1731745946686720:12345-10.240.43.61@tcp:104: 00000100:00100000:0.0:1651529552.250422:0:174489:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:047aa495-7059-4dea-a0a8-a98005327d33+3:207847:x1731745946686720:12345-10.240.43.61@tcp:104: Request processed in 50us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529552.250426:0:174489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00010000:00010000:1.0:1651529552.250435:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250442:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000edc3646f) 10000000:00010000:1.0:1651529552.250444:0:174494:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250448:0:174494:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529552.250452:0:174494:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529552.250454:0:174494:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651529552.250473:0:174494:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250478:0:174494:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1651529552.250503:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529552.250506:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccee1bd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966725440:10.240.43.61@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529552.250507:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000015b2637/0xa29a79078f3c1976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6053 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529552.251132:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccee1bd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966725440:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529552.608317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529552.608329:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686912 00000100:00100000:1.0:1651529552.608342:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529552.608344:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946686912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529552.608357:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529552.608380:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946686912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529552.608383:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 10000000:01000000:0.0:1651529553.916849:0:174496:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651529553.916851:0:174496:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16bbdd6800 from 13 10000000:01000000:0.0:1651529553.916861:0:174496:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529553.916873:0:174496:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.916878:0:174496:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.916882:0:174496:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529553.916889:0:174496:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725504:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.916909:0:174496:0:(client.c:2492:ptlrpc_set_wait()) set 000000000ba4db76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.917175:0:174496:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725504:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529553.917182:0:174496:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.917186:0:174496:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529553.917213:0:174496:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725568:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.917231:0:174496:0:(client.c:2492:ptlrpc_set_wait()) set 000000000ba4db76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.917454:0:174496:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725568:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.917465:0:174496:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725632:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.917485:0:174496:0:(client.c:2492:ptlrpc_set_wait()) set 000000000ba4db76 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.917743:0:174496:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:047aa495-7059-4dea-a0a8-a98005327d33:174496:1731745966725632:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.917837:0:175093:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:047aa495-7059-4dea-a0a8-a98005327d33:175093:1731745966725696:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529553.917863:0:175093:0:(client.c:2492:ptlrpc_set_wait()) set 000000009eedde3a going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.918419:0:175093:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:047aa495-7059-4dea-a0a8-a98005327d33:175093:1731745966725696:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529553.918429:0:175093:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529553.918432:0:175093:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529553.918434:0:175093:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1651529553.918436:0:175093:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e16bbdd6800 00000020:00000080:0.0:1651529553.918437:0:175093:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529553.920730:0:175093:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2287us 00000100:00100000:0.0:1651529553.920743:0:175093:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:047aa495-7059-4dea-a0a8-a98005327d33:175093:1731745966725760:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529553.920767:0:175093:0:(client.c:2492:ptlrpc_set_wait()) set 000000009eedde3a going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.921012:0:175093:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:047aa495-7059-4dea-a0a8-a98005327d33:175093:1731745966725760:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529553.921021:0:175093:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529553.921023:0:175093:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529553.921023:0:175093:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1651529553.921025:0:175093:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 16 count 16 00000020:01000000:0.0:1651529553.921059:0:174496:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 13-15 (rc=0) 10000000:01000000:0.0:1651529553.921065:0:174496:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529553.921067:0:174496:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.921072:0:174496:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1651529554.136259:0:174486:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000100:00100000:1.0:1651529557.728515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529557.728533:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687680 00000100:00100000:1.0:1651529557.728553:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529557.728556:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946687680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529557.728572:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529557.728600:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946687680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529557.728604:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000400:00000080:0.0:1651529558.541646:0:175309:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529558.541648:0:175309:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133g: Check reads/writes of server lustre proc files with bad area io ========================================================== 22:12:38 (1651529558) 00000100:00100000:1.0:1651529559.292452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.292469:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687872 00000100:00100000:1.0:1651529559.292492:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529559.292496:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946687872:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.292529:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946687872:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 33us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.292533:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529559.296899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.296907:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688000 00000100:00100000:1.0:1651529559.296919:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529559.296921:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688000:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.296936:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688000:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 14us (37us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.296939:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529559.309834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.309842:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688128 00000100:00100000:1.0:1651529559.309854:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529559.309865:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688128:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.309876:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688128:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 20us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.309879:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529559.313211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.313219:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688256 00000100:00100000:1.0:1651529559.313230:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529559.313232:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688256:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.313246:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688256:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (35us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.313249:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529559.416756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.416765:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688512 00000100:00100000:1.0:1651529559.416780:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529559.416782:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688512:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.416795:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688512:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (39us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.416798:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529559.419732:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.419740:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688640 00000100:00100000:1.0:1651529559.419751:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529559.419753:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688640:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.419767:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688640:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (35us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.419770:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529559.429200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.429207:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688768 00000100:00100000:1.0:1651529559.429219:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529559.429220:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688768:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.429234:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688768:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (34us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.429237:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529559.431850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.431864:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688896 00000100:00100000:1.0:1651529559.431875:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529559.431877:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688896:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.431891:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688896:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (41us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.431894:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529559.480190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.480197:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689024 00000100:00100000:1.0:1651529559.480208:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529559.480210:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689024:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.480224:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689024:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 13us (35us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.480227:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529559.483052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529559.483059:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689152 00000100:00100000:1.0:1651529559.483070:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529559.483072:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689152:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529559.483086:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689152:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 14us (34us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529559.483089:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529562.848190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529562.848205:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689344 00000100:00100000:1.0:1651529562.848221:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529562.848224:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529562.848239:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529562.848266:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529562.848269:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529567.420856:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529567.420879:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966725824:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529567.421175:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966725824:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529567.968164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529567.968175:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689472 00000100:00100000:1.0:1651529567.968200:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529567.968202:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529567.968211:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529567.968230:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 27us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529567.968233:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529572.588528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529572.588540:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229500288 00000100:00100000:1.0:1651529572.588561:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529572.588565:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+5:435372:x1731754229500288:12345-10.240.43.64@tcp:9:kworker/u4:1.0 00000020:00000080:1.0:1651529572.588584:0:174500:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1a79 00000100:00080000:1.0:1651529572.588588:0:174500:0:(import.c:85:import_set_state_nolock()) 000000005772487b TôµŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529572.588606:0:174500:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738368 00000100:00100000:1.0:1651529572.588665:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+2:435372:x1731754229500288:12345-10.240.43.64@tcp:9:kworker/u4:1.0 Request processed in 100us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529572.588669:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529573.088106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529573.088116:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689536 00000100:00100000:1.0:1651529573.088126:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529573.088128:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689536:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529573.088136:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529573.088154:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689536:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529573.088157:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529578.208168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529578.208187:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689664 00000100:00100000:1.0:1651529578.208210:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529578.208213:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529578.208225:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529578.208250:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529578.208254:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000001:00100000:0.0:1651529578.267967:0:174486:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000020:00000080:0.0:1651529578.267969:0:174486:0:(genops.c:985:class_export_put()) final put 00000000d2548d32/eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000020:00000080:1.0:1651529578.267992:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000d2548d32/eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 for lustre-OST0000 00000020:00000080:1.0:1651529578.268011:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000005772487b for lustre-OST0000 00000100:00100000:0.0:1651529578.684879:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966725888:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529578.685120:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966725888:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529583.328143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529583.328155:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689920 00000100:00100000:1.0:1651529583.328170:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529583.328172:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529583.328184:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529583.328208:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529583.328211:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529588.448152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529588.448165:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690112 00000100:00100000:1.0:1651529588.448180:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:1.0:1651529588.448182:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690112:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529588.448195:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529588.448218:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690112:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529588.448221:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:0.0:1651529593.020857:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529593.020869:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966725952:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529593.021163:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966725952:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529593.568109:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529593.568122:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690176 00000100:00100000:1.0:1651529593.568139:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:1.0:1651529593.568142:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690176:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529593.568156:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529593.568179:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690176:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529593.568183:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:1.0:1651529598.688151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529598.688168:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690368 00000100:00100000:1.0:1651529598.688188:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529598.688190:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529598.688206:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529598.688234:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529598.688237:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529603.808122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529603.808135:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690496 00000100:00100000:1.0:1651529603.808150:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:1.0:1651529603.808152:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690496:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529603.808164:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529603.808188:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690496:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529603.808191:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:0.0:1651529604.284854:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966726016:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529604.285125:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966726016:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529608.702586:0:175418:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726080:10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529608.702626:0:175418:0:(client.c:2492:ptlrpc_set_wait()) set 0000000082a8edc5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529608.702948:0:175418:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726080:10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529608.703548:0:175418:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726144:10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529608.703578:0:175418:0:(client.c:2492:ptlrpc_set_wait()) set 0000000082a8edc5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529608.703898:0:175418:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726144:10.240.43.61@tcp:400:lctl.0 00000020:00000004:1.0:1651529608.704696:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 12141, max_age 13207 00002000:00000024:1.0:1651529608.704702:0:175418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000020:00000004:1.0:1651529608.704705:0:175418:0:(obd_class.h:1089:obd_statfs()) lustre-OST0000: update 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.704971:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.704973:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.705009:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.705010:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.705370:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.705371:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.705398:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.705400:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.705451:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.705453:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708040:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708041:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708144:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708145:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708187:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708188:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708432:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708433:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708455:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708456:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.708486:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.708497:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.710679:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.710680:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.710851:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.710852:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.710912:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.710913:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.711113:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.711114:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.711138:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.711139:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.711207:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.711209:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000100:00100000:0.0:1651529608.784109:0:175418:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726208:10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529608.784126:0:175418:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd95dbf0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529608.784470:0:175418:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726208:10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529608.784992:0:175418:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726272:10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529608.785031:0:175418:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd95dbf0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529608.785228:0:175418:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job lctl:047aa495-7059-4dea-a0a8-a98005327d33:175418:1731745966726272:10.240.43.61@tcp:400:lctl.0 00000020:00000004:0.0:1651529608.785848:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.785850:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.786021:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.786022:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.786043:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.786044:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.786281:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.786282:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.786331:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.786333:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.786353:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.786354:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.788610:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.788611:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.788766:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.788767:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.788844:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.788845:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.789015:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.789016:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.789036:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.789037:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.789055:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.789056:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790412:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790413:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790502:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790503:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790522:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790523:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790663:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790664:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790683:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790683:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:0.0:1651529608.790703:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:0.0:1651529608.790703:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.813651:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.813663:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.813872:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.813874:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.813928:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.813930:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.814213:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.814214:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.814240:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.814242:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.814285:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.814286:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.816799:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.816801:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.817020:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.817022:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.817064:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.817065:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.817339:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.817340:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.817369:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.817370:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.817412:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.817414:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.819734:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.819735:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.819921:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.819923:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.819958:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.819968:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.820201:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.820202:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.820242:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.820243:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000020:00000004:1.0:1651529608.820273:0:175418:0:(obd_class.h:1065:obd_statfs()) lustre-OST0000: age 13208, max_age 13207 00000020:00000004:1.0:1651529608.820275:0:175418:0:(obd_class.h:1103:obd_statfs()) lustre-OST0000: use 000000006e74d77d cache blocks 18808171/19860985 objects 1186873/1188480 00000100:00100000:0.0:1651529608.928171:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529608.928359:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690624 00000100:00100000:1.0:1651529608.928382:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:1.0:1651529608.928384:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529608.928397:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529608.928421:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529608.928425:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:0.0:1651529614.048172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529614.048211:0:174502:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690816 00000100:00100000:1.0:1651529614.048234:0:174502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:1.0:1651529614.048237:0:174502:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529614.048253:0:174502:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529614.048278:0:174502:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529614.048282:0:174502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:1.0:1651529618.620907:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966726336:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529618.621227:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966726336:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529619.168132:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529619.168150:0:174503:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690944 00000100:00100000:1.0:1651529619.168170:0:174503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:1.0:1651529619.168173:0:174503:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690944:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529619.168191:0:174503:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529619.168222:0:174503:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690944:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529619.168226:0:174503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:1.0:1651529620.654267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529620.654284:0:174500:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946691392 00000100:00100000:1.0:1651529620.654308:0:174500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529620.654311:0:174500:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208861:x1731745946691392:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651529620.654327:0:174500:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1992 00000100:00080000:1.0:1651529620.654331:0:174500:0:(import.c:85:import_set_state_nolock()) 0000000014207b18 TôµŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529620.654357:0:174500:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738368 00000100:00100000:1.0:1651529620.654428:0:174500:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:208861:x1731745946691392:12345-10.240.43.61@tcp:9:umount.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529620.654433:0:174500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000001:00100000:0.0:1651529626.327197:0:174486:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651529626.327201:0:174486:0:(genops.c:985:class_export_put()) final put 0000000061587afd/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529626.327225:0:170153:0:(genops.c:944:class_export_destroy()) destroying export 0000000061587afd/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1651529626.327245:0:170153:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000014207b18 for lustre-OST0000 00000100:00100000:1.0:1651529633.980880:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529633.980893:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081f2c15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:047aa495-7059-4dea-a0a8-a98005327d33:39027:1731745966726400:10.240.43.61@tcp:400:kworker/u4:2.0 00000020:01000004:1.0:1651529635.500290:0:175838:0:(obd_mount_server.c:1699:server_umount_begin()) umount -f 00000020:01000004:1.0:1651529635.505939:0:175838:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1651529635.505949:0:175838:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.505957:0:175838:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.505960:0:175838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.505963:0:175838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529635.505971:0:175838:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1651529635.505976:0:175838:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529635.505979:0:175838:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1651529635.505981:0:175838:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1651529635.505992:0:175838:0:(import.c:85:import_set_state_nolock()) 0000000061c4bb06 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1651529635.506002:0:175838:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9ee32db pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-OST0000_UUID:175838:1731745966726464:10.240.43.61@tcp:39:umount.0 00000100:00100000:1.0:1651529635.506038:0:175838:0:(client.c:2492:ptlrpc_set_wait()) set 0000000082a8edc5 going to sleep for 5 seconds 00010000:00010000:1.0:1651529635.506047:0:174494:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.506053:0:174494:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000edc3646f) 10000000:00010000:1.0:1651529635.506055:0:174494:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.506058:0:174494:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529635.506061:0:174494:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529635.506063:0:174494:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529635.506065:0:174494:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1651529635.506066:0:174494:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1651529635.506076:0:174494:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.506088:0:174494:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1651529635.506100:0:174494:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529635.506103:0:174494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000007e0d18c5/0xa29a79078f3c197d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd605a expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529635.506111:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529635.506139:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966726528:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00000400:1.0:1651529640.060858:0:39027:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529633/real 1651529633] req@0000000081f2c15e x1731745966726400/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529640 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:1.0:1651529640.067712:0:39027:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@0000000081f2c15e x1731745966726400/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529640 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:1.0:1651529640.067717:0:39027:0:(import.c:85:import_set_state_nolock()) 0000000050241750 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1651529640.067719:0:39027:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1651529640.070229:0:39027:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1651529640.070231:0:39027:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529640.070233:0:39027:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000081f2c15e x1731745966726400/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529640 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:1.0:1651529640.070237:0:39027:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000f685b181 x1731745966726528/t0(0) o103->MGC10.240.43.61@tcp@10.240.43.61@tcp:17/18 lens 328/224 e 0 to 0 dl 1651529642 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'ldlm_bl_02.0' 10000000:01000000:1.0:1651529640.070244:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1651529640.070245:0:39027:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1651529640.070246:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1651529640.070247:0:39027:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1651529640.070254:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081f2c15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:047aa495-7059-4dea-a0a8-a98005327d33:39027:1731745966726400:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:1.0:1651529640.070265:0:139617:0:(pinger.c:250:ptlrpc_pinger_process_import()) 047aa495-7059-4dea-a0a8-a98005327d33->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529640.070267:0:139617:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651529640.070268:0:139617:0:(import.c:85:import_set_state_nolock()) 0000000050241750 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529640.070270:0:139617:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 13141 00000100:00080000:1.0:1651529640.070273:0:139617:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 0000000050241750 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529640.070280:0:139617:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000081f2c15e x1731745966726592/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651529640.070300:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:047aa495-7059-4dea-a0a8-a98005327d33:39028:1731745966726528:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529640.070309:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081f2c15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:047aa495-7059-4dea-a0a8-a98005327d33:39026:1731745966726592:10.240.43.61@tcp:250:kworker/u4:2.0 00000100:00100000:1.0:1651529640.636838:0:175838:0:(client.c:2492:ptlrpc_set_wait()) set 0000000082a8edc5 going to sleep for 1 seconds 00000100:00000400:1.0:1651529641.660839:0:175838:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529635/real 1651529635] req@00000000a9ee32db x1731745966726464/t0(0) o39->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 224/224 e 0 to 1 dl 1651529641 ref 2 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'umount.0' 00000100:00100000:1.0:1651529641.660849:0:175838:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000a9ee32db x1731745966726464/t0(0) o39->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 224/224 e 0 to 1 dl 1651529641 ref 2 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'umount.0' 00000100:00100000:1.0:1651529641.660852:0:175838:0:(client.c:2492:ptlrpc_set_wait()) set 0000000082a8edc5 going to sleep for 0 seconds 00000100:00100000:1.0:1651529641.660863:0:175838:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9ee32db pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-OST0000_UUID:175838:1731745966726464:10.240.43.61@tcp:39:umount.0 00000100:00080000:1.0:1651529641.660868:0:175838:0:(import.c:85:import_set_state_nolock()) 0000000061c4bb06 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529641.660870:0:175838:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529641.660871:0:175838:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1651529641.660872:0:175838:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00010000:00010000:1.0:1651529641.662595:0:175838:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662600:0:175838:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662603:0:175838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662606:0:175838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662617:0:175838:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662620:0:175838:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662622:0:175838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.662625:0:175838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529641.662630:0:175838:0:(mgc_request.c:544:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1651529641.662631:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000020:01000004:1.0:1651529641.662633:0:175838:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1651529641.662637:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000edc3646f) 10000000:00010000:0.0:1651529641.662638:0:174493:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000020:01000000:1.0:1651529641.662641:0:175838:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1651529641.662643:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1651529641.662644:0:174493:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1651529641.662645:0:175838:0:(obd_config.c:877:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529641.662647:0:175838:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (00000000433f472d) has no exports 10000000:00010000:0.0:1651529641.662647:0:174493:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529641.662649:0:174493:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1651529641.662650:0:174493:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1651529641.662651:0:174493:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1651529641.662655:0:174493:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 0000000050241750 00010000:00010000:0.0:1651529641.662656:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529641.662658:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000088561f21/0xa29a79078f3c1961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd604c expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529641.662661:0:174493:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529641.662664:0:174493:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000203d678c already unused, calling callback (00000000edc3646f) 10000000:00010000:0.0:1651529641.662665:0:174493:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529641.662667:0:174493:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529641.662669:0:174493:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1651529641.662671:0:175838:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (00000000433f472d) has no exports 10000000:01000000:0.0:1651529641.662671:0:174493:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1651529641.662672:0:174493:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1651529641.662673:0:174493:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:0.0:1651529641.662674:0:174493:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 0000000050241750 00010000:00010000:0.0:1651529641.662675:0:174493:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529641.662677:0:174493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1a80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6125 expref: -99 pid: 174496 timeout: 0 lvb_type: 0 00000020:01000000:1.0:1651529641.666105:0:175838:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 0000000008f05cac - data 00000000c26994d7/000000008f0179d4 00000020:01000000:1.0:1651529641.666113:0:175838:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 000000009ccb4e5c - data 00000000aafee1d9/0000000054e19ce5 00000020:00020000:1.0:1651529641.666152:0:175838:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00100000:10000000:1.0:1651529641.669848:0:175838:0:(lfsck_layout.c:764:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1651529641.684593:0:175838:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c196f 00000020:00000080:1.0:1651529641.684596:0:175838:0:(genops.c:985:class_export_put()) final put 00000000f256f53f/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1651529641.684608:0:175838:0:(obd_mount_server.c:201:server_put_mount()) put mount 00000000c0f4914e from lustre-OST0000, refs=2 00000020:01000004:1.0:1651529641.684610:0:175838:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000c0f4914e 2 00000020:01000004:1.0:1651529641.684611:0:175838:0:(obd_mount_server.c:135:server_deregister_mount()) deregister mount 00000000c0f4914e from lustre-OST0000 00000020:00000080:0.0:1651529641.684619:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000f256f53f/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1651529641.684628:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529641.684630:0:175838:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1651529641.684631:0:175838:0:(genops.c:985:class_export_put()) final put 0000000054249c53/lustre-OST0000_UUID 00000020:00000080:1.0:1651529641.684632:0:175838:0:(genops.c:944:class_export_destroy()) destroying export 0000000054249c53/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1651529641.684634:0:175838:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000000:1.0:1651529641.684652:0:175838:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1651529641.684653:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529641.684654:0:175838:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/2 00000020:00080000:1.0:1651529641.684657:0:175838:0:(genops.c:1752:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE 00000000ed1703df lustre-MDT0000-lwp-OST0000 10.240.43.61@tcp 3 (0 0 0) 0 0 0 0: 0000000002beaa81 0 stale:0 00000020:00080000:1.0:1651529641.684659:0:175838:0:(genops.c:1525:class_disconnect_exports()) OBD device 4 (00000000f2874c42) has exports, disconnecting them 00000020:00080000:1.0:1651529641.684660:0:175838:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 10.240.43.61@tcp (00000000ed1703df), last request at 1651529541 00000020:00000080:1.0:1651529641.684662:0:175838:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c198b 00000020:00080000:1.0:1651529641.684664:0:175838:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 10.240.43.61@tcp (00000000ed1703df): rc 0 00000020:00000080:1.0:1651529641.684670:0:175838:0:(genops.c:985:class_export_put()) final put 00000000ed1703df/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1651529641.684688:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000ed1703df/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1651529641.685571:0:175838:0:(obd_class.h:647:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1651529641.685573:0:175838:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529641.685574:0:175838:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1651529641.685575:0:175838:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00000020:00000080:0.0:1651529641.685595:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000061c4bb06 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1651529641.685612:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529641.685613:0:175838:0:(obd_config.c:805:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1651529641.685614:0:175838:0:(genops.c:985:class_export_put()) final put 00000000c7a1d861/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1651529641.685615:0:175838:0:(genops.c:944:class_export_destroy()) destroying export 00000000c7a1d861/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1651529641.685616:0:175838:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1651529641.685625:0:175838:0:(obd_mount.c:926:lustre_common_put_super()) dropping sb 00000000c0f4914e 00000100:00080000:1.0:1651529641.685628:0:175838:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import 047aa495-7059-4dea-a0a8-a98005327d33->MGS 00010000:00010000:1.0:1651529641.685632:0:175838:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529641.685636:0:175838:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529641.685639:0:175838:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1651529641.685640:0:175838:0:(mgc_request.c:1053:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1651529641.685641:0:175838:0:(mgc_request.c:153:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1651529641.685643:0:175838:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 0000000050241750 00010000:00010000:1.0:1651529641.685644:0:175838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000021275de8/0xa29a79078f3c195a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6045 expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529641.685648:0:175838:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529641.685650:0:175838:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529641.685653:0:175838:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529641.685654:0:175838:0:(mgc_request.c:1053:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1651529641.685654:0:175838:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1651529641.685657:0:175838:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 0000000050241750 00010000:00010000:1.0:1651529641.685658:0:175838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000f4be2ac0/0xa29a79078f3c1953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd603e expref: -99 pid: 174484 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529641.685666:0:175838:0:(import.c:85:import_set_state_nolock()) 0000000050241750 MGS: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529641.685668:0:175838:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529641.685670:0:175838:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000081f2c15e x1731745966726592/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 1651529646 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 10000000:01000000:1.0:1651529641.685676:0:175838:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529641.685677:0:175838:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1651529641.685686:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081f2c15e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:047aa495-7059-4dea-a0a8-a98005327d33:39026:1731745966726592:10.240.43.61@tcp:250:kworker/u4:2.0 10000000:01000000:1.0:1651529641.685779:0:175838:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1651529641.685782:0:175838:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1945 00000020:00000080:1.0:1651529641.685783:0:175838:0:(genops.c:985:class_export_put()) final put 0000000005605cac/047aa495-7059-4dea-a0a8-a98005327d33 00000020:01000000:1.0:1651529641.685792:0:175838:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of MGC10.240.43.61@tcp (flags='') 00000020:00000080:1.0:1651529641.685793:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529641.685795:0:175838:0:(obd_config.c:877:class_cleanup()) MGC10.240.43.61@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1651529641.685796:0:175838:0:(genops.c:1530:class_disconnect_exports()) OBD device 1 (000000003fd86c22) has no exports 00000020:00000080:0.0:1651529641.685798:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 0000000005605cac/047aa495-7059-4dea-a0a8-a98005327d33 for MGC10.240.43.61@tcp 10000000:01000000:1.0:1651529641.685822:0:174496:0:(mgc_request.c:704:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1651529641.685888:0:175838:0:(obd_class.h:647:obd_cleanup_client_import()) MGC10.240.43.61@tcp: client import never connected 00000100:00080000:1.0:1651529641.685889:0:175838:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1651529641.685890:0:175838:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529641.685891:0:175838:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651529641.685892:0:175838:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1651529641.685919:0:139617:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000050241750 for MGC10.240.43.61@tcp 00000020:00000080:1.0:1651529641.685920:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529641.685922:0:175838:0:(obd_config.c:805:class_detach()) detach on obd MGC10.240.43.61@tcp (uuid 047aa495-7059-4dea-a0a8-a98005327d33) 00000020:00000080:1.0:1651529641.685923:0:175838:0:(genops.c:985:class_export_put()) final put 00000000e44799f5/047aa495-7059-4dea-a0a8-a98005327d33 00000020:00000080:1.0:1651529641.685924:0:175838:0:(genops.c:944:class_export_destroy()) destroying export 00000000e44799f5/047aa495-7059-4dea-a0a8-a98005327d33 for MGC10.240.43.61@tcp 00000020:01000000:1.0:1651529641.685925:0:175838:0:(genops.c:447:class_free_dev()) finishing cleanup of obd MGC10.240.43.61@tcp (047aa495-7059-4dea-a0a8-a98005327d33) 00000100:00100000:0.0:1651529641.686097:0:174489:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_001: service thread [00000000e5bd24cb:174489] 1 exiting: rc = 0 00000100:00100000:0.0:1651529641.686133:0:174488:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_000: service thread [00000000fd6adcd9:174488] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.686167:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.686238:0:174492:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_002: service thread [0000000064b67439:174492] 2 exiting: rc = 0 00000100:00100000:1.0:1651529641.686274:0:174491:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_001: service thread [0000000025a0a1c5:174491] 1 exiting: rc = 0 00000100:00100000:0.0:1651529641.686275:0:174490:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_000: service thread [0000000071d2b2ac:174490] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.686350:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686353:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686355:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686357:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686359:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686361:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686363:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686365:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686368:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686370:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686372:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686374:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686376:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686378:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686381:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686383:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686385:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686387:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686389:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686391:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686394:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686396:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686398:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686400:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686402:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686404:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686406:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686409:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686411:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686413:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686415:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686417:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686419:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686422:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686424:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686426:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686441:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686443:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686446:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686448:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686450:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686452:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686454:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686456:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686459:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686461:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686462:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686464:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686466:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686468:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686470:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686472:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686474:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686476:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686479:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686481:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686483:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686485:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686487:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686489:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686491:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686493:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686495:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.686497:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1651529641.686684:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf006 00000020:00000080:1.0:1651529641.686685:0:175838:0:(obd_config.c:1377:class_process_config()) removing mappings for uuid MGC10.240.43.61@tcp_0 00000020:01000004:1.0:1651529641.686688:0:175838:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000c0f4914e 1 00000020:00000080:1.0:1651529641.686689:0:175838:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1937 00000020:00000080:1.0:1651529641.686691:0:175838:0:(genops.c:985:class_export_put()) final put 00000000750d20e8/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1651529641.686696:0:175838:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1651529641.686697:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529641.686705:0:175838:0:(obd_config.c:877:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00000080:0.0:1651529641.686705:0:139617:0:(genops.c:944:class_export_destroy()) destroying export 00000000750d20e8/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:1.0:1651529641.686706:0:175838:0:(genops.c:1530:class_disconnect_exports()) OBD device 0 (00000000af78932b) has no exports 00000020:00000080:1.0:1651529641.687775:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529641.687777:0:175838:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1651529641.687778:0:175838:0:(genops.c:985:class_export_put()) final put 0000000017fb191c/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1651529641.687779:0:175838:0:(genops.c:944:class_export_destroy()) destroying export 0000000017fb191c/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1651529641.687780:0:175838:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1651529641.687931:0:175838:0:(obd_mount.c:608:lustre_free_lsi()) Freeing lsi 0000000054db759c 00000020:01000000:1.0:1651529641.687938:0:175838:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1651529641.687940:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529641.687941:0:175838:0:(obd_config.c:877:class_cleanup()) OSS: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529641.687942:0:175838:0:(genops.c:1530:class_disconnect_exports()) OBD device 2 (0000000012670da7) has no exports 00000020:00000080:1.0:1651529641.687949:0:175838:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529641.687950:0:175838:0:(obd_config.c:805:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1651529641.687951:0:175838:0:(genops.c:985:class_export_put()) final put 000000001b3804b9/OSS_uuid 00000020:00000080:1.0:1651529641.687952:0:175838:0:(genops.c:944:class_export_destroy()) destroying export 000000001b3804b9/OSS_uuid for OSS 00000020:01000000:1.0:1651529641.687953:0:175838:0:(genops.c:447:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1651529641.687969:0:174511:0:(pinger.c:538:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1651529641.687979:0:174501:0:(service.c:2915:ptlrpc_main()) ll_ost00_002: service thread [00000000b0826569:174501] 2 exiting: rc = 0 00000100:00100000:1.0:1651529641.688006:0:174500:0:(service.c:2915:ptlrpc_main()) ll_ost00_001: service thread [0000000091cef212:174500] 1 exiting: rc = 0 00000100:00100000:1.0:1651529641.688030:0:174498:0:(service.c:2915:ptlrpc_main()) ll_ost00_000: service thread [00000000652c15e1:174498] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.688119:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688121:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688124:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688126:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688128:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688130:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688132:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688135:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688137:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688138:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688141:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688143:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688145:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688147:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688149:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688151:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688153:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688155:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688157:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688160:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688162:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688164:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688166:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688168:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688170:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688172:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688174:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688176:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688178:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688179:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688182:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688183:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688185:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688187:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688190:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688192:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688194:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688196:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688198:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688200:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688202:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688204:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688206:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688208:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688210:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688212:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688214:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688216:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688218:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688220:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688222:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688224:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688226:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688228:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688231:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688232:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688234:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688237:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688239:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688241:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688242:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688244:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688246:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688248:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688641:0:174502:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_000: service thread [00000000f47ce927:174502] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.688675:0:174503:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_001: service thread [00000000612a4ee9:174503] 1 exiting: rc = 0 00000100:00100000:1.0:1651529641.688750:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688753:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688755:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688757:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688759:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688761:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688763:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688765:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688767:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688769:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688771:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688773:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688775:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688777:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688779:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688781:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688783:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688785:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688788:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688790:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688792:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688794:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688796:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688798:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688800:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688802:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688836:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688838:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688840:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688842:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688844:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688846:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688848:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688850:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688853:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688855:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688857:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688858:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688860:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688863:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688865:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688867:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688869:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688871:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688873:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688875:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688877:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688879:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688881:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688883:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688885:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688887:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688889:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688891:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688893:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688895:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688897:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688899:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688911:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688913:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688915:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688917:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688919:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.688922:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.689454:0:174506:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_002: service thread [00000000374a805b:174506] 2 exiting: rc = 0 00000100:00100000:1.0:1651529641.689620:0:174505:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_001: service thread [00000000cbfe207f:174505] 1 exiting: rc = 0 00000100:00100000:1.0:1651529641.689779:0:174504:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_000: service thread [00000000f5fbb87f:174504] 0 exiting: rc = 1 00000100:00100000:0.0:1651529641.689838:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689841:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689844:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689846:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689848:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689851:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689853:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689856:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689859:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689861:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689863:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689866:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689868:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689870:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689873:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689875:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689877:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689879:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689882:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689884:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689887:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689889:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689891:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689894:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689896:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689899:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689901:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689914:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689916:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689918:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689921:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689923:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689925:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689928:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689930:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689932:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689934:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689937:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689939:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689941:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689943:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689945:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689948:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689950:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689952:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689954:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689956:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689959:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689961:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689963:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689965:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689968:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689970:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689972:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689974:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689976:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689978:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689981:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689983:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689985:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689987:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689990:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689992:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.689994:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.694885:0:174507:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_000: service thread [0000000081ac71f2:174507] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.694944:0:174508:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_001: service thread [00000000fc30f0a3:174508] 1 exiting: rc = 0 00000100:00100000:0.0:1651529641.694974:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694979:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694981:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694983:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694986:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694988:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694990:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694992:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694994:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694996:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694998:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.694999:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695001:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695003:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695005:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695007:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695009:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695012:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695014:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695016:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695018:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695020:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695022:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695024:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695026:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695029:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695030:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695032:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695034:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695037:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695039:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695041:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695043:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695045:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695047:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695049:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695051:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695053:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695055:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695058:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695060:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695062:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695064:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695066:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695068:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695070:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695072:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695074:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695076:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695078:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695080:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695082:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695084:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695086:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695089:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695091:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695093:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695094:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695097:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695098:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695100:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695102:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695104:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695107:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529641.695505:0:174509:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_000: service thread [00000000f266f607:174509] 0 exiting: rc = 1 00000100:00100000:1.0:1651529641.695535:0:174510:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_001: service thread [0000000092c96c26:174510] 1 exiting: rc = 0 00000100:00100000:0.0:1651529641.695558:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695561:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695564:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695566:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695568:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695570:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695573:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695575:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695579:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695581:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695584:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695586:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695588:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695590:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695592:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695595:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695597:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695599:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695601:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695603:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695607:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695609:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695611:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695614:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695616:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695618:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695620:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695623:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695625:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695627:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695629:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695632:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695635:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695637:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695639:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695641:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695644:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695646:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695648:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695650:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695652:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695654:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695657:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695659:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695662:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695664:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695666:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695669:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695671:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695673:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695675:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695678:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695680:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695682:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695685:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695687:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695690:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695692:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695694:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695696:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695699:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695701:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695703:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529641.695705:0:175838:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1651529641.704966:0:175838:0:(obd_mount_server.c:1687:server_put_super()) server umount lustre-OST0000 complete 00000400:00000100:1.0:1651529655.450340:0:39021:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946692416 offset 0 length 520: 4 00000080:01200004:1.0:1651529659.039122:0:176848:0:(super25.c:114:lustre_fill_super()) VFS Op: sb 000000004e524ac0 00000020:01000004:1.0:1651529659.039140:0:176848:0:(obd_mount.c:952:lmd_print()) mount data: 00000020:01000004:1.0:1651529659.039141:0:176848:0:(obd_mount.c:955:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1651529659.039142:0:176848:0:(obd_mount.c:956:lmd_print()) flags: 0 00000020:01000004:1.0:1651529659.039142:0:176848:0:(obd_mount.c:959:lmd_print()) options: errors=remount-ro 00000020:01000004:1.0:1651529659.039145:0:176848:0:(obd_mount_server.c:1916:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1651529659.039173:0:176848:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1651529659.039175:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529659.039181:0:176848:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0000-osd (000000002d3518b9) 00000020:00000080:1.0:1651529659.039211:0:176848:0:(obd_config.c:648:class_attach()) OBD: dev 0 attached type osd-ldiskfs with refcount 1 00000020:00000080:1.0:1651529659.039213:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00100000:10000000:1.0:1651529659.064358:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1651529659.064759:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1651529659.064838:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1651529659.064990:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1651529659.065068:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1651529659.065145:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1651529659.065232:0:176848:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1651529659.065829:0:176848:0:(osd_lproc.c:834:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1651529659.065886:0:176848:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1651529659.065889:0:176848:0:(osd_handler.c:8440:osd_obd_connect()) connect #0 00000020:00000080:1.0:1651529659.065891:0:176848:0:(genops.c:1359:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa29a79078f3c1a8e 00000020:01000004:1.0:1651529659.065893:0:176848:0:(obd_mount_server.c:1999:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1651529659.065954:0:176848:0:(obd_mount.c:340:lustre_start_mgc()) Start MGC 'MGC10.240.43.61@tcp' 00000020:01000004:1.0:1651529659.065955:0:176848:0:(obd_mount.c:347:lustre_start_mgc()) mgs NIDs 10.240.43.61@tcp. 00000020:00000080:1.0:1651529659.065957:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1651529659.065958:0:176848:0:(obd_config.c:1368:class_process_config()) adding mapping from uuid MGC10.240.43.61@tcp_0 to nid 0x200000af02b3d (10.240.43.61@tcp) 00000020:01000004:1.0:1651529659.065965:0:176848:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD MGC10.240.43.61@tcp (typ=mgc) 00000020:00000080:1.0:1651529659.065966:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529659.065980:0:176848:0:(genops.c:417:class_newdev()) Allocate new device MGC10.240.43.61@tcp (00000000b77b38ed) 00000020:00000080:1.0:1651529659.066009:0:176848:0:(obd_config.c:648:class_attach()) OBD: dev 1 attached type mgc with refcount 1 00000020:00000080:1.0:1651529659.066011:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529659.066061:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1651529659.066098:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 40 00000100:00100000:1.0:1651529659.066101:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1651529659.066180:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 40 00000100:00100000:1.0:1651529659.066182:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1651529659.066364:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.066405:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 40 00000100:00100000:1.0:1651529659.066406:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1651529659.066938:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 40 00000100:00100000:1.0:1651529659.066941:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1651529659.067279:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 40 00000100:00100000:1.0:1651529659.067282:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00080000:1.0:1651529659.068606:0:176848:0:(ldlm_lib.c:115:import_set_conn()) imp 000000003127423f@MGC10.240.43.61@tcp: add connection MGC10.240.43.61@tcp_0 at head 00010000:00010000:1.0:1651529659.068656:0:176848:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-MGC10.240.43.61@tcp-0 is initialized 00000040:01000000:1.0:1651529659.068659:0:176848:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 1 is initialized 10000000:01000000:1.0:1651529659.069352:0:176861:0:(mgc_request.c:628:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1651529659.069357:0:176848:0:(obd_config.c:752:class_setup()) finished setup of obd MGC10.240.43.61@tcp (uuid 30052a09-f4a3-492a-add7-6d156733f5e5) 00000020:00000080:1.0:1651529659.069363:0:176848:0:(genops.c:1359:class_connect()) connect: client 30052a09-f4a3-492a-add7-6d156733f5e5, cookie 0xa29a79078f3c1a9c 00000100:00080000:1.0:1651529659.069368:0:176848:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:1.0:1651529659.069370:0:176848:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000003127423f using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529659.069383:0:176848:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf518e04 x1731745966726720/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529659.069393:0:176848:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import 30052a09-f4a3-492a-add7-6d156733f5e5->MGS 00000020:01000004:1.0:1651529659.069398:0:176848:0:(obd_mount_server.c:1354:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1651529659.069423:0:176848:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1651529659.069425:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529659.069437:0:176848:0:(genops.c:417:class_newdev()) Allocate new device OSS (000000007ce51a4b) 00000020:00000080:1.0:1651529659.069466:0:176848:0:(obd_config.c:648:class_attach()) OBD: dev 2 attached type ost with refcount 1 00000020:00000080:1.0:1651529659.069468:0:176848:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529659.069951:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.069986:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 0 min 3 max 80 00000100:00100000:1.0:1651529659.069988:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1651529659.070003:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966726720:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:1.0:1651529659.070794:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 1 min 3 max 80 00000100:00100000:1.0:1651529659.070797:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1651529659.070874:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 2 min 3 max 80 00000100:00100000:1.0:1651529659.070876:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1651529659.071381:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.071433:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529659.071435:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1651529659.071576:0:39026:0:(client.c:2892:ptlrpc_free_committed()) MGC10.240.43.61@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1651529659.071580:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 00000100:00080000:1.0:1651529659.071583:0:39026:0:(import.c:933:ptlrpc_connect_set_flags()) MGC10.240.43.61@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002020 10000000:01000000:1.0:1651529659.071584:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1651529659.071586:0:39026:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1651529659.071588:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651529659.071590:0:39026:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1651529659.071593:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966726720:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:1.0:1651529659.071665:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529659.071669:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1651529659.078058:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.078147:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 80 00000100:00100000:1.0:1651529659.078150:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1651529659.079052:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 80 00000100:00100000:1.0:1651529659.079055:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1651529659.079585:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 80 00000100:00100000:1.0:1651529659.079587:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1651529659.080631:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.080676:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529659.080677:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1651529659.081094:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529659.081097:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1651529659.093040:0:176848:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529659.093123:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529659.093126:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1651529659.093950:0:176848:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529659.093955:0:176848:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1651529659.094405:0:176848:0:(obd_config.c:752:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1651529659.094421:0:176848:0:(obd_mount_server.c:294:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 00000100:00080000:0.0:1651529659.094613:0:176875:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:1.0:1651529659.095594:0:176848:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 0 is initialized 00000020:01000004:1.0:1651529659.095604:0:176848:0:(obd_mount_server.c:1245:server_register_target()) Registration lustre-OST0000, fs=lustre, 10.240.43.62@tcp, index=0000, flags=0x2 10000000:01000000:1.0:1651529659.095607:0:176848:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0000 0x10000002 10000000:01000000:1.0:1651529659.095619:0:176848:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1651529659.095628:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726784:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:1.0:1651529659.095661:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 000000008448fae4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.096952:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726784:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:1.0:1651529659.096957:0:176848:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1651529659.096963:0:176848:0:(obd_mount_server.c:116:server_register_mount()) register mount 000000004e524ac0 from lustre-OST0000 10000000:01000000:1.0:1651529659.096966:0:176848:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1651529659.096967:0:176848:0:(mgc_request.c:334:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1651529659.096969:0:176848:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e16844ada28 10000000:01000000:1.0:1651529659.096970:0:176848:0:(mgc_request.c:90:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529659.096973:0:176848:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8e16844ada28 from 1 10000000:01000000:1.0:1651529659.096974:0:176848:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1651529659.096985:0:176848:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.096990:0:176848:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.096994:0:176848:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.097000:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726848:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529659.097012:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 000000009f99ddef going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.097231:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726848:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529659.097238:0:176848:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.097242:0:176848:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.097265:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726912:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.097276:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 000000009f99ddef going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.097493:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726912:10.240.43.61@tcp:501:mount.lustre.0 10000000:01000000:1.0:1651529659.097504:0:176848:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1651529659.097506:0:176848:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.097509:0:176848:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529659.097512:0:176848:0:(mgc_request.c:215:do_config_log_add()) do adding config log nodemap-ffff8e16844ada28 10000000:01000000:1.0:1651529659.097514:0:176848:0:(mgc_request.c:90:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1651529659.097515:0:176848:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff8e16844ada28 from 1 10000000:01000000:1.0:1651529659.097516:0:176848:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1651529659.097520:0:176848:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.097523:0:176848:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.097526:0:176848:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.097531:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726976:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529659.097541:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 000000009f99ddef going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.097744:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966726976:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529659.097748:0:176848:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.097751:0:176848:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.097837:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727040:10.240.43.61@tcp:256:mount.lustre.0 00000100:00100000:1.0:1651529659.097851:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000695a8219 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.098343:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727040:10.240.43.61@tcp:256:mount.lustre.0 10000000:01000000:1.0:1651529659.098414:0:176848:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1651529659.098416:0:176848:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.098420:0:176848:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529659.098423:0:176848:0:(mgc_request.c:215:do_config_log_add()) do adding config log params-ffff8e16c2c2a000 10000000:01000000:1.0:1651529659.098424:0:176848:0:(mgc_request.c:90:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1651529659.098425:0:176848:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1651529659.098426:0:176848:0:(mgc_request.c:90:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529659.098427:0:176848:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1651529659.098428:0:176848:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1651529659.098432:0:176848:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.098435:0:176848:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.098438:0:176848:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.098443:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727104:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529659.098454:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000695a8219 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.098660:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727104:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529659.098664:0:176848:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.098668:0:176848:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529659.099846:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529659.104851:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.104862:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 128 off8544 00000040:00080000:1.0:1651529659.104867:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 112 off8656 00000040:00080000:1.0:1651529659.104872:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8880 00000040:00080000:1.0:1651529659.104878:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9104 00000040:00080000:1.0:1651529659.104882:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 120 off9224 00000040:00080000:1.0:1651529659.104889:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 224 off9448 00000040:00080000:1.0:1651529659.104890:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2a:10:0 index 8 count 8 00000100:00100000:1.0:1651529659.104903:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727168:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.104926:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000024e7ebed going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.105174:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727168:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.105184:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727232:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529659.105199:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000024e7ebed going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.105633:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727232:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529659.105754:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529659.105762:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727296:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.105776:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.106107:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727296:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.106171:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.106178:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 128 off8544 00000040:00080000:1.0:1651529659.106183:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 112 off8656 00000040:00080000:1.0:1651529659.106187:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8880 00000040:00080000:1.0:1651529659.106191:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9104 00000040:00080000:1.0:1651529659.106195:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 120 off9224 00000100:00100000:1.0:1651529659.106202:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727360:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.106215:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.106434:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727360:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.106449:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 224 off9448 00000040:00080000:1.0:1651529659.106451:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x8:10:0 index 8 count 8 00000020:01000000:0.0:1651529659.106891:0:176876:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1651529659.106894:0:176876:0:(obd_mount.c:991:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1651529659.106897:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529659.106898:0:176876:0:(obd_config.c:1432:class_process_config()) marker 8 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1651529659.106901:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529659.106906:0:176876:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0000 (0000000012670da7) 00000020:00000080:0.0:1651529659.106949:0:176876:0:(obd_config.c:648:class_attach()) OBD: dev 3 attached type obdfilter with refcount 1 00000020:00000080:0.0:1651529659.106952:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1651529659.106977:0:176876:0:(obd_mount_server.c:167:server_get_mount()) get mount 000000004e524ac0 from lustre-OST0000, refs=2 00080000:01000000:0.0:1651529659.106980:0:176876:0:(osd_handler.c:8440:osd_obd_connect()) connect #1 00000020:00000080:0.0:1651529659.106982:0:176876:0:(genops.c:1359:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa29a79078f3c1ac6 00010000:00010000:0.0:1651529659.109230:0:176876:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-0 is initialized 00000001:00000004:0.0:1651529659.109364:0:176876:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 34359738368 00080000:10000000:0.0:1651529659.110510:0:176876:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0000: index object [0x200000003:0x15:0x0] (8/32) registered 00000020:00000080:0.0:1651529659.111176:0:176876:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1651529659.111179:0:176876:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529659.111182:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529659.111182:0:176876:0:(obd_config.c:1432:class_process_config()) marker 8 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1651529659.111184:0:176876:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529659.111185:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529659.111186:0:176876:0:(obd_config.c:1432:class_process_config()) marker 15 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1651529659.111187:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1651529659.111194:0:176876:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529659.111195:0:176876:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529659.111196:0:176876:0:(obd_config.c:1432:class_process_config()) marker 15 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1651529659.111197:0:176876:0:(llog.c:768:llog_process_thread()) stop processing plain 0x30:10:0 index 8 count 8 00000020:01000000:1.0:1651529659.111503:0:176848:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1651529659.111512:0:176848:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1651529659.111514:0:176848:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.111519:0:176848:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529659.111522:0:176848:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16c2c2a000 from 1 10000000:01000000:1.0:1651529659.111523:0:176848:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1651529659.111530:0:176848:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.111533:0:176848:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.111536:0:176848:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.111542:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727424:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529659.111556:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.111870:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727424:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529659.111876:0:176848:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.111880:0:176848:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529659.112111:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529659.112238:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.112247:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].2, 112 off8528 00000040:00080000:1.0:1651529659.112251:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].3, 224 off8752 00000040:00080000:1.0:1651529659.112255:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].4, 224 off8976 00000040:00080000:1.0:1651529659.112259:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].5, 112 off9088 00000040:00080000:1.0:1651529659.112262:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].6, 224 off9312 00000040:00080000:1.0:1651529659.112266:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].7, 224 off9536 00000040:00080000:1.0:1651529659.112270:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].8, 112 off9648 00000040:00080000:1.0:1651529659.112274:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].9, 224 off9872 00000040:00080000:1.0:1651529659.112278:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].10, 224 off10096 00000040:00080000:1.0:1651529659.112282:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].11, 112 off10208 00000040:00080000:1.0:1651529659.112288:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x31:0x0].12, 224 off10432 00000040:00080000:1.0:1651529659.112289:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2c:10:0 index 13 count 13 00000100:00100000:1.0:1651529659.112301:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727488:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.112314:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.112538:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727488:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.112548:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727552:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529659.112563:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.112786:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727552:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529659.112879:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529659.112888:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727616:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.112903:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.113140:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727616:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.113204:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.113212:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].2, 112 off8528 00000040:00080000:1.0:1651529659.113216:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].3, 224 off8752 00000040:00080000:1.0:1651529659.113220:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].4, 224 off8976 00000040:00080000:1.0:1651529659.113224:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].5, 112 off9088 00000040:00080000:1.0:1651529659.113228:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].6, 224 off9312 00000040:00080000:1.0:1651529659.113232:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].7, 224 off9536 00000040:00080000:1.0:1651529659.113236:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].8, 112 off9648 00000040:00080000:1.0:1651529659.113239:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].9, 224 off9872 00000040:00080000:1.0:1651529659.113244:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].10, 224 off10096 00000040:00080000:1.0:1651529659.113248:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].11, 112 off10208 00000040:00080000:1.0:1651529659.113251:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].12, 224 off10432 00000040:00080000:1.0:1651529659.113255:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].13, 224 off10656 00000040:00080000:1.0:1651529659.113259:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].14, 112 off10768 00000100:00100000:1.0:1651529659.113266:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727680:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.113279:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 0000000091519362 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.113486:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727680:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.113500:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x32:0x0].15, 224 off10992 00000040:00080000:1.0:1651529659.113503:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 16 count 16 00000020:01000000:1.0:1651529659.113622:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529659.113624:0:176879:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1651529659.113624:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113625:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113626:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529659.113627:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113628:0:176879:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) general lod.*.mdt_hash 00000020:01000000:1.0:1651529659.113629:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529659.113631:0:176879:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1651529659.113631:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113632:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113632:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529659.113633:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113634:0:176879:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529659.113635:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529659.113635:0:176879:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1651529659.113636:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113636:0:176879:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529659.113637:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529659.113638:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113638:0:176879:0:(obd_config.c:1432:class_process_config()) marker 3 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529659.113639:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529659.113640:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113640:0:176879:0:(obd_config.c:1432:class_process_config()) marker 4 (0x1) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529659.113642:0:176879:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e16c2c2a000 00000020:00000080:1.0:1651529659.113643:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1651529659.113656:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529659.113657:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113657:0:176879:0:(obd_config.c:1432:class_process_config()) marker 4 (0x2) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529659.113658:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529659.113659:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529659.113660:0:176879:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1651529659.113661:0:176879:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e16c2c2a000 00000020:00000080:1.0:1651529659.113662:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529659.116827:0:176879:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 3162us 00000020:01000000:0.0:1651529659.116837:0:176879:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529659.116839:0:176879:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529659.116840:0:176879:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1651529659.116841:0:176879:0:(llog.c:768:llog_process_thread()) stop processing plain 0x32:10:0 index 16 count 16 00000020:01000000:1.0:1651529659.117741:0:176848:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 1-15 (rc=0) 10000000:01000000:1.0:1651529659.117750:0:176848:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1651529659.117752:0:176848:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.117757:0:176848:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529659.117764:0:176848:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1651529659.117765:0:176848:0:(mgc_request.c:334:config_log_add()) add config log lustre-client-ffff8e16c2c2a000 10000000:01000000:1.0:1651529659.117766:0:176848:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-client-ffff8e16c2c2a000 10000000:01000000:1.0:1651529659.117768:0:176848:0:(mgc_request.c:90:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529659.117769:0:176848:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8e16c2c2a000 from 1 10000000:01000000:1.0:1651529659.117770:0:176848:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1651529659.117776:0:176848:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.117779:0:176848:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.117783:0:176848:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529659.117789:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727744:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529659.117821:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.118062:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727744:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529659.118067:0:176848:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.118077:0:176848:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529659.118393:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529659.118587:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.118596:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].2, 120 off8536 00000040:00080000:1.0:1651529659.118600:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].3, 168 off8704 00000040:00080000:1.0:1651529659.118605:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].4, 224 off8928 00000040:00080000:1.0:1651529659.118609:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].5, 224 off9152 00000040:00080000:1.0:1651529659.118613:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].6, 120 off9272 00000040:00080000:1.0:1651529659.118617:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].7, 168 off9440 00000040:00080000:1.0:1651529659.118621:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].8, 224 off9664 00000040:00080000:1.0:1651529659.118625:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].9, 224 off9888 00000040:00080000:1.0:1651529659.118629:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].10, 88 off9976 00000040:00080000:1.0:1651529659.118633:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].11, 128 off10104 00000040:00080000:1.0:1651529659.118637:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].12, 144 off10248 00000040:00080000:1.0:1651529659.118641:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].13, 160 off10408 00000040:00080000:1.0:1651529659.118645:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].14, 224 off10632 00000040:00080000:1.0:1651529659.118649:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].15, 224 off10856 00000040:00080000:1.0:1651529659.118652:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].16, 120 off10976 00000040:00080000:1.0:1651529659.118656:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].17, 224 off11200 00000040:00080000:1.0:1651529659.118660:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].18, 224 off11424 00000040:00080000:1.0:1651529659.118665:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].19, 88 off11512 00000040:00080000:1.0:1651529659.118669:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].20, 128 off11640 00000040:00080000:1.0:1651529659.118672:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].21, 144 off11784 00000040:00080000:1.0:1651529659.118676:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].22, 128 off11912 00000040:00080000:1.0:1651529659.118680:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].23, 224 off12136 00000040:00080000:1.0:1651529659.118701:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].24, 224 off12360 00000040:00080000:1.0:1651529659.118707:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].25, 88 off12448 00000040:00080000:1.0:1651529659.118711:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].26, 128 off12576 00000040:00080000:1.0:1651529659.118715:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].27, 144 off12720 00000040:00080000:1.0:1651529659.118719:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].28, 128 off12848 00000040:00080000:1.0:1651529659.118723:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].29, 224 off13072 00000040:00080000:1.0:1651529659.118726:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].30, 224 off13296 00000040:00080000:1.0:1651529659.118730:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].31, 120 off13416 00000040:00080000:1.0:1651529659.118734:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].32, 224 off13640 00000040:00080000:1.0:1651529659.118738:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].33, 224 off13864 00000040:00080000:1.0:1651529659.118741:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].34, 112 off13976 00000040:00080000:1.0:1651529659.118745:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].35, 224 off14200 00000040:00080000:1.0:1651529659.118749:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].36, 224 off14424 00000040:00080000:1.0:1651529659.118753:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].37, 136 off14560 00000040:00080000:1.0:1651529659.118757:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].38, 224 off14784 00000040:00080000:1.0:1651529659.118761:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].39, 224 off15008 00000040:00080000:1.0:1651529659.118765:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].40, 136 off15144 00000040:00080000:1.0:1651529659.118782:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].41, 224 off15368 00000040:00080000:1.0:1651529659.118786:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].42, 224 off15592 00000040:00080000:1.0:1651529659.118790:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].43, 112 off15704 00000040:00080000:1.0:1651529659.118793:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].44, 224 off15928 00000040:00080000:1.0:1651529659.118797:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].45, 224 off16152 00000040:00080000:1.0:1651529659.118801:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].46, 112 off16264 00000040:00080000:1.0:1651529659.119093:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].48, 224 off16608 00000040:00080000:1.0:1651529659.119101:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].49, 224 off16832 00000040:00080000:1.0:1651529659.119105:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].50, 136 off16968 00000040:00080000:1.0:1651529659.119109:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].51, 224 off17192 00000040:00080000:1.0:1651529659.119113:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].52, 224 off17416 00000040:00080000:1.0:1651529659.119118:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].53, 136 off17552 00000040:00080000:1.0:1651529659.119122:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].54, 224 off17776 00000040:00080000:1.0:1651529659.119126:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].55, 224 off18000 00000040:00080000:1.0:1651529659.119130:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].56, 136 off18136 00000040:00080000:1.0:1651529659.119134:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].57, 224 off18360 00000040:00080000:1.0:1651529659.119138:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].58, 224 off18584 00000040:00080000:1.0:1651529659.119142:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].59, 136 off18720 00000040:00080000:1.0:1651529659.119145:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].60, 224 off18944 00000040:00080000:1.0:1651529659.119149:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].61, 224 off19168 00000040:00080000:1.0:1651529659.119153:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].62, 112 off19280 00000040:00080000:1.0:1651529659.119157:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].63, 224 off19504 00000040:00080000:1.0:1651529659.119161:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].64, 224 off19728 00000040:00080000:1.0:1651529659.119165:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].65, 112 off19840 00000040:00080000:1.0:1651529659.119168:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].66, 224 off20064 00000040:00080000:1.0:1651529659.119172:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].67, 224 off20288 00000040:00080000:1.0:1651529659.119177:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].68, 136 off20424 00000040:00080000:1.0:1651529659.119197:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].69, 224 off20648 00000040:00080000:1.0:1651529659.119204:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].70, 224 off20872 00000040:00080000:1.0:1651529659.119208:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].71, 136 off21008 00000040:00080000:1.0:1651529659.119212:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].72, 224 off21232 00000040:00080000:1.0:1651529659.119216:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].73, 224 off21456 00000040:00080000:1.0:1651529659.119220:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].74, 112 off21568 00000040:00080000:1.0:1651529659.119223:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].75, 224 off21792 00000040:00080000:1.0:1651529659.119227:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].76, 224 off22016 00000040:00080000:1.0:1651529659.119231:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].77, 112 off22128 00000040:00080000:1.0:1651529659.119235:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].78, 224 off22352 00000040:00080000:1.0:1651529659.119238:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].79, 224 off22576 00000040:00080000:1.0:1651529659.119242:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].80, 136 off22712 00000040:00080000:1.0:1651529659.119247:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].81, 224 off22936 00000040:00080000:1.0:1651529659.119250:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].82, 224 off23160 00000040:00080000:1.0:1651529659.119254:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].83, 136 off23296 00000040:00080000:1.0:1651529659.119258:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].84, 224 off23520 00000040:00080000:1.0:1651529659.119262:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].85, 224 off23744 00000040:00080000:1.0:1651529659.119266:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].86, 112 off23856 00000040:00080000:1.0:1651529659.119269:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].87, 224 off24080 00000040:00080000:1.0:1651529659.119273:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].88, 224 off24304 00000040:00080000:1.0:1651529659.119277:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].89, 112 off24416 00000040:00080000:1.0:1651529659.119442:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].91, 224 off24800 00000040:00080000:1.0:1651529659.119450:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].92, 224 off25024 00000040:00080000:1.0:1651529659.119454:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].93, 112 off25136 00000040:00080000:1.0:1651529659.119458:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].94, 224 off25360 00000040:00080000:1.0:1651529659.119462:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].95, 224 off25584 00000040:00080000:1.0:1651529659.119466:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].96, 112 off25696 00000040:00080000:1.0:1651529659.119470:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].97, 224 off25920 00000040:00080000:1.0:1651529659.119474:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].98, 224 off26144 00000040:00080000:1.0:1651529659.119477:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].99, 136 off26280 00000040:00080000:1.0:1651529659.119482:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].100, 224 off26504 00000040:00080000:1.0:1651529659.119486:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].101, 224 off26728 00000040:00080000:1.0:1651529659.119490:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].102, 136 off26864 00000040:00080000:1.0:1651529659.119494:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].103, 224 off27088 00000040:00080000:1.0:1651529659.119498:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].104, 224 off27312 00000040:00080000:1.0:1651529659.119502:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].105, 136 off27448 00000040:00080000:1.0:1651529659.119505:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].106, 224 off27672 00000040:00080000:1.0:1651529659.119522:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].107, 224 off27896 00000040:00080000:1.0:1651529659.119527:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].108, 136 off28032 00000040:00080000:1.0:1651529659.119531:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].109, 224 off28256 00000040:00080000:1.0:1651529659.119535:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].110, 224 off28480 00000040:00080000:1.0:1651529659.119538:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].111, 112 off28592 00000040:00080000:1.0:1651529659.119560:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].112, 224 off28816 00000040:00080000:1.0:1651529659.119566:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].113, 224 off29040 00000040:00080000:1.0:1651529659.119570:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].114, 112 off29152 00000040:00080000:1.0:1651529659.119574:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].115, 224 off29376 00000040:00080000:1.0:1651529659.119579:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].116, 224 off29600 00000040:00080000:1.0:1651529659.119583:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].117, 136 off29736 00000040:00080000:1.0:1651529659.119587:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].118, 224 off29960 00000040:00080000:1.0:1651529659.119591:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].119, 224 off30184 00000040:00080000:1.0:1651529659.119595:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].120, 136 off30320 00000040:00080000:1.0:1651529659.119598:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].121, 224 off30544 00000040:00080000:1.0:1651529659.119602:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].122, 224 off30768 00000040:00080000:1.0:1651529659.119606:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].123, 112 off30880 00000040:00080000:1.0:1651529659.119610:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].124, 224 off31104 00000040:00080000:1.0:1651529659.119613:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].125, 224 off31328 00000040:00080000:1.0:1651529659.119617:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].126, 112 off31440 00000040:00080000:1.0:1651529659.119621:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].127, 224 off31664 00000040:00080000:1.0:1651529659.119625:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].128, 224 off31888 00000040:00080000:1.0:1651529659.119628:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].129, 136 off32024 00000040:00080000:1.0:1651529659.119632:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].130, 224 off32248 00000040:00080000:1.0:1651529659.119637:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].131, 224 off32472 00000040:00080000:1.0:1651529659.119640:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].132, 112 off32584 00000040:00080000:1.0:1651529659.119795:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].134, 224 off32992 00000040:00080000:1.0:1651529659.119821:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].135, 224 off33216 00000040:00080000:1.0:1651529659.119827:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].136, 136 off33352 00000040:00080000:1.0:1651529659.119831:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].137, 224 off33576 00000040:00080000:1.0:1651529659.119835:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].138, 224 off33800 00000040:00080000:1.0:1651529659.119839:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].139, 112 off33912 00000040:00080000:1.0:1651529659.119843:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].140, 224 off34136 00000040:00080000:1.0:1651529659.119847:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].141, 224 off34360 00000040:00080000:1.0:1651529659.119851:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].142, 136 off34496 00000040:00080000:1.0:1651529659.119855:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].143, 224 off34720 00000040:00080000:1.0:1651529659.119859:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].144, 224 off34944 00000040:00080000:1.0:1651529659.119863:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].145, 136 off35080 00000040:00080000:1.0:1651529659.119866:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].146, 224 off35304 00000040:00080000:1.0:1651529659.119871:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].147, 224 off35528 00000040:00080000:1.0:1651529659.119875:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].148, 136 off35664 00000040:00080000:1.0:1651529659.119879:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].149, 224 off35888 00000040:00080000:1.0:1651529659.119882:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].150, 224 off36112 00000040:00080000:1.0:1651529659.119886:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].151, 112 off36224 00000040:00080000:1.0:1651529659.119890:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].152, 224 off36448 00000040:00080000:1.0:1651529659.119894:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].153, 224 off36672 00000040:00080000:1.0:1651529659.119898:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].154, 136 off36808 00000040:00080000:1.0:1651529659.119930:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].155, 224 off37032 00000040:00080000:1.0:1651529659.119937:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].156, 224 off37256 00000040:00080000:1.0:1651529659.119941:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].157, 112 off37368 00000040:00080000:1.0:1651529659.119945:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].158, 224 off37592 00000040:00080000:1.0:1651529659.119949:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].159, 224 off37816 00000040:00080000:1.0:1651529659.119952:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].160, 136 off37952 00000040:00080000:1.0:1651529659.119956:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].161, 224 off38176 00000040:00080000:1.0:1651529659.119961:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].162, 224 off38400 00000040:00080000:1.0:1651529659.119965:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].163, 136 off38536 00000040:00080000:1.0:1651529659.119969:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].164, 224 off38760 00000040:00080000:1.0:1651529659.119973:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].165, 224 off38984 00000040:00080000:1.0:1651529659.119976:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].166, 112 off39096 00000040:00080000:1.0:1651529659.119980:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].167, 224 off39320 00000040:00080000:1.0:1651529659.119984:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].168, 224 off39544 00000040:00080000:1.0:1651529659.119988:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].169, 112 off39656 00000040:00080000:1.0:1651529659.119991:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].170, 224 off39880 00000040:00080000:1.0:1651529659.119995:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].171, 224 off40104 00000040:00080000:1.0:1651529659.120008:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].172, 136 off40240 00000040:00080000:1.0:1651529659.120012:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].173, 224 off40464 00000040:00080000:1.0:1651529659.120016:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].174, 224 off40688 00000040:00080000:1.0:1651529659.120020:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].175, 136 off40824 00000040:00080000:1.0:1651529659.120180:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].177, 224 off41184 00000040:00080000:1.0:1651529659.120187:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].178, 224 off41408 00000040:00080000:1.0:1651529659.120192:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].179, 136 off41544 00000040:00080000:1.0:1651529659.120196:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].180, 224 off41768 00000040:00080000:1.0:1651529659.120200:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].181, 224 off41992 00000040:00080000:1.0:1651529659.120203:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].182, 136 off42128 00000040:00080000:1.0:1651529659.120207:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].183, 224 off42352 00000040:00080000:1.0:1651529659.120211:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].184, 224 off42576 00000040:00080000:1.0:1651529659.120215:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].185, 112 off42688 00000040:00080000:1.0:1651529659.120219:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].186, 224 off42912 00000040:00080000:1.0:1651529659.120222:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].187, 224 off43136 00000040:00080000:1.0:1651529659.120226:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].188, 112 off43248 00000040:00080000:1.0:1651529659.120230:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].189, 224 off43472 00000040:00080000:1.0:1651529659.120234:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].190, 224 off43696 00000040:00080000:1.0:1651529659.120237:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].191, 136 off43832 00000040:00080000:1.0:1651529659.120241:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].192, 224 off44056 00000040:00080000:1.0:1651529659.120245:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].193, 224 off44280 00000040:00080000:1.0:1651529659.120249:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].194, 136 off44416 00000040:00080000:1.0:1651529659.120253:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].195, 224 off44640 00000040:00080000:1.0:1651529659.120257:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].196, 224 off44864 00000040:00080000:1.0:1651529659.120260:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].197, 136 off45000 00000040:00080000:1.0:1651529659.120280:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].198, 224 off45224 00000040:00080000:1.0:1651529659.120287:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].199, 224 off45448 00000040:00080000:1.0:1651529659.120291:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].200, 136 off45584 00000040:00080000:1.0:1651529659.120295:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].201, 224 off45808 00000040:00080000:1.0:1651529659.120298:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].202, 224 off46032 00000040:00080000:1.0:1651529659.120302:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].203, 112 off46144 00000040:00080000:1.0:1651529659.120308:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x33:0x0].204, 224 off46368 00000040:00080000:1.0:1651529659.120320:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2e:10:0 index 205 count 201 00000100:00100000:1.0:1651529659.120333:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727808:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.120347:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.120562:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727808:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529659.120572:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727872:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529659.120585:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.120798:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727872:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529659.120920:0:176848:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529659.120930:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727936:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.120945:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.121172:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966727936:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.121250:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].1, 224 off8416 00000040:00080000:1.0:1651529659.121258:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].2, 120 off8536 00000040:00080000:1.0:1651529659.121263:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].3, 168 off8704 00000040:00080000:1.0:1651529659.121267:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].4, 224 off8928 00000040:00080000:1.0:1651529659.121271:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].5, 224 off9152 00000040:00080000:1.0:1651529659.121275:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].6, 120 off9272 00000040:00080000:1.0:1651529659.121279:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].7, 168 off9440 00000040:00080000:1.0:1651529659.121283:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].8, 224 off9664 00000040:00080000:1.0:1651529659.121286:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].9, 224 off9888 00000040:00080000:1.0:1651529659.121290:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].10, 88 off9976 00000040:00080000:1.0:1651529659.121294:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].11, 128 off10104 00000040:00080000:1.0:1651529659.121298:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].12, 144 off10248 00000040:00080000:1.0:1651529659.121302:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].13, 160 off10408 00000040:00080000:1.0:1651529659.121305:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].14, 224 off10632 00000040:00080000:1.0:1651529659.121309:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].15, 224 off10856 00000040:00080000:1.0:1651529659.121313:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].16, 120 off10976 00000040:00080000:1.0:1651529659.121317:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].17, 224 off11200 00000040:00080000:1.0:1651529659.121322:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].18, 224 off11424 00000040:00080000:1.0:1651529659.121325:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].19, 88 off11512 00000040:00080000:1.0:1651529659.121329:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].20, 128 off11640 00000040:00080000:1.0:1651529659.121333:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].21, 144 off11784 00000040:00080000:1.0:1651529659.121337:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].22, 128 off11912 00000040:00080000:1.0:1651529659.121341:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].23, 224 off12136 00000040:00080000:1.0:1651529659.121361:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].24, 224 off12360 00000040:00080000:1.0:1651529659.121367:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].25, 88 off12448 00000040:00080000:1.0:1651529659.121371:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].26, 128 off12576 00000040:00080000:1.0:1651529659.121375:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].27, 144 off12720 00000040:00080000:1.0:1651529659.121379:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].28, 128 off12848 00000040:00080000:1.0:1651529659.121383:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].29, 224 off13072 00000040:00080000:1.0:1651529659.121387:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].30, 224 off13296 00000040:00080000:1.0:1651529659.121390:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].31, 120 off13416 00000040:00080000:1.0:1651529659.121394:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].32, 224 off13640 00000040:00080000:1.0:1651529659.121399:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].33, 224 off13864 00000040:00080000:1.0:1651529659.121402:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].34, 112 off13976 00000040:00080000:1.0:1651529659.121406:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].35, 224 off14200 00000040:00080000:1.0:1651529659.121410:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].36, 224 off14424 00000040:00080000:1.0:1651529659.121414:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].37, 136 off14560 00000040:00080000:1.0:1651529659.121418:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].38, 224 off14784 00000040:00080000:1.0:1651529659.121422:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].39, 224 off15008 00000040:00080000:1.0:1651529659.121425:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].40, 136 off15144 00000040:00080000:1.0:1651529659.121429:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].41, 224 off15368 00000040:00080000:1.0:1651529659.121433:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].42, 224 off15592 00000040:00080000:1.0:1651529659.121436:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].43, 112 off15704 00000040:00080000:1.0:1651529659.121440:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].44, 224 off15928 00000040:00080000:1.0:1651529659.121444:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].45, 224 off16152 00000040:00080000:1.0:1651529659.121447:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].46, 112 off16264 00000100:00100000:1.0:1651529659.121455:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728000:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.121469:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.121677:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728000:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.121713:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].48, 224 off16608 00000040:00080000:1.0:1651529659.121719:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].49, 224 off16832 00000040:00080000:1.0:1651529659.121724:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].50, 136 off16968 00000040:00080000:1.0:1651529659.121728:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].51, 224 off17192 00000040:00080000:1.0:1651529659.121732:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].52, 224 off17416 00000040:00080000:1.0:1651529659.121736:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].53, 136 off17552 00000040:00080000:1.0:1651529659.121740:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].54, 224 off17776 00000040:00080000:1.0:1651529659.121744:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].55, 224 off18000 00000040:00080000:1.0:1651529659.121748:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].56, 136 off18136 00000040:00080000:1.0:1651529659.121751:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].57, 224 off18360 00000040:00080000:1.0:1651529659.121755:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].58, 224 off18584 00000040:00080000:1.0:1651529659.121759:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].59, 136 off18720 00000040:00080000:1.0:1651529659.121763:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].60, 224 off18944 00000040:00080000:1.0:1651529659.121767:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].61, 224 off19168 00000040:00080000:1.0:1651529659.121770:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].62, 112 off19280 00000040:00080000:1.0:1651529659.121774:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].63, 224 off19504 00000040:00080000:1.0:1651529659.121778:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].64, 224 off19728 00000040:00080000:1.0:1651529659.121782:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].65, 112 off19840 00000040:00080000:1.0:1651529659.121786:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].66, 224 off20064 00000040:00080000:1.0:1651529659.121790:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].67, 224 off20288 00000040:00080000:1.0:1651529659.121794:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].68, 136 off20424 00000040:00080000:1.0:1651529659.121836:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].69, 224 off20648 00000040:00080000:1.0:1651529659.121844:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].70, 224 off20872 00000040:00080000:1.0:1651529659.121848:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].71, 136 off21008 00000040:00080000:1.0:1651529659.121854:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].72, 224 off21232 00000040:00080000:1.0:1651529659.121859:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].73, 224 off21456 00000040:00080000:1.0:1651529659.121863:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].74, 112 off21568 00000040:00080000:1.0:1651529659.121868:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].75, 224 off21792 00000040:00080000:1.0:1651529659.121881:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].76, 224 off22016 00000040:00080000:1.0:1651529659.121885:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].77, 112 off22128 00000040:00080000:1.0:1651529659.121889:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].78, 224 off22352 00000040:00080000:1.0:1651529659.121893:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].79, 224 off22576 00000040:00080000:1.0:1651529659.121897:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].80, 136 off22712 00000040:00080000:1.0:1651529659.121901:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].81, 224 off22936 00000040:00080000:1.0:1651529659.121905:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].82, 224 off23160 00000040:00080000:1.0:1651529659.121909:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].83, 136 off23296 00000040:00080000:1.0:1651529659.121922:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].84, 224 off23520 00000040:00080000:1.0:1651529659.121927:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].85, 224 off23744 00000040:00080000:1.0:1651529659.121931:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].86, 112 off23856 00000040:00080000:1.0:1651529659.121935:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].87, 224 off24080 00000040:00080000:1.0:1651529659.121939:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].88, 224 off24304 00000040:00080000:1.0:1651529659.121943:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].89, 112 off24416 00000100:00100000:1.0:1651529659.121950:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728064:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.121964:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.122178:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728064:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.122213:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].91, 224 off24800 00000040:00080000:1.0:1651529659.122220:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].92, 224 off25024 00000040:00080000:1.0:1651529659.122224:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].93, 112 off25136 00000040:00080000:1.0:1651529659.122228:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].94, 224 off25360 00000040:00080000:1.0:1651529659.122232:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].95, 224 off25584 00000040:00080000:1.0:1651529659.122237:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].96, 112 off25696 00000040:00080000:1.0:1651529659.122241:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].97, 224 off25920 00000040:00080000:1.0:1651529659.122245:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].98, 224 off26144 00000040:00080000:1.0:1651529659.122249:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].99, 136 off26280 00000040:00080000:1.0:1651529659.122255:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].100, 224 off26504 00000040:00080000:1.0:1651529659.122259:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].101, 224 off26728 00000040:00080000:1.0:1651529659.122263:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].102, 136 off26864 00000040:00080000:1.0:1651529659.122266:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].103, 224 off27088 00000040:00080000:1.0:1651529659.122282:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].104, 224 off27312 00000040:00080000:1.0:1651529659.122286:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].105, 136 off27448 00000040:00080000:1.0:1651529659.122290:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].106, 224 off27672 00000040:00080000:1.0:1651529659.122294:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].107, 224 off27896 00000040:00080000:1.0:1651529659.122297:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].108, 136 off28032 00000040:00080000:1.0:1651529659.122301:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].109, 224 off28256 00000040:00080000:1.0:1651529659.122305:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].110, 224 off28480 00000040:00080000:1.0:1651529659.122308:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].111, 112 off28592 00000040:00080000:1.0:1651529659.122330:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].112, 224 off28816 00000040:00080000:1.0:1651529659.122336:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].113, 224 off29040 00000040:00080000:1.0:1651529659.122340:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].114, 112 off29152 00000040:00080000:1.0:1651529659.122344:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].115, 224 off29376 00000040:00080000:1.0:1651529659.122350:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].116, 224 off29600 00000040:00080000:1.0:1651529659.122354:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].117, 136 off29736 00000040:00080000:1.0:1651529659.122357:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].118, 224 off29960 00000040:00080000:1.0:1651529659.122361:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].119, 224 off30184 00000040:00080000:1.0:1651529659.122365:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].120, 136 off30320 00000040:00080000:1.0:1651529659.122369:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].121, 224 off30544 00000040:00080000:1.0:1651529659.122373:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].122, 224 off30768 00000040:00080000:1.0:1651529659.122376:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].123, 112 off30880 00000040:00080000:1.0:1651529659.122380:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].124, 224 off31104 00000040:00080000:1.0:1651529659.122384:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].125, 224 off31328 00000040:00080000:1.0:1651529659.122387:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].126, 112 off31440 00000040:00080000:1.0:1651529659.122391:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].127, 224 off31664 00000040:00080000:1.0:1651529659.122395:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].128, 224 off31888 00000040:00080000:1.0:1651529659.122399:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].129, 136 off32024 00000040:00080000:1.0:1651529659.122402:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].130, 224 off32248 00000040:00080000:1.0:1651529659.122406:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].131, 224 off32472 00000040:00080000:1.0:1651529659.122411:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].132, 112 off32584 00000100:00100000:1.0:1651529659.122418:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728128:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.122431:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.122637:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728128:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.122672:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].134, 224 off32992 00000040:00080000:1.0:1651529659.122679:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].135, 224 off33216 00000040:00080000:1.0:1651529659.122683:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].136, 136 off33352 00000040:00080000:1.0:1651529659.122687:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].137, 224 off33576 00000040:00080000:1.0:1651529659.122691:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].138, 224 off33800 00000040:00080000:1.0:1651529659.122695:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].139, 112 off33912 00000040:00080000:1.0:1651529659.122698:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].140, 224 off34136 00000040:00080000:1.0:1651529659.122702:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].141, 224 off34360 00000040:00080000:1.0:1651529659.122706:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].142, 136 off34496 00000040:00080000:1.0:1651529659.122710:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].143, 224 off34720 00000040:00080000:1.0:1651529659.122713:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].144, 224 off34944 00000040:00080000:1.0:1651529659.122717:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].145, 136 off35080 00000040:00080000:1.0:1651529659.122721:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].146, 224 off35304 00000040:00080000:1.0:1651529659.122725:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].147, 224 off35528 00000040:00080000:1.0:1651529659.122729:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].148, 136 off35664 00000040:00080000:1.0:1651529659.122734:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].149, 224 off35888 00000040:00080000:1.0:1651529659.122738:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].150, 224 off36112 00000040:00080000:1.0:1651529659.122742:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].151, 112 off36224 00000040:00080000:1.0:1651529659.122745:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].152, 224 off36448 00000040:00080000:1.0:1651529659.122749:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].153, 224 off36672 00000040:00080000:1.0:1651529659.122753:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].154, 136 off36808 00000040:00080000:1.0:1651529659.122773:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].155, 224 off37032 00000040:00080000:1.0:1651529659.122779:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].156, 224 off37256 00000040:00080000:1.0:1651529659.122783:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].157, 112 off37368 00000040:00080000:1.0:1651529659.122787:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].158, 224 off37592 00000040:00080000:1.0:1651529659.122791:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].159, 224 off37816 00000040:00080000:1.0:1651529659.122795:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].160, 136 off37952 00000040:00080000:1.0:1651529659.122799:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].161, 224 off38176 00000040:00080000:1.0:1651529659.122830:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].162, 224 off38400 00000040:00080000:1.0:1651529659.122836:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].163, 136 off38536 00000040:00080000:1.0:1651529659.122841:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].164, 224 off38760 00000040:00080000:1.0:1651529659.122846:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].165, 224 off38984 00000040:00080000:1.0:1651529659.122850:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].166, 112 off39096 00000040:00080000:1.0:1651529659.122854:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].167, 224 off39320 00000040:00080000:1.0:1651529659.122858:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].168, 224 off39544 00000040:00080000:1.0:1651529659.122862:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].169, 112 off39656 00000040:00080000:1.0:1651529659.122866:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].170, 224 off39880 00000040:00080000:1.0:1651529659.122869:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].171, 224 off40104 00000040:00080000:1.0:1651529659.122873:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].172, 136 off40240 00000040:00080000:1.0:1651529659.122877:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].173, 224 off40464 00000040:00080000:1.0:1651529659.122881:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].174, 224 off40688 00000040:00080000:1.0:1651529659.122885:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].175, 136 off40824 00000100:00100000:1.0:1651529659.122892:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728192:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.122905:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.123124:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728192:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.123160:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].177, 224 off41184 00000040:00080000:1.0:1651529659.123167:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].178, 224 off41408 00000040:00080000:1.0:1651529659.123171:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].179, 136 off41544 00000040:00080000:1.0:1651529659.123175:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].180, 224 off41768 00000040:00080000:1.0:1651529659.123179:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].181, 224 off41992 00000040:00080000:1.0:1651529659.123184:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].182, 136 off42128 00000040:00080000:1.0:1651529659.123188:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].183, 224 off42352 00000040:00080000:1.0:1651529659.123192:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].184, 224 off42576 00000040:00080000:1.0:1651529659.123196:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].185, 112 off42688 00000040:00080000:1.0:1651529659.123200:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].186, 224 off42912 00000040:00080000:1.0:1651529659.123204:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].187, 224 off43136 00000040:00080000:1.0:1651529659.123207:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].188, 112 off43248 00000040:00080000:1.0:1651529659.123211:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].189, 224 off43472 00000040:00080000:1.0:1651529659.123215:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].190, 224 off43696 00000040:00080000:1.0:1651529659.123219:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].191, 136 off43832 00000040:00080000:1.0:1651529659.123223:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].192, 224 off44056 00000040:00080000:1.0:1651529659.123227:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].193, 224 off44280 00000040:00080000:1.0:1651529659.123230:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].194, 136 off44416 00000040:00080000:1.0:1651529659.123234:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].195, 224 off44640 00000040:00080000:1.0:1651529659.123238:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].196, 224 off44864 00000040:00080000:1.0:1651529659.123242:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].197, 136 off45000 00000040:00080000:1.0:1651529659.123263:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].198, 224 off45224 00000040:00080000:1.0:1651529659.123269:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].199, 224 off45448 00000040:00080000:1.0:1651529659.123273:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].200, 136 off45584 00000040:00080000:1.0:1651529659.123277:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].201, 224 off45808 00000040:00080000:1.0:1651529659.123281:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].202, 224 off46032 00000040:00080000:1.0:1651529659.123285:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].203, 112 off46144 00000100:00100000:1.0:1651529659.123292:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728256:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529659.123305:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b512ab57 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.123522:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728256:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529659.123536:0:176848:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x34:0x0].204, 224 off46368 00000040:00080000:1.0:1651529659.123539:0:176848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 205 count 201 00000020:01000004:1.0:1651529659.123674:0:176883:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1651529659.123676:0:176883:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529659.123689:0:176883:0:(genops.c:417:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (000000005c29ba19) 00000020:00000080:1.0:1651529659.123719:0:176883:0:(obd_config.c:648:class_attach()) OBD: dev 4 attached type lwp with refcount 1 00000020:00000080:1.0:1651529659.123720:0:176883:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1651529659.123772:0:176883:0:(ldlm_lib.c:115:import_set_conn()) imp 0000000010ca3c65@lustre-MDT0000-lwp-OST0000: add connection 10.240.43.61@tcp at head 00010000:00010000:1.0:1651529659.125133:0:176883:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-1 is initialized 00000020:00000080:1.0:1651529659.125152:0:176883:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1651529659.125160:0:176883:0:(lwp_dev.c:495:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1651529659.125163:0:176883:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa29a79078f3c1ae2 00000100:00080000:1.0:1651529659.125166:0:176883:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:1.0:1651529659.125168:0:176883:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000010ca3c65 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651529659.125189:0:176883:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf518e04 x1731745966728320/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529659.125198:0:176883:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1651529659.125211:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966728320:10.240.43.61@tcp:38:llog_process_th.0 00010000:00080000:1.0:1651529659.125470:0:39026:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@00000000cf518e04 x1731745966728320/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529664 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'llog_process_th.0' 00000100:00100000:1.0:1651529659.125475:0:39026:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1651529659.125477:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 8 00000100:00080000:1.0:1651529659.125479:0:39026:0:(import.c:933:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1651529659.125481:0:39026:0:(import.c:1158:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1651529659.125482:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1651529659.125484:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966728320:10.240.43.61@tcp:38:llog_process_th.0 00000040:00080000:1.0:1651529659.125658:0:176883:0:(llog.c:768:llog_process_thread()) stop processing plain 0x34:10:0 index 205 count 201 00000020:01000000:1.0:1651529659.125686:0:176848:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 1-204 (rc=0) 10000000:01000000:1.0:1651529659.125693:0:176848:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1651529659.125695:0:176848:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529659.125700:0:176848:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529659.125708:0:176848:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0000 0x40000002 10000000:01000000:1.0:1651529659.125713:0:176848:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1651529659.125717:0:176848:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728384:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:1.0:1651529659.125729:0:176848:0:(client.c:2492:ptlrpc_set_wait()) set 000000006a957e74 going to sleep for 6 seconds 00000100:00100000:1.0:1651529659.172749:0:176848:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30052a09-f4a3-492a-add7-6d156733f5e5:176848:1731745966728384:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:1.0:1651529659.172753:0:176848:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:02000000:1.0:1651529659.172757:0:176848:0:(obd_mount_server.c:2104:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 300-900 00000001:00000004:1.0:1651529659.174984:0:176848:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00002000:00080000:1.0:1651529659.238719:0:176848:0:(ofd_obd.c:544:ofd_postrecov()) lustre-OST0000: recovery is over 00000020:01000004:1.0:1651529659.238728:0:176848:0:(obd_mount_server.c:312:server_mgc_clear_fs()) Unassign mgc disk 00000020:01000004:1.0:1651529659.238742:0:176848:0:(obd_mount_server.c:1875:server_fill_super_common()) Server sb, dev=51 00000080:00000004:1.0:1651529659.238746:0:176848:0:(super25.c:179:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000400:00000080:0.0:1651529660.308101:0:177230:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529660.308104:0:177230:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm3.trevis.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 48 00000100:00100000:1.0:1651529660.640659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529660.640795:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946694528 00000100:00100000:1.0:1651529660.640827:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529660.640829:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:39028:x1731745946694528:12345-10.240.43.61@tcp:8:kworker/u4:1.0 00010000:00080000:1.0:1651529660.640842:0:176865:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000002beaa81 cur 13260 last 0 00000020:00000080:1.0:1651529660.640855:0:176865:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa29a79078f3c1ae9 00002000:00100000:1.0:1651529660.640860:0:176865:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/0000000025c57667 ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1651529660.640862:0:176865:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1651529660.640863:0:176865:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651529660.640892:0:176865:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651529660.640906:0:176865:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529660.640928:0:176865:0:(import.c:85:import_set_state_nolock()) 00000000b9cbdc7e .«Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529660.640954:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946694528:12345-10.240.43.61@tcp:8:kworker/u4:1.0 Request processed in 124us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529660.640958:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529660.641207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529660.641217:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529660.641229:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946694720 00000100:00100000:1.0:1651529660.641237:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529660.641240:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946694720:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529660.641249:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529660.641261:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946694720:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529660.641264:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529660.641272:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946694784 00000100:00100000:1.0:1651529660.641278:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529660.641279:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209976:x1731745946694784:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529660.641653:0:176864:0:(ofd_fs.c:445:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1651529660.641656:0:176864:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179073 -> diff = -114 00002000:02000040:1.0:1651529660.641658:0:176864:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:178960 to 0x0:179073 00002000:00010000:1.0:1651529660.643586:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.643590:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 3/0,1 mode: --/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643597:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.643598:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.643600:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 3/0,1 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643607:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 3/0,1 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643612:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 3/0,1 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643615:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 2/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.643967:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.643970:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 3/0,1 mode: --/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643974:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.643975:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.643976:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 3/0,1 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643980:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 3/0,1 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643983:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 3/0,1 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.643986:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 2/0,0 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.644213:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.644216:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 3/0,1 mode: --/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644220:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644220:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644221:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 3/0,1 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644225:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 3/0,1 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644228:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 3/0,1 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644231:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 2/0,0 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.644439:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.644441:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 3/0,1 mode: --/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644445:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644445:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644446:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 3/0,1 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644450:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 3/0,1 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644453:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 3/0,1 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644456:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 2/0,0 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.644663:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.644665:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 3/0,1 mode: --/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644672:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644673:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.644674:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 3/0,1 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644677:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 3/0,1 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644680:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 3/0,1 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644683:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 2/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644834:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 2/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644838:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2f9496d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.644840:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 2/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644843:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 3/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644850:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 1/0,0 mode: --/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644865:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f9496d/0xa29a79078f3c1af0 lrc: 0/0,0 mode: --/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644870:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 2/0,0 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644873:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6e2a7ad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.644874:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 2/0,0 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644877:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 3/0,0 mode: PW/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644880:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 1/0,0 mode: --/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644883:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e2a7ad/0xa29a79078f3c1af7 lrc: 0/0,0 mode: --/PW res: [0x2bb80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644886:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 2/0,0 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644888:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748a867f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.644889:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 2/0,0 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644894:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 3/0,0 mode: PW/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644897:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 1/0,0 mode: --/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644900:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748a867f/0xa29a79078f3c1afe lrc: 0/0,0 mode: --/PW res: [0x2bb7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644903:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 2/0,0 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644905:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.644906:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 2/0,0 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644909:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 3/0,0 mode: PW/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644911:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 1/0,0 mode: --/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644921:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1b05 lrc: 0/0,0 mode: --/PW res: [0x2bb7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644925:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 2/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644928:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.644929:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 2/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644931:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 3/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644934:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 1/0,0 mode: --/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.644937:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1b0c lrc: 0/0,0 mode: --/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.645019:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.645021:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 3/0,1 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645024:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645025:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645026:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645029:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645032:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645038:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645090:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645094:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.645094:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645098:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645102:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 1/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645105:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1b13 lrc: 0/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.645259:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.645261:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 3/0,1 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645265:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645265:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645266:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645281:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645284:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645287:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645339:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645342:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.645343:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645346:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645351:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 1/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645353:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1b1a lrc: 0/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.645500:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.645510:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 3/0,1 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645514:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645514:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645515:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645519:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645522:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645524:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645576:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645580:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.645581:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645584:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645589:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 1/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645601:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1b21 lrc: 0/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.645744:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.645746:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 3/0,1 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645749:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645750:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.645751:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645754:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645758:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645760:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645827:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645831:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.645832:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645837:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645842:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 1/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.645845:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1b28 lrc: 0/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.645997:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.645999:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 3/0,1 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646003:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646004:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646005:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646008:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646011:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646014:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646067:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646072:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.646073:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646076:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646080:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 1/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646083:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b2f lrc: 0/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.646226:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.646228:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 3/0,1 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646232:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646232:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646233:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646237:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646242:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646245:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646291:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646299:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529660.646300:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646304:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646312:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 1/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646315:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b36 lrc: 0/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.646493:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.646495:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 3/0,1 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646499:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646500:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646501:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646504:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646507:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646510:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646565:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646572:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.646573:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646575:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646580:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 1/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646583:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b3d lrc: 0/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.646762:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.646764:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 3/0,1 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646768:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646769:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.646770:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646780:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646784:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.646797:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646845:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646851:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068800f9f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529660.646852:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646858:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646864:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 1/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.646867:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068800f9f/0xa29a79078f3c1b44 lrc: 0/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.647047:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.647050:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 3/0,1 mode: --/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647054:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647054:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647055:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 3/0,1 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647059:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 3/0,1 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647062:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 3/0,1 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647065:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 2/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647120:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 2/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647124:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfcbc7ed already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.647125:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 2/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647137:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 3/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647143:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 1/0,0 mode: --/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647145:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcbc7ed/0xa29a79078f3c1b4b lrc: 0/0,0 mode: --/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.647304:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.647306:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 3/0,1 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647310:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647310:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647311:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647315:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647318:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647321:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.647376:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.647380:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068fe190e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529660.647381:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.647384:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 3/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.647390:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 1/0,0 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529660.647392:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fe190e/0xa29a79078f3c1b52 lrc: 0/0,0 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.647938:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.647941:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 3/0,1 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647945:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647946:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.647946:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647950:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647954:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.647956:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648003:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648007:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8457821 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.648008:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648011:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 3/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648018:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 1/0,0 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648021:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8457821/0xa29a79078f3c1b59 lrc: 0/0,0 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.648203:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.648205:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 3/0,1 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648209:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648210:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648211:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648214:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648217:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648220:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.648433:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.648435:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 3/0,1 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648441:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648442:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648443:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648446:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648449:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648452:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648507:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648511:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e7f88a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.648513:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648516:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 3/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648520:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 1/0,0 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648526:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e7f88a/0xa29a79078f3c1b60 lrc: 0/0,0 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648530:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648532:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f3fd4d2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.648533:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648547:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 3/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648550:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 1/0,0 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648553:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3fd4d2/0xa29a79078f3c1b67 lrc: 0/0,0 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.648682:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.648684:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 3/0,1 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648688:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648688:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648689:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648695:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648698:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648700:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648750:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648754:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003add3d75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.648755:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648759:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 3/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648763:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 1/0,0 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648766:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003add3d75/0xa29a79078f3c1b6e lrc: 0/0,0 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.648910:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.648922:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 3/0,1 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648926:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648926:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.648927:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648931:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648934:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648936:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648987:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648995:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004518a1dd already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.648996:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.648999:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 3/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649003:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 1/0,0 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649008:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004518a1dd/0xa29a79078f3c1b75 lrc: 0/0,0 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.649152:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.649154:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 3/0,1 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649158:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649158:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649159:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649163:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649166:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649168:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649218:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649222:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80aa875 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.649223:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649229:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 3/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649234:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 1/0,0 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649236:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80aa875/0xa29a79078f3c1b7c lrc: 0/0,0 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.649377:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.649380:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 3/0,1 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649383:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649384:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649385:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649388:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649391:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649394:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649457:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649461:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000230803cc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.649462:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649465:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 3/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649470:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 1/0,0 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649472:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230803cc/0xa29a79078f3c1b83 lrc: 0/0,0 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.649616:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.649618:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 3/0,1 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649622:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649623:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649623:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649627:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649632:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649635:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649686:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649690:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb0ce92a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.649691:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649694:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 3/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649698:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 1/0,0 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649701:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb0ce92a/0xa29a79078f3c1b8a lrc: 0/0,0 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.649848:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.649850:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 3/0,1 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649854:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649855:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.649856:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649859:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649862:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649865:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649923:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649927:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9cf9467 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.649928:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649931:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 3/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649936:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 1/0,0 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.649939:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9cf9467/0xa29a79078f3c1b91 lrc: 0/0,0 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.650082:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.650084:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 3/0,1 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650088:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650088:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650089:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650092:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650095:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650098:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650148:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650152:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000432a99 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.650153:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650156:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 3/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650164:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 1/0,0 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650167:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000432a99/0xa29a79078f3c1b98 lrc: 0/0,0 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.650305:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.650307:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 3/0,1 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650311:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650311:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650312:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650316:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650319:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650321:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650371:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650377:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071a5e057 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.650379:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650381:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 3/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650386:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 1/0,0 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650389:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a5e057/0xa29a79078f3c1b9f lrc: 0/0,0 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.650529:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.650531:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 3/0,1 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650535:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650535:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650536:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650539:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650542:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650547:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650598:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650602:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000116ed8ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.650603:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650606:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 3/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650611:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 1/0,0 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650614:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116ed8ae/0xa29a79078f3c1ba6 lrc: 0/0,0 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.650757:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.650759:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 3/0,1 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650763:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650763:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.650764:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650770:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650773:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650775:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650838:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650842:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a60e195 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.650843:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650846:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 3/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650850:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 1/0,0 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.650853:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60e195/0xa29a79078f3c1bad lrc: 0/0,0 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.651004:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.651007:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 3/0,1 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651010:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651011:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651012:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651015:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651018:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651021:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651077:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651082:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ff9a3a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.651083:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651086:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 3/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651090:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 1/0,0 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651095:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ff9a3a/0xa29a79078f3c1bb4 lrc: 0/0,0 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.651236:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.651238:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 3/0,1 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651241:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651242:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651243:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651246:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651249:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651252:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651302:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651306:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036531b38 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.651307:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651320:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 3/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651324:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 1/0,0 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651327:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036531b38/0xa29a79078f3c1bbb lrc: 0/0,0 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.651470:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.651472:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 3/0,1 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651475:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651476:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651477:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651480:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651483:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651486:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651548:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651552:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014e2ea2c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.651553:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651556:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 3/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651561:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 1/0,0 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651564:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e2ea2c/0xa29a79078f3c1bc2 lrc: 0/0,0 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529660.651708:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bb62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529660.651710:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 3/0,1 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651714:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651715:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529660.651715:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651719:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651733:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651735:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651788:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651792:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055085556 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529660.651792:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651795:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 3/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651800:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 1/0,0 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529660.651813:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055085556/0xa29a79078f3c1bc9 lrc: 0/0,0 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529660.655956:0:176864:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:178959 00000100:00100000:1.0:1651529660.655971:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209976:x1731745946694784:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 14691us (14764us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529660.655975:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529660.656196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529660.656204:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946694848 00000100:00100000:1.0:1651529660.656212:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529660.656214:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209976:x1731745946694848:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651529660.656224:0:176864:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 179074 00000100:00100000:1.0:1651529660.657793:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209976:x1731745946694848:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 1578us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529660.657797:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529665.760161:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529665.760182:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946695168 00000100:00100000:1.0:1651529665.760199:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529665.760202:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946695168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529665.760219:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529665.760239:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946695168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529665.760243:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529666.020541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529666.020551:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352182720 00000100:00100000:1.0:1651529666.020560:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529666.020562:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:438145:x1731754352182720:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:1.0:1651529666.020571:0:176864:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13265 last 0 00000020:00000080:1.0:1651529666.020583:0:176864:0:(genops.c:1359:class_connect()) connect: client ec96cd77-f6e5-48c2-876b-61a646cc1c34, cookie 0xa29a79078f3c1bd0 00002000:00100000:1.0:1651529666.020588:0:176864:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli ec96cd77-f6e5-48c2-876b-61a646cc1c34/00000000e580177a ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529666.020592:0:176864:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529666.020624:0:176864:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651529666.020648:0:176864:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529666.020659:0:176864:0:(import.c:85:import_set_state_nolock()) 000000008046fc10 .«Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529666.020674:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438145:x1731754352182720:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 111us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529666.020677:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00000001:00100000:1.0:1651529666.093228:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000001:00100000:1.0:1651529666.093242:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1651529667.307826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529667.307844:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183040 00000100:00100000:1.0:1651529667.307864:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529667.307867:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:439218:x1731754352183040:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529667.307881:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529667.307929:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:439218:x1731754352183040:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529667.307933:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000400:00000080:1.0:1651529667.839308:0:177399:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529667.839311:0:177399:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=100 00000100:00100000:1.0:1651529668.562483:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529668.562507:0:176853:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946695360 00000100:00100000:1.0:1651529668.562525:0:176853:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529668.562528:0:176853:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30052a09-f4a3-492a-add7-6d156733f5e5+3:210728:x1731745946695360:12345-10.240.43.61@tcp:104: 00000100:00100000:1.0:1651529668.562566:0:176853:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6a45c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30052a09-f4a3-492a-add7-6d156733f5e5+3:210728:x1731745946695360:12345-10.240.43.61@tcp:104: Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529668.562570:0:176853:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00010000:00010000:1.0:1651529668.562581:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562591:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020767202 already unused, calling callback (00000000edc3646f) 10000000:00010000:1.0:1651529668.562593:0:176858:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562596:0:176858:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529668.562599:0:176858:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529668.562602:0:176858:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651529668.562625:0:176858:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562628:0:176858:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1651529668.562636:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562639:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000020767202/0xa29a79078f3c1acd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd6267 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529668.562660:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966728448:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529668.562941:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966728448:10.240.43.61@tcp:103:ldlm_bl_02.0 10000000:01000000:0.0:1651529670.140836:0:176861:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651529670.140839:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16c2c2a000 from 16 10000000:01000000:0.0:1651529670.140841:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529670.140853:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.140858:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.140863:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529670.140871:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728512:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.140891:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000005115c455 going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.141144:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728512:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529670.141151:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.141155:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529670.141180:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728576:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.141196:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000005115c455 going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.141393:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728576:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.141404:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728640:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.141423:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000005115c455 going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.141654:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966728640:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.141733:0:177457:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30052a09-f4a3-492a-add7-6d156733f5e5:177457:1731745966728704:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529670.141750:0:177457:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4f4936e going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.142343:0:177457:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30052a09-f4a3-492a-add7-6d156733f5e5:177457:1731745966728704:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529670.142352:0:177457:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529670.142355:0:177457:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529670.142356:0:177457:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1651529670.142359:0:177457:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e16c2c2a000 00000020:00000080:0.0:1651529670.142360:0:177457:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529670.144600:0:177457:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2234us 00000100:00100000:0.0:1651529670.144612:0:177457:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30052a09-f4a3-492a-add7-6d156733f5e5:177457:1731745966728768:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529670.144634:0:177457:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4f4936e going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.144872:0:177457:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30052a09-f4a3-492a-add7-6d156733f5e5:177457:1731745966728768:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529670.144879:0:177457:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529670.144881:0:177457:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529670.144882:0:177457:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1651529670.144884:0:177457:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 19 count 19 00000020:01000000:0.0:1651529670.144929:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 16-18 (rc=0) 10000000:01000000:0.0:1651529670.144936:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529670.144938:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.144943:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529670.880122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529670.880133:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946695872 00000100:00100000:1.0:1651529670.880144:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529670.880147:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946695872:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529670.880160:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529670.880180:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946695872:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529670.880184:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529676.000227:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529676.000245:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696256 00000100:00100000:1.0:1651529676.000265:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529676.000268:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696256:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529676.000285:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529676.000314:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696256:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529676.000317:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000400:00000080:0.0:1651529676.049415:0:177673:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529676.049417:0:177673:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133h: Proc files should end with newlines ========================================================== 22:14:35 (1651529675) 00000100:00100000:1.0:1651529677.795715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529677.795734:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183616 00000100:00100000:1.0:1651529677.795755:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529677.795758:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441137:x1731754352183616:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529677.795790:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441137:x1731754352183616:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 31us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529677.795793:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529678.932531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529678.932544:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183808 00000100:00100000:1.0:1651529678.932559:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529678.932561:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000bf9a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441767:x1731754352183808:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529678.932585:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000bf9a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441767:x1731754352183808:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 23us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529678.932588:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529679.733202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529679.733217:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352184064 00000100:00100000:1.0:1651529679.733234:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529679.733237:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:442208:x1731754352184064:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529679.733261:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:442208:x1731754352184064:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 24us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529679.733264:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529681.120191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529681.120205:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696448 00000100:00100000:1.0:1651529681.120221:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529681.120224:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696448:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529681.120240:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529681.120261:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696448:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529681.120265:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529684.156872:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529684.156883:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966728832:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529684.159199:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ccddbd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966728832:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529686.240938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529686.240951:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696576 00000100:00100000:1.0:1651529686.240964:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529686.240967:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529686.240979:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529686.240995:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 27us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529686.241000:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529691.360184:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529691.360199:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696704 00000100:00100000:1.0:1651529691.360215:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529691.360217:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529691.360231:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529691.360251:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529691.360254:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529695.420886:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529695.420900:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090d075b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966728896:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529695.423134:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090d075b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966728896:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529696.480200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529696.480212:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696960 00000100:00100000:1.0:1651529696.480225:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529696.480228:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529696.480240:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529696.480254:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 26us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529696.480258:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529701.600220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529701.600233:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697088 00000100:00100000:1.0:1651529701.600248:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529701.600250:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946697088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529701.600263:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529701.600280:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946697088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529701.600284:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529705.668308:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529705.668322:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352184320 00000100:00100000:1.0:1651529705.668338:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529705.668341:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:438145:x1731754352184320:12345-10.240.43.64@tcp:9:kworker/u4:0.0 00000020:00000080:1.0:1651529705.668358:0:176864:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1bd0 00000100:00080000:1.0:1651529705.668361:0:176864:0:(import.c:85:import_set_state_nolock()) 000000008046fc10 PôµŽÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529705.668377:0:176864:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00000100:00100000:1.0:1651529705.668435:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+2:438145:x1731754352184320:12345-10.240.43.64@tcp:9:kworker/u4:0.0 Request processed in 93us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529705.668438:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529706.720190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529706.720203:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697216 00000100:00100000:1.0:1651529706.720215:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:1.0:1651529706.720217:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697216:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529706.720229:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529706.720244:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697216:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 26us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529706.720247:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:1.0:1651529708.732892:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529708.732904:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966728960:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529708.733215:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966728960:10.240.43.61@tcp:400:kworker/u4:1.0 00000001:00100000:1.0:1651529711.362897:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:1.0:1651529711.362900:0:176850:0:(genops.c:985:class_export_put()) final put 00000000e580177a/ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:0.0:1651529711.362925:0:170153:0:(genops.c:944:class_export_destroy()) destroying export 00000000e580177a/ec96cd77-f6e5-48c2-876b-61a646cc1c34 for lustre-OST0000 00000020:00000080:0.0:1651529711.362957:0:170153:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000008046fc10 for lustre-OST0000 00000100:00100000:1.0:1651529711.841009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529711.841022:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697344 00000100:00100000:1.0:1651529711.841036:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:1.0:1651529711.841039:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529711.841052:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529711.841068:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 28us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529711.841071:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:1.0:1651529716.960264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529716.960276:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697472 00000100:00100000:1.0:1651529716.960289:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529716.960292:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529716.960303:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529716.960319:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 27us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529716.960322:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529721.020878:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529721.020890:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966729024:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529721.021192:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c9f0a92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966729024:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529722.080204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529722.080215:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697728 00000100:00100000:1.0:1651529722.080228:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:1.0:1651529722.080230:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529722.080243:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529722.080257:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 26us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529722.080261:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:1.0:1651529727.202337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529727.202353:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697920 00000100:00100000:1.0:1651529727.202370:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:1.0:1651529727.202372:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529727.202387:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529727.202405:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 32us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529727.202409:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:1.0:1651529732.321155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529732.321168:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698048 00000100:00100000:1.0:1651529732.321182:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:1.0:1651529732.321185:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698048:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529732.321198:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529732.321216:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698048:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 31us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529732.321219:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:0.0:1651529734.332859:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529734.332870:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966729088:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529734.333216:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966729088:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529737.440149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529737.440161:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698176 00000100:00100000:1.0:1651529737.440174:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:1.0:1651529737.440177:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698176:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529737.440189:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529737.440216:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698176:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529737.440220:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:1.0:1651529742.560151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529742.560169:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698368 00000100:00100000:1.0:1651529742.560188:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 17 00000100:00100000:1.0:1651529742.560190:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529742.560207:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529742.560230:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529742.560233:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 17 00000100:00100000:1.0:1651529746.622385:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000830ccf65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729152:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529746.622669:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000830ccf65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729152:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529747.680164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529747.680893:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698496 00000100:00100000:0.0:1651529747.680919:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 18 00000100:00100000:0.0:1651529747.680922:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698496:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529747.680939:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529747.680975:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698496:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 53us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529747.680979:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 18 00000100:00100000:1.0:1651529752.800135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529752.800152:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698688 00000100:00100000:1.0:1651529752.800176:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 19 00000100:00100000:1.0:1651529752.800179:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698688:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529752.800196:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529752.800220:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698688:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529752.800224:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 19 00000100:00100000:1.0:1651529757.920114:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529757.920139:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698816 00000100:00100000:1.0:1651529757.920159:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 20 00000100:00100000:1.0:1651529757.920162:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529757.920179:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529757.920203:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529757.920207:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 20 00000100:00100000:1.0:1651529758.908888:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529758.908901:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966729216:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529758.909178:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006faf06e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966729216:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529763.040143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529763.040160:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698880 00000100:00100000:1.0:1651529763.040179:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 21 00000100:00100000:1.0:1651529763.040182:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698880:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529763.040198:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529763.040221:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698880:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529763.040225:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 21 00000100:00100000:1.0:1651529768.160364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529768.160382:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699136 00000100:00100000:1.0:1651529768.160401:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 22 00000100:00100000:1.0:1651529768.160404:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699136:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529768.160421:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529768.160444:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699136:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529768.160448:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 22 00000100:00100000:1.0:1651529772.220864:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000763950ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729280:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529772.221165:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000763950ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729280:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529773.280148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529773.280166:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699200 00000100:00100000:1.0:1651529773.280185:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 23 00000100:00100000:1.0:1651529773.280188:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529773.280205:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529773.280229:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529773.280232:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 23 00000100:00100000:1.0:1651529778.401018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529778.401036:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699456 00000100:00100000:1.0:1651529778.401062:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 24 00000100:00100000:1.0:1651529778.401064:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699456:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529778.401081:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529778.401106:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699456:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529778.401109:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 24 00000100:00100000:1.0:1651529780.353462:0:189488:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd55cbfc pname:cluuid:pid:xid:nid:opc:job lctl:30052a09-f4a3-492a-add7-6d156733f5e5:189488:1731745966729344:10.240.43.61@tcp:400:lctl.0 00000100:00100000:1.0:1651529780.353497:0:189488:0:(client.c:2492:ptlrpc_set_wait()) set 00000000225a769d going to sleep for 6 seconds 00000100:00100000:1.0:1651529780.354173:0:189488:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd55cbfc pname:cluuid:pid:xid:nid:opc:job lctl:30052a09-f4a3-492a-add7-6d156733f5e5:189488:1731745966729344:10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529783.522852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529783.524830:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699584 00000100:00100000:0.0:1651529783.524850:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 25 00000100:00100000:0.0:1651529783.524853:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699584:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529783.524870:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529783.524893:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699584:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529783.524897:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 25 00000100:00100000:1.0:1651529784.508886:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd55cbfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966729408:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529784.509203:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd55cbfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966729408:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529788.640164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529788.640182:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699648 00000100:00100000:0.0:1651529788.640200:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 26 00000100:00100000:0.0:1651529788.640203:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529788.640219:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529788.640242:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529788.640247:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 26 00000100:00100000:0.0:1651529793.760125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529793.760142:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699904 00000100:00100000:0.0:1651529793.760161:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 27 00000100:00100000:0.0:1651529793.760163:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699904:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529793.760181:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529793.760204:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699904:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529793.760207:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 27 00000400:00000080:1.0:1651529796.853416:0:193963:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529796.853419:0:193963:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 134a: Server reclaims locks when reaching lock_reclaim_threshold ========================================================== 22:16:36 (1651529796) 00000100:00100000:0.0:1651529798.761679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529798.761713:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352474240 00000100:00100000:1.0:1651529798.761742:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651529798.761745:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:438145:x1731754352474240:12345-10.240.43.64@tcp:8:touch.0 00010000:00080000:1.0:1651529798.761785:0:176865:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13398 last 0 00000020:00000080:1.0:1651529798.761828:0:176865:0:(genops.c:1359:class_connect()) connect: client ec96cd77-f6e5-48c2-876b-61a646cc1c34, cookie 0xa29a79078f3c1bde 00002000:00100000:1.0:1651529798.761834:0:176865:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli ec96cd77-f6e5-48c2-876b-61a646cc1c34/00000000e614bec4 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529798.761839:0:176865:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529798.761877:0:176865:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651529798.761888:0:176865:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529798.761918:0:176865:0:(import.c:85:import_set_state_nolock()) 000000006b1932d0 PôµŽÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529798.761950:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438145:x1731754352474240:12345-10.240.43.64@tcp:8:touch.0 Request processed in 204us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529798.761954:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:0.0:1651529798.762199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529798.762221:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352474304 00000100:00100000:1.0:1651529798.762232:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651529798.762234:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:0:x1731754352474304:12345-10.240.43.64@tcp:2:touch.0 00000001:00080000:1.0:1651529798.867270:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654705665 is committed 00000001:00100000:1.0:1651529798.867273:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000100:00100000:1.0:1651529798.867338:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:0:x1731754352474304:12345-10.240.43.64@tcp:2:touch.0 Request processed in 105103us (105139us total) trans 38654705665 rc 0/0 00000100:00100000:1.0:1651529798.867342:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651529798.880119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529798.880138:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734400 00000100:00100000:0.0:1651529798.880156:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 28 00000100:00100000:0.0:1651529798.880159:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca831975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734400:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529798.880166:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8701632 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529798.880181:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca831975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734400:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529798.880184:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 28 00000100:00100000:0.0:1651529804.000131:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529804.000140:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734592 00000100:00100000:0.0:1651529804.000160:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 29 00000100:00100000:0.0:1651529804.000162:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000051dd470 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734592:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529804.000172:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8701632 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529804.000186:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000051dd470 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734592:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529804.000190:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 29 00000100:00100000:1.0:1651529806.012900:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966729536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529806.012900:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009601edf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729472:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529806.013252:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009601edf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966729472:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529806.013256:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d462b184 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966729536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529809.120168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529809.120183:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734656 00000100:00100000:1.0:1651529809.120207:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 30 00000100:00100000:1.0:1651529809.120210:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651529809.120224:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8701632 pending 0 free 81208979456 avail 77038268416 00000100:00100000:1.0:1651529809.120248:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529809.120251:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 30 00000100:00100000:1.0:1651529809.248494:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529809.248506:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352474816 00000100:00100000:1.0:1651529809.248523:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:1.0:1651529809.248526:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:438149:x1731754352474816:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:1.0:1651529809.248531:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529809.248562:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1be5 lrc: 2/0,0 mode: --/PR res: [0x2bd76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f0ec7 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529809.248588:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd76:0x0] initial LVB size: 0, mtime: 0x62705846, atime: 0x62705846, ctime: 0x62705846, blocks: 0x0 00010000:00010000:1.0:1651529809.248611:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529809.248612:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529809.248624:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1be5 lrc: 3/0,0 mode: PR/PR res: [0x2bd76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f0ec7 expref: 6 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529809.248636:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020767202/0xa29a79078f3c1be5 lrc: 3/0,0 mode: PR/PR res: [0x2bd76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f0ec7 expref: 6 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529809.248645:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000020767202, rc 0) 00000100:00100000:1.0:1651529809.248662:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438149:x1731754352474816:12345-10.240.43.64@tcp:101:rm.0 Request processed in 136us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529809.248665:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000400:00000080:0.0:1651529811.706322:0:194397:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529811.706335:0:194397:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 134b: Server rejects lock request when reaching lock_limit_mb ========================================================== 22:16:51 (1651529811) 00000400:00000080:1.0:1651529916.203649:0:194833:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529916.203660:0:194833:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_135 skipping SLOW test 135 00000400:00000080:1.0:1651529916.507365:0:194887:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529916.507368:0:194887:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_136 skipping SLOW test 136 00000100:00100000:0.0:1651529916.640279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529916.640322:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803008 00000100:00100000:0.0:1651529916.640355:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 51 00000100:00100000:0.0:1651529916.640358:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946803008:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529916.640379:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 254912 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529916.640405:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946803008:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529916.640409:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 51 00000100:00100000:0.0:1651529917.229337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.229380:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803136 00000100:00100000:0.0:1651529917.229386:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803264 00000100:00100000:1.0:1651529917.229406:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 524 00000100:00100000:1.0:1651529917.229410:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5035c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946803136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.229410:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 525 00000100:00100000:0.0:1651529917.229412:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946803264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.229425:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179576 count 1 00002000:00080000:0.0:1651529917.229425:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179578 count 1 00002000:00010000:1.0:1651529917.229448:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529917.229449:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229458:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 3/0,1 mode: --/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229458:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 3/0,1 mode: --/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229480:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229480:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229488:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229493:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229494:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229494:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 3/0,1 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229505:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229506:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 3/0,1 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229510:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229510:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 3/0,1 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229513:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 2/0,0 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229516:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229614:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5035c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946803136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 204us (287us total) trans 38654706167 rc 0/0 00000100:00100000:0.0:1651529917.229614:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946803264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 200us (261us total) trans 38654706168 rc 0/0 00000100:00100000:0.0:1651529917.229618:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 525 00000100:00100000:1.0:1651529917.229620:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 524 00000100:00100000:0.0:1651529917.229646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.229665:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803392 00000100:00100000:0.0:1651529917.229666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.229670:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803520 00000100:00100000:1.0:1651529917.229674:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 526 00000100:00100000:1.0:1651529917.229675:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946803392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.229681:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179580 count 1 00000100:00100000:0.0:1651529917.229686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529917.229695:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229697:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 3/0,1 mode: --/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.229701:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229702:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229703:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 3/0,1 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229703:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.229707:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 3/0,1 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229710:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 3/0,1 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229713:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 2/0,0 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229716:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 2/0,0 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229725:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.229742:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 2/0,0 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229750:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 3/0,0 mode: PW/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229757:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 1/0,0 mode: --/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229760:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c299f lrc: 0/0,0 mode: --/PW res: [0x2bd7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229767:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946803392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (120us total) trans 38654706169 rc 0/0 00000100:00100000:1.0:1651529917.229770:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 526 00010000:00010000:0.0:1651529917.229772:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229775:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803072 00010000:00010000:0.0:1651529917.229775:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008215e54b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.229776:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229779:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803200 00010000:00010000:0.0:1651529917.229779:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 3/0,0 mode: PW/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229781:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803328 00010000:00010000:0.0:1651529917.229783:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 1/0,0 mode: --/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229784:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803456 00010000:00010000:0.0:1651529917.229785:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c29a6 lrc: 0/0,0 mode: --/PW res: [0x2bd78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229787:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 527 00000100:00100000:1.0:1651529917.229789:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946803520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.229789:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 2/0,0 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229792:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009456242c already unused, calling callback (00000000109466a4) 00002000:00080000:1.0:1651529917.229793:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179582 count 1 00010000:00010000:0.0:1651529917.229793:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 2/0,0 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229795:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 3/0,0 mode: PW/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229798:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 1/0,0 mode: --/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.229799:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229801:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 3/0,1 mode: --/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229801:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c29ad lrc: 0/0,0 mode: --/PW res: [0x2bd7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229819:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229820:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229821:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229825:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229828:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229831:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229845:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 528 00000100:00100000:0.0:1651529917.229848:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946803072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.229860:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179575 count 1 00002000:00010000:0.0:1651529917.229867:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.229869:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 3/0,1 mode: --/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229872:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229873:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229874:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 3/0,1 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229877:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 3/0,1 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229881:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 3/0,1 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229883:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 2/0,0 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229902:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946803520:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 106us (229us total) trans 38654706170 rc 0/0 00000100:00100000:1.0:1651529917.229905:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 527 00000100:00100000:1.0:1651529917.229911:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 529 00000100:00100000:1.0:1651529917.229913:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946803200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.229918:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179577 count 1 00002000:00010000:1.0:1651529917.229923:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229925:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 3/0,1 mode: --/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229929:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229929:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229930:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229934:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229936:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229939:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229965:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946803072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 116us (278us total) trans 38654706171 rc 0/0 00000100:00100000:0.0:1651529917.229968:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 528 00000100:00100000:0.0:1651529917.229974:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 530 00000100:00100000:1.0:1651529917.229975:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946803200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (282us total) trans 38654706172 rc 0/0 00000100:00100000:0.0:1651529917.229976:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946803328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.229981:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179579 count 1 00000100:00100000:1.0:1651529917.229987:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 529 00002000:00010000:0.0:1651529917.229987:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.229988:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 3/0,1 mode: --/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229992:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.229993:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 531 00010000:00010000:0.0:1651529917.229993:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229994:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229995:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946803456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.229997:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.229999:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179581 count 1 00010000:00010000:0.0:1651529917.230000:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.230005:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230006:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 3/0,1 mode: --/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230006:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230010:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230010:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230011:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230015:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230018:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230021:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230056:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946803328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (359us total) trans 38654706173 rc 0/0 00000100:00100000:0.0:1651529917.230060:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 530 00010000:00010000:0.0:1651529917.230068:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230069:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946803456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (366us total) trans 38654706174 rc 0/0 00000100:00100000:1.0:1651529917.230072:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 531 00010000:00010000:0.0:1651529917.230072:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093eda540 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230073:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230076:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 3/0,0 mode: PW/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230081:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 1/0,0 mode: --/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230084:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c29b4 lrc: 0/0,0 mode: --/PW res: [0x2bd7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230088:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 2/0,0 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230091:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230092:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 2/0,0 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230095:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 3/0,0 mode: PW/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230098:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 1/0,0 mode: --/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230101:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c29bb lrc: 0/0,0 mode: --/PW res: [0x2bd77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230104:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230106:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d1e2872 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230107:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230110:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 3/0,0 mode: PW/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230113:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 1/0,0 mode: --/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230115:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c29c2 lrc: 0/0,0 mode: --/PW res: [0x2bd79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230121:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230124:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230124:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230127:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 3/0,0 mode: PW/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230130:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 1/0,0 mode: --/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230132:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c29c9 lrc: 0/0,0 mode: --/PW res: [0x2bd7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230135:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230138:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb9b2147 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230139:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230141:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 3/0,0 mode: PW/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230147:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 1/0,0 mode: --/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230149:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c29d0 lrc: 0/0,0 mode: --/PW res: [0x2bd7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230205:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804160 00000100:00100000:1.0:1651529917.230213:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804096 00000100:00100000:0.0:1651529917.230231:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 532 00000100:00100000:0.0:1651529917.230233:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946804160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.230238:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 533 00000100:00100000:1.0:1651529917.230244:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946804096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.230249:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179583 count 1 00002000:00080000:0.0:1651529917.230254:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179584 count 1 00002000:00010000:1.0:1651529917.230255:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230257:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 3/0,1 mode: --/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.230260:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230261:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230261:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230262:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230262:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 3/0,1 mode: --/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230265:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230266:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230266:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230267:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 3/0,1 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230269:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230270:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 3/0,1 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230272:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230273:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 3/0,1 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230276:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 2/0,0 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230319:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946804096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (125us total) trans 38654706175 rc 0/0 00000100:00100000:1.0:1651529917.230322:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 533 00000100:00100000:0.0:1651529917.230346:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946804160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 112us (169us total) trans 38654706176 rc 0/0 00000100:00100000:0.0:1651529917.230349:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 532 00000100:00100000:0.0:1651529917.230365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.230393:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230397:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064963318 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230398:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230401:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 3/0,0 mode: PW/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230406:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 1/0,0 mode: --/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230409:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c29d7 lrc: 0/0,0 mode: --/PW res: [0x2bd7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230413:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 2/0,0 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230416:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230417:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 2/0,0 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230430:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 3/0,0 mode: PW/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230434:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 1/0,0 mode: --/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230437:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c29de lrc: 0/0,0 mode: --/PW res: [0x2bd80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230472:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804736 00000100:00100000:1.0:1651529917.230495:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 534 00000100:00100000:1.0:1651529917.230497:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946804736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.230503:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179585 count 1 00002000:00010000:1.0:1651529917.230509:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230510:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 3/0,1 mode: --/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230522:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230523:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230524:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230528:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.230536:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230539:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230592:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230599:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946804736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 101us (233us total) trans 38654706177 rc 0/0 00000100:00100000:1.0:1651529917.230602:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 534 00000100:00100000:1.0:1651529917.230607:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804864 00000100:00100000:1.0:1651529917.230611:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804992 00000100:00100000:1.0:1651529917.230614:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804800 00000100:00100000:1.0:1651529917.230616:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804928 00000100:00100000:1.0:1651529917.230618:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805056 00000100:00100000:0.0:1651529917.230623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230629:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805184 00010000:00010000:0.0:1651529917.230629:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230631:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805120 00010000:00010000:0.0:1651529917.230633:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e16f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230634:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230635:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 535 00000100:00100000:1.0:1651529917.230636:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946804864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.230637:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 3/0,0 mode: PW/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.230641:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179587 count 1 00002000:00010000:1.0:1651529917.230647:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230649:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 3/0,1 mode: --/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230651:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 1/0,0 mode: --/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230652:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230653:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230654:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 3/0,1 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230654:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c29e5 lrc: 0/0,0 mode: --/PW res: [0x2bd81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230658:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 3/0,1 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230661:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 3/0,1 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230663:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 2/0,0 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230663:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 536 00000100:00100000:0.0:1651529917.230665:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946804992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.230677:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179589 count 1 00002000:00010000:0.0:1651529917.230683:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230685:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 3/0,1 mode: --/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230688:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230689:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230690:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230694:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230696:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230699:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230708:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946804864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (180us total) trans 38654706178 rc 0/0 00000100:00100000:1.0:1651529917.230711:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 535 00000100:00100000:1.0:1651529917.230716:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 537 00000100:00100000:1.0:1651529917.230718:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946804800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.230722:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179586 count 1 00002000:00010000:1.0:1651529917.230727:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230729:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 3/0,1 mode: --/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230733:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230733:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230734:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 3/0,1 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230737:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 3/0,1 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230740:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 3/0,1 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230743:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 2/0,0 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230753:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946804992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (208us total) trans 38654706179 rc 0/0 00000100:00100000:0.0:1651529917.230756:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 536 00000100:00100000:0.0:1651529917.230762:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 538 00000100:00100000:0.0:1651529917.230763:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946804928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.230768:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179588 count 1 00002000:00010000:0.0:1651529917.230773:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230775:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 3/0,1 mode: --/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230777:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946804800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (216us total) trans 38654706180 rc 0/0 00010000:00010000:0.0:1651529917.230779:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230779:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.230780:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 537 00010000:00010000:0.0:1651529917.230780:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 3/0,1 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230784:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 3/0,1 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230785:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 539 00000100:00100000:1.0:1651529917.230787:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946805056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.230787:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 3/0,1 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230789:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 2/0,0 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.230791:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179590 count 1 00002000:00010000:1.0:1651529917.230796:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230797:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 3/0,1 mode: --/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230801:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230801:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230814:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 3/0,1 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230826:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 3/0,1 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230830:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 3/0,1 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230832:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 2/0,0 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230848:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946804928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (271us total) trans 38654706181 rc 0/0 00000100:00100000:0.0:1651529917.230857:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 538 00000100:00100000:0.0:1651529917.230862:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 540 00000100:00100000:0.0:1651529917.230864:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946805184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.230868:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946805056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (282us total) trans 38654706182 rc 0/0 00002000:00080000:0.0:1651529917.230869:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179592 count 1 00000100:00100000:1.0:1651529917.230871:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 539 00002000:00010000:0.0:1651529917.230875:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.230876:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 541 00010000:00010000:0.0:1651529917.230876:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 3/0,1 mode: --/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230877:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946805120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.230880:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230881:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230881:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 3/0,1 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.230882:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179591 count 1 00010000:00010000:0.0:1651529917.230885:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 3/0,1 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.230888:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230888:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 3/0,1 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230889:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 3/0,1 mode: --/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230891:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 2/0,0 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230893:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230893:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230894:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 3/0,1 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230897:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 3/0,1 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230903:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 3/0,1 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230906:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 2/0,0 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230945:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946805120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (322us total) trans 38654706184 rc 0/0 00000100:00100000:0.0:1651529917.230947:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946805184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (354us total) trans 38654706183 rc 0/0 00000100:00100000:1.0:1651529917.230948:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 541 00000100:00100000:0.0:1651529917.230950:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 540 00010000:00010000:0.0:1651529917.230958:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 2/0,0 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230964:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000090d6fec already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230965:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 2/0,0 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230968:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 3/0,0 mode: PW/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230972:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 1/0,0 mode: --/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230975:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c29ec lrc: 0/0,0 mode: --/PW res: [0x2bd83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230980:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230982:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.230983:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230986:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 3/0,0 mode: PW/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230989:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 1/0,0 mode: --/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230994:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c29f3 lrc: 0/0,0 mode: --/PW res: [0x2bd85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230997:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 2/0,0 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231000:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f7fcb52 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231001:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 2/0,0 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231003:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 3/0,0 mode: PW/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231006:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 1/0,0 mode: --/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231009:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c29fa lrc: 0/0,0 mode: --/PW res: [0x2bd82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231012:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 2/0,0 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231014:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231015:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 2/0,0 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231020:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 3/0,0 mode: PW/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231023:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 1/0,0 mode: --/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231026:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2a01 lrc: 0/0,0 mode: --/PW res: [0x2bd84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231029:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 2/0,0 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231031:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d543ebfe already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231032:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 2/0,0 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231035:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 3/0,0 mode: PW/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231049:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 1/0,0 mode: --/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231052:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2a08 lrc: 0/0,0 mode: --/PW res: [0x2bd86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231056:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 2/0,0 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231059:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231060:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 2/0,0 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231062:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 3/0,0 mode: PW/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231065:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 1/0,0 mode: --/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231068:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2a0f lrc: 0/0,0 mode: --/PW res: [0x2bd88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231071:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 2/0,0 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231073:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000053cb223d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231074:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 2/0,0 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231076:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 3/0,0 mode: PW/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231079:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 1/0,0 mode: --/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231091:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2a16 lrc: 0/0,0 mode: --/PW res: [0x2bd87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231128:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805696 00000100:00100000:1.0:1651529917.231135:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 542 00000100:00100000:1.0:1651529917.231137:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946805696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.231148:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179593 count 1 00002000:00010000:1.0:1651529917.231173:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231180:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 3/0,1 mode: --/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231184:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231185:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231186:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 3/0,1 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231189:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 3/0,1 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231193:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 3/0,1 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231196:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 2/0,0 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231218:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 2/0,0 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231236:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c686380d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231237:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 2/0,0 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231240:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 3/0,0 mode: PW/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231245:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 1/0,0 mode: --/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231248:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2a1d lrc: 0/0,0 mode: --/PW res: [0x2bd89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231253:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946805696:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 115us (145us total) trans 38654706185 rc 0/0 00000100:00100000:1.0:1651529917.231256:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 542 00000100:00100000:0.0:1651529917.231526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231546:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805888 00000100:00100000:0.0:1651529917.231550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231563:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805952 00000100:00100000:1.0:1651529917.231567:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806016 00000100:00100000:1.0:1651529917.231570:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 543 00000100:00100000:1.0:1651529917.231572:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:39030:x1731745946805888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.231577:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179594 count 1 00000100:00100000:0.0:1651529917.231580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529917.231583:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231585:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 3/0,1 mode: --/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231588:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.231588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.231589:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231590:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 3/0,1 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231594:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 3/0,1 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231595:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806080 00010000:00010000:1.0:1651529917.231597:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 3/0,1 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231611:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 2/0,0 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231635:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806336 00000100:00100000:0.0:1651529917.231639:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 544 00000100:00100000:0.0:1651529917.231641:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946805952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.231647:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179595 count 1 00002000:00010000:0.0:1651529917.231653:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231655:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 3/0,1 mode: --/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231659:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231660:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231661:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 3/0,1 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231671:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 3/0,1 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231672:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946805888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (141us total) trans 38654706186 rc 0/0 00010000:00010000:0.0:1651529917.231675:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 3/0,1 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231676:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 543 00010000:00010000:0.0:1651529917.231677:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 2/0,0 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231681:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 545 00000100:00100000:1.0:1651529917.231683:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946806016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.231687:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179596 count 1 00002000:00010000:1.0:1651529917.231693:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231694:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 3/0,1 mode: --/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231698:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231698:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231699:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 3/0,1 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231703:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 3/0,1 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231706:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 3/0,1 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231708:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 2/0,0 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231719:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946805952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (182us total) trans 38654706187 rc 0/0 00000100:00100000:0.0:1651529917.231722:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 544 00000100:00100000:0.0:1651529917.231728:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 546 00000100:00100000:0.0:1651529917.231729:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946806080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.231734:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179597 count 1 00002000:00010000:0.0:1651529917.231749:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231751:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 3/0,1 mode: --/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231752:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946806016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (201us total) trans 38654706188 rc 0/0 00000100:00100000:1.0:1651529917.231755:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 545 00010000:00010000:0.0:1651529917.231755:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231755:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231756:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 3/0,1 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231759:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 3/0,1 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231760:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 547 00000100:00100000:1.0:1651529917.231762:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946806336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.231762:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 3/0,1 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231765:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 2/0,0 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.231766:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179598 count 1 00002000:00010000:1.0:1651529917.231774:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231776:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 3/0,1 mode: --/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231780:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231780:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231781:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 3/0,1 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231785:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 3/0,1 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231787:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 3/0,1 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231790:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 2/0,0 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231801:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946806080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (231us total) trans 38654706189 rc 0/0 00000100:00100000:0.0:1651529917.231824:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 546 00010000:00010000:0.0:1651529917.231834:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 2/0,0 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231837:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d712eb2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231838:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 2/0,0 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231841:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 3/0,0 mode: PW/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231844:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946806336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (255us total) trans 38654706190 rc 0/0 00010000:00010000:0.0:1651529917.231854:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 1/0,0 mode: --/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231856:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 547 00010000:00010000:0.0:1651529917.231857:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2a24 lrc: 0/0,0 mode: --/PW res: [0x2bd8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231862:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 2/0,0 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231864:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231865:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 2/0,0 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231868:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 3/0,0 mode: PW/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231871:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 1/0,0 mode: --/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231873:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2a2b lrc: 0/0,0 mode: --/PW res: [0x2bd8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231877:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 2/0,0 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231879:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000859862c6 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529917.231880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.231880:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 2/0,0 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231883:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 3/0,0 mode: PW/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231886:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 1/0,0 mode: --/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231888:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2a32 lrc: 0/0,0 mode: --/PW res: [0x2bd8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231892:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 2/0,0 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.231894:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004044efa8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231895:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 2/0,0 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231897:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 3/0,0 mode: PW/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231900:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 1/0,0 mode: --/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231903:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2a39 lrc: 0/0,0 mode: --/PW res: [0x2bd8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.231909:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 2/0,0 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231911:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cefd9f91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.231912:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 2/0,0 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231914:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 3/0,0 mode: PW/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231917:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 1/0,0 mode: --/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231920:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2a40 lrc: 0/0,0 mode: --/PW res: [0x2bd8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231967:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806400 00000100:00100000:1.0:1651529917.231979:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806464 00000100:00100000:1.0:1651529917.231982:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806528 00000100:00100000:1.0:1651529917.231985:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 548 00000100:00100000:1.0:1651529917.231986:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946806400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.231991:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 549 00002000:00080000:1.0:1651529917.231992:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179599 count 1 00000100:00100000:0.0:1651529917.231993:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946806464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.231997:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231999:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 3/0,1 mode: --/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.231999:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179600 count 1 00010000:00010000:1.0:1651529917.232003:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232003:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232004:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 3/0,1 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.232004:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232006:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 3/0,1 mode: --/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232008:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 3/0,1 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232009:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232010:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232011:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 3/0,1 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232011:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 3/0,1 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232014:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 2/0,0 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232036:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 3/0,1 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232048:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 3/0,1 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232051:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 2/0,0 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232079:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946806400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (198us total) trans 38654706191 rc 0/0 00000100:00100000:1.0:1651529917.232082:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 548 00000100:00100000:1.0:1651529917.232087:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 550 00000100:00100000:1.0:1651529917.232089:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946806528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.232093:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179601 count 1 00002000:00010000:1.0:1651529917.232098:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232100:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 3/0,1 mode: --/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232100:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946806464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 106us (205us total) trans 38654706192 rc 0/0 00010000:00010000:1.0:1651529917.232103:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.232103:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 549 00010000:00010000:1.0:1651529917.232104:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232105:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 3/0,1 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232109:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 3/0,1 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232111:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 2/0,0 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232112:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 3/0,1 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232114:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 2/0,0 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232114:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f425678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232115:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 2/0,0 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232118:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 3/0,0 mode: PW/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232123:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 1/0,0 mode: --/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232126:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2a47 lrc: 0/0,0 mode: --/PW res: [0x2bd8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232151:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 2/0,0 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232154:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232155:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 2/0,0 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232158:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 3/0,0 mode: PW/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232161:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 1/0,0 mode: --/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232164:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2a4e lrc: 0/0,0 mode: --/PW res: [0x2bd90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232165:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946806528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (260us total) trans 38654706193 rc 0/0 00010000:00010000:0.0:1651529917.232167:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 2/0,0 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232170:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 550 00010000:00010000:0.0:1651529917.232170:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c179deaa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232171:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 2/0,0 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232174:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 3/0,0 mode: PW/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232179:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 1/0,0 mode: --/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232182:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2a55 lrc: 0/0,0 mode: --/PW res: [0x2bd91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.232232:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807040 00000100:00100000:1.0:1651529917.232248:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 551 00000100:00100000:1.0:1651529917.232250:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946807040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.232251:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529917.232256:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179603 count 1 00000100:00100000:0.0:1651529917.232258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529917.232261:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232263:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 3/0,1 mode: --/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.232266:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232267:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232268:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 3/0,1 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.232271:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 3/0,1 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232274:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 3/0,1 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232274:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806976 00010000:00010000:1.0:1651529917.232277:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 2/0,0 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232279:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807168 00000100:00100000:0.0:1651529917.232281:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807232 00000100:00100000:0.0:1651529917.232292:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807296 00000100:00100000:0.0:1651529917.232307:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 552 00000100:00100000:0.0:1651529917.232309:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946806976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.232315:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179602 count 1 00000100:00100000:1.0:1651529917.232321:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946807040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (136us total) trans 38654706194 rc 0/0 00002000:00010000:0.0:1651529917.232321:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232322:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 3/0,1 mode: --/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232324:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 551 00010000:00010000:0.0:1651529917.232326:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232327:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232328:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 3/0,1 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232330:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 553 00000100:00100000:1.0:1651529917.232331:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030a5b84a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946807168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.232331:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 3/0,1 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232334:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 3/0,1 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.232335:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179604 count 1 00010000:00010000:0.0:1651529917.232337:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 2/0,0 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.232341:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232342:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 3/0,1 mode: --/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232345:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232346:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232347:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 3/0,1 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232351:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 3/0,1 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232354:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 3/0,1 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232356:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 2/0,0 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232379:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946806976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (128us total) trans 38654706195 rc 0/0 00000100:00100000:0.0:1651529917.232382:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 552 00000100:00100000:0.0:1651529917.232387:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 554 00000100:00100000:0.0:1651529917.232389:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946807232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.232390:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030a5b84a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946807168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (131us total) trans 38654706196 rc 0/0 00000100:00100000:1.0:1651529917.232393:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 553 00002000:00080000:0.0:1651529917.232393:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179605 count 1 00000100:00100000:1.0:1651529917.232411:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 555 00000100:00100000:1.0:1651529917.232412:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946807296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.232416:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179606 count 1 00002000:00010000:0.0:1651529917.232417:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.232421:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232423:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 3/0,1 mode: --/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232427:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232427:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232428:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 3/0,1 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232432:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 3/0,1 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232435:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 3/0,1 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232437:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 2/0,0 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232438:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 3/0,1 mode: --/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232443:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232443:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232444:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 3/0,1 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232448:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 3/0,1 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232451:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 3/0,1 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232457:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 2/0,0 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232481:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946807296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (213us total) trans 38654706197 rc 0/0 00000100:00100000:1.0:1651529917.232484:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 555 00000100:00100000:0.0:1651529917.232495:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946807232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (231us total) trans 38654706198 rc 0/0 00000100:00100000:0.0:1651529917.232498:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 554 00010000:00010000:0.0:1651529917.232505:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 2/0,0 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.232509:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000084cb5491 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232510:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 2/0,0 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232520:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 3/0,0 mode: PW/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.232526:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 1/0,0 mode: --/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232528:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2a5c lrc: 0/0,0 mode: --/PW res: [0x2bd93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232533:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 2/0,0 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232536:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2632ae4 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529917.232537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.232537:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 2/0,0 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232539:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 3/0,0 mode: PW/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232542:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 1/0,0 mode: --/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232545:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2a63 lrc: 0/0,0 mode: --/PW res: [0x2bd92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232548:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 2/0,0 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232551:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b1768d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232551:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 2/0,0 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232554:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 3/0,0 mode: PW/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232557:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 1/0,0 mode: --/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232559:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2a6a lrc: 0/0,0 mode: --/PW res: [0x2bd94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232565:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 2/0,0 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232568:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b45e480 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232569:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 2/0,0 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232571:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 3/0,0 mode: PW/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232574:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 1/0,0 mode: --/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232577:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2a78 lrc: 0/0,0 mode: --/PW res: [0x2bd96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232580:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 2/0,0 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232582:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d27cca91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232583:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 2/0,0 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232585:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 3/0,0 mode: PW/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232591:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 1/0,0 mode: --/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232593:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2a71 lrc: 0/0,0 mode: --/PW res: [0x2bd95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232596:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807488 00000100:00100000:1.0:1651529917.232602:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807552 00000100:00100000:0.0:1651529917.232602:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807424 00000100:00100000:1.0:1651529917.232605:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 556 00000100:00100000:1.0:1651529917.232607:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946807488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.232608:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 557 00000100:00100000:0.0:1651529917.232610:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946807552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.232612:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179608 count 1 00002000:00080000:0.0:1651529917.232614:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179609 count 1 00002000:00010000:0.0:1651529917.232619:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232621:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 3/0,1 mode: --/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232624:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.232625:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232625:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232626:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 3/0,1 mode: --/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232626:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 3/0,1 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232629:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 3/0,1 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232630:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232631:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232632:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 3/0,1 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232632:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 3/0,1 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232635:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 3/0,1 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232635:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 2/0,0 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232639:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 3/0,1 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232641:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 2/0,0 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232684:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946807488:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (185us total) trans 38654706199 rc 0/0 00000100:00100000:1.0:1651529917.232687:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 556 00000100:00100000:1.0:1651529917.232692:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 558 00000100:00100000:1.0:1651529917.232694:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946807424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.232698:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179607 count 1 00000100:00100000:0.0:1651529917.232702:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946807552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (165us total) trans 38654706200 rc 0/0 00000100:00100000:0.0:1651529917.232705:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 557 00002000:00010000:1.0:1651529917.232711:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232713:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 3/0,1 mode: --/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232713:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 2/0,0 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232717:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232718:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 2/0,0 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232720:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232720:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232721:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 3/0,1 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232721:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 3/0,0 mode: PW/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232724:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 3/0,1 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232725:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 1/0,0 mode: --/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232727:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 3/0,1 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232728:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2a7f lrc: 0/0,0 mode: --/PW res: [0x2bd99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232730:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 2/0,0 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232732:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 2/0,0 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232735:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051a46c40 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232736:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 2/0,0 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232741:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 3/0,0 mode: PW/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232744:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 1/0,0 mode: --/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232747:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2a86 lrc: 0/0,0 mode: --/PW res: [0x2bd98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232751:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 2/0,0 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232753:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001001cb5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.232754:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 2/0,0 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232757:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 3/0,0 mode: PW/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232760:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 1/0,0 mode: --/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232763:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946807424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (237us total) trans 38654706201 rc 0/0 00010000:00010000:0.0:1651529917.232763:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2a8d lrc: 0/0,0 mode: --/PW res: [0x2bd97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232766:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 558 00000100:00100000:0.0:1651529917.232847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.232868:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808064 00000100:00100000:0.0:1651529917.232873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.232882:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808128 00000100:00100000:1.0:1651529917.232890:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 559 00000100:00100000:1.0:1651529917.232892:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946808064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.232894:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 560 00000100:00100000:0.0:1651529917.232896:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946808128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.232897:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179610 count 1 00002000:00080000:0.0:1651529917.232902:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179611 count 1 00002000:00010000:1.0:1651529917.232904:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232905:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 3/0,1 mode: --/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.232907:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232909:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232909:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 3/0,1 mode: --/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232913:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232913:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232914:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 3/0,1 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232917:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232918:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 3/0,1 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232918:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 3/0,1 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232922:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 3/0,1 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232925:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 3/0,1 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232928:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 2/0,0 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232967:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 3/0,1 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232971:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 2/0,0 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232987:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946808064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (140us total) trans 38654706202 rc 0/0 00000100:00100000:1.0:1651529917.232990:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 559 00000100:00100000:1.0:1651529917.233014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233019:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946808128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 122us (145us total) trans 38654706203 rc 0/0 00000100:00100000:0.0:1651529917.233022:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 560 00000100:00100000:0.0:1651529917.233028:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808192 00000100:00100000:1.0:1651529917.233049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233049:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 561 00000100:00100000:0.0:1651529917.233051:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946808192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.233056:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179612 count 1 00002000:00010000:0.0:1651529917.233062:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233064:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 3/0,1 mode: --/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233067:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233068:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233069:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 3/0,1 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233073:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 3/0,1 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.233076:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 3/0,1 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233078:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 2/0,0 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233086:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233098:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808320 00000100:00100000:1.0:1651529917.233104:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808256 00000100:00100000:1.0:1651529917.233106:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808448 00000100:00100000:1.0:1651529917.233108:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808576 00000100:00100000:1.0:1651529917.233110:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808512 00000100:00100000:1.0:1651529917.233113:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 562 00000100:00100000:1.0:1651529917.233114:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.233119:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (105us total) trans 38654706204 rc 0/0 00000100:00100000:0.0:1651529917.233122:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 561 00000100:00100000:0.0:1651529917.233128:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 563 00000100:00100000:0.0:1651529917.233129:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946808256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.233134:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179613 count 1 00002000:00080000:1.0:1651529917.233135:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179614 count 1 00002000:00010000:0.0:1651529917.233139:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233140:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 3/0,1 mode: --/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.233141:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233142:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 3/0,1 mode: --/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233144:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233145:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233145:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 3/0,1 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233146:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233147:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233148:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 3/0,1 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233149:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 3/0,1 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233151:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 3/0,1 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233152:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 3/0,1 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233154:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 3/0,1 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233155:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 2/0,0 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233157:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 2/0,0 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233187:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946808256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (110us total) trans 38654706205 rc 0/0 00000100:00100000:0.0:1651529917.233190:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 563 00000100:00100000:1.0:1651529917.233193:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (155us total) trans 38654706206 rc 0/0 00000100:00100000:0.0:1651529917.233194:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 564 00000100:00100000:1.0:1651529917.233196:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 562 00000100:00100000:0.0:1651529917.233196:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.233200:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179615 count 1 00000100:00100000:1.0:1651529917.233202:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 565 00000100:00100000:1.0:1651529917.233203:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946808576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.233207:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179617 count 1 00002000:00010000:1.0:1651529917.233212:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233214:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 3/0,1 mode: --/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.233222:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bd9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233224:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 3/0,1 mode: --/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233226:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233226:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233227:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 3/0,1 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233228:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233229:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233229:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233231:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 3/0,1 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233233:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233234:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 3/0,1 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233236:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233237:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 2/0,0 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233239:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 2/0,0 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233272:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946808576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (184us total) trans 38654706207 rc 0/0 00000100:00100000:1.0:1651529917.233274:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 565 00000100:00100000:0.0:1651529917.233275:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946808448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (193us total) trans 38654706208 rc 0/0 00000100:00100000:0.0:1651529917.233278:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 564 00000100:00100000:1.0:1651529917.233280:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 566 00000100:00100000:1.0:1651529917.233282:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946808512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.233286:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179616 count 1 00010000:00010000:0.0:1651529917.233286:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 2/0,0 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233290:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edb5d78c already unused, calling callback (00000000109466a4) 00002000:00010000:1.0:1651529917.233291:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233291:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 2/0,0 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233292:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 3/0,1 mode: --/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233294:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 3/0,0 mode: PW/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233296:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233296:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233297:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 3/0,1 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233299:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 1/0,0 mode: --/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233302:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2a94 lrc: 0/0,0 mode: --/PW res: [0x2bd9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233306:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 2/0,0 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233309:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 3/0,1 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233309:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233310:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 2/0,0 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233312:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 3/0,1 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233312:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 3/0,0 mode: PW/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233315:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 2/0,0 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233315:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 1/0,0 mode: --/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233318:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2a9b lrc: 0/0,0 mode: --/PW res: [0x2bd9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233321:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 2/0,0 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233324:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db5120f7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233324:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 2/0,0 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233327:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 3/0,0 mode: PW/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233343:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 1/0,0 mode: --/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233346:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2aa2 lrc: 0/0,0 mode: --/PW res: [0x2bd9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233350:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 2/0,0 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233352:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008215e54b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233353:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 2/0,0 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233355:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (256us total) trans 38654706209 rc 0/0 00010000:00010000:0.0:1651529917.233356:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 3/0,0 mode: PW/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233358:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 566 00010000:00010000:0.0:1651529917.233359:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 1/0,0 mode: --/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233361:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2aa9 lrc: 0/0,0 mode: --/PW res: [0x2bd9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233364:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 2/0,0 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233367:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4ecf9ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233372:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 2/0,0 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.233375:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 3/0,0 mode: PW/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233379:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 1/0,0 mode: --/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233381:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2ab0 lrc: 0/0,0 mode: --/PW res: [0x2bd9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233385:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 2/0,0 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.233387:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad6adb6f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233388:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 2/0,0 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233391:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 3/0,0 mode: PW/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233400:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 1/0,0 mode: --/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233403:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2abe lrc: 0/0,0 mode: --/PW res: [0x2bda1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233414:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 2/0,0 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233417:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e7cb770 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233418:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 2/0,0 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233420:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 3/0,0 mode: PW/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233424:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 1/0,0 mode: --/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233426:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2ab7 lrc: 0/0,0 mode: --/PW res: [0x2bd9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233429:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 2/0,0 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233432:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a7e4551 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233432:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 2/0,0 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233435:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 3/0,0 mode: PW/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233443:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808640 00010000:00010000:0.0:1651529917.233445:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 1/0,0 mode: --/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233448:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2ac5 lrc: 0/0,0 mode: --/PW res: [0x2bda0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233449:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808704 00000100:00100000:1.0:1651529917.233452:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 567 00000100:00100000:1.0:1651529917.233453:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946808640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.233457:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 568 00002000:00080000:1.0:1651529917.233458:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179618 count 1 00000100:00100000:0.0:1651529917.233459:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946808704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.233464:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233466:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 3/0,1 mode: --/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233469:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233470:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233471:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 3/0,1 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.233471:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179619 count 1 00002000:00010000:0.0:1651529917.233476:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233477:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 3/0,1 mode: --/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233481:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233481:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233482:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 3/0,1 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233484:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 3/0,1 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233485:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 3/0,1 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233487:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 3/0,1 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233489:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 2/0,0 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233507:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 3/0,1 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233511:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 2/0,0 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233533:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946808640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (159us total) trans 38654706210 rc 0/0 00000100:00100000:1.0:1651529917.233536:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 567 00000100:00100000:0.0:1651529917.233564:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946808704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (176us total) trans 38654706211 rc 0/0 00000100:00100000:0.0:1651529917.233567:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 568 00010000:00010000:0.0:1651529917.233574:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 2/0,0 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233577:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f3b4cc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233578:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 2/0,0 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233581:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 3/0,0 mode: PW/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233586:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 1/0,0 mode: --/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233588:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2acc lrc: 0/0,0 mode: --/PW res: [0x2bda2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233592:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 2/0,0 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233595:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000897c5bf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.233596:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 2/0,0 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233609:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 3/0,0 mode: PW/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233613:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 1/0,0 mode: --/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233615:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2ad3 lrc: 0/0,0 mode: --/PW res: [0x2bda3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233790:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809280 00000100:00100000:0.0:1651529917.233801:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809344 00000100:00100000:0.0:1651529917.233815:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809472 00000100:00100000:0.0:1651529917.233819:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 569 00000100:00100000:0.0:1651529917.233821:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946809280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.233828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.233831:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179620 count 1 00000100:00100000:1.0:1651529917.233835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.233837:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.233839:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.233839:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 3/0,1 mode: --/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233843:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233843:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233844:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 3/0,1 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.233848:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 3/0,1 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233852:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809408 00000100:00100000:1.0:1651529917.233857:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809600 00000100:00100000:1.0:1651529917.233859:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809536 00000100:00100000:1.0:1651529917.233861:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809664 00010000:00010000:0.0:1651529917.233861:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 3/0,1 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233864:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 570 00000100:00100000:1.0:1651529917.233866:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946809344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.233871:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179621 count 1 00010000:00010000:0.0:1651529917.233878:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 2/0,0 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.233885:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233887:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 3/0,1 mode: --/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233890:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233891:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233892:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 3/0,1 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233896:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 3/0,1 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233899:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 3/0,1 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233901:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 2/0,0 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233936:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946809280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 108us (162us total) trans 38654706212 rc 0/0 00000100:00100000:0.0:1651529917.233939:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 569 00000100:00100000:0.0:1651529917.233944:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 571 00000100:00100000:0.0:1651529917.233946:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946809472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.233952:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946809344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 85us (176us total) trans 38654706213 rc 0/0 00000100:00100000:1.0:1651529917.233955:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 570 00002000:00080000:0.0:1651529917.233956:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179623 count 1 00000100:00100000:1.0:1651529917.233960:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 572 00000100:00100000:1.0:1651529917.233961:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946809408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.233962:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233963:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 3/0,1 mode: --/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.233966:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179622 count 1 00010000:00010000:0.0:1651529917.233967:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233968:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233969:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 3/0,1 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233972:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 3/0,1 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.233974:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233976:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 3/0,1 mode: --/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233976:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 3/0,1 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233985:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 2/0,0 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233991:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233992:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233993:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 3/0,1 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233997:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 3/0,1 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234000:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 3/0,1 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234003:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 2/0,0 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234021:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946809472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (235us total) trans 38654706214 rc 0/0 00000100:00100000:0.0:1651529917.234024:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 571 00000100:00100000:0.0:1651529917.234029:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 573 00000100:00100000:0.0:1651529917.234030:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946809600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.234045:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946809408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (209us total) trans 38654706215 rc 0/0 00000100:00100000:1.0:1651529917.234049:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 572 00002000:00080000:0.0:1651529917.234049:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179625 count 1 00000100:00100000:1.0:1651529917.234054:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 574 00002000:00010000:0.0:1651529917.234055:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.234056:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946809536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.234057:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 3/0,1 mode: --/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.234060:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179624 count 1 00010000:00010000:0.0:1651529917.234060:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234061:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234062:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 3/0,1 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.234065:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bda8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234066:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 3/0,1 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234067:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 3/0,1 mode: --/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234069:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 3/0,1 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234071:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234071:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234072:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 3/0,1 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234072:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 2/0,0 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234083:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 3/0,1 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234087:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 3/0,1 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234089:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 2/0,0 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234121:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946809600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (286us total) trans 38654706216 rc 0/0 00000100:00100000:1.0:1651529917.234124:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946809536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (284us total) trans 38654706217 rc 0/0 00000100:00100000:0.0:1651529917.234125:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 573 00000100:00100000:1.0:1651529917.234127:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 574 00000100:00100000:0.0:1651529917.234130:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 575 00000100:00100000:0.0:1651529917.234132:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946809664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.234136:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179626 count 1 00002000:00010000:0.0:1651529917.234141:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234143:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 3/0,1 mode: --/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234146:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234147:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234148:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 3/0,1 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234151:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 3/0,1 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234154:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 3/0,1 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234157:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 2/0,0 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234188:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946809664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (342us total) trans 38654706218 rc 0/0 00000100:00100000:0.0:1651529917.234201:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 575 00000100:00100000:0.0:1651529917.234206:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809728 00000100:00100000:0.0:1651529917.234211:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 576 00000100:00100000:0.0:1651529917.234212:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946809728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.234217:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179627 count 1 00002000:00010000:0.0:1651529917.234223:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234224:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 3/0,1 mode: --/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234228:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234228:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234229:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 3/0,1 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234233:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 3/0,1 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234235:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 3/0,1 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234238:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 2/0,0 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234245:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 2/0,0 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234249:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff73fa02 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234250:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 2/0,0 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234254:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 3/0,0 mode: PW/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234259:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 1/0,0 mode: --/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234265:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2ada lrc: 0/0,0 mode: --/PW res: [0x2bda4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234269:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 2/0,0 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234272:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b7551ddc already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529917.234276:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946809728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (132us total) trans 38654706219 rc 0/0 00010000:00010000:1.0:1651529917.234278:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 2/0,0 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234279:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 576 00010000:00010000:1.0:1651529917.234282:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 3/0,0 mode: PW/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234285:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 1/0,0 mode: --/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234288:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2ae1 lrc: 0/0,0 mode: --/PW res: [0x2bda5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234292:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 2/0,0 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234294:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234295:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 2/0,0 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234308:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 3/0,0 mode: PW/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234312:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 1/0,0 mode: --/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234314:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2aef lrc: 0/0,0 mode: --/PW res: [0x2bda6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234318:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 2/0,0 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234321:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000406c58a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234322:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 2/0,0 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234324:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 3/0,0 mode: PW/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234327:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 1/0,0 mode: --/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234330:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2af6 lrc: 0/0,0 mode: --/PW res: [0x2bda9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234333:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 2/0,0 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234341:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016217824 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234342:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 2/0,0 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234344:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 3/0,0 mode: PW/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234347:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 1/0,0 mode: --/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234350:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2afd lrc: 0/0,0 mode: --/PW res: [0x2bda8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234353:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 2/0,0 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234356:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6595fad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234357:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 2/0,0 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234359:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 3/0,0 mode: PW/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234362:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 1/0,0 mode: --/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234367:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2b04 lrc: 0/0,0 mode: --/PW res: [0x2bdaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234371:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 2/0,0 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234373:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2e406ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.234374:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 2/0,0 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234377:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 3/0,0 mode: PW/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234380:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 1/0,0 mode: --/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234382:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2b0b lrc: 0/0,0 mode: --/PW res: [0x2bdab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234486:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810368 00000100:00100000:1.0:1651529917.234492:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810304 00000100:00100000:1.0:1651529917.234494:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810432 00000100:00100000:1.0:1651529917.234497:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 577 00000100:00100000:1.0:1651529917.234499:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:39030:x1731745946810368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.234504:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179629 count 1 00002000:00010000:1.0:1651529917.234510:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234512:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 3/0,1 mode: --/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234515:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234516:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234517:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 3/0,1 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234521:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 3/0,1 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234523:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 3/0,1 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234526:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 2/0,0 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234582:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946810368:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (129us total) trans 38654706220 rc 0/0 00000100:00100000:1.0:1651529917.234585:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 577 00000100:00100000:1.0:1651529917.234590:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:1.0:1651529917.234592:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:39029:x1731745946810304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.234596:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179628 count 1 00002000:00010000:1.0:1651529917.234601:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234603:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 3/0,1 mode: --/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234616:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234617:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234617:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 3/0,1 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234621:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 3/0,1 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234624:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 3/0,1 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234627:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 2/0,0 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234660:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946810304:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (195us total) trans 38654706221 rc 0/0 00000100:00100000:1.0:1651529917.234663:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:1.0:1651529917.234668:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 579 00000100:00100000:1.0:1651529917.234669:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:39029:x1731745946810432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.234673:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179630 count 1 00002000:00010000:1.0:1651529917.234678:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234680:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 3/0,1 mode: --/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234683:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234684:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234685:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 3/0,1 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234697:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 3/0,1 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234700:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 3/0,1 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234702:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 2/0,0 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234733:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946810432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (253us total) trans 38654706222 rc 0/0 00000100:00100000:1.0:1651529917.234736:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 579 00010000:00010000:0.0:1651529917.234755:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 2/0,0 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234770:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234770:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.234771:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 2/0,0 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234774:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 3/0,0 mode: PW/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234780:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 1/0,0 mode: --/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234783:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2b12 lrc: 0/0,0 mode: --/PW res: [0x2bdad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234793:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 2/0,0 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234796:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.234797:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 2/0,0 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234798:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234800:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 3/0,0 mode: PW/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234821:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 1/0,0 mode: --/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234832:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2b19 lrc: 0/0,0 mode: --/PW res: [0x2bdac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234836:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 2/0,0 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234839:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.234839:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 2/0,0 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234842:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 3/0,0 mode: PW/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234846:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 1/0,0 mode: --/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234848:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2b20 lrc: 0/0,0 mode: --/PW res: [0x2bdae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.234854:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 2/0,0 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234857:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000101e4964 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.234858:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 2/0,0 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234863:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810496 00010000:00010000:0.0:1651529917.234863:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 3/0,0 mode: PW/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234866:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 1/0,0 mode: --/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234868:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810560 00010000:00010000:0.0:1651529917.234869:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2ae8 lrc: 0/0,0 mode: --/PW res: [0x2bda7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234870:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810624 00000100:00100000:1.0:1651529917.234872:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810688 00000100:00100000:1.0:1651529917.234874:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810752 00000100:00100000:0.0:1651529917.234877:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 580 00000100:00100000:0.0:1651529917.234879:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946810496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.234882:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 581 00000100:00100000:1.0:1651529917.234883:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946810560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.234886:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179631 count 1 00002000:00080000:1.0:1651529917.234889:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179632 count 1 00002000:00010000:0.0:1651529917.234891:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234892:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 3/0,1 mode: --/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.234894:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234896:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234896:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234897:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 3/0,1 mode: --/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234897:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 3/0,1 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234901:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234901:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234901:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 3/0,1 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234902:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 3/0,1 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234904:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 3/0,1 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234906:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 3/0,1 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234909:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 3/0,1 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234909:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 2/0,0 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234912:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 2/0,0 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234954:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946810560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (170us total) trans 38654706224 rc 0/0 00000100:00100000:1.0:1651529917.234957:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 581 00000100:00100000:1.0:1651529917.234969:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:0.0:1651529917.234969:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946810496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (198us total) trans 38654706223 rc 0/0 00000100:00100000:1.0:1651529917.234971:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:39030:x1731745946810624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.234972:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 580 00002000:00080000:1.0:1651529917.234975:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179633 count 1 00000100:00100000:0.0:1651529917.234978:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 583 00000100:00100000:0.0:1651529917.234980:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946810688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.234981:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234983:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 3/0,1 mode: --/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.234985:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179634 count 1 00010000:00010000:1.0:1651529917.234986:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529917.234991:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234992:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234993:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 3/0,1 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234993:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 3/0,1 mode: --/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234996:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234997:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 3/0,1 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234997:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234998:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 3/0,1 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235000:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 3/0,1 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235001:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 3/0,1 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235002:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 2/0,0 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235005:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 3/0,1 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235007:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 2/0,0 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235055:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946810624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (257us total) trans 38654706225 rc 0/0 00000100:00100000:1.0:1651529917.235058:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:1.0:1651529917.235083:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 584 00000100:00100000:1.0:1651529917.235085:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946810752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.235087:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c3625c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946810688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (239us total) trans 38654706226 rc 0/0 00002000:00080000:1.0:1651529917.235089:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179635 count 1 00000100:00100000:0.0:1651529917.235090:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 583 00002000:00010000:1.0:1651529917.235094:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235096:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 3/0,1 mode: --/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235098:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 2/0,0 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235100:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235100:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235101:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 3/0,1 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235102:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a772ca06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235103:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 2/0,0 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235105:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 3/0,1 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235106:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 3/0,0 mode: PW/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235108:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 3/0,1 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235111:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 2/0,0 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235111:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 1/0,0 mode: --/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235113:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2b27 lrc: 0/0,0 mode: --/PW res: [0x2bdaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235118:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 2/0,0 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235121:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235121:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 2/0,0 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235143:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c32785 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946810752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 58us (288us total) trans 38654706227 rc 0/0 00000100:00100000:1.0:1651529917.235146:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 584 00010000:00010000:0.0:1651529917.235152:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 3/0,0 mode: PW/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235156:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 1/0,0 mode: --/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235159:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2b2e lrc: 0/0,0 mode: --/PW res: [0x2bdb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235163:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 2/0,0 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235165:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 2/0,0 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235166:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235167:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 2/0,0 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235169:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7d0c66c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.235170:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 2/0,0 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235170:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 3/0,0 mode: PW/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235173:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 3/0,0 mode: PW/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235173:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 1/0,0 mode: --/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235175:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2b35 lrc: 0/0,0 mode: --/PW res: [0x2bdb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235178:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 1/0,0 mode: --/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235178:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 2/0,0 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235180:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2b3c lrc: 0/0,0 mode: --/PW res: [0x2bdb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235181:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235182:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 2/0,0 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235185:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 3/0,0 mode: PW/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235188:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 1/0,0 mode: --/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235191:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2b43 lrc: 0/0,0 mode: --/PW res: [0x2bdb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235230:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811328 00000100:00100000:1.0:1651529917.235232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235236:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811392 00000100:00100000:0.0:1651529917.235239:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811456 00000100:00100000:0.0:1651529917.235242:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 585 00000100:00100000:0.0:1651529917.235243:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946811328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.235248:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179636 count 1 00002000:00010000:0.0:1651529917.235254:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235255:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 3/0,1 mode: --/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235259:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235259:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235260:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 3/0,1 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235266:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 3/0,1 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235269:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 3/0,1 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235272:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 2/0,0 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235285:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 586 00000100:00100000:1.0:1651529917.235287:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946811392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.235293:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179637 count 1 00002000:00010000:1.0:1651529917.235298:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235300:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 3/0,1 mode: --/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235304:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235304:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235305:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 3/0,1 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235309:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 3/0,1 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235312:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 3/0,1 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235314:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 2/0,0 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235319:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000119a28ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946811328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (123us total) trans 38654706228 rc 0/0 00000100:00100000:0.0:1651529917.235342:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 585 00000100:00100000:0.0:1651529917.235348:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 587 00000100:00100000:0.0:1651529917.235349:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946811456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.235354:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179638 count 1 00002000:00010000:0.0:1651529917.235360:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.235361:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b525c147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946811392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (142us total) trans 38654706229 rc 0/0 00010000:00010000:0.0:1651529917.235362:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 3/0,1 mode: --/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235364:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 586 00010000:00010000:0.0:1651529917.235365:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235366:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235367:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 3/0,1 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235370:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 3/0,1 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235372:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 2/0,0 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235375:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 3/0,1 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235378:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 2/0,0 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235390:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9386f1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.235391:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 2/0,0 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235394:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 3/0,0 mode: PW/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235399:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 1/0,0 mode: --/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235402:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2b4a lrc: 0/0,0 mode: --/PW res: [0x2bdb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235406:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 2/0,0 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235409:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.235410:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 2/0,0 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235413:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 3/0,0 mode: PW/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235415:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078d0fc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946811456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (182us total) trans 38654706230 rc 0/0 00010000:00010000:1.0:1651529917.235416:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 1/0,0 mode: --/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235418:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 587 00010000:00010000:1.0:1651529917.235421:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2b51 lrc: 0/0,0 mode: --/PW res: [0x2bdb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235425:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 2/0,0 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235427:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acfd0ef2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.235428:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 2/0,0 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235431:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 3/0,0 mode: PW/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235434:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 1/0,0 mode: --/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235436:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2b58 lrc: 0/0,0 mode: --/PW res: [0x2bdb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235556:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811776 00000100:00100000:1.0:1651529917.235562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235562:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811712 00000100:00100000:0.0:1651529917.235564:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811904 00000100:00100000:0.0:1651529917.235566:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811840 00000100:00100000:1.0:1651529917.235568:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811968 00000100:00100000:0.0:1651529917.235570:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:0.0:1651529917.235571:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946811776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.235574:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 589 00000100:00100000:1.0:1651529917.235576:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946811712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.235576:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179640 count 1 00002000:00010000:0.0:1651529917.235582:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235584:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 3/0,1 mode: --/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235587:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.235588:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179639 count 1 00010000:00010000:0.0:1651529917.235588:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235589:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 3/0,1 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235593:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 3/0,1 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.235594:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235595:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 3/0,1 mode: --/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235598:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 3/0,1 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235599:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235600:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235600:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 2/0,0 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235601:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 3/0,1 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235604:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 3/0,1 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235607:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 3/0,1 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235610:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 2/0,0 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235652:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f0ef493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:39030:x1731745946811776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (137us total) trans 38654706231 rc 0/0 00000100:00100000:0.0:1651529917.235655:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:1.0:1651529917.235660:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000158e8cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:39029:x1731745946811712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (128us total) trans 38654706232 rc 0/0 00000100:00100000:0.0:1651529917.235660:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 590 00000100:00100000:0.0:1651529917.235662:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946811904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.235663:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 589 00002000:00080000:0.0:1651529917.235666:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179642 count 1 00000100:00100000:1.0:1651529917.235669:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 591 00000100:00100000:1.0:1651529917.235670:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946811840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.235671:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235673:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 3/0,1 mode: --/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.235675:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179641 count 1 00010000:00010000:0.0:1651529917.235676:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235677:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235678:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 3/0,1 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.235680:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235681:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 3/0,1 mode: --/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235682:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 3/0,1 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235685:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 3/0,1 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235686:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235686:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235687:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 3/0,1 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235690:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 3/0,1 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235690:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 2/0,0 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235693:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 3/0,1 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235703:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 2/0,0 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235752:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000348e2c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:39029:x1731745946811840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (196us total) trans 38654706233 rc 0/0 00000100:00100000:1.0:1651529917.235755:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 591 00000100:00100000:0.0:1651529917.235759:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eeece7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946811904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (212us total) trans 38654706234 rc 0/0 00000100:00100000:1.0:1651529917.235760:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 592 00000100:00100000:1.0:1651529917.235762:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:39029:x1731745946811968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.235762:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 590 00002000:00080000:1.0:1651529917.235766:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179643 count 1 00010000:00010000:0.0:1651529917.235770:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 2/0,0 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.235771:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235773:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 3/0,1 mode: --/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235774:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000268d25e1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235775:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 2/0,0 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235776:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235777:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235777:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 3/0,1 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235778:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 3/0,0 mode: PW/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235781:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 3/0,1 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235783:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 1/0,0 mode: --/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235784:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 3/0,1 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235786:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2b5f lrc: 0/0,0 mode: --/PW res: [0x2bdb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235787:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 2/0,0 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235790:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 2/0,0 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235793:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235794:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 2/0,0 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235797:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 3/0,0 mode: PW/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235800:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 1/0,0 mode: --/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235821:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2b66 lrc: 0/0,0 mode: --/PW res: [0x2bdb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235825:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 2/0,0 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235828:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030acc86a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235829:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 2/0,0 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235831:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 3/0,0 mode: PW/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235835:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 1/0,0 mode: --/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235837:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2b6d lrc: 0/0,0 mode: --/PW res: [0x2bdba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235839:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9440a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:39029:x1731745946811968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (276us total) trans 38654706235 rc 0/0 00000100:00100000:1.0:1651529917.235841:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 592 00010000:00010000:0.0:1651529917.235843:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 2/0,0 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235846:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235846:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 2/0,0 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235849:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 3/0,0 mode: PW/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235851:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 2/0,0 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235852:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 1/0,0 mode: --/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235854:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.235854:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2b74 lrc: 0/0,0 mode: --/PW res: [0x2bdb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235855:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 2/0,0 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235858:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 3/0,0 mode: PW/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235863:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 1/0,0 mode: --/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235866:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2b7b lrc: 0/0,0 mode: --/PW res: [0x2bdbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235930:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812032 00000100:00100000:0.0:1651529917.235936:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812160 00000100:00100000:0.0:1651529917.235938:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812096 00000100:00100000:0.0:1651529917.235941:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 593 00000100:00100000:0.0:1651529917.235943:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946812032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.235948:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179644 count 1 00002000:00010000:0.0:1651529917.235953:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235955:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 3/0,1 mode: --/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235958:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235959:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235960:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 3/0,1 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235963:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 3/0,1 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235966:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 3/0,1 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235969:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 2/0,0 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235974:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 594 00000100:00100000:1.0:1651529917.235976:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946812160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.235982:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179646 count 1 00002000:00010000:1.0:1651529917.235988:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235990:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 3/0,1 mode: --/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235993:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235994:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235995:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 3/0,1 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235998:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 3/0,1 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236001:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 3/0,1 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236004:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 2/0,0 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236047:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db0a6d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946812032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (147us total) trans 38654706236 rc 0/0 00000100:00100000:0.0:1651529917.236050:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 593 00000100:00100000:0.0:1651529917.236055:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 595 00000100:00100000:0.0:1651529917.236057:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946812096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.236062:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179645 count 1 00000100:00100000:1.0:1651529917.236064:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076b9d582 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946812160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (159us total) trans 38654706237 rc 0/0 00002000:00010000:0.0:1651529917.236068:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.236069:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 594 00010000:00010000:0.0:1651529917.236070:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 3/0,1 mode: --/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236073:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236074:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236075:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 3/0,1 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236079:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 3/0,1 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236082:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 3/0,1 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236085:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 2/0,0 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236108:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 2/0,0 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236113:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a8ba774 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.236114:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 2/0,0 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236117:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 3/0,0 mode: PW/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236122:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 1/0,0 mode: --/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236124:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2b82 lrc: 0/0,0 mode: --/PW res: [0x2bdbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236129:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f71c0be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946812096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (201us total) trans 38654706238 rc 0/0 00000100:00100000:0.0:1651529917.236131:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 595 00010000:00010000:1.0:1651529917.236134:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 2/0,0 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236137:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.236138:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 2/0,0 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236139:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 2/0,0 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236141:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 3/0,0 mode: PW/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236143:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236144:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 2/0,0 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236147:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 1/0,0 mode: --/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236147:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 3/0,0 mode: PW/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236149:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2b89 lrc: 0/0,0 mode: --/PW res: [0x2bdbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236152:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 1/0,0 mode: --/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236154:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2b90 lrc: 0/0,0 mode: --/PW res: [0x2bdbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236246:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236246:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812800 00000100:00100000:1.0:1651529917.236252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236252:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812928 00000100:00100000:0.0:1651529917.236255:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812736 00000100:00100000:0.0:1651529917.236257:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812864 00000100:00100000:1.0:1651529917.236258:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812992 00000100:00100000:0.0:1651529917.236260:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 596 00000100:00100000:0.0:1651529917.236262:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946812800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.236264:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 597 00000100:00100000:1.0:1651529917.236266:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946812928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.236271:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179650 count 1 00002000:00080000:0.0:1651529917.236276:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179648 count 1 00002000:00010000:1.0:1651529917.236277:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236279:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 3/0,1 mode: --/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236282:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529917.236282:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236283:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236284:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 3/0,1 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236284:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 3/0,1 mode: --/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236287:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 3/0,1 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236287:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236288:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236289:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 3/0,1 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236292:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 3/0,1 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236295:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 3/0,1 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236298:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 2/0,0 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236300:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 3/0,1 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236309:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 2/0,0 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236361:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946812928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (147us total) trans 38654706240 rc 0/0 00000100:00100000:0.0:1651529917.236368:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000592ec605 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946812800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (172us total) trans 38654706239 rc 0/0 00000100:00100000:1.0:1651529917.236376:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 597 00000100:00100000:0.0:1651529917.236378:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 596 00000100:00100000:1.0:1651529917.236381:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 598 00000100:00100000:1.0:1651529917.236383:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946812736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.236384:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 599 00000100:00100000:0.0:1651529917.236386:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946812864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.236388:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179647 count 1 00002000:00010000:1.0:1651529917.236397:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236398:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 3/0,1 mode: --/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.236398:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179649 count 1 00010000:00010000:1.0:1651529917.236402:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236403:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236403:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.236404:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236405:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 3/0,1 mode: --/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236407:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236409:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236410:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236410:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236410:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 3/0,1 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236414:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 3/0,1 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236417:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 3/0,1 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236420:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 2/0,0 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236422:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 2/0,0 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236455:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:39029:x1731745946812736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (218us total) trans 38654706241 rc 0/0 00000100:00100000:1.0:1651529917.236458:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 598 00000100:00100000:1.0:1651529917.236462:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 600 00000100:00100000:1.0:1651529917.236464:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:39029:x1731745946812992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.236478:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179651 count 1 00002000:00010000:1.0:1651529917.236483:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236485:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 3/0,1 mode: --/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236487:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:39029:x1731745946812864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 100us (241us total) trans 38654706242 rc 0/0 00010000:00010000:1.0:1651529917.236488:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236489:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236490:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 3/0,1 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236490:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 599 00010000:00010000:1.0:1651529917.236493:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 3/0,1 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236496:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 3/0,1 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236498:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 2/0,0 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236499:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 2/0,0 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236502:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236503:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 2/0,0 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236508:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 3/0,0 mode: PW/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236513:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 1/0,0 mode: --/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236516:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2b9e lrc: 0/0,0 mode: --/PW res: [0x2bdc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236520:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 2/0,0 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236523:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236524:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 2/0,0 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236527:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 3/0,0 mode: PW/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236530:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 1/0,0 mode: --/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236532:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2b97 lrc: 0/0,0 mode: --/PW res: [0x2bdc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236536:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 2/0,0 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236538:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236539:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 2/0,0 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236542:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:39029:x1731745946812992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (289us total) trans 38654706243 rc 0/0 00010000:00010000:0.0:1651529917.236542:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 3/0,0 mode: PW/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236545:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 600 00010000:00010000:0.0:1651529917.236545:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 1/0,0 mode: --/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236547:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2bac lrc: 0/0,0 mode: --/PW res: [0x2bdc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236551:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 2/0,0 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236553:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 2/0,0 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236553:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa7cb3f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236554:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 2/0,0 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236556:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 3/0,0 mode: PW/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236557:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e8ecd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.236558:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 2/0,0 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236559:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 1/0,0 mode: --/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236561:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 3/0,0 mode: PW/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236564:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2ba5 lrc: 0/0,0 mode: --/PW res: [0x2bdbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236565:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 1/0,0 mode: --/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236568:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2bb3 lrc: 0/0,0 mode: --/PW res: [0x2bdc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236594:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236606:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813184 00000100:00100000:1.0:1651529917.236608:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236611:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813248 00000100:00100000:0.0:1651529917.236613:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813568 00000100:00100000:0.0:1651529917.236616:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 601 00000100:00100000:0.0:1651529917.236617:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946813184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.236622:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179652 count 1 00002000:00010000:0.0:1651529917.236627:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236629:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 3/0,1 mode: --/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236632:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236633:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236634:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 3/0,1 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236637:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 3/0,1 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236640:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 3/0,1 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236643:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 2/0,0 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236658:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 602 00000100:00100000:1.0:1651529917.236660:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:39029:x1731745946813248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.236666:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179653 count 1 00002000:00010000:1.0:1651529917.236679:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236681:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 3/0,1 mode: --/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236689:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946813184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (107us total) trans 38654706244 rc 0/0 00010000:00010000:1.0:1651529917.236690:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236691:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236692:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 3/0,1 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236692:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 601 00010000:00010000:1.0:1651529917.236696:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 3/0,1 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236697:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 603 00010000:00010000:1.0:1651529917.236699:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 3/0,1 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236699:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946813568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.236702:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 2/0,0 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.236704:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179654 count 1 00002000:00010000:0.0:1651529917.236729:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236731:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 3/0,1 mode: --/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236735:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236736:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236737:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236740:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236743:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946813248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (148us total) trans 38654706245 rc 0/0 00010000:00010000:0.0:1651529917.236743:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236746:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 602 00010000:00010000:0.0:1651529917.236746:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 2/0,0 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236790:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946813568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (182us total) trans 38654706246 rc 0/0 00010000:00010000:1.0:1651529917.236792:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 2/0,0 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236795:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 603 00010000:00010000:1.0:1651529917.236797:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.236798:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 2/0,0 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236801:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 3/0,0 mode: PW/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236823:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 2/0,0 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236827:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 1/0,0 mode: --/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236827:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000682ba7bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.236828:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 2/0,0 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236830:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2bba lrc: 0/0,0 mode: --/PW res: [0x2bdc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236831:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 3/0,0 mode: PW/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236835:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 2/0,0 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236835:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 1/0,0 mode: --/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236837:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.236838:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 2/0,0 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236838:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2bc1 lrc: 0/0,0 mode: --/PW res: [0x2bdc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236841:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 3/0,0 mode: PW/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236844:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 1/0,0 mode: --/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236847:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2bc8 lrc: 0/0,0 mode: --/PW res: [0x2bdc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236948:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236973:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813824 00000100:00100000:1.0:1651529917.236974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236979:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813952 00000100:00100000:1.0:1651529917.236980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236981:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814080 00000100:00100000:0.0:1651529917.236983:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813888 00000100:00100000:1.0:1651529917.236986:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814016 00000100:00100000:0.0:1651529917.236986:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814208 00000100:00100000:0.0:1651529917.236989:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 604 00000100:00100000:0.0:1651529917.236991:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946813824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.236993:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 605 00000100:00100000:1.0:1651529917.236994:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946813952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.236996:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179655 count 1 00002000:00080000:1.0:1651529917.237000:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179657 count 1 00002000:00010000:0.0:1651529917.237001:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237003:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 3/0,1 mode: --/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.237005:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237007:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 3/0,1 mode: --/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237007:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237007:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237008:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 3/0,1 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237010:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237011:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237011:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 3/0,1 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237012:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 3/0,1 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237014:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 3/0,1 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237015:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 3/0,1 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237017:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 2/0,0 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237018:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 3/0,1 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237021:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 2/0,0 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237089:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946813952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (140us total) trans 38654706247 rc 0/0 00000100:00100000:1.0:1651529917.237092:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 605 00000100:00100000:1.0:1651529917.237097:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 606 00000100:00100000:1.0:1651529917.237099:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+91:39030:x1731745946814080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.237100:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:39030:x1731745946813824:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 107us (168us total) trans 38654706248 rc 0/0 00000100:00100000:0.0:1651529917.237103:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 604 00000100:00100000:0.0:1651529917.237109:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 607 00000100:00100000:0.0:1651529917.237110:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946813888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.237113:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179659 count 1 00002000:00080000:0.0:1651529917.237115:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179656 count 1 00002000:00010000:1.0:1651529917.237118:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237120:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 3/0,1 mode: --/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.237120:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237123:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237124:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237125:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 3/0,1 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237128:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 3/0,1 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237131:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 3/0,1 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237134:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 2/0,0 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237136:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 3/0,1 mode: --/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237140:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237140:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237141:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 3/0,1 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237145:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 3/0,1 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237148:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 3/0,1 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237151:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 2/0,0 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237170:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946814080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (214us total) trans 38654706249 rc 0/0 00000100:00100000:1.0:1651529917.237173:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 606 00000100:00100000:1.0:1651529917.237178:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 608 00000100:00100000:1.0:1651529917.237180:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+91:39030:x1731745946814208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.237184:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179660 count 1 00000100:00100000:0.0:1651529917.237187:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:39030:x1731745946813888:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (222us total) trans 38654706250 rc 0/0 00002000:00010000:1.0:1651529917.237188:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237190:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 3/0,1 mode: --/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237190:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 607 00000100:00100000:0.0:1651529917.237195:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 609 00000100:00100000:0.0:1651529917.237197:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946814016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.237201:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237202:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.237202:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179658 count 1 00010000:00010000:1.0:1651529917.237203:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 3/0,1 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237207:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 3/0,1 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.237207:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237208:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 3/0,1 mode: --/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237210:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 3/0,1 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237212:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237212:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237213:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 2/0,0 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237213:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 3/0,1 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237216:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 3/0,1 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237222:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 3/0,1 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237224:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 2/0,0 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237246:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946814208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (265us total) trans 38654706251 rc 0/0 00000100:00100000:1.0:1651529917.237249:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 608 00010000:00010000:1.0:1651529917.237256:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 2/0,0 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237258:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:39030:x1731745946814016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (284us total) trans 38654706252 rc 0/0 00010000:00010000:1.0:1651529917.237260:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.237261:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 2/0,0 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237261:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 609 00010000:00010000:1.0:1651529917.237264:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 3/0,0 mode: PW/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237269:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 2/0,0 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237271:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 1/0,0 mode: --/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237273:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820f2298 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.237274:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2bcf lrc: 0/0,0 mode: --/PW res: [0x2bdc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237274:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 2/0,0 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237277:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 3/0,0 mode: PW/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237279:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 2/0,0 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237281:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3b8469c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.237282:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 2/0,0 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237282:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 1/0,0 mode: --/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237284:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2bd6 lrc: 0/0,0 mode: --/PW res: [0x2bdc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237285:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 3/0,0 mode: PW/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237288:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 1/0,0 mode: --/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237289:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 2/0,0 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237291:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2bdd lrc: 0/0,0 mode: --/PW res: [0x2bdcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237292:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d27cca91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.237293:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 2/0,0 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237294:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 2/0,0 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237295:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 3/0,0 mode: PW/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237296:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f4abd4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.237297:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 2/0,0 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237298:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 1/0,0 mode: --/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237300:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 3/0,0 mode: PW/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237301:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2be4 lrc: 0/0,0 mode: --/PW res: [0x2bdc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237303:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 1/0,0 mode: --/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237304:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 2/0,0 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237306:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2beb lrc: 0/0,0 mode: --/PW res: [0x2bdcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237307:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2632ae4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.237308:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 2/0,0 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237310:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 3/0,0 mode: PW/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237313:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 1/0,0 mode: --/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237318:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2bf2 lrc: 0/0,0 mode: --/PW res: [0x2bdca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237336:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814272 00000100:00100000:1.0:1651529917.237337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237341:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814336 00000100:00100000:0.0:1651529917.237344:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 610 00000100:00100000:0.0:1651529917.237346:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946814272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.237350:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179661 count 1 00002000:00010000:0.0:1651529917.237355:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237357:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 3/0,1 mode: --/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237360:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237361:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237361:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 3/0,1 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237365:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 3/0,1 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237368:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 3/0,1 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237370:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 2/0,0 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237391:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 2/0,0 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237395:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.237395:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 2/0,0 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237398:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 3/0,0 mode: PW/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237403:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 1/0,0 mode: --/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237406:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2bf9 lrc: 0/0,0 mode: --/PW res: [0x2bdcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237416:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:39029:x1731745946814272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (97us total) trans 38654706253 rc 0/0 00000100:00100000:0.0:1651529917.237419:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 610 00000100:00100000:0.0:1651529917.237425:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 611 00000100:00100000:0.0:1651529917.237426:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946814336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.237446:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179662 count 1 00002000:00010000:0.0:1651529917.237452:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237454:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 3/0,1 mode: --/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237457:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237458:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237459:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 3/0,1 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237463:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 3/0,1 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237466:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 3/0,1 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237468:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 2/0,0 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237514:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946814336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (177us total) trans 38654706254 rc 0/0 00000100:00100000:0.0:1651529917.237517:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 611 00010000:00010000:0.0:1651529917.237537:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 2/0,0 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237543:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004044efa8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.237544:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 2/0,0 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237547:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 3/0,0 mode: PW/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237551:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 1/0,0 mode: --/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237554:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2c00 lrc: 0/0,0 mode: --/PW res: [0x2bdce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.237664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237672:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814976 00000100:00100000:0.0:1651529917.237682:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815104 00000100:00100000:0.0:1651529917.237689:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 612 00000100:00100000:0.0:1651529917.237690:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946814976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.237695:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179664 count 1 00000100:00100000:1.0:1651529917.237702:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.237710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.237710:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237712:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 3/0,1 mode: --/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237715:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.237716:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237716:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237717:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 3/0,1 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.237725:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814912 00000100:00100000:1.0:1651529917.237731:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815232 00000100:00100000:1.0:1651529917.237733:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815040 00000100:00100000:1.0:1651529917.237735:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815168 00000100:00100000:1.0:1651529917.237738:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 613 00000100:00100000:1.0:1651529917.237739:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946815104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.237746:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 3/0,1 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237750:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 3/0,1 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237753:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 2/0,0 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.237757:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179666 count 1 00002000:00010000:1.0:1651529917.237763:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237765:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 3/0,1 mode: --/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237769:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237769:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237770:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 3/0,1 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237774:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 3/0,1 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237777:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 3/0,1 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237790:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 2/0,0 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237796:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+99:39030:x1731745946814976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 104us (143us total) trans 38654706255 rc 0/0 00000100:00100000:0.0:1651529917.237799:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 612 00000100:00100000:0.0:1651529917.237831:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 614 00000100:00100000:0.0:1651529917.237833:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+99:39029:x1731745946814912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.237838:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179663 count 1 00002000:00010000:0.0:1651529917.237843:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237845:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 3/0,1 mode: --/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237849:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237849:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237850:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 3/0,1 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237851:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+99:39030:x1731745946815104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 110us (186us total) trans 38654706256 rc 0/0 00010000:00010000:0.0:1651529917.237853:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 3/0,1 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237854:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 613 00000100:00100000:1.0:1651529917.237859:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 615 00000100:00100000:1.0:1651529917.237861:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946815232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.237865:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179668 count 1 00010000:00010000:0.0:1651529917.237868:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 3/0,1 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.237870:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237871:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 3/0,1 mode: --/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237871:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 2/0,0 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237875:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237876:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237877:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 3/0,1 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237880:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 3/0,1 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237883:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 3/0,1 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237886:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 2/0,0 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237909:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946814912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (206us total) trans 38654706257 rc 0/0 00000100:00100000:0.0:1651529917.237912:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 614 00000100:00100000:0.0:1651529917.237917:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 616 00000100:00100000:0.0:1651529917.237919:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+99:39029:x1731745946815040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.237921:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+99:39030:x1731745946815232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (210us total) trans 38654706258 rc 0/0 00002000:00080000:0.0:1651529917.237923:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179665 count 1 00000100:00100000:1.0:1651529917.237924:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 615 00002000:00010000:0.0:1651529917.237928:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.237929:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 617 00010000:00010000:0.0:1651529917.237930:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 3/0,1 mode: --/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237931:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:39029:x1731745946815168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.237933:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237934:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.237935:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179667 count 1 00010000:00010000:0.0:1651529917.237935:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 3/0,1 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237938:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 3/0,1 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.237939:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237940:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 3/0,1 mode: --/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237941:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 3/0,1 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237944:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237944:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237945:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 3/0,1 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237948:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 3/0,1 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237951:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 3/0,1 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237954:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 2/0,0 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237955:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 2/0,0 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237984:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946815168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 52us (264us total) trans 38654706259 rc 0/0 00000100:00100000:0.0:1651529917.237990:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946815040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (275us total) trans 38654706260 rc 0/0 00000100:00100000:0.0:1651529917.237993:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 616 00000100:00100000:1.0:1651529917.237998:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 617 00010000:00010000:0.0:1651529917.238001:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 2/0,0 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238004:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238005:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 2/0,0 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238008:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 3/0,0 mode: PW/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238009:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 2/0,0 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238013:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000005aa332 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238013:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 1/0,0 mode: --/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238014:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 2/0,0 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238016:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2c07 lrc: 0/0,0 mode: --/PW res: [0x2bdd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238017:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 3/0,0 mode: PW/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238020:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 2/0,0 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238022:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 1/0,0 mode: --/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238023:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.238024:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2c0e lrc: 0/0,0 mode: --/PW res: [0x2bdd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238029:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 2/0,0 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238031:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006d9a23ca already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238031:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 2/0,0 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238032:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 2/0,0 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238034:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 3/0,0 mode: PW/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238035:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 3/0,0 mode: PW/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238045:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 1/0,0 mode: --/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238049:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2c15 lrc: 0/0,0 mode: --/PW res: [0x2bdcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238053:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 2/0,0 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238055:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb7f365b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.238056:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 1/0,0 mode: --/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238056:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 2/0,0 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238058:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2c1c lrc: 0/0,0 mode: --/PW res: [0x2bdd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238059:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 3/0,0 mode: PW/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238062:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 2/0,0 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238062:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 1/0,0 mode: --/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238065:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001001cb5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238065:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2c2a lrc: 0/0,0 mode: --/PW res: [0x2bdd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238066:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 2/0,0 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238069:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 3/0,0 mode: PW/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238072:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 1/0,0 mode: --/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238075:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c2c23 lrc: 0/0,0 mode: --/PW res: [0x2bdd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238115:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815296 00000100:00100000:0.0:1651529917.238121:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815424 00000100:00100000:0.0:1651529917.238124:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 618 00000100:00100000:0.0:1651529917.238126:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:39030:x1731745946815296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.238131:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179669 count 1 00002000:00010000:0.0:1651529917.238135:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238137:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 3/0,1 mode: --/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238140:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238141:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238142:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 3/0,1 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238145:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 3/0,1 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238148:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 3/0,1 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238151:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 2/0,0 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238160:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 619 00000100:00100000:1.0:1651529917.238162:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:39029:x1731745946815424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.238175:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179670 count 1 00002000:00010000:1.0:1651529917.238180:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238182:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 3/0,1 mode: --/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238186:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238186:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238187:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 3/0,1 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238194:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+101:39030:x1731745946815296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (104us total) trans 38654706261 rc 0/0 00010000:00010000:1.0:1651529917.238196:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 3/0,1 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238197:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 618 00010000:00010000:1.0:1651529917.238200:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 3/0,1 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238203:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 2/0,0 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238219:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 2/0,0 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238222:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051a46c40 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238223:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 2/0,0 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238226:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 3/0,0 mode: PW/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238231:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 1/0,0 mode: --/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238244:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946815424:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (139us total) trans 38654706262 rc 0/0 00000100:00100000:1.0:1651529917.238247:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 619 00010000:00010000:0.0:1651529917.238249:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c2c31 lrc: 0/0,0 mode: --/PW res: [0x2bdd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238254:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 2/0,0 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238257:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdd840ca already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238258:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 2/0,0 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238260:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 3/0,0 mode: PW/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238264:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 1/0,0 mode: --/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238284:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2c38 lrc: 0/0,0 mode: --/PW res: [0x2bdd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238309:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816000 00000100:00100000:1.0:1651529917.238310:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816064 00000100:00100000:0.0:1651529917.238316:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 620 00000100:00100000:0.0:1651529917.238317:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946816000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.238318:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 621 00000100:00100000:1.0:1651529917.238319:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946816064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.238322:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179671 count 1 00002000:00080000:1.0:1651529917.238324:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179672 count 1 00002000:00010000:0.0:1651529917.238328:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238329:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 3/0,1 mode: --/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238332:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238333:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238334:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 3/0,1 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.238337:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238337:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 3/0,1 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238338:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 3/0,1 mode: --/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238340:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 3/0,1 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238342:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238343:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238343:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 3/0,1 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238343:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 2/0,0 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238347:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 3/0,1 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238357:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 3/0,1 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238360:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 2/0,0 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238396:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+104:39030:x1731745946816000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (103us total) trans 38654706263 rc 0/0 00000100:00100000:0.0:1651529917.238407:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 620 00000100:00100000:1.0:1651529917.238410:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946816064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (110us total) trans 38654706264 rc 0/0 00000100:00100000:1.0:1651529917.238413:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 621 00010000:00010000:0.0:1651529917.238415:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 2/0,0 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238418:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b45e480 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238419:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 2/0,0 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238420:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 2/0,0 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238422:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 3/0,0 mode: PW/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238424:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea01ff05 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.238425:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 2/0,0 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238427:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 1/0,0 mode: --/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238428:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 3/0,0 mode: PW/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238430:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c2c3f lrc: 0/0,0 mode: --/PW res: [0x2bdd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238442:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 1/0,0 mode: --/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238445:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2c46 lrc: 0/0,0 mode: --/PW res: [0x2bdd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238592:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238617:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816192 00000100:00100000:1.0:1651529917.238623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238623:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816128 00000100:00100000:0.0:1651529917.238625:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816320 00000100:00100000:0.0:1651529917.238627:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816256 00000100:00100000:0.0:1651529917.238630:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 622 00000100:00100000:0.0:1651529917.238632:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946816192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.238636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.238637:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179674 count 1 00000100:00100000:1.0:1651529917.238642:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816640 00002000:00010000:0.0:1651529917.238642:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238644:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 3/0,1 mode: --/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238647:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816576 00000100:00100000:1.0:1651529917.238650:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 623 00000100:00100000:1.0:1651529917.238651:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+108:39030:x1731745946816128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.238657:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179673 count 1 00010000:00010000:0.0:1651529917.238658:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238659:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238659:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 3/0,1 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.238662:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238663:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 3/0,1 mode: --/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238663:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 3/0,1 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238666:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 3/0,1 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238667:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238668:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238668:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 3/0,1 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238669:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 2/0,0 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238672:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 3/0,1 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238685:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 3/0,1 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238688:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 2/0,0 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238739:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946816192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 106us (163us total) trans 38654706265 rc 0/0 00000100:00100000:0.0:1651529917.238742:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 622 00000100:00100000:1.0:1651529917.238744:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946816128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (152us total) trans 38654706266 rc 0/0 00000100:00100000:0.0:1651529917.238747:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 624 00000100:00100000:1.0:1651529917.238749:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 623 00000100:00100000:0.0:1651529917.238749:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946816320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.238754:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 625 00002000:00080000:0.0:1651529917.238754:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179676 count 1 00000100:00100000:1.0:1651529917.238756:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+108:39030:x1731745946816256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.238759:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bddc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.238760:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179675 count 1 00010000:00010000:0.0:1651529917.238761:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 3/0,1 mode: --/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238764:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.238765:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bddb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238765:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238766:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 3/0,1 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238767:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 3/0,1 mode: --/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238770:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238770:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 3/0,1 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238771:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238772:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 3/0,1 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238772:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 3/0,1 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238775:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 2/0,0 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238776:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 3/0,1 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238779:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 3/0,1 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238791:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 2/0,0 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238844:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946816320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (245us total) trans 38654706267 rc 0/0 00000100:00100000:0.0:1651529917.238847:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 624 00000100:00100000:1.0:1651529917.238853:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946816256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (247us total) trans 38654706268 rc 0/0 00000100:00100000:0.0:1651529917.238853:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 626 00000100:00100000:0.0:1651529917.238854:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946816640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.238856:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 625 00002000:00080000:0.0:1651529917.238859:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179678 count 1 00000100:00100000:1.0:1651529917.238862:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 627 00000100:00100000:1.0:1651529917.238863:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+108:39030:x1731745946816576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.238864:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238865:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 3/0,1 mode: --/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.238868:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179677 count 1 00010000:00010000:0.0:1651529917.238869:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238870:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238871:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 3/0,1 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.238873:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bddd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238874:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 3/0,1 mode: --/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238874:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 3/0,1 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238878:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238878:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238879:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 3/0,1 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238880:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 3/0,1 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238882:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 2/0,0 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238883:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 3/0,1 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238886:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 3/0,1 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238889:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 2/0,0 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238915:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946816640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (292us total) trans 38654706269 rc 0/0 00000100:00100000:0.0:1651529917.238918:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 626 00010000:00010000:0.0:1651529917.238926:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 2/0,0 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238929:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b1768d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238930:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 2/0,0 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238933:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+109:39030:x1731745946816576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (297us total) trans 38654706270 rc 0/0 00010000:00010000:0.0:1651529917.238933:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 3/0,0 mode: PW/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238936:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 627 00010000:00010000:0.0:1651529917.238937:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 1/0,0 mode: --/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238940:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c2c4d lrc: 0/0,0 mode: --/PW res: [0x2bdda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238944:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 2/0,0 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238944:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 2/0,0 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238947:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000084cb5491 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.238948:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000047b5824 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238948:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 2/0,0 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238949:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 2/0,0 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238951:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 3/0,0 mode: PW/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238952:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 3/0,0 mode: PW/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238954:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 1/0,0 mode: --/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238956:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c2c5b lrc: 0/0,0 mode: --/PW res: [0x2bddc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238957:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 1/0,0 mode: --/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238959:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2c54 lrc: 0/0,0 mode: --/PW res: [0x2bdd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238960:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 2/0,0 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238962:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071429b39 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238963:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 2/0,0 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238964:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 2/0,0 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238965:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 3/0,0 mode: PW/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238967:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f3b4cc3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.238967:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 2/0,0 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238969:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 1/0,0 mode: --/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238974:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2c62 lrc: 0/0,0 mode: --/PW res: [0x2bddb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238977:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 2/0,0 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238980:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 3/0,0 mode: PW/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238980:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5f37e43 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.238981:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 2/0,0 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238983:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 3/0,0 mode: PW/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238984:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 1/0,0 mode: --/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238986:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 1/0,0 mode: --/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238987:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c2c69 lrc: 0/0,0 mode: --/PW res: [0x2bdde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238989:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2c70 lrc: 0/0,0 mode: --/PW res: [0x2bddd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.239015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239026:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816704 00000100:00100000:0.0:1651529917.239031:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816768 00000100:00100000:0.0:1651529917.239034:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 628 00000100:00100000:0.0:1651529917.239036:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946816704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.239050:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179679 count 1 00002000:00010000:0.0:1651529917.239055:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bddf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239056:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 3/0,1 mode: --/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239068:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239068:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239069:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 3/0,1 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239073:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 3/0,1 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239076:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 3/0,1 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239078:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 2/0,0 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239079:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 629 00000100:00100000:1.0:1651529917.239081:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946816768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.239092:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179680 count 1 00002000:00010000:1.0:1651529917.239097:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239099:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 3/0,1 mode: --/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239102:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239103:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239104:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 3/0,1 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239108:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 3/0,1 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239110:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 3/0,1 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239113:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 2/0,0 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239142:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946816704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (140us total) trans 38654706271 rc 0/0 00000100:00100000:0.0:1651529917.239146:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 628 00010000:00010000:0.0:1651529917.239153:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 2/0,0 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239157:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946816768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (142us total) trans 38654706272 rc 0/0 00010000:00010000:0.0:1651529917.239157:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a7e4551 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.239158:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 2/0,0 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239160:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 629 00010000:00010000:0.0:1651529917.239161:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 3/0,0 mode: PW/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239168:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 2/0,0 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239172:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239173:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 2/0,0 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239176:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 3/0,0 mode: PW/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239177:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 1/0,0 mode: --/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239180:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 1/0,0 mode: --/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239180:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c2c77 lrc: 0/0,0 mode: --/PW res: [0x2bddf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239183:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2c7e lrc: 0/0,0 mode: --/PW res: [0x2bde0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.239321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.239326:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.239332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239356:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817408 00000100:00100000:1.0:1651529917.239362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239362:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817344 00000100:00100000:0.0:1651529917.239365:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817472 00000100:00100000:0.0:1651529917.239367:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817600 00000100:00100000:1.0:1651529917.239368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239369:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817536 00000100:00100000:0.0:1651529917.239371:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817664 00000100:00100000:1.0:1651529917.239375:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 630 00000100:00100000:1.0:1651529917.239377:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+116:39030:x1731745946817408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.239378:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 631 00000100:00100000:0.0:1651529917.239380:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+116:39030:x1731745946817344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.239382:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179682 count 1 00002000:00080000:0.0:1651529917.239385:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179681 count 1 00002000:00010000:1.0:1651529917.239387:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239389:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 3/0,1 mode: --/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.239391:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239392:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239393:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239393:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 3/0,1 mode: --/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239394:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 3/0,1 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239396:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239397:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 3/0,1 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239397:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239398:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 3/0,1 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239401:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 3/0,1 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239402:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 3/0,1 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239403:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 2/0,0 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239404:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 3/0,1 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239418:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 2/0,0 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239448:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946817408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (142us total) trans 38654706273 rc 0/0 00000100:00100000:1.0:1651529917.239451:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 630 00000100:00100000:1.0:1651529917.239456:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 632 00000100:00100000:1.0:1651529917.239458:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946817472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.239458:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946817344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (137us total) trans 38654706274 rc 0/0 00000100:00100000:0.0:1651529917.239461:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 631 00002000:00080000:1.0:1651529917.239463:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179683 count 1 00002000:00010000:1.0:1651529917.239467:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.239467:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 633 00010000:00010000:1.0:1651529917.239469:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 3/0,1 mode: --/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239469:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+116:39029:x1731745946817600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.239472:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239473:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.239473:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179685 count 1 00010000:00010000:1.0:1651529917.239474:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 3/0,1 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239477:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 3/0,1 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239480:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 3/0,1 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239483:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 2/0,0 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.239497:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239500:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 3/0,1 mode: --/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239503:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239504:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239505:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 3/0,1 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239509:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 3/0,1 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239512:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 3/0,1 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239514:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 2/0,0 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239524:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946817472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (198us total) trans 38654706275 rc 0/0 00000100:00100000:1.0:1651529917.239527:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 632 00000100:00100000:1.0:1651529917.239533:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 634 00000100:00100000:1.0:1651529917.239534:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+116:39029:x1731745946817536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.239538:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179684 count 1 00002000:00010000:1.0:1651529917.239543:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239544:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 3/0,1 mode: --/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239557:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239558:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239559:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 3/0,1 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239560:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946817600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (227us total) trans 38654706276 rc 0/0 00010000:00010000:1.0:1651529917.239562:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 3/0,1 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239563:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 633 00010000:00010000:1.0:1651529917.239566:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 3/0,1 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239568:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 2/0,0 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239568:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 635 00000100:00100000:0.0:1651529917.239570:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+116:39029:x1731745946817664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.239574:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179686 count 1 00002000:00010000:0.0:1651529917.239579:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239580:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 3/0,1 mode: --/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239584:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239585:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239585:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 3/0,1 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239589:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 3/0,1 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239592:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 3/0,1 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239595:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 2/0,0 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239602:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946817536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (246us total) trans 38654706277 rc 0/0 00000100:00100000:1.0:1651529917.239605:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 634 00010000:00010000:1.0:1651529917.239612:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 2/0,0 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239616:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239617:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 2/0,0 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239620:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 3/0,0 mode: PW/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239627:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 1/0,0 mode: --/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239627:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946817664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (258us total) trans 38654706278 rc 0/0 00010000:00010000:1.0:1651529917.239630:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2c85 lrc: 0/0,0 mode: --/PW res: [0x2bde2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239634:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 2/0,0 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239636:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad6adb6f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239637:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 2/0,0 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239640:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 3/0,0 mode: PW/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239640:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 635 00010000:00010000:1.0:1651529917.239643:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 1/0,0 mode: --/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239646:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c2c8c lrc: 0/0,0 mode: --/PW res: [0x2bde1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239648:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 2/0,0 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239649:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 2/0,0 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239652:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4ecf9ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.239652:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239653:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 2/0,0 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239653:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 2/0,0 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239656:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 3/0,0 mode: PW/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239656:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 3/0,0 mode: PW/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239659:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 1/0,0 mode: --/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239661:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c2c9a lrc: 0/0,0 mode: --/PW res: [0x2bde5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239661:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 1/0,0 mode: --/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239664:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 2/0,0 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239664:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2c93 lrc: 0/0,0 mode: --/PW res: [0x2bde3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239667:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239668:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 2/0,0 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239668:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 2/0,0 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239670:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 3/0,0 mode: PW/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239671:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edb5d78c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.239672:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 2/0,0 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239673:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 1/0,0 mode: --/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239674:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 3/0,0 mode: PW/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239676:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2ca1 lrc: 0/0,0 mode: --/PW res: [0x2bde4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239686:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 1/0,0 mode: --/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239689:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c2ca8 lrc: 0/0,0 mode: --/PW res: [0x2bde6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239708:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817920 00000100:00100000:1.0:1651529917.239709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239713:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817856 00000100:00100000:0.0:1651529917.239716:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 636 00000100:00100000:0.0:1651529917.239718:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946817920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.239723:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179688 count 1 00002000:00010000:0.0:1651529917.239728:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239729:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 3/0,1 mode: --/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239733:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239733:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239734:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 3/0,1 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239738:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 3/0,1 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239741:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 3/0,1 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239743:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 2/0,0 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239780:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 2/0,0 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239784:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c179deaa already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.239785:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 2/0,0 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239788:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 3/0,0 mode: PW/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239795:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946817920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (103us total) trans 38654706279 rc 0/0 00010000:00010000:1.0:1651529917.239797:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 1/0,0 mode: --/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239798:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 636 00010000:00010000:1.0:1651529917.239800:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c2caf lrc: 0/0,0 mode: --/PW res: [0x2bde8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239831:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 637 00000100:00100000:0.0:1651529917.239833:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39029:x1731745946817856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.239839:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179687 count 1 00002000:00010000:0.0:1651529917.239844:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239846:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 3/0,1 mode: --/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239849:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239850:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239851:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 3/0,1 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239855:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 3/0,1 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239858:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 3/0,1 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239860:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 2/0,0 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239904:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+119:39029:x1731745946817856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (194us total) trans 38654706280 rc 0/0 00000100:00100000:0.0:1651529917.239915:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 637 00010000:00010000:0.0:1651529917.239989:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 2/0,0 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239993:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f425678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.239995:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 2/0,0 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239998:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 3/0,0 mode: PW/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240002:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 1/0,0 mode: --/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240005:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c2cb6 lrc: 0/0,0 mode: --/PW res: [0x2bde7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.240092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240092:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818432 00000100:00100000:0.0:1651529917.240103:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818560 00000100:00100000:1.0:1651529917.240105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240113:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818496 00000100:00100000:1.0:1651529917.240118:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 638 00000100:00100000:1.0:1651529917.240120:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946818432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.240120:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 639 00000100:00100000:0.0:1651529917.240122:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946818560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.240126:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179689 count 1 00002000:00080000:0.0:1651529917.240127:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179691 count 1 00002000:00010000:1.0:1651529917.240131:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bde9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529917.240132:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240133:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 3/0,1 mode: --/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240134:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 3/0,1 mode: --/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240140:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240140:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240141:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 3/0,1 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240145:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240145:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 3/0,1 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240146:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240147:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 3/0,1 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240147:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 3/0,1 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240150:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 3/0,1 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240150:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 2/0,0 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240153:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 3/0,1 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240156:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 2/0,0 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240211:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946818432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (129us total) trans 38654706281 rc 0/0 00000100:00100000:1.0:1651529917.240214:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 638 00000100:00100000:1.0:1651529917.240220:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 640 00000100:00100000:0.0:1651529917.240221:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+122:39030:x1731745946818560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 97us (127us total) trans 38654706282 rc 0/0 00000100:00100000:1.0:1651529917.240222:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009722cac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946818496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.240224:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 639 00002000:00080000:1.0:1651529917.240226:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179690 count 1 00002000:00010000:1.0:1651529917.240231:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240232:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 3/0,1 mode: --/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240232:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 2/0,0 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240235:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240236:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240236:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 2/0,0 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240237:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240237:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 3/0,1 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240239:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 3/0,0 mode: PW/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240247:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 1/0,0 mode: --/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240250:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2cbd lrc: 0/0,0 mode: --/PW res: [0x2bde9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240251:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 3/0,1 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240254:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 3/0,1 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240254:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 2/0,0 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240256:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 2/0,0 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240256:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cefd9f91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.240257:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 2/0,0 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240260:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 3/0,0 mode: PW/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240271:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 1/0,0 mode: --/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240274:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c2cc4 lrc: 0/0,0 mode: --/PW res: [0x2bdeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240278:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 2/0,0 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240280:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.240281:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 2/0,0 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240284:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 3/0,0 mode: PW/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240287:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 1/0,0 mode: --/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240290:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ccb lrc: 0/0,0 mode: --/PW res: [0x2bdea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240294:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009722cac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946818496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (189us total) trans 38654706283 rc 0/0 00000100:00100000:1.0:1651529917.240297:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 640 00000100:00100000:1.0:1651529917.240344:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.240358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240368:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818688 00000100:00100000:1.0:1651529917.240372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240373:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818816 00000100:00100000:0.0:1651529917.240375:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818624 00000100:00100000:0.0:1651529917.240378:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 641 00000100:00100000:0.0:1651529917.240380:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946818688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.240384:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179693 count 1 00002000:00010000:0.0:1651529917.240389:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bded:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240391:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 3/0,1 mode: --/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240394:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240395:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.240396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.240396:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 3/0,1 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240399:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 3/0,1 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.240404:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 3/0,1 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240407:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 2/0,0 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240410:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818752 00000100:00100000:1.0:1651529917.240415:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818880 00000100:00100000:1.0:1651529917.240418:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 642 00000100:00100000:1.0:1651529917.240420:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946818816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.240425:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179695 count 1 00002000:00010000:1.0:1651529917.240430:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240431:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 3/0,1 mode: --/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240447:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240447:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240448:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 3/0,1 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240458:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 3/0,1 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240461:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 3/0,1 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240464:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 2/0,0 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240465:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818688:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (121us total) trans 38654706284 rc 0/0 00000100:00100000:0.0:1651529917.240468:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 641 00000100:00100000:0.0:1651529917.240480:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 643 00000100:00100000:0.0:1651529917.240482:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946818624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.240486:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179692 count 1 00002000:00010000:0.0:1651529917.240491:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240493:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 3/0,1 mode: --/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240497:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240497:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240498:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 3/0,1 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240502:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 3/0,1 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240505:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (147us total) trans 38654706285 rc 0/0 00010000:00010000:0.0:1651529917.240505:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 3/0,1 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240508:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 642 00010000:00010000:0.0:1651529917.240510:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 2/0,0 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240513:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 644 00000100:00100000:1.0:1651529917.240515:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946818752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.240527:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179694 count 1 00002000:00010000:1.0:1651529917.240532:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240533:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 3/0,1 mode: --/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240537:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240538:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240538:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 3/0,1 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240542:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 3/0,1 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240545:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 3/0,1 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240548:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 2/0,0 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240549:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (177us total) trans 38654706286 rc 0/0 00000100:00100000:0.0:1651529917.240552:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 643 00000100:00100000:0.0:1651529917.240557:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 645 00000100:00100000:0.0:1651529917.240559:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946818880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.240563:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179696 count 1 00002000:00010000:0.0:1651529917.240568:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240570:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 3/0,1 mode: --/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240573:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240574:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240575:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 3/0,1 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240578:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 3/0,1 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240581:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 3/0,1 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240582:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (186us total) trans 38654706287 rc 0/0 00010000:00010000:0.0:1651529917.240583:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 2/0,0 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240585:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 644 00010000:00010000:1.0:1651529917.240592:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 2/0,0 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240596:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b7551ddc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240597:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 2/0,0 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240600:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 3/0,0 mode: PW/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240613:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 1/0,0 mode: --/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240617:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c2cd2 lrc: 0/0,0 mode: --/PW res: [0x2bded:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240629:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 2/0,0 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240632:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240633:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 2/0,0 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240636:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 3/0,0 mode: PW/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240639:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 1/0,0 mode: --/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240641:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2cd9 lrc: 0/0,0 mode: --/PW res: [0x2bdef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240641:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 81us (238us total) trans 38654706288 rc 0/0 00000100:00100000:0.0:1651529917.240644:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 645 00010000:00010000:1.0:1651529917.240645:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 2/0,0 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240647:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000268d25e1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240648:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 2/0,0 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240650:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 3/0,0 mode: PW/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240661:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 1/0,0 mode: --/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240664:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c2ce0 lrc: 0/0,0 mode: --/PW res: [0x2bdec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240667:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 2/0,0 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240670:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a772ca06 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240671:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 2/0,0 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240673:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 3/0,0 mode: PW/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240675:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 2/0,0 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240676:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 1/0,0 mode: --/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240680:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016217824 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.240681:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 2/0,0 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240684:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 3/0,0 mode: PW/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240687:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c2cee lrc: 0/0,0 mode: --/PW res: [0x2bdf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240689:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 1/0,0 mode: --/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240692:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ce7 lrc: 0/0,0 mode: --/PW res: [0x2bdee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240702:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240713:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819200 00000100:00100000:1.0:1651529917.240719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240727:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819264 00000100:00100000:0.0:1651529917.240731:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 646 00000100:00100000:0.0:1651529917.240733:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946819200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.240737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.240738:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179697 count 1 00002000:00010000:0.0:1651529917.240743:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240744:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 3/0,1 mode: --/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240748:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240749:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240749:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 3/0,1 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240753:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 3/0,1 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240756:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 3/0,1 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240758:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 2/0,0 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240797:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 2/0,0 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240825:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:39030:x1731745946819200:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (123us total) trans 38654706289 rc 0/0 00010000:00010000:1.0:1651529917.240827:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000101e4964 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.240829:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 2/0,0 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240829:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 646 00010000:00010000:1.0:1651529917.240832:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 3/0,0 mode: PW/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240833:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819456 00010000:00010000:1.0:1651529917.240836:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 1/0,0 mode: --/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240838:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 647 00010000:00010000:1.0:1651529917.240839:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c2cf5 lrc: 0/0,0 mode: --/PW res: [0x2bdf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240839:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946819264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.240844:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179698 count 1 00002000:00010000:0.0:1651529917.240848:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240850:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 3/0,1 mode: --/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240854:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.240871:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 648 00010000:00010000:0.0:1651529917.240871:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240872:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 3/0,1 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240873:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+129:39030:x1731745946819456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.240877:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 3/0,1 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.240879:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179699 count 1 00010000:00010000:0.0:1651529917.240880:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 3/0,1 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240882:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 2/0,0 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.240884:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240886:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 3/0,1 mode: --/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240889:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240889:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240890:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 3/0,1 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240894:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 3/0,1 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240897:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 3/0,1 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240900:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 2/0,0 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240933:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946819264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (214us total) trans 38654706290 rc 0/0 00000100:00100000:0.0:1651529917.240936:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 647 00010000:00010000:0.0:1651529917.240943:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 2/0,0 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240947:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030acc86a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.240948:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 2/0,0 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240950:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946819456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (212us total) trans 38654706291 rc 0/0 00010000:00010000:0.0:1651529917.240951:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 3/0,0 mode: PW/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240953:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 648 00010000:00010000:0.0:1651529917.240955:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 1/0,0 mode: --/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240961:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2cfc lrc: 0/0,0 mode: --/PW res: [0x2bdf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240965:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 2/0,0 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240967:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.240968:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 2/0,0 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240971:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 3/0,0 mode: PW/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240974:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 1/0,0 mode: --/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240977:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2d03 lrc: 0/0,0 mode: --/PW res: [0x2bdf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241075:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819904 00000100:00100000:1.0:1651529917.241082:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 649 00000100:00100000:1.0:1651529917.241083:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946819904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.241088:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179700 count 1 00002000:00010000:1.0:1651529917.241094:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241095:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 3/0,1 mode: --/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241099:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241099:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241100:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 3/0,1 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241104:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 3/0,1 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241109:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 3/0,1 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241112:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 2/0,0 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241150:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946819904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (82us total) trans 38654706292 rc 0/0 00000100:00100000:1.0:1651529917.241153:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 649 00010000:00010000:1.0:1651529917.241159:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 2/0,0 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241162:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.241163:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 2/0,0 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241166:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 3/0,0 mode: PW/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241170:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 1/0,0 mode: --/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241173:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2d0a lrc: 0/0,0 mode: --/PW res: [0x2bdf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241231:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241239:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241256:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819968 00000100:00100000:1.0:1651529917.241260:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241269:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820032 00000100:00100000:0.0:1651529917.241276:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820096 00000100:00100000:1.0:1651529917.241280:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820160 00000100:00100000:0.0:1651529917.241280:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820224 00000100:00100000:0.0:1651529917.241283:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 650 00000100:00100000:1.0:1651529917.241285:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 651 00000100:00100000:0.0:1651529917.241285:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946819968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.241287:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946820032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.241290:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179701 count 1 00002000:00080000:1.0:1651529917.241292:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179702 count 1 00002000:00010000:0.0:1651529917.241295:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.241297:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241297:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 3/0,1 mode: --/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241299:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 3/0,1 mode: --/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241300:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241301:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241302:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241302:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 3/0,1 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241303:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241304:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 3/0,1 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241306:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 3/0,1 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241307:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 3/0,1 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241308:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 3/0,1 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241310:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 3/0,1 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241311:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 2/0,0 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241313:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 2/0,0 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241362:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946819968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (130us total) trans 38654706293 rc 0/0 00000100:00100000:0.0:1651529917.241365:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 650 00000100:00100000:1.0:1651529917.241367:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+137:39029:x1731745946820032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (127us total) trans 38654706294 rc 0/0 00000100:00100000:0.0:1651529917.241370:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 652 00000100:00100000:1.0:1651529917.241372:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 651 00000100:00100000:0.0:1651529917.241372:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946820096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.241376:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179703 count 1 00000100:00100000:1.0:1651529917.241377:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 653 00000100:00100000:1.0:1651529917.241379:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946820224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.241381:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241383:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 3/0,1 mode: --/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.241384:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179705 count 1 00010000:00010000:0.0:1651529917.241386:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241387:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241388:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 3/0,1 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.241389:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241390:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 3/0,1 mode: --/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241392:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 3/0,1 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241394:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241394:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241395:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 3/0,1 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241395:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 3/0,1 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241397:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 2/0,0 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241399:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 3/0,1 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241402:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 3/0,1 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241405:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 2/0,0 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241450:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946820224:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (190us total) trans 38654706295 rc 0/0 00000100:00100000:1.0:1651529917.241453:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 653 00000100:00100000:1.0:1651529917.241458:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 654 00000100:00100000:0.0:1651529917.241459:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946820096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (213us total) trans 38654706296 rc 0/0 00000100:00100000:1.0:1651529917.241460:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946820160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.241462:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 652 00002000:00080000:1.0:1651529917.241464:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179704 count 1 00002000:00010000:1.0:1651529917.241469:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241470:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 3/0,1 mode: --/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241470:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 2/0,0 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241473:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acfd0ef2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.241474:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241474:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241475:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 3/0,1 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241475:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 2/0,0 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241478:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 3/0,0 mode: PW/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241479:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 3/0,1 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241482:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 3/0,1 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241482:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 1/0,0 mode: --/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241484:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 2/0,0 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241487:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2d11 lrc: 0/0,0 mode: --/PW res: [0x2bdf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241491:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 2/0,0 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241494:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.241495:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 2/0,0 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241498:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 3/0,0 mode: PW/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241501:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 1/0,0 mode: --/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241503:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2d18 lrc: 0/0,0 mode: --/PW res: [0x2bdf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241507:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 2/0,0 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241509:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.241510:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 2/0,0 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241515:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 3/0,0 mode: PW/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241516:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946820160:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (261us total) trans 38654706297 rc 0/0 00010000:00010000:0.0:1651529917.241518:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 1/0,0 mode: --/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241519:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 654 00010000:00010000:0.0:1651529917.241521:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2d26 lrc: 0/0,0 mode: --/PW res: [0x2bdf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241524:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 2/0,0 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241526:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9386f1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.241527:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 2/0,0 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241527:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 2/0,0 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241530:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.241530:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 3/0,0 mode: PW/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241531:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 2/0,0 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241533:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 1/0,0 mode: --/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241535:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2d1f lrc: 0/0,0 mode: --/PW res: [0x2bdf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241537:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 3/0,0 mode: PW/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241542:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 1/0,0 mode: --/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241544:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2d2d lrc: 0/0,0 mode: --/PW res: [0x2bdf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241581:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820352 00000100:00100000:1.0:1651529917.241584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241586:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820288 00000100:00100000:0.0:1651529917.241589:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820672 00000100:00100000:0.0:1651529917.241592:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 655 00000100:00100000:0.0:1651529917.241593:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+138:39030:x1731745946820352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.241598:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179707 count 1 00002000:00010000:0.0:1651529917.241603:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241605:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 3/0,1 mode: --/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241608:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241609:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241609:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 3/0,1 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241613:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 3/0,1 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241616:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 3/0,1 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241618:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 2/0,0 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241632:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 656 00000100:00100000:1.0:1651529917.241634:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+138:39029:x1731745946820288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.241640:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179706 count 1 00002000:00010000:1.0:1651529917.241645:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241647:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 3/0,1 mode: --/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241650:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241651:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241651:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 3/0,1 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241655:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 3/0,1 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241667:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 3/0,1 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241670:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 2/0,0 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241674:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946820352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (118us total) trans 38654706298 rc 0/0 00000100:00100000:0.0:1651529917.241683:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 655 00000100:00100000:0.0:1651529917.241689:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 657 00000100:00100000:0.0:1651529917.241690:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946820672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.241696:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179708 count 1 00002000:00010000:0.0:1651529917.241702:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241703:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 3/0,1 mode: --/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241707:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241708:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241708:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 3/0,1 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241710:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946820288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (141us total) trans 38654706299 rc 0/0 00010000:00010000:0.0:1651529917.241712:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 3/0,1 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241713:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 656 00010000:00010000:0.0:1651529917.241715:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 3/0,1 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241718:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 2/0,0 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241755:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 2/0,0 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241761:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946820672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (177us total) trans 38654706300 rc 0/0 00010000:00010000:1.0:1651529917.241764:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7d0c66c already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529917.241764:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 657 00010000:00010000:1.0:1651529917.241765:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 2/0,0 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241768:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 3/0,0 mode: PW/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241772:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 2/0,0 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241773:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 1/0,0 mode: --/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241775:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.241776:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2d34 lrc: 0/0,0 mode: --/PW res: [0x2bdfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241776:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 2/0,0 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241780:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 2/0,0 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241781:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 3/0,0 mode: PW/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241783:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000897c5bf already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.241784:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 2/0,0 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241786:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 1/0,0 mode: --/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241787:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 3/0,0 mode: PW/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241789:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2d3b lrc: 0/0,0 mode: --/PW res: [0x2bdfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241790:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 1/0,0 mode: --/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241793:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2d42 lrc: 0/0,0 mode: --/PW res: [0x2bdfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241950:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820992 00000100:00100000:1.0:1651529917.241952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241969:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821120 00000100:00100000:0.0:1651529917.241972:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821248 00000100:00100000:1.0:1651529917.241974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241975:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821056 00000100:00100000:0.0:1651529917.241977:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821184 00000100:00100000:1.0:1651529917.241980:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241985:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821312 00000100:00100000:0.0:1651529917.241988:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 658 00000100:00100000:0.0:1651529917.241990:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946820992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.241992:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 659 00000100:00100000:1.0:1651529917.241993:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946821120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.241995:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179709 count 1 00002000:00080000:1.0:1651529917.241998:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179711 count 1 00002000:00010000:0.0:1651529917.242001:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242002:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 3/0,1 mode: --/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.242004:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242005:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 3/0,1 mode: --/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242006:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242007:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242007:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 3/0,1 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242011:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242011:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 3/0,1 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242012:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242013:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 3/0,1 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242015:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 3/0,1 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242016:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 3/0,1 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242017:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 2/0,0 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242019:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 3/0,1 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242022:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 2/0,0 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242077:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946821120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (140us total) trans 38654706302 rc 0/0 00000100:00100000:1.0:1651529917.242080:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 659 00000100:00100000:0.0:1651529917.242099:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946820992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 107us (178us total) trans 38654706301 rc 0/0 00000100:00100000:1.0:1651529917.242100:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 660 00000100:00100000:1.0:1651529917.242102:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946821248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.242102:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 658 00002000:00080000:1.0:1651529917.242107:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179713 count 1 00000100:00100000:0.0:1651529917.242108:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 661 00000100:00100000:0.0:1651529917.242109:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946821056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.242112:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242114:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 3/0,1 mode: --/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.242114:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179710 count 1 00010000:00010000:1.0:1651529917.242117:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242118:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242119:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 3/0,1 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.242119:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bdfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242121:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 3/0,1 mode: --/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242124:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242125:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242126:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 3/0,1 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242129:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 3/0,1 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242131:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 3/0,1 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242133:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 3/0,1 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242135:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 3/0,1 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242137:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 2/0,0 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242138:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 2/0,0 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242171:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946821056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (210us total) trans 38654706303 rc 0/0 00000100:00100000:0.0:1651529917.242174:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 661 00000100:00100000:1.0:1651529917.242177:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946821248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (225us total) trans 38654706304 rc 0/0 00000100:00100000:0.0:1651529917.242179:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 662 00000100:00100000:1.0:1651529917.242181:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 660 00000100:00100000:0.0:1651529917.242181:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946821184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.242185:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179712 count 1 00000100:00100000:1.0:1651529917.242186:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 663 00000100:00100000:1.0:1651529917.242188:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+144:39029:x1731745946821312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.242189:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242191:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 3/0,1 mode: --/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.242192:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179714 count 1 00010000:00010000:0.0:1651529917.242194:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242195:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.242196:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242196:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 3/0,1 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242198:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 3/0,1 mode: --/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242199:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 3/0,1 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242201:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242202:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242202:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 3/0,1 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242203:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 3/0,1 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242205:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 2/0,0 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242206:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 3/0,1 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242220:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 3/0,1 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242222:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 2/0,0 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242236:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946821184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (262us total) trans 38654706305 rc 0/0 00000100:00100000:0.0:1651529917.242239:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 662 00010000:00010000:0.0:1651529917.242247:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 2/0,0 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242250:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2e406ba already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.242251:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 2/0,0 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242255:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 3/0,0 mode: PW/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242257:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946821312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (277us total) trans 38654706306 rc 0/0 00010000:00010000:0.0:1651529917.242259:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 1/0,0 mode: --/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242260:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 663 00010000:00010000:0.0:1651529917.242262:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2d49 lrc: 0/0,0 mode: --/PW res: [0x2bdfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242266:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 2/0,0 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242268:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 2/0,0 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242269:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.242269:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 2/0,0 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242271:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242272:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 2/0,0 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242275:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 3/0,0 mode: PW/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242275:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 3/0,0 mode: PW/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242278:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 1/0,0 mode: --/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242280:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 1/0,0 mode: --/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242280:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2d50 lrc: 0/0,0 mode: --/PW res: [0x2bdff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242283:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2d57 lrc: 0/0,0 mode: --/PW res: [0x2be01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242284:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 2/0,0 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242286:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6595fad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242287:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 2/0,0 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242287:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 2/0,0 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242290:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 3/0,0 mode: PW/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242293:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 1/0,0 mode: --/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242296:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2d5e lrc: 0/0,0 mode: --/PW res: [0x2bdfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242298:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000406c58a2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242299:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 2/0,0 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242299:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 2/0,0 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242301:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 3/0,0 mode: PW/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242302:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.242303:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 2/0,0 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242305:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 1/0,0 mode: --/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242306:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 3/0,0 mode: PW/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242308:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2d65 lrc: 0/0,0 mode: --/PW res: [0x2be00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242309:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 1/0,0 mode: --/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242311:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2d6c lrc: 0/0,0 mode: --/PW res: [0x2be02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242333:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821504 00000100:00100000:1.0:1651529917.242338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242340:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821952 00000100:00100000:0.0:1651529917.242352:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 664 00000100:00100000:0.0:1651529917.242354:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946821504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.242359:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179715 count 1 00002000:00010000:0.0:1651529917.242364:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242365:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 3/0,1 mode: --/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242369:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242369:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242370:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 3/0,1 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242376:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 3/0,1 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242379:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 3/0,1 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242382:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 2/0,0 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242394:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 665 00000100:00100000:1.0:1651529917.242396:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946821952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.242401:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179716 count 1 00002000:00010000:1.0:1651529917.242406:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242408:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 3/0,1 mode: --/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242412:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242412:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242413:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 3/0,1 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242427:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 3/0,1 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242430:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 3/0,1 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242433:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 2/0,0 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242447:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946821504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (123us total) trans 38654706307 rc 0/0 00000100:00100000:0.0:1651529917.242450:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 664 00010000:00010000:0.0:1651529917.242457:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 2/0,0 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242461:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff73fa02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.242461:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 2/0,0 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242465:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 3/0,0 mode: PW/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242469:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 1/0,0 mode: --/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242472:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2d73 lrc: 0/0,0 mode: --/PW res: [0x2be03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242476:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 2/0,0 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242477:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946821952:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (138us total) trans 38654706308 rc 0/0 00010000:00010000:0.0:1651529917.242479:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529917.242480:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 665 00010000:00010000:0.0:1651529917.242480:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 2/0,0 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242483:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 3/0,0 mode: PW/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242486:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 1/0,0 mode: --/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242488:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2d7a lrc: 0/0,0 mode: --/PW res: [0x2be04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.242565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242575:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822144 00000100:00100000:1.0:1651529917.242576:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242607:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822272 00000100:00100000:1.0:1651529917.242615:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822400 00000100:00100000:0.0:1651529917.242616:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 666 00000100:00100000:0.0:1651529917.242617:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+149:39030:x1731745946822144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.242622:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 667 00002000:00080000:0.0:1651529917.242622:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179717 count 1 00000100:00100000:1.0:1651529917.242624:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+149:39030:x1731745946822272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.242627:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242628:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 3/0,1 mode: --/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.242629:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179719 count 1 00010000:00010000:0.0:1651529917.242632:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242633:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.242634:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242634:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 3/0,1 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242636:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 3/0,1 mode: --/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242637:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 3/0,1 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242640:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242640:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242640:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 3/0,1 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242641:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 3/0,1 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242642:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 2/0,0 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242657:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 3/0,1 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242660:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 3/0,1 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242663:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 2/0,0 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242695:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946822144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (153us total) trans 38654706309 rc 0/0 00000100:00100000:0.0:1651529917.242698:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 666 00000100:00100000:0.0:1651529917.242703:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 668 00000100:00100000:0.0:1651529917.242705:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946822400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.242709:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179721 count 1 00000100:00100000:1.0:1651529917.242711:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946822272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (151us total) trans 38654706310 rc 0/0 00000100:00100000:1.0:1651529917.242714:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 667 00002000:00010000:0.0:1651529917.242714:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242716:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 3/0,1 mode: --/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242720:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242720:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242721:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 2/0,0 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242721:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 3/0,1 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242725:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e7cb770 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.242725:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 3/0,1 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242726:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 2/0,0 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242728:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 3/0,1 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242729:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 3/0,0 mode: PW/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242731:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 2/0,0 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242734:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 1/0,0 mode: --/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242736:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2d81 lrc: 0/0,0 mode: --/PW res: [0x2be05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242741:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 2/0,0 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242744:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004044efa8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242744:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 2/0,0 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242747:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 3/0,0 mode: PW/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242750:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 1/0,0 mode: --/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242753:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2d88 lrc: 0/0,0 mode: --/PW res: [0x2be07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242756:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 2/0,0 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242759:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a8ba774 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242759:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 2/0,0 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242762:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 3/0,0 mode: PW/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242777:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 1/0,0 mode: --/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242780:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2d8f lrc: 0/0,0 mode: --/PW res: [0x2be09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242794:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946822400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (218us total) trans 38654706311 rc 0/0 00000100:00100000:0.0:1651529917.242797:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 668 00000100:00100000:1.0:1651529917.242831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242841:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822208 00000100:00100000:0.0:1651529917.242848:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 669 00000100:00100000:1.0:1651529917.242849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242850:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f341eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946822208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.242854:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179718 count 1 00000100:00100000:1.0:1651529917.242859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.242860:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242862:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 3/0,1 mode: --/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242865:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242866:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242867:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 3/0,1 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242870:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 3/0,1 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242873:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 3/0,1 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242876:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 2/0,0 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.242897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.242902:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 2/0,0 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242906:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5f37e43 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.242907:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 2/0,0 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242910:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 3/0,0 mode: PW/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242915:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 1/0,0 mode: --/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242918:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2d96 lrc: 0/0,0 mode: --/PW res: [0x2be06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242922:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f341eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946822208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (91us total) trans 38654706312 rc 0/0 00000100:00100000:0.0:1651529917.242925:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 669 00000100:00100000:0.0:1651529917.242971:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822336 00000100:00100000:0.0:1651529917.242975:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822464 00000100:00100000:0.0:1651529917.242978:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822528 00000100:00100000:0.0:1651529917.242980:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822912 00000100:00100000:0.0:1651529917.242982:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 670 00000100:00100000:0.0:1651529917.242984:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+154:39030:x1731745946822336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.242987:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 671 00000100:00100000:1.0:1651529917.242989:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+154:39030:x1731745946822464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.242989:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179720 count 1 00002000:00080000:1.0:1651529917.242994:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179722 count 1 00002000:00010000:0.0:1651529917.242994:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242995:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 3/0,1 mode: --/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242999:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.243000:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243000:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243001:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 3/0,1 mode: --/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243001:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 3/0,1 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243004:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 3/0,1 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243005:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243005:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243006:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 3/0,1 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243007:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 3/0,1 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243010:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 3/0,1 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243012:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 2/0,0 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243013:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 3/0,1 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243015:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 2/0,0 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243070:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:39030:x1731745946822464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (210us total) trans 38654706313 rc 0/0 00000100:00100000:1.0:1651529917.243073:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 671 00000100:00100000:1.0:1651529917.243078:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 672 00000100:00100000:1.0:1651529917.243080:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+155:39029:x1731745946822528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.243081:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946822336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (232us total) trans 38654706314 rc 0/0 00000100:00100000:0.0:1651529917.243084:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 670 00000100:00100000:0.0:1651529917.243089:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 673 00000100:00100000:0.0:1651529917.243091:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+154:39030:x1731745946822912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.243092:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179723 count 1 00002000:00080000:0.0:1651529917.243095:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179724 count 1 00002000:00010000:1.0:1651529917.243098:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243099:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 3/0,1 mode: --/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.243100:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243102:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 3/0,1 mode: --/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243103:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243104:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243104:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 3/0,1 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243105:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243106:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243107:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 3/0,1 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243108:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 3/0,1 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243110:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 3/0,1 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243111:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 3/0,1 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243113:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 3/0,1 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243114:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 2/0,0 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243116:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 2/0,0 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243150:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:39029:x1731745946822528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (265us total) trans 38654706315 rc 0/0 00000100:00100000:1.0:1651529917.243160:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 672 00010000:00010000:1.0:1651529917.243167:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 2/0,0 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243170:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071429b39 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.243171:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 2/0,0 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243182:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946822912:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (284us total) trans 38654706316 rc 0/0 00010000:00010000:1.0:1651529917.243184:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 3/0,0 mode: PW/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243186:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 673 00010000:00010000:1.0:1651529917.243189:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 1/0,0 mode: --/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243192:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2d9d lrc: 0/0,0 mode: --/PW res: [0x2be08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243194:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 2/0,0 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243196:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 2/0,0 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243197:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2632ae4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243198:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 2/0,0 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243199:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d27cca91 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.243200:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 2/0,0 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243201:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 3/0,0 mode: PW/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243202:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 3/0,0 mode: PW/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243205:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 1/0,0 mode: --/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243206:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 1/0,0 mode: --/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243208:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2dab lrc: 0/0,0 mode: --/PW res: [0x2be0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243209:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2da4 lrc: 0/0,0 mode: --/PW res: [0x2be0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243211:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 2/0,0 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243219:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000047b5824 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.243220:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 2/0,0 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243223:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 3/0,0 mode: PW/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243226:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 1/0,0 mode: --/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243228:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2db2 lrc: 0/0,0 mode: --/PW res: [0x2be0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243272:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823168 00000100:00100000:1.0:1651529917.243277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243279:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 674 00000100:00100000:0.0:1651529917.243280:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+155:39030:x1731745946823168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.243285:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179725 count 1 00000100:00100000:1.0:1651529917.243287:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.243290:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243292:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 3/0,1 mode: --/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243295:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243296:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243297:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 3/0,1 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243300:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 3/0,1 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243303:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 3/0,1 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243306:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 2/0,0 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243339:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823232 00000100:00100000:0.0:1651529917.243348:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946823168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (87us total) trans 38654706317 rc 0/0 00000100:00100000:1.0:1651529917.243350:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823296 00000100:00100000:0.0:1651529917.243351:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 674 00000100:00100000:1.0:1651529917.243353:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823360 00000100:00100000:1.0:1651529917.243356:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 675 00000100:00100000:1.0:1651529917.243357:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+158:39029:x1731745946823232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.243358:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 676 00000100:00100000:0.0:1651529917.243359:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946823296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.243362:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179726 count 1 00002000:00080000:0.0:1651529917.243364:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179727 count 1 00002000:00010000:1.0:1651529917.243367:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243369:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 3/0,1 mode: --/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.243369:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243370:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 3/0,1 mode: --/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243383:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243384:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243384:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 3/0,1 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243388:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 3/0,1 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243389:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243389:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243390:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 3/0,1 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243391:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 3/0,1 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243394:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 2/0,0 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243394:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 3/0,1 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243397:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 3/0,1 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243400:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 2/0,0 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243441:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946823232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (163us total) trans 38654706318 rc 0/0 00000100:00100000:1.0:1651529917.243444:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 675 00000100:00100000:0.0:1651529917.243447:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946823296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (159us total) trans 38654706319 rc 0/0 00000100:00100000:1.0:1651529917.243449:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 677 00000100:00100000:1.0:1651529917.243451:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946823360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.243451:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 676 00002000:00080000:1.0:1651529917.243455:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179728 count 1 00010000:00010000:0.0:1651529917.243459:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 2/0,0 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.243460:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243462:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 3/0,1 mode: --/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243463:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea01ff05 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243464:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 2/0,0 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243465:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243466:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243467:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 3/0,1 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243467:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 3/0,0 mode: PW/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243470:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 3/0,1 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243472:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 1/0,0 mode: --/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243473:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 3/0,1 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243474:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2db9 lrc: 0/0,0 mode: --/PW res: [0x2be0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243476:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 2/0,0 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243479:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 2/0,0 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243481:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243482:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 2/0,0 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243485:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 3/0,0 mode: PW/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243488:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 1/0,0 mode: --/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243491:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2dc0 lrc: 0/0,0 mode: --/PW res: [0x2be0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243494:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 2/0,0 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243497:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdd840ca already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243497:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 2/0,0 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243500:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 3/0,0 mode: PW/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243505:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 1/0,0 mode: --/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243508:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946823360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (194us total) trans 38654706320 rc 0/0 00010000:00010000:0.0:1651529917.243508:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2dc7 lrc: 0/0,0 mode: --/PW res: [0x2be0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243511:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 677 00010000:00010000:0.0:1651529917.243511:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 2/0,0 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243514:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243514:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 2/0,0 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243517:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 3/0,0 mode: PW/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243520:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 1/0,0 mode: --/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243522:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2dce lrc: 0/0,0 mode: --/PW res: [0x2be10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243587:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823552 00000100:00100000:0.0:1651529917.243598:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 678 00000100:00100000:0.0:1651529917.243600:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946823552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.243605:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179729 count 1 00002000:00010000:0.0:1651529917.243610:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243612:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 3/0,1 mode: --/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243615:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243616:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243617:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 3/0,1 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243627:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 3/0,1 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243630:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 3/0,1 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243633:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 2/0,0 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243636:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823680 00000100:00100000:1.0:1651529917.243647:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823616 00000100:00100000:1.0:1651529917.243649:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823744 00000100:00100000:1.0:1651529917.243652:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 679 00000100:00100000:1.0:1651529917.243654:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+162:39030:x1731745946823680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.243658:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179731 count 1 00002000:00010000:1.0:1651529917.243663:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243665:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 3/0,1 mode: --/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243671:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243672:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243672:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 3/0,1 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243676:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 3/0,1 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243679:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 3/0,1 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243682:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 2/0,0 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243699:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946823552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (121us total) trans 38654706321 rc 0/0 00000100:00100000:0.0:1651529917.243702:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 678 00000100:00100000:0.0:1651529917.243707:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 680 00000100:00100000:0.0:1651529917.243709:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:39029:x1731745946823616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.243713:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179730 count 1 00002000:00010000:0.0:1651529917.243718:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243720:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 3/0,1 mode: --/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243726:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243727:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.243728:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946823680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (113us total) trans 38654706322 rc 0/0 00010000:00010000:0.0:1651529917.243728:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 3/0,1 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243731:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 679 00010000:00010000:0.0:1651529917.243731:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 3/0,1 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243734:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 3/0,1 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243736:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 681 00010000:00010000:0.0:1651529917.243736:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 2/0,0 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243738:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+162:39029:x1731745946823744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.243742:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179732 count 1 00002000:00010000:1.0:1651529917.243747:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243748:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 3/0,1 mode: --/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243752:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243752:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243753:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 3/0,1 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243757:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 3/0,1 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243760:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 3/0,1 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243763:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 2/0,0 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243772:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:39029:x1731745946823616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (147us total) trans 38654706323 rc 0/0 00000100:00100000:0.0:1651529917.243775:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 680 00010000:00010000:0.0:1651529917.243782:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 2/0,0 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243786:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb7f365b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243787:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 2/0,0 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243790:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 3/0,0 mode: PW/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243794:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39029:x1731745946823744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (164us total) trans 38654706324 rc 0/0 00000100:00100000:1.0:1651529917.243797:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 681 00010000:00010000:0.0:1651529917.243797:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 1/0,0 mode: --/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243800:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c2dd5 lrc: 0/0,0 mode: --/PW res: [0x2be11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243817:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 2/0,0 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243821:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 2/0,0 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243824:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006d9a23ca already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.243825:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243825:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 2/0,0 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243826:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 2/0,0 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243828:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 3/0,0 mode: PW/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243829:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 3/0,0 mode: PW/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243831:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 1/0,0 mode: --/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243834:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 1/0,0 mode: --/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243834:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c2de3 lrc: 0/0,0 mode: --/PW res: [0x2be12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243837:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ddc lrc: 0/0,0 mode: --/PW res: [0x2be13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243837:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 2/0,0 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243840:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db5120f7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.243841:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 2/0,0 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243844:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 3/0,0 mode: PW/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243847:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 1/0,0 mode: --/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243849:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2dea lrc: 0/0,0 mode: --/PW res: [0x2be14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243916:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824256 00000100:00100000:1.0:1651529917.243921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243934:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824384 00000100:00100000:0.0:1651529917.243946:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 682 00000100:00100000:0.0:1651529917.243948:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946824256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.243953:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179734 count 1 00002000:00010000:0.0:1651529917.243958:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243960:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 3/0,1 mode: --/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243963:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243963:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243964:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 3/0,1 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243968:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 3/0,1 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243973:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824192 00010000:00010000:0.0:1651529917.243973:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 3/0,1 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243976:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 2/0,0 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243978:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824320 00000100:00100000:1.0:1651529917.243981:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 683 00000100:00100000:1.0:1651529917.243989:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+166:39029:x1731745946824384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.243995:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179736 count 1 00002000:00010000:1.0:1651529917.244000:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244001:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 3/0,1 mode: --/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244005:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244006:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244006:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 3/0,1 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244010:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 3/0,1 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244013:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 3/0,1 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244016:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 2/0,0 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244023:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946824256:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (117us total) trans 38654706325 rc 0/0 00000100:00100000:0.0:1651529917.244026:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 682 00000100:00100000:0.0:1651529917.244064:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 684 00000100:00100000:0.0:1651529917.244066:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+167:39030:x1731745946824192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.244080:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946824384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 96us (159us total) trans 38654706326 rc 0/0 00000100:00100000:1.0:1651529917.244083:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 683 00000100:00100000:1.0:1651529917.244089:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 685 00000100:00100000:1.0:1651529917.244090:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946824320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.244092:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179733 count 1 00002000:00010000:0.0:1651529917.244098:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244100:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 3/0,1 mode: --/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.244104:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179735 count 1 00010000:00010000:0.0:1651529917.244104:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244105:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244105:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 3/0,1 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.244109:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244109:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 3/0,1 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244111:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 3/0,1 mode: --/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244112:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 3/0,1 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244115:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244115:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244116:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 3/0,1 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244117:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 2/0,0 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244120:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 3/0,1 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244123:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 3/0,1 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244125:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 2/0,0 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244169:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946824320:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (202us total) trans 38654706328 rc 0/0 00000100:00100000:0.0:1651529917.244180:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946824192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 112us (218us total) trans 38654706327 rc 0/0 00000100:00100000:0.0:1651529917.244183:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 684 00000100:00100000:1.0:1651529917.244185:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 685 00010000:00010000:0.0:1651529917.244191:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 2/0,0 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244193:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 2/0,0 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244194:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000005aa332 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244195:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 2/0,0 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244196:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.244197:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 2/0,0 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244198:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 3/0,0 mode: PW/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244200:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 3/0,0 mode: PW/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244203:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 1/0,0 mode: --/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244205:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 1/0,0 mode: --/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244206:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c2df1 lrc: 0/0,0 mode: --/PW res: [0x2be16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244208:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2df8 lrc: 0/0,0 mode: --/PW res: [0x2be18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244210:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 2/0,0 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244212:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 2/0,0 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244213:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f4abd4e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244214:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 2/0,0 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244215:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.244216:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 2/0,0 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244217:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 3/0,0 mode: PW/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244219:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 3/0,0 mode: PW/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244220:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 1/0,0 mode: --/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244222:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c2dff lrc: 0/0,0 mode: --/PW res: [0x2be15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244224:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 1/0,0 mode: --/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244227:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2e06 lrc: 0/0,0 mode: --/PW res: [0x2be17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244271:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824576 00000100:00100000:1.0:1651529917.244277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244289:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824640 00000100:00100000:0.0:1651529917.244293:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 686 00000100:00100000:0.0:1651529917.244295:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946824576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.244297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.244299:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179737 count 1 00002000:00010000:0.0:1651529917.244304:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244306:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 3/0,1 mode: --/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244309:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244309:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244310:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 3/0,1 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244314:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 3/0,1 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244319:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 3/0,1 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244322:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 2/0,0 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244324:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.244351:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824768 00000100:00100000:1.0:1651529917.244357:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824704 00000100:00100000:1.0:1651529917.244360:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 687 00000100:00100000:1.0:1651529917.244361:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946824640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.244367:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946824576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (107us total) trans 38654706329 rc 0/0 00000100:00100000:0.0:1651529917.244371:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 686 00002000:00080000:1.0:1651529917.244372:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179738 count 1 00000100:00100000:0.0:1651529917.244376:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 688 00002000:00010000:1.0:1651529917.244377:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.244377:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+170:39029:x1731745946824768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.244379:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 3/0,1 mode: --/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.244382:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179740 count 1 00010000:00010000:1.0:1651529917.244383:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244383:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244384:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 3/0,1 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.244387:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244388:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 3/0,1 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244388:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 3/0,1 mode: --/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244392:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244392:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244393:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 3/0,1 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244401:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 3/0,1 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244404:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 2/0,0 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244418:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 3/0,1 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244422:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 3/0,1 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244427:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 2/0,0 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244453:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+172:39030:x1731745946824640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (175us total) trans 38654706330 rc 0/0 00000100:00100000:1.0:1651529917.244456:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 687 00000100:00100000:1.0:1651529917.244461:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 689 00000100:00100000:1.0:1651529917.244462:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946824704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.244467:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179739 count 1 00000100:00100000:0.0:1651529917.244469:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+171:39029:x1731745946824768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (171us total) trans 38654706331 rc 0/0 00000100:00100000:0.0:1651529917.244471:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 688 00002000:00010000:1.0:1651529917.244472:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244473:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 3/0,1 mode: --/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244477:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244477:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244478:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 3/0,1 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244479:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 2/0,0 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244482:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 3/0,1 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244483:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3b8469c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244484:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 2/0,0 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244485:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 3/0,1 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244487:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 3/0,0 mode: PW/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244492:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 1/0,0 mode: --/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244494:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c2e0d lrc: 0/0,0 mode: --/PW res: [0x2be19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244498:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 2/0,0 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244498:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 2/0,0 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244501:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244502:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 2/0,0 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244505:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 3/0,0 mode: PW/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244508:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 1/0,0 mode: --/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244511:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2e14 lrc: 0/0,0 mode: --/PW res: [0x2be1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244514:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 2/0,0 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244517:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e8ecd1e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244518:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 2/0,0 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244532:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946824704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (207us total) trans 38654706332 rc 0/0 00000100:00100000:1.0:1651529917.244535:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 689 00010000:00010000:0.0:1651529917.244540:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 3/0,0 mode: PW/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244544:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 1/0,0 mode: --/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244547:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c2e1b lrc: 0/0,0 mode: --/PW res: [0x2be1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244549:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 2/0,0 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244553:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.244554:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 2/0,0 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244557:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 3/0,0 mode: PW/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244561:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 1/0,0 mode: --/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244564:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c2e22 lrc: 0/0,0 mode: --/PW res: [0x2be1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244589:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825152 00000100:00100000:0.0:1651529917.244600:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 690 00000100:00100000:0.0:1651529917.244601:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055faf4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+171:39029:x1731745946825152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.244603:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.244611:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179742 count 1 00002000:00010000:0.0:1651529917.244616:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244618:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 3/0,1 mode: --/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244622:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244622:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244623:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 3/0,1 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244626:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 3/0,1 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244629:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 3/0,1 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244632:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 2/0,0 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244647:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825088 00000100:00100000:1.0:1651529917.244658:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 691 00000100:00100000:1.0:1651529917.244670:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946825088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.244675:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179741 count 1 00002000:00010000:1.0:1651529917.244681:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244682:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 3/0,1 mode: --/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244686:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244686:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244687:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 3/0,1 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244693:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055faf4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946825152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (113us total) trans 38654706333 rc 0/0 00010000:00010000:1.0:1651529917.244697:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 3/0,1 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244700:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 3/0,1 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244703:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 2/0,0 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244716:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 690 00010000:00010000:0.0:1651529917.244723:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 2/0,0 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244727:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820f2298 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244728:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 2/0,0 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244731:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 3/0,0 mode: PW/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244736:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 1/0,0 mode: --/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244739:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c2e29 lrc: 0/0,0 mode: --/PW res: [0x2be1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244743:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 2/0,0 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244744:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946825088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (146us total) trans 38654706334 rc 0/0 00010000:00010000:0.0:1651529917.244745:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.244746:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 2/0,0 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244747:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 691 00010000:00010000:0.0:1651529917.244749:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 3/0,0 mode: PW/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244752:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 1/0,0 mode: --/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244757:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c2e30 lrc: 0/0,0 mode: --/PW res: [0x2be1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244781:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244791:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825472 00000100:00100000:1.0:1651529917.244822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244850:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 692 00000100:00100000:0.0:1651529917.244852:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946825472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.244858:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179743 count 1 00000100:00100000:1.0:1651529917.244868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.244880:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244882:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 3/0,1 mode: --/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244886:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244886:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244887:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 3/0,1 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244891:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 3/0,1 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244894:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 3/0,1 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244897:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 2/0,0 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.244918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.244923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.244927:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 2/0,0 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244931:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000682ba7bc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.244932:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 2/0,0 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244935:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 3/0,0 mode: PW/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244940:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 1/0,0 mode: --/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244943:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c2e37 lrc: 0/0,0 mode: --/PW res: [0x2be1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244950:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+174:39030:x1731745946825472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 97us (170us total) trans 38654706335 rc 0/0 00000100:00100000:0.0:1651529917.244955:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 692 00000100:00100000:0.0:1651529917.244961:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825536 00000100:00100000:0.0:1651529917.244965:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825600 00000100:00100000:0.0:1651529917.244967:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825664 00000100:00100000:0.0:1651529917.244969:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825728 00000100:00100000:0.0:1651529917.244971:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825792 00000100:00100000:0.0:1651529917.244974:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 693 00000100:00100000:0.0:1651529917.244975:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946825536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.244980:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179744 count 1 00000100:00100000:1.0:1651529917.244982:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 694 00000100:00100000:1.0:1651529917.244984:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946825600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.244985:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244986:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 3/0,1 mode: --/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.244990:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179745 count 1 00010000:00010000:0.0:1651529917.244990:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244991:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244991:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 3/0,1 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.244995:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244995:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 3/0,1 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244997:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 3/0,1 mode: --/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244998:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 3/0,1 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245000:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245000:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 2/0,0 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245001:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245002:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 3/0,1 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245008:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 3/0,1 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245010:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 3/0,1 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245013:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 2/0,0 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245074:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+180:39030:x1731745946825600:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (205us total) trans 38654706337 rc 0/0 00000100:00100000:0.0:1651529917.245075:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+180:39029:x1731745946825536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 98us (252us total) trans 38654706336 rc 0/0 00000100:00100000:1.0:1651529917.245077:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 694 00000100:00100000:0.0:1651529917.245078:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 693 00000100:00100000:1.0:1651529917.245082:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 695 00000100:00100000:1.0:1651529917.245084:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946825664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.245084:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 696 00000100:00100000:0.0:1651529917.245086:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946825728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.245088:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179746 count 1 00002000:00080000:0.0:1651529917.245090:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179747 count 1 00002000:00010000:1.0:1651529917.245093:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245094:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 3/0,1 mode: --/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.245096:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245098:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245098:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245098:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 3/0,1 mode: --/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245099:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 3/0,1 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245101:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245102:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 3/0,1 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245102:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245103:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 3/0,1 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245106:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 3/0,1 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245109:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 3/0,1 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245112:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 2/0,0 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245117:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 3/0,1 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245125:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 2/0,0 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245161:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+180:39029:x1731745946825664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (265us total) trans 38654706339 rc 0/0 00000100:00100000:1.0:1651529917.245164:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 695 00000100:00100000:0.0:1651529917.245165:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+180:39030:x1731745946825728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (246us total) trans 38654706338 rc 0/0 00000100:00100000:0.0:1651529917.245168:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 696 00000100:00100000:1.0:1651529917.245170:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 697 00000100:00100000:1.0:1651529917.245172:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946825792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.245176:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179748 count 1 00002000:00010000:1.0:1651529917.245180:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245180:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 2/0,0 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245182:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 3/0,1 mode: --/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245185:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245186:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245186:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa7cb3f3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.245187:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 3/0,1 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245187:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 2/0,0 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245190:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 3/0,1 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245190:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 3/0,0 mode: PW/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245193:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 3/0,1 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245195:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 1/0,0 mode: --/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245198:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c2e3e lrc: 0/0,0 mode: --/PW res: [0x2be20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245202:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 2/0,0 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245205:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.245205:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 2/0,0 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245207:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 2/0,0 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245208:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 3/0,0 mode: PW/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245211:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 1/0,0 mode: --/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245226:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c2e45 lrc: 0/0,0 mode: --/PW res: [0x2be21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245231:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 2/0,0 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245233:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008215e54b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.245234:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 2/0,0 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245237:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 3/0,0 mode: PW/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245239:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946825792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (316us total) trans 38654706340 rc 0/0 00010000:00010000:0.0:1651529917.245240:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 1/0,0 mode: --/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245242:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 697 00010000:00010000:0.0:1651529917.245243:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2e53 lrc: 0/0,0 mode: --/PW res: [0x2be23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245246:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 2/0,0 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245248:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.245249:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 2/0,0 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245250:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 2/0,0 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245253:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.245254:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 2/0,0 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245257:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 3/0,0 mode: PW/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245259:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 3/0,0 mode: PW/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245262:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 1/0,0 mode: --/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245262:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 1/0,0 mode: --/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245265:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2e5a lrc: 0/0,0 mode: --/PW res: [0x2be24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245265:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c2e4c lrc: 0/0,0 mode: --/PW res: [0x2be22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245309:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825856 00000100:00100000:1.0:1651529917.245315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245320:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 698 00000100:00100000:0.0:1651529917.245321:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c7bf97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946825856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.245331:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179749 count 1 00002000:00010000:0.0:1651529917.245336:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245338:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 3/0,1 mode: --/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245341:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245341:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245342:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 3/0,1 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.245346:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 3/0,1 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245349:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 3/0,1 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245359:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 2/0,0 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245402:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c7bf97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+180:39030:x1731745946825856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (103us total) trans 38654706341 rc 0/0 00000100:00100000:0.0:1651529917.245405:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 698 00000100:00100000:0.0:1651529917.245424:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825920 00000100:00100000:0.0:1651529917.245428:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825984 00000100:00100000:0.0:1651529917.245430:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 699 00000100:00100000:0.0:1651529917.245432:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946825920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.245434:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 700 00000100:00100000:1.0:1651529917.245436:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:39030:x1731745946825984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.245436:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179750 count 1 00002000:00080000:1.0:1651529917.245442:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179751 count 1 00002000:00010000:1.0:1651529917.245447:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245449:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 3/0,1 mode: --/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245452:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245453:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245454:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 3/0,1 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245457:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 3/0,1 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.245457:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245459:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 3/0,1 mode: --/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245461:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 3/0,1 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245463:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 2/0,0 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245463:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245464:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245464:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 3/0,1 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245468:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 3/0,1 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245471:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 3/0,1 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245474:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 2/0,0 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245502:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946825984:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (159us total) trans 38654706342 rc 0/0 00000100:00100000:1.0:1651529917.245505:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 700 00010000:00010000:1.0:1651529917.245511:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 2/0,0 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245515:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000859862c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.245516:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 2/0,0 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245528:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 3/0,0 mode: PW/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245533:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 1/0,0 mode: --/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245536:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2e61 lrc: 0/0,0 mode: --/PW res: [0x2be25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245538:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946825920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (222us total) trans 38654706343 rc 0/0 00010000:00010000:1.0:1651529917.245540:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 2/0,0 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245541:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 699 00010000:00010000:1.0:1651529917.245543:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.245544:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 2/0,0 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245547:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 3/0,0 mode: PW/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245549:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 2/0,0 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245550:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 1/0,0 mode: --/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245552:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2e68 lrc: 0/0,0 mode: --/PW res: [0x2be27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245553:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d712eb2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.245554:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 2/0,0 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245557:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 3/0,0 mode: PW/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245562:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 1/0,0 mode: --/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245565:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2e6f lrc: 0/0,0 mode: --/PW res: [0x2be26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245647:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826560 00000100:00100000:0.0:1651529917.245647:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826624 00000100:00100000:0.0:1651529917.245655:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 701 00000100:00100000:0.0:1651529917.245656:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946826624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.245657:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 702 00000100:00100000:1.0:1651529917.245658:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946826560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.245661:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179753 count 1 00002000:00080000:1.0:1651529917.245664:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179752 count 1 00002000:00010000:0.0:1651529917.245667:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245668:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 3/0,1 mode: --/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.245669:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245670:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 3/0,1 mode: --/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245672:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245673:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245674:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245674:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245674:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 3/0,1 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245675:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 3/0,1 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245677:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 3/0,1 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245679:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 3/0,1 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245680:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 3/0,1 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245682:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 3/0,1 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245683:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 2/0,0 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245684:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 2/0,0 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245774:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946826624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 116us (156us total) trans 38654706344 rc 0/0 00000100:00100000:1.0:1651529917.245777:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946826560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 118us (141us total) trans 38654706345 rc 0/0 00000100:00100000:0.0:1651529917.245777:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 701 00000100:00100000:1.0:1651529917.245781:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 702 00010000:00010000:0.0:1651529917.245785:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 2/0,0 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245788:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 2/0,0 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245788:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c686380d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.245789:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 2/0,0 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245794:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.245795:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 2/0,0 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245798:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 3/0,0 mode: PW/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245802:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 1/0,0 mode: --/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245818:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 3/0,0 mode: PW/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245820:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2e7d lrc: 0/0,0 mode: --/PW res: [0x2be28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245826:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 1/0,0 mode: --/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245829:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c2e76 lrc: 0/0,0 mode: --/PW res: [0x2be29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245855:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245866:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826752 00000100:00100000:0.0:1651529917.245876:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 703 00000100:00100000:0.0:1651529917.245877:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946826752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.245882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.245882:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179754 count 1 00002000:00010000:0.0:1651529917.245895:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245897:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 3/0,1 mode: --/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245900:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245901:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245902:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 3/0,1 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245905:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 3/0,1 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245908:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 3/0,1 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245911:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 2/0,0 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245935:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826816 00000100:00100000:1.0:1651529917.245940:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826880 00000100:00100000:1.0:1651529917.245942:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826944 00000100:00100000:1.0:1651529917.245944:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827136 00000100:00100000:1.0:1651529917.245946:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827072 00000100:00100000:1.0:1651529917.245949:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 704 00000100:00100000:1.0:1651529917.245950:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+190:39029:x1731745946826816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.245957:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946826752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (101us total) trans 38654706346 rc 0/0 00000100:00100000:0.0:1651529917.245961:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 703 00002000:00080000:1.0:1651529917.245962:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179755 count 1 00000100:00100000:0.0:1651529917.245966:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 705 00002000:00010000:1.0:1651529917.245968:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.245968:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+189:39030:x1731745946826880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.245969:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 3/0,1 mode: --/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.245972:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179756 count 1 00010000:00010000:1.0:1651529917.245973:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245974:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245975:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 3/0,1 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245978:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 3/0,1 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.245978:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245979:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 3/0,1 mode: --/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245981:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 3/0,1 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245983:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245983:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245984:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 2/0,0 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245984:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 3/0,1 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245988:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 3/0,1 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245991:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 3/0,1 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245993:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 2/0,0 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246022:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946826816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 70us (140us total) trans 38654706347 rc 0/0 00000100:00100000:1.0:1651529917.246025:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 704 00000100:00100000:1.0:1651529917.246030:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 706 00000100:00100000:0.0:1651529917.246031:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946826880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 62us (118us total) trans 38654706348 rc 0/0 00000100:00100000:1.0:1651529917.246032:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+190:39029:x1731745946826944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.246036:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179757 count 1 00000100:00100000:0.0:1651529917.246036:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 705 00000100:00100000:0.0:1651529917.246051:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 707 00002000:00010000:1.0:1651529917.246052:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.246052:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+189:39030:x1731745946827136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.246054:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 3/0,1 mode: --/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.246057:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179759 count 1 00002000:00010000:0.0:1651529917.246062:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246063:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 3/0,1 mode: --/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246067:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246067:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246067:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246068:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246068:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 3/0,1 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246068:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 3/0,1 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246072:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 3/0,1 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246072:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 3/0,1 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246075:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 3/0,1 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246075:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 3/0,1 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246078:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 2/0,0 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246078:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 2/0,0 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246121:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946826944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (202us total) trans 38654706349 rc 0/0 00000100:00100000:1.0:1651529917.246124:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 706 00000100:00100000:1.0:1651529917.246129:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 708 00000100:00100000:1.0:1651529917.246130:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946827072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.246135:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179758 count 1 00002000:00010000:1.0:1651529917.246140:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246141:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 3/0,1 mode: --/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246145:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246145:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246146:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 3/0,1 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246158:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946827136:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 104us (234us total) trans 38654706350 rc 0/0 00000100:00100000:0.0:1651529917.246161:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 707 00010000:00010000:1.0:1651529917.246166:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 3/0,1 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246169:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 2/0,0 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246170:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 3/0,1 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246172:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 2/0,0 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246182:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000053cb223d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246184:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 2/0,0 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246187:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 3/0,0 mode: PW/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246192:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 1/0,0 mode: --/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246194:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c2e84 lrc: 0/0,0 mode: --/PW res: [0x2be2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246199:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 2/0,0 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246201:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246202:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 2/0,0 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246205:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946827072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (276us total) trans 38654706351 rc 0/0 00010000:00010000:0.0:1651529917.246205:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 3/0,0 mode: PW/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246208:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 708 00010000:00010000:0.0:1651529917.246208:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 1/0,0 mode: --/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246216:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 2/0,0 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246218:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c2e8b lrc: 0/0,0 mode: --/PW res: [0x2be2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246219:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d543ebfe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246220:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 2/0,0 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246222:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 2/0,0 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246223:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 3/0,0 mode: PW/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246224:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246225:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 2/0,0 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246228:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 1/0,0 mode: --/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246228:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 3/0,0 mode: PW/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246231:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c2e92 lrc: 0/0,0 mode: --/PW res: [0x2be2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246231:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 1/0,0 mode: --/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246234:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c2e99 lrc: 0/0,0 mode: --/PW res: [0x2be2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246235:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 2/0,0 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246237:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 2/0,0 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246238:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f7fcb52 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246239:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 2/0,0 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246240:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246240:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 2/0,0 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246242:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 3/0,0 mode: PW/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246245:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 1/0,0 mode: --/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246247:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c2ea0 lrc: 0/0,0 mode: --/PW res: [0x2be2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246250:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 3/0,0 mode: PW/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246254:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 1/0,0 mode: --/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246256:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c2ea7 lrc: 0/0,0 mode: --/PW res: [0x2be2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246265:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827392 00000100:00100000:0.0:1651529917.246272:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 709 00000100:00100000:1.0:1651529917.246274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246274:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946827392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.246279:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179761 count 1 00002000:00010000:0.0:1651529917.246283:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246285:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 3/0,1 mode: --/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246288:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246288:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246289:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 3/0,1 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246293:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 3/0,1 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246296:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 3/0,1 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246306:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 2/0,0 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246347:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+191:39030:x1731745946827392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (87us total) trans 38654706352 rc 0/0 00000100:00100000:0.0:1651529917.246350:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 709 00000100:00100000:0.0:1651529917.246355:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827328 00000100:00100000:0.0:1651529917.246359:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 710 00000100:00100000:0.0:1651529917.246361:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946827328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.246365:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179760 count 1 00002000:00010000:0.0:1651529917.246369:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246371:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 3/0,1 mode: --/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246372:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 2/0,0 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246375:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246375:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246376:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000090d6fec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246377:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 2/0,0 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246379:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 3/0,0 mode: PW/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246384:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 1/0,0 mode: --/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246387:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c2eae lrc: 0/0,0 mode: --/PW res: [0x2be31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246393:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 3/0,1 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246397:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 3/0,1 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246401:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 3/0,1 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246403:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 2/0,0 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246470:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946827328:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 108us (196us total) trans 38654706353 rc 0/0 00000100:00100000:0.0:1651529917.246473:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 710 00010000:00010000:0.0:1651529917.246481:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 2/0,0 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246485:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e16f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246486:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 2/0,0 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246489:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 3/0,0 mode: PW/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246494:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 1/0,0 mode: --/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246496:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c2eb5 lrc: 0/0,0 mode: --/PW res: [0x2be30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246619:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827904 00000100:00100000:1.0:1651529917.246627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246635:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827840 00000100:00100000:0.0:1651529917.246638:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828032 00000100:00100000:1.0:1651529917.246640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246641:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 711 00000100:00100000:0.0:1651529917.246643:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+194:39030:x1731745946827904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.246647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.246648:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179763 count 1 00000100:00100000:1.0:1651529917.246653:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827968 00002000:00010000:0.0:1651529917.246653:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.246659:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828096 00000100:00100000:1.0:1651529917.246661:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 712 00010000:00010000:0.0:1651529917.246661:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 3/0,1 mode: --/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246663:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+196:39029:x1731745946827840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.246665:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246666:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246667:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 3/0,1 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.246668:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179762 count 1 00010000:00010000:0.0:1651529917.246670:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 3/0,1 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.246673:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246673:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 3/0,1 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246675:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 3/0,1 mode: --/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246676:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 2/0,0 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246678:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246679:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246680:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 3/0,1 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246691:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 3/0,1 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246704:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 3/0,1 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246721:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 2/0,0 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246754:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946827904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 109us (152us total) trans 38654706354 rc 0/0 00000100:00100000:0.0:1651529917.246757:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 711 00000100:00100000:0.0:1651529917.246762:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 713 00000100:00100000:0.0:1651529917.246763:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946828032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.246768:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179765 count 1 00000100:00100000:1.0:1651529917.246770:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946827840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 106us (151us total) trans 38654706355 rc 0/0 00000100:00100000:1.0:1651529917.246773:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 712 00002000:00010000:0.0:1651529917.246773:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246775:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 3/0,1 mode: --/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246778:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.246779:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 714 00000100:00100000:1.0:1651529917.246780:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+196:39029:x1731745946827968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.246785:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179764 count 1 00010000:00010000:0.0:1651529917.246786:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246787:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 3/0,1 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.246790:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246791:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 3/0,1 mode: --/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246791:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 3/0,1 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246794:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 3/0,1 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246795:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246795:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246796:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 3/0,1 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246797:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 2/0,0 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246800:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 3/0,1 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246824:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 3/0,1 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246830:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 2/0,0 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246855:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946828032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (227us total) trans 38654706356 rc 0/0 00000100:00100000:0.0:1651529917.246858:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 713 00000100:00100000:1.0:1651529917.246863:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946827968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (223us total) trans 38654706357 rc 0/0 00000100:00100000:0.0:1651529917.246863:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 715 00000100:00100000:0.0:1651529917.246865:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946828096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.246866:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 714 00002000:00080000:0.0:1651529917.246869:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179766 count 1 00010000:00010000:1.0:1651529917.246874:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 2/0,0 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.246875:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246876:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 3/0,1 mode: --/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246878:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064963318 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246879:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 2/0,0 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246880:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246880:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246881:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 3/0,1 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246882:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 3/0,0 mode: PW/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246885:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 3/0,1 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246887:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 1/0,0 mode: --/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246890:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c2ebc lrc: 0/0,0 mode: --/PW res: [0x2be33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246894:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 2/0,0 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246896:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 3/0,1 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246897:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246899:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 2/0,0 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246905:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 2/0,0 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246908:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 3/0,0 mode: PW/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246912:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 1/0,0 mode: --/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246915:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c2ec3 lrc: 0/0,0 mode: --/PW res: [0x2be32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246918:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 2/0,0 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246921:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb9b2147 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246922:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 2/0,0 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246924:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 3/0,0 mode: PW/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246928:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 1/0,0 mode: --/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246930:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c2eca lrc: 0/0,0 mode: --/PW res: [0x2be35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246933:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946828096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (285us total) trans 38654706358 rc 0/0 00000100:00100000:0.0:1651529917.246936:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 715 00010000:00010000:1.0:1651529917.246941:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 2/0,0 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246944:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016217824 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.246944:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 2/0,0 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246944:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 2/0,0 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246947:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 3/0,0 mode: PW/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246947:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d1e2872 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.246948:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 2/0,0 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246950:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 1/0,0 mode: --/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246951:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 3/0,0 mode: PW/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246953:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c2ed1 lrc: 0/0,0 mode: --/PW res: [0x2be34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246956:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 1/0,0 mode: --/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246959:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c2ed8 lrc: 0/0,0 mode: --/PW res: [0x2be36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246978:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828288 00000100:00100000:1.0:1651529917.246984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246987:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828416 00000100:00100000:0.0:1651529917.246990:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 716 00000100:00100000:0.0:1651529917.246992:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946828288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.246993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.246996:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179767 count 1 00002000:00010000:0.0:1651529917.247001:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247003:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 3/0,1 mode: --/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247006:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247007:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247007:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 3/0,1 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247011:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 3/0,1 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247014:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 3/0,1 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247016:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 2/0,0 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247046:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 2/0,0 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247050:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093eda540 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.247051:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 2/0,0 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247062:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 3/0,0 mode: PW/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247070:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946828288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (102us total) trans 38654706359 rc 0/0 00010000:00010000:1.0:1651529917.247072:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 1/0,0 mode: --/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247073:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 716 00010000:00010000:1.0:1651529917.247075:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c2edf lrc: 0/0,0 mode: --/PW res: [0x2be37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247078:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828352 00000100:00100000:0.0:1651529917.247082:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 717 00000100:00100000:0.0:1651529917.247083:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946828416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.247105:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179769 count 1 00002000:00010000:0.0:1651529917.247110:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.247111:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 718 00010000:00010000:0.0:1651529917.247112:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 3/0,1 mode: --/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247113:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946828352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.247116:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247116:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247117:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 3/0,1 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.247119:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179768 count 1 00010000:00010000:0.0:1651529917.247121:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 3/0,1 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.247124:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247124:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 3/0,1 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247126:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 3/0,1 mode: --/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247126:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 2/0,0 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247130:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247130:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247131:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 3/0,1 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247135:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 3/0,1 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247137:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 3/0,1 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247150:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 2/0,0 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247177:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946828416:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 92us (193us total) trans 38654706360 rc 0/0 00000100:00100000:0.0:1651529917.247180:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 717 00010000:00010000:0.0:1651529917.247188:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 2/0,0 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247191:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009456242c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247192:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 2/0,0 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247197:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 3/0,0 mode: PW/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247202:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946828352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (208us total) trans 38654706361 rc 0/0 00010000:00010000:0.0:1651529917.247202:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 1/0,0 mode: --/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247205:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 718 00010000:00010000:0.0:1651529917.247205:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c2ee6 lrc: 0/0,0 mode: --/PW res: [0x2be39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247209:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 2/0,0 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247212:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247213:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 2/0,0 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247215:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 3/0,0 mode: PW/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247218:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 1/0,0 mode: --/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247221:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2eed lrc: 0/0,0 mode: --/PW res: [0x2be38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247392:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247411:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828928 00000100:00100000:1.0:1651529917.247418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247427:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828992 00000100:00100000:0.0:1651529917.247430:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829056 00000100:00100000:1.0:1651529917.247432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247432:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829120 00000100:00100000:0.0:1651529917.247434:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829184 00000100:00100000:0.0:1651529917.247437:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 719 00000100:00100000:0.0:1651529917.247439:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946828928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.247444:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179770 count 1 00000100:00100000:1.0:1651529917.247445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.247449:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247451:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 3/0,1 mode: --/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247454:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247455:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247456:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 3/0,1 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247458:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829248 00010000:00010000:0.0:1651529917.247459:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 3/0,1 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247462:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 3/0,1 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247465:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 720 00010000:00010000:0.0:1651529917.247465:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 2/0,0 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247466:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946828992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.247477:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179771 count 1 00002000:00010000:1.0:1651529917.247483:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247484:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 3/0,1 mode: --/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247488:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247489:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247490:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 3/0,1 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247493:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 3/0,1 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247496:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 3/0,1 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247499:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 2/0,0 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247516:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946828928:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (131us total) trans 38654706362 rc 0/0 00000100:00100000:0.0:1651529917.247519:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 719 00000100:00100000:0.0:1651529917.247540:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 721 00000100:00100000:0.0:1651529917.247542:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946829056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.247552:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946828992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 85us (159us total) trans 38654706363 rc 0/0 00000100:00100000:1.0:1651529917.247555:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 720 00002000:00080000:0.0:1651529917.247556:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179772 count 1 00000100:00100000:1.0:1651529917.247560:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 722 00002000:00010000:0.0:1651529917.247561:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.247562:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946829120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.247563:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 3/0,1 mode: --/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.247566:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179773 count 1 00010000:00010000:0.0:1651529917.247566:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247567:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247568:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 3/0,1 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.247571:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247572:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 3/0,1 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247573:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 3/0,1 mode: --/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247575:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 3/0,1 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247576:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247577:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247577:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 2/0,0 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247578:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 3/0,1 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247581:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 3/0,1 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247584:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 3/0,1 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247589:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 2/0,0 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247614:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946829056:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (196us total) trans 38654706364 rc 0/0 00000100:00100000:0.0:1651529917.247617:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 721 00000100:00100000:1.0:1651529917.247622:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946829120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 59us (194us total) trans 38654706365 rc 0/0 00000100:00100000:0.0:1651529917.247622:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 723 00000100:00100000:1.0:1651529917.247624:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 722 00000100:00100000:0.0:1651529917.247624:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946829184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.247628:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179774 count 1 00000100:00100000:1.0:1651529917.247629:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 724 00000100:00100000:1.0:1651529917.247631:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946829248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.247633:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.247635:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179775 count 1 00010000:00010000:0.0:1651529917.247635:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 3/0,1 mode: --/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247638:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.247639:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247639:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247639:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 3/0,1 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247641:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 3/0,1 mode: --/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247643:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 3/0,1 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247644:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247644:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247645:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 3/0,1 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247646:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 3/0,1 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247649:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 3/0,1 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247649:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 2/0,0 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247652:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 3/0,1 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247655:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 2/0,0 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247679:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946829184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 54us (247us total) trans 38654706366 rc 0/0 00000100:00100000:0.0:1651529917.247682:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 723 00010000:00010000:0.0:1651529917.247689:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 2/0,0 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247692:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247693:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 2/0,0 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247696:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 3/0,0 mode: PW/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247701:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946829248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (255us total) trans 38654706367 rc 0/0 00010000:00010000:0.0:1651529917.247703:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 1/0,0 mode: --/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247704:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 724 00010000:00010000:0.0:1651529917.247706:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c2ef4 lrc: 0/0,0 mode: --/PW res: [0x2be3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247710:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 2/0,0 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247712:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 2/0,0 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247712:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247713:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 2/0,0 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247715:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.247716:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 2/0,0 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247716:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 3/0,0 mode: PW/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247719:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 3/0,0 mode: PW/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247719:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 1/0,0 mode: --/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247722:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2efb lrc: 0/0,0 mode: --/PW res: [0x2be3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247724:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 1/0,0 mode: --/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247725:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 2/0,0 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247727:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c2f02 lrc: 0/0,0 mode: --/PW res: [0x2be3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247728:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdd840ca already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247729:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 2/0,0 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247731:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 2/0,0 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247732:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 3/0,0 mode: PW/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247734:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.247735:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 2/0,0 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247735:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 1/0,0 mode: --/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247737:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c2f09 lrc: 0/0,0 mode: --/PW res: [0x2be3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247740:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 2/0,0 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247743:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000047b5824 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247744:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 2/0,0 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247746:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 3/0,0 mode: PW/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247748:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 3/0,0 mode: PW/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247749:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 1/0,0 mode: --/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247752:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 1/0,0 mode: --/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247752:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c2f17 lrc: 0/0,0 mode: --/PW res: [0x2be3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247755:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c2f10 lrc: 0/0,0 mode: --/PW res: [0x2be3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247799:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829440 00000100:00100000:0.0:1651529917.247819:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 725 00000100:00100000:1.0:1651529917.247821:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247821:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946829440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.247831:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179776 count 1 00002000:00010000:0.0:1651529917.247836:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247838:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 3/0,1 mode: --/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247842:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247842:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247843:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 3/0,1 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247847:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 3/0,1 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247850:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 3/0,1 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247852:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 2/0,0 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247876:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829504 00000100:00100000:1.0:1651529917.247883:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 726 00000100:00100000:1.0:1651529917.247884:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946829504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.247894:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946829440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (106us total) trans 38654706368 rc 0/0 00002000:00080000:1.0:1651529917.247895:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179777 count 1 00000100:00100000:0.0:1651529917.247897:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 725 00002000:00010000:1.0:1651529917.247901:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247903:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 3/0,1 mode: --/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247905:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 2/0,0 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247906:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247907:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247908:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 3/0,1 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247908:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d27cca91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247910:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 2/0,0 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247911:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 3/0,1 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247912:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 3/0,0 mode: PW/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247917:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 3/0,1 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247920:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 2/0,0 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247931:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 1/0,0 mode: --/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247934:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d27cca91/0xa29a79078f3c2f1e lrc: 0/0,0 mode: --/PW res: [0x2be40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247939:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 2/0,0 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247941:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea01ff05 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.247942:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 2/0,0 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247945:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 3/0,0 mode: PW/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247948:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 1/0,0 mode: --/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247954:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c2f25 lrc: 0/0,0 mode: --/PW res: [0x2be41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247958:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946829504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (137us total) trans 38654706369 rc 0/0 00000100:00100000:1.0:1651529917.247961:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 726 00000100:00100000:1.0:1651529917.248122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248129:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830080 00000100:00100000:1.0:1651529917.248136:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 727 00000100:00100000:1.0:1651529917.248137:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004888e338 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946830080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.248142:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179778 count 1 00002000:00010000:1.0:1651529917.248148:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248149:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 3/0,1 mode: --/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248153:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248154:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248155:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 3/0,1 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248158:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 3/0,1 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248173:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 3/0,1 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248176:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 2/0,0 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248221:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 2/0,0 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248225:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071429b39 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.248226:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 2/0,0 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248229:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 3/0,0 mode: PW/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248232:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004888e338 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+209:39030:x1731745946830080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 94us (110us total) trans 38654706370 rc 0/0 00010000:00010000:0.0:1651529917.248234:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 1/0,0 mode: --/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248235:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 727 00010000:00010000:0.0:1651529917.248236:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c2f2c lrc: 0/0,0 mode: --/PW res: [0x2be42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248330:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830144 00000100:00100000:1.0:1651529917.248339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248341:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830272 00000100:00100000:1.0:1651529917.248343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248344:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830208 00000100:00100000:0.0:1651529917.248346:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830336 00000100:00100000:1.0:1651529917.248348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248348:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830400 00000100:00100000:0.0:1651529917.248350:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830528 00000100:00100000:1.0:1651529917.248353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248353:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 728 00000100:00100000:0.0:1651529917.248355:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946830144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.248360:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830592 00002000:00080000:0.0:1651529917.248361:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179779 count 1 00000100:00100000:1.0:1651529917.248366:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 729 00002000:00010000:0.0:1651529917.248366:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.248368:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946830272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.248368:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 3/0,1 mode: --/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248371:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248372:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.248373:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179781 count 1 00010000:00010000:0.0:1651529917.248373:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 3/0,1 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248376:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 3/0,1 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.248378:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248379:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 3/0,1 mode: --/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248379:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 3/0,1 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248382:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 2/0,0 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248383:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248384:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248385:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 3/0,1 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248389:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 3/0,1 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248392:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 3/0,1 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248395:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 2/0,0 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248427:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+217:39029:x1731745946830144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (138us total) trans 38654706371 rc 0/0 00000100:00100000:0.0:1651529917.248430:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 728 00000100:00100000:0.0:1651529917.248435:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 730 00000100:00100000:0.0:1651529917.248437:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946830208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.248440:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946830272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (120us total) trans 38654706372 rc 0/0 00002000:00080000:0.0:1651529917.248441:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179780 count 1 00000100:00100000:1.0:1651529917.248443:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 729 00002000:00010000:0.0:1651529917.248446:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248447:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 3/0,1 mode: --/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248448:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 731 00000100:00100000:1.0:1651529917.248450:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946830336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.248451:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248452:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248453:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 3/0,1 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.248454:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179782 count 1 00010000:00010000:0.0:1651529917.248456:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 3/0,1 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.248459:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248459:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 3/0,1 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248461:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 3/0,1 mode: --/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248462:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 2/0,0 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248464:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248465:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248466:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 3/0,1 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248469:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 3/0,1 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248481:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 3/0,1 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248484:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 2/0,0 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248521:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946830208:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (189us total) trans 38654706373 rc 0/0 00000100:00100000:0.0:1651529917.248524:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 730 00000100:00100000:1.0:1651529917.248526:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946830336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (187us total) trans 38654706374 rc 0/0 00000100:00100000:0.0:1651529917.248529:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 732 00000100:00100000:1.0:1651529917.248530:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 731 00000100:00100000:0.0:1651529917.248530:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946830400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.248535:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179783 count 1 00000100:00100000:1.0:1651529917.248536:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 733 00000100:00100000:1.0:1651529917.248537:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946830528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.248539:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.248541:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179784 count 1 00010000:00010000:0.0:1651529917.248541:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 3/0,1 mode: --/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248545:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248545:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.248546:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248546:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 3/0,1 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248548:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 3/0,1 mode: --/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248550:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 3/0,1 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248551:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248552:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248553:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 3/0,1 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248553:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 3/0,1 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248556:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 3/0,1 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248556:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 2/0,0 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248559:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 3/0,1 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248573:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 2/0,0 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248587:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946830400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 55us (243us total) trans 38654706375 rc 0/0 00000100:00100000:0.0:1651529917.248590:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 732 00000100:00100000:0.0:1651529917.248594:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 734 00000100:00100000:0.0:1651529917.248596:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946830592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.248600:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179785 count 1 00002000:00010000:0.0:1651529917.248604:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248606:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 3/0,1 mode: --/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248607:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946830528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (259us total) trans 38654706376 rc 0/0 00010000:00010000:0.0:1651529917.248609:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.248610:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 733 00010000:00010000:0.0:1651529917.248610:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248610:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 3/0,1 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248614:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 3/0,1 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248618:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 2/0,0 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248619:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 3/0,1 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248621:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2632ae4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.248622:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 2/0,0 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248622:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 2/0,0 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248625:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 3/0,0 mode: PW/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248630:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 1/0,0 mode: --/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248633:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2632ae4/0xa29a79078f3c2f33 lrc: 0/0,0 mode: --/PW res: [0x2be43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248637:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 2/0,0 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248640:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5f37e43 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.248648:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 2/0,0 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248651:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 3/0,0 mode: PW/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248654:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 1/0,0 mode: --/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248654:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946830592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (300us total) trans 38654706377 rc 0/0 00000100:00100000:0.0:1651529917.248656:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 734 00010000:00010000:1.0:1651529917.248657:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c2f3a lrc: 0/0,0 mode: --/PW res: [0x2be45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248661:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 2/0,0 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248664:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004044efa8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.248664:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 2/0,0 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248664:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 2/0,0 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248667:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 3/0,0 mode: PW/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248667:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a8ba774 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.248668:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 2/0,0 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248670:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 1/0,0 mode: --/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248671:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 3/0,0 mode: PW/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248672:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c2f41 lrc: 0/0,0 mode: --/PW res: [0x2be44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248676:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 1/0,0 mode: --/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248679:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c2f48 lrc: 0/0,0 mode: --/PW res: [0x2be46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248683:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 2/0,0 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248683:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 2/0,0 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248686:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e7cb770 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.248686:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.248687:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 2/0,0 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248687:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 2/0,0 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248689:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 3/0,0 mode: PW/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248690:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 3/0,0 mode: PW/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248692:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 1/0,0 mode: --/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248693:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 1/0,0 mode: --/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248695:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c2f4f lrc: 0/0,0 mode: --/PW res: [0x2be47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248696:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c2f56 lrc: 0/0,0 mode: --/PW res: [0x2be48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248698:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 2/0,0 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248701:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.248702:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 2/0,0 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248704:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 3/0,0 mode: PW/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248707:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 1/0,0 mode: --/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.248727:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c2f5d lrc: 0/0,0 mode: --/PW res: [0x2be49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248735:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830656 00000100:00100000:0.0:1651529917.248746:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 735 00000100:00100000:0.0:1651529917.248747:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946830656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.248752:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179786 count 1 00002000:00010000:0.0:1651529917.248757:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248758:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 3/0,1 mode: --/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248762:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248762:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248763:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 3/0,1 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248767:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 3/0,1 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248770:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 3/0,1 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248772:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 2/0,0 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248799:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 2/0,0 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248826:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.248827:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 2/0,0 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248830:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 3/0,0 mode: PW/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248834:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+217:39029:x1731745946830656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (118us total) trans 38654706378 rc 0/0 00010000:00010000:1.0:1651529917.248843:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 1/0,0 mode: --/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248845:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 735 00010000:00010000:1.0:1651529917.248846:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c2f64 lrc: 0/0,0 mode: --/PW res: [0x2be4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.249065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.249072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.249083:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831232 00000100:00100000:0.0:1651529917.249084:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831296 00000100:00100000:1.0:1651529917.249093:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831360 00000100:00100000:1.0:1651529917.249097:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 736 00000100:00100000:1.0:1651529917.249099:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+219:39030:x1731745946831232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.249100:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 737 00000100:00100000:0.0:1651529917.249101:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+219:39029:x1731745946831296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.249104:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179787 count 1 00002000:00080000:0.0:1651529917.249107:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179788 count 1 00002000:00010000:1.0:1651529917.249109:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249111:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 3/0,1 mode: --/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.249112:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249114:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249114:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 3/0,1 mode: --/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249115:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249116:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 3/0,1 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249118:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249118:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249119:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 3/0,1 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249119:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 3/0,1 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249122:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 3/0,1 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249123:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 3/0,1 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249126:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 3/0,1 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249129:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 2/0,0 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249133:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 2/0,0 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249173:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+221:39029:x1731745946831296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (107us total) trans 38654706379 rc 0/0 00000100:00100000:1.0:1651529917.249182:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+221:39030:x1731745946831232:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (124us total) trans 38654706380 rc 0/0 00000100:00100000:1.0:1651529917.249185:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 736 00000100:00100000:0.0:1651529917.249194:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 737 00000100:00100000:1.0:1651529917.249196:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 738 00000100:00100000:1.0:1651529917.249198:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+219:39030:x1731745946831360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.249202:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179789 count 1 00010000:00010000:0.0:1651529917.249202:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 2/0,0 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.249207:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249209:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 3/0,1 mode: --/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249212:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249213:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249213:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249214:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 3/0,1 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249214:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 2/0,0 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249217:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 3/0,1 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249217:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 3/0,0 mode: PW/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249220:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 3/0,1 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249222:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 1/0,0 mode: --/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249223:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 2/0,0 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249225:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c2f72 lrc: 0/0,0 mode: --/PW res: [0x2be4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249229:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 2/0,0 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249237:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff73fa02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.249239:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 2/0,0 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249242:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 3/0,0 mode: PW/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249245:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 1/0,0 mode: --/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249255:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c2f6b lrc: 0/0,0 mode: --/PW res: [0x2be4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249259:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 2/0,0 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249262:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000406c58a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.249263:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 2/0,0 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249266:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 3/0,0 mode: PW/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249269:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 1/0,0 mode: --/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249272:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946831360:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (198us total) trans 38654706381 rc 0/0 00010000:00010000:0.0:1651529917.249272:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c2f79 lrc: 0/0,0 mode: --/PW res: [0x2be4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249275:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 738 00000100:00100000:1.0:1651529917.249310:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.249324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249334:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831616 00000100:00100000:1.0:1651529917.249337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249348:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831744 00000100:00100000:0.0:1651529917.249351:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831552 00000100:00100000:0.0:1651529917.249354:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 739 00000100:00100000:0.0:1651529917.249355:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946831616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.249360:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179791 count 1 00000100:00100000:1.0:1651529917.249365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.249365:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249374:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 3/0,1 mode: --/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249378:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249378:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.249379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249379:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 3/0,1 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249383:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 3/0,1 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249386:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 3/0,1 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249387:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831680 00010000:00010000:0.0:1651529917.249389:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 2/0,0 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249392:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831808 00000100:00100000:1.0:1651529917.249395:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 740 00000100:00100000:1.0:1651529917.249396:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946831744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.249402:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179793 count 1 00002000:00010000:1.0:1651529917.249407:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249409:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 3/0,1 mode: --/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249412:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249413:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249414:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 3/0,1 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249418:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 3/0,1 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249421:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 3/0,1 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249431:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 2/0,0 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249452:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 95us (149us total) trans 38654706382 rc 0/0 00000100:00100000:0.0:1651529917.249455:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 739 00000100:00100000:0.0:1651529917.249460:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 741 00000100:00100000:0.0:1651529917.249462:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.249466:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179790 count 1 00002000:00010000:0.0:1651529917.249471:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249473:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 3/0,1 mode: --/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249476:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.249480:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (156us total) trans 38654706383 rc 0/0 00000100:00100000:1.0:1651529917.249483:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 740 00010000:00010000:0.0:1651529917.249484:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249485:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 3/0,1 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249489:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 742 00010000:00010000:0.0:1651529917.249489:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 3/0,1 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249490:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946831680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.249492:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 3/0,1 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.249495:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179792 count 1 00010000:00010000:0.0:1651529917.249495:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 2/0,0 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.249499:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249508:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 3/0,1 mode: --/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249512:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249513:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249514:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 3/0,1 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249517:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 3/0,1 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249520:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 3/0,1 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249523:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 2/0,0 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249552:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946831552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (215us total) trans 38654706384 rc 0/0 00000100:00100000:0.0:1651529917.249555:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 741 00000100:00100000:0.0:1651529917.249560:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 743 00000100:00100000:0.0:1651529917.249562:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.249565:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (200us total) trans 38654706385 rc 0/0 00002000:00080000:0.0:1651529917.249566:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179794 count 1 00000100:00100000:1.0:1651529917.249568:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 742 00002000:00010000:0.0:1651529917.249571:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249573:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 3/0,1 mode: --/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249575:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 2/0,0 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249577:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249577:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249578:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 3/0,1 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249579:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db5120f7 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249580:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 2/0,0 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249582:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 3/0,1 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249583:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 3/0,0 mode: PW/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249587:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 1/0,0 mode: --/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249590:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c2f80 lrc: 0/0,0 mode: --/PW res: [0x2be4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249594:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 2/0,0 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249597:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6595fad already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249598:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 2/0,0 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249603:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 3/0,0 mode: PW/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249606:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 1/0,0 mode: --/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249609:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c2f87 lrc: 0/0,0 mode: --/PW res: [0x2be51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249612:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 2/0,0 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249615:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 3/0,1 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249618:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 2/0,0 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249625:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249626:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 2/0,0 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249628:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 3/0,0 mode: PW/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249632:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 1/0,0 mode: --/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249635:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c2f8e lrc: 0/0,0 mode: --/PW res: [0x2be4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249639:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 2/0,0 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249642:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2e406ba already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249642:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 2/0,0 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249645:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 3/0,0 mode: PW/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249648:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 1/0,0 mode: --/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249651:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c2f95 lrc: 0/0,0 mode: --/PW res: [0x2be50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249654:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 2/0,0 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249656:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529917.249656:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946831808:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 93us (276us total) trans 38654706386 rc 0/0 00010000:00010000:1.0:1651529917.249657:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 2/0,0 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249659:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 3/0,0 mode: PW/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249659:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 743 00010000:00010000:1.0:1651529917.249662:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 1/0,0 mode: --/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249675:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c2f9c lrc: 0/0,0 mode: --/PW res: [0x2be52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249701:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832384 00000100:00100000:1.0:1651529917.249707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249710:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832512 00000100:00100000:0.0:1651529917.249713:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 744 00000100:00100000:0.0:1651529917.249715:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+226:39029:x1731745946832384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.249717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.249720:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179795 count 1 00002000:00010000:0.0:1651529917.249725:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249726:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 3/0,1 mode: --/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249730:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249731:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249732:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 3/0,1 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249735:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 3/0,1 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249738:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 3/0,1 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249749:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 2/0,0 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249778:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832448 00000100:00100000:1.0:1651529917.249785:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 745 00000100:00100000:1.0:1651529917.249787:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946832512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.249793:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+228:39029:x1731745946832384:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (102us total) trans 38654706387 rc 0/0 00000100:00100000:0.0:1651529917.249796:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 744 00002000:00080000:1.0:1651529917.249797:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179797 count 1 00002000:00010000:1.0:1651529917.249813:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249815:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 3/0,1 mode: --/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249819:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249819:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249820:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 3/0,1 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249829:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 3/0,1 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249830:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 746 00010000:00010000:1.0:1651529917.249832:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 3/0,1 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249833:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+227:39030:x1731745946832448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.249834:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 2/0,0 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.249839:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179796 count 1 00002000:00010000:0.0:1651529917.249851:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249853:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 3/0,1 mode: --/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249856:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249857:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249858:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 3/0,1 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249861:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 3/0,1 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249865:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 3/0,1 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249867:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 2/0,0 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249885:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946832512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 97us (178us total) trans 38654706388 rc 0/0 00000100:00100000:1.0:1651529917.249889:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 745 00010000:00010000:1.0:1651529917.249898:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 2/0,0 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249902:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249903:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 2/0,0 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249906:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 3/0,0 mode: PW/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249910:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 1/0,0 mode: --/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249910:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946832448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (192us total) trans 38654706389 rc 0/0 00010000:00010000:1.0:1651529917.249913:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c2fa3 lrc: 0/0,0 mode: --/PW res: [0x2be53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249913:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 746 00010000:00010000:1.0:1651529917.249917:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 2/0,0 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249920:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9386f1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.249921:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 2/0,0 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249921:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 2/0,0 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249924:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000859862c6 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.249925:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 2/0,0 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249926:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 3/0,0 mode: PW/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249928:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 3/0,0 mode: PW/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249929:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 1/0,0 mode: --/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249932:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c2faa lrc: 0/0,0 mode: --/PW res: [0x2be55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249933:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 1/0,0 mode: --/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249935:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c2fb1 lrc: 0/0,0 mode: --/PW res: [0x2be54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250062:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833024 00000100:00100000:1.0:1651529917.250076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250086:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 747 00000100:00100000:0.0:1651529917.250088:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946833024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.250090:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833152 00002000:00080000:0.0:1651529917.250093:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179799 count 1 00000100:00100000:1.0:1651529917.250096:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832960 00000100:00100000:1.0:1651529917.250098:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833088 00002000:00010000:0.0:1651529917.250098:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.250100:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833216 00010000:00010000:0.0:1651529917.250100:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 3/0,1 mode: --/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250103:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 748 00010000:00010000:0.0:1651529917.250103:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.250104:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946833152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.250104:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250105:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 3/0,1 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250108:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 3/0,1 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.250110:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179801 count 1 00010000:00010000:0.0:1651529917.250111:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 3/0,1 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250114:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 2/0,0 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.250115:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250116:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 3/0,1 mode: --/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250120:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250128:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250129:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 3/0,1 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250133:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 3/0,1 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250136:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 3/0,1 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250139:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 2/0,0 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250168:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946833024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (140us total) trans 38654706390 rc 0/0 00000100:00100000:0.0:1651529917.250171:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 747 00000100:00100000:1.0:1651529917.250195:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946833152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (143us total) trans 38654706391 rc 0/0 00000100:00100000:1.0:1651529917.250198:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 748 00000100:00100000:0.0:1651529917.250201:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 749 00000100:00100000:0.0:1651529917.250203:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946832960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.250209:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179798 count 1 00000100:00100000:1.0:1651529917.250213:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 750 00000100:00100000:1.0:1651529917.250214:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+232:39030:x1731745946833088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.250214:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250216:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 3/0,1 mode: --/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.250219:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179800 count 1 00010000:00010000:0.0:1651529917.250220:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250220:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250221:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 3/0,1 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.250224:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250225:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 3/0,1 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250226:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 3/0,1 mode: --/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250228:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 3/0,1 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250229:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250230:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250230:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 2/0,0 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250231:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 3/0,1 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250234:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 3/0,1 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250246:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 3/0,1 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250249:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 2/0,0 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250267:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946832960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 63us (206us total) trans 38654706392 rc 0/0 00000100:00100000:0.0:1651529917.250270:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 749 00000100:00100000:0.0:1651529917.250275:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 751 00000100:00100000:0.0:1651529917.250277:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946833216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.250281:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179802 count 1 00000100:00100000:1.0:1651529917.250284:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946833088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (208us total) trans 38654706393 rc 0/0 00002000:00010000:0.0:1651529917.250286:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.250287:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 750 00010000:00010000:0.0:1651529917.250287:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 3/0,1 mode: --/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250291:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250291:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250292:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 3/0,1 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250294:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 2/0,0 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250296:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 3/0,1 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250298:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d712eb2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.250299:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 2/0,0 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250301:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 3/0,1 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250302:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 3/0,0 mode: PW/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250303:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 2/0,0 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250307:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 1/0,0 mode: --/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250310:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c2fb8 lrc: 0/0,0 mode: --/PW res: [0x2be57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250314:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 2/0,0 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250317:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acfd0ef2 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.250318:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 2/0,0 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250321:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 3/0,0 mode: PW/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250324:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 1/0,0 mode: --/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250326:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c2fbf lrc: 0/0,0 mode: --/PW res: [0x2be59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250329:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 2/0,0 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250332:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008215e54b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.250333:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 2/0,0 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250335:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 3/0,0 mode: PW/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250335:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946833216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57us (250us total) trans 38654706394 rc 0/0 00010000:00010000:1.0:1651529917.250338:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 1/0,0 mode: --/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250338:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 751 00010000:00010000:1.0:1651529917.250343:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c2fc6 lrc: 0/0,0 mode: --/PW res: [0x2be56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250346:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 2/0,0 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250347:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 2/0,0 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250349:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.250349:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030acc86a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.250350:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 2/0,0 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250350:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 2/0,0 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250353:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 3/0,0 mode: PW/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250353:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 3/0,0 mode: PW/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250356:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 1/0,0 mode: --/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250358:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c2fd4 lrc: 0/0,0 mode: --/PW res: [0x2be5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250358:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 1/0,0 mode: --/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250361:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c2fcd lrc: 0/0,0 mode: --/PW res: [0x2be58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250383:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833408 00000100:00100000:1.0:1651529917.250388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250400:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250410:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833536 00000100:00100000:0.0:1651529917.250413:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833472 00000100:00100000:0.0:1651529917.250416:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 752 00000100:00100000:0.0:1651529917.250417:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946833408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.250422:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179803 count 1 00002000:00010000:0.0:1651529917.250428:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250430:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 3/0,1 mode: --/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250433:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250434:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250434:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 3/0,1 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250438:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 3/0,1 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250441:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 3/0,1 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250443:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 2/0,0 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250470:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 2/0,0 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250479:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.250480:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 2/0,0 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250483:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 3/0,0 mode: PW/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250488:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+236:39030:x1731745946833408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 69us (116us total) trans 38654706395 rc 0/0 00000100:00100000:0.0:1651529917.250491:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 752 00010000:00010000:1.0:1651529917.250492:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 1/0,0 mode: --/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250495:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c2fdb lrc: 0/0,0 mode: --/PW res: [0x2be5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250511:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 753 00000100:00100000:0.0:1651529917.250513:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946833536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.250526:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179805 count 1 00000100:00100000:1.0:1651529917.250530:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 754 00000100:00100000:1.0:1651529917.250532:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946833472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.250532:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250533:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 3/0,1 mode: --/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250537:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250537:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.250538:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179804 count 1 00010000:00010000:0.0:1651529917.250538:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 3/0,1 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250542:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 3/0,1 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.250543:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250545:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 3/0,1 mode: --/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250545:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 3/0,1 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250548:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250548:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 2/0,0 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250549:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250550:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 3/0,1 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250553:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 3/0,1 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250556:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 3/0,1 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250560:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 2/0,0 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250613:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946833536:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 99us (224us total) trans 38654706396 rc 0/0 00000100:00100000:0.0:1651529917.250616:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 753 00000100:00100000:1.0:1651529917.250617:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946833472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (217us total) trans 38654706397 rc 0/0 00000100:00100000:1.0:1651529917.250620:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 754 00010000:00010000:0.0:1651529917.250623:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 2/0,0 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250627:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.250628:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 2/0,0 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250640:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 3/0,0 mode: PW/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250645:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 1/0,0 mode: --/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250648:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c2fe2 lrc: 0/0,0 mode: --/PW res: [0x2be5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250652:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 2/0,0 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250655:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000897c5bf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.250656:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 2/0,0 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250659:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 3/0,0 mode: PW/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250662:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 1/0,0 mode: --/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250664:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c2fe9 lrc: 0/0,0 mode: --/PW res: [0x2be5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250864:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833664 00000100:00100000:0.0:1651529917.250881:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833792 00000100:00100000:1.0:1651529917.250885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250886:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 755 00000100:00100000:0.0:1651529917.250887:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946833664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.250891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.250893:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179806 count 1 00000100:00100000:1.0:1651529917.250897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.250898:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250899:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 3/0,1 mode: --/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250902:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833920 00010000:00010000:0.0:1651529917.250903:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250904:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250905:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 3/0,1 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250907:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833728 00010000:00010000:0.0:1651529917.250908:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 3/0,1 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250909:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833856 00010000:00010000:0.0:1651529917.250911:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 3/0,1 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250912:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 756 00000100:00100000:1.0:1651529917.250914:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946833792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.250914:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 2/0,0 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.250919:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179808 count 1 00002000:00010000:1.0:1651529917.250931:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250932:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 3/0,1 mode: --/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250936:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250937:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250938:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 3/0,1 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250941:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 3/0,1 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250963:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 3/0,1 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250966:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 2/0,0 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250993:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+242:39030:x1731745946833664:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 104us (140us total) trans 38654706398 rc 0/0 00000100:00100000:0.0:1651529917.250996:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 755 00000100:00100000:0.0:1651529917.251002:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 757 00000100:00100000:0.0:1651529917.251003:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251008:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179810 count 1 00000100:00100000:1.0:1651529917.251014:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000faba6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833792:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 99us (149us total) trans 38654706399 rc 0/0 00000100:00100000:1.0:1651529917.251017:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 756 00002000:00010000:0.0:1651529917.251020:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251022:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 3/0,1 mode: --/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251026:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251026:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251027:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 3/0,1 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251031:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 3/0,1 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251034:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 3/0,1 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251035:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 758 00000100:00100000:1.0:1651529917.251036:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946833728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.251036:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 2/0,0 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.251050:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179807 count 1 00002000:00010000:1.0:1651529917.251056:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251058:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 3/0,1 mode: --/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251061:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251062:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251063:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 3/0,1 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251066:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 3/0,1 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251070:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 3/0,1 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251075:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 2/0,0 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251083:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833920:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (197us total) trans 38654706400 rc 0/0 00000100:00100000:0.0:1651529917.251086:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 757 00000100:00100000:0.0:1651529917.251091:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 759 00000100:00100000:0.0:1651529917.251092:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251097:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179809 count 1 00002000:00010000:0.0:1651529917.251102:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251103:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 3/0,1 mode: --/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251108:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833728:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (217us total) trans 38654706401 rc 0/0 00000100:00100000:1.0:1651529917.251111:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 758 00010000:00010000:0.0:1651529917.251117:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251118:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251119:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 2/0,0 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251119:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 3/0,1 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251123:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.251123:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 3/0,1 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251124:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 2/0,0 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251126:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 3/0,1 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251127:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 3/0,0 mode: PW/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251129:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 2/0,0 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251132:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 1/0,0 mode: --/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251135:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c2ff0 lrc: 0/0,0 mode: --/PW res: [0x2be5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251139:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 2/0,0 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251142:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7d0c66c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251151:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 2/0,0 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251154:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 3/0,0 mode: PW/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251157:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 1/0,0 mode: --/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251160:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c2ff7 lrc: 0/0,0 mode: --/PW res: [0x2be60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251161:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946833856:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (264us total) trans 38654706402 rc 0/0 00010000:00010000:1.0:1651529917.251164:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 2/0,0 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251164:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 759 00010000:00010000:1.0:1651529917.251167:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251167:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 2/0,0 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251170:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 3/0,0 mode: PW/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251172:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 2/0,0 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251173:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 1/0,0 mode: --/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251175:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c2ffe lrc: 0/0,0 mode: --/PW res: [0x2be62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251175:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000101e4964 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.251176:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 2/0,0 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251179:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 3/0,0 mode: PW/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251186:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 2/0,0 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251189:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251190:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 2/0,0 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251192:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 3/0,0 mode: PW/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251195:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 1/0,0 mode: --/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251196:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 1/0,0 mode: --/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251198:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c3005 lrc: 0/0,0 mode: --/PW res: [0x2be5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251199:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c300c lrc: 0/0,0 mode: --/PW res: [0x2be61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251224:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834432 00000100:00100000:1.0:1651529917.251230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251231:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 760 00000100:00100000:0.0:1651529917.251233:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946834432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251237:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179811 count 1 00000100:00100000:1.0:1651529917.251240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.251242:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251244:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 3/0,1 mode: --/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251247:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251248:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251249:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 3/0,1 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251252:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 3/0,1 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251255:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 3/0,1 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251258:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 2/0,0 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251290:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 2/0,0 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251294:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251295:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 2/0,0 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251308:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 3/0,0 mode: PW/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251312:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39030:x1731745946834432:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (99us total) trans 38654706403 rc 0/0 00000100:00100000:0.0:1651529917.251315:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 760 00010000:00010000:1.0:1651529917.251317:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 1/0,0 mode: --/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251320:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3013 lrc: 0/0,0 mode: --/PW res: [0x2be63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251320:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834496 00000100:00100000:0.0:1651529917.251324:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834560 00000100:00100000:0.0:1651529917.251327:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 761 00000100:00100000:0.0:1651529917.251328:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946834496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251349:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179812 count 1 00000100:00100000:1.0:1651529917.251353:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 762 00002000:00010000:0.0:1651529917.251355:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.251356:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946834560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.251357:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 3/0,1 mode: --/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251360:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.251361:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179813 count 1 00010000:00010000:0.0:1651529917.251361:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251362:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 3/0,1 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.251366:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251366:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 3/0,1 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251368:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 3/0,1 mode: --/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251369:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 3/0,1 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251371:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251371:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 2/0,0 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251372:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251373:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 3/0,1 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251376:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 3/0,1 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251379:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 3/0,1 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251384:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 2/0,0 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251421:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946834496:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (191us total) trans 38654706404 rc 0/0 00000100:00100000:0.0:1651529917.251424:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 761 00010000:00010000:0.0:1651529917.251432:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 2/0,0 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251435:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946834560:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (194us total) trans 38654706405 rc 0/0 00010000:00010000:0.0:1651529917.251435:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.251436:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 2/0,0 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251438:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 762 00010000:00010000:0.0:1651529917.251439:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 3/0,0 mode: PW/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251444:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 1/0,0 mode: --/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251446:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c301a lrc: 0/0,0 mode: --/PW res: [0x2be64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251451:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 2/0,0 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251454:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a772ca06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.251454:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 2/0,0 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251457:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 3/0,0 mode: PW/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251463:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 1/0,0 mode: --/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251465:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3021 lrc: 0/0,0 mode: --/PW res: [0x2be65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251529:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834752 00000100:00100000:0.0:1651529917.251539:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 763 00000100:00100000:0.0:1651529917.251541:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+244:39029:x1731745946834752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.251542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.251546:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179814 count 1 00000100:00100000:1.0:1651529917.251549:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.251551:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.251558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.251558:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 3/0,1 mode: --/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251562:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251563:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.251564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.251564:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 3/0,1 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251567:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 3/0,1 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251569:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834880 00010000:00010000:0.0:1651529917.251570:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 3/0,1 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251573:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 2/0,0 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251575:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835008 00000100:00100000:1.0:1651529917.251577:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834816 00000100:00100000:1.0:1651529917.251579:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834944 00000100:00100000:1.0:1651529917.251587:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 764 00000100:00100000:1.0:1651529917.251589:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+248:39029:x1731745946834880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.251594:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179816 count 1 00002000:00010000:1.0:1651529917.251600:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251601:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 3/0,1 mode: --/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251605:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251606:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251607:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 3/0,1 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251613:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 3/0,1 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251619:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946834752:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (100us total) trans 38654706406 rc 0/0 00010000:00010000:1.0:1651529917.251622:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 3/0,1 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251622:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 763 00010000:00010000:1.0:1651529917.251625:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 2/0,0 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251627:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 765 00000100:00100000:0.0:1651529917.251629:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+248:39029:x1731745946835008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251658:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179818 count 1 00002000:00010000:0.0:1651529917.251663:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251665:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 3/0,1 mode: --/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251669:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251669:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251670:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 3/0,1 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251672:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946834880:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (136us total) trans 38654706407 rc 0/0 00010000:00010000:0.0:1651529917.251674:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 3/0,1 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251676:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 764 00010000:00010000:0.0:1651529917.251677:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 3/0,1 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251680:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 2/0,0 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251681:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 766 00000100:00100000:1.0:1651529917.251682:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+248:39029:x1731745946834816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.251687:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179815 count 1 00002000:00010000:1.0:1651529917.251692:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251693:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 3/0,1 mode: --/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251697:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251698:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251698:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 3/0,1 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251702:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 3/0,1 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251716:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 3/0,1 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251719:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 2/0,0 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251741:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946835008:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 111us (191us total) trans 38654706408 rc 0/0 00000100:00100000:0.0:1651529917.251746:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 765 00000100:00100000:0.0:1651529917.251751:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 767 00000100:00100000:0.0:1651529917.251753:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946834944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251757:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179817 count 1 00002000:00010000:0.0:1651529917.251762:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.251763:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946834816:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 79us (204us total) trans 38654706409 rc 0/0 00010000:00010000:0.0:1651529917.251764:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 3/0,1 mode: --/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251766:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 766 00010000:00010000:0.0:1651529917.251768:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251768:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251769:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 3/0,1 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251773:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 3/0,1 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251774:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 2/0,0 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251776:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 3/0,1 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251777:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251778:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 2/0,0 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251779:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 2/0,0 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251781:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 3/0,0 mode: PW/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251786:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 1/0,0 mode: --/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251789:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3028 lrc: 0/0,0 mode: --/PW res: [0x2be66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251793:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 2/0,0 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251815:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000268d25e1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251816:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 2/0,0 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251823:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 3/0,0 mode: PW/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251828:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 1/0,0 mode: --/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251830:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c302f lrc: 0/0,0 mode: --/PW res: [0x2be68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251831:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946834944:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (266us total) trans 38654706410 rc 0/0 00010000:00010000:1.0:1651529917.251834:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 2/0,0 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251834:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 767 00010000:00010000:1.0:1651529917.251837:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251838:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 2/0,0 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251841:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 3/0,0 mode: PW/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251841:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 2/0,0 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251844:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 1/0,0 mode: --/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251855:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3036 lrc: 0/0,0 mode: --/PW res: [0x2be6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251855:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.251856:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 2/0,0 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251859:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 2/0,0 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251859:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 3/0,0 mode: PW/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251862:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.251862:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 2/0,0 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251864:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 1/0,0 mode: --/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251865:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 3/0,0 mode: PW/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251867:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c303d lrc: 0/0,0 mode: --/PW res: [0x2be67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251869:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 1/0,0 mode: --/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251871:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3044 lrc: 0/0,0 mode: --/PW res: [0x2be69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251899:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835456 00000100:00100000:1.0:1651529917.251904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251906:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 768 00000100:00100000:0.0:1651529917.251908:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+249:39030:x1731745946835456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.251913:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179820 count 1 00000100:00100000:1.0:1651529917.251914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.251917:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251919:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 3/0,1 mode: --/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251922:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251923:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251924:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 3/0,1 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251927:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 3/0,1 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251938:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 3/0,1 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251941:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 2/0,0 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251962:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835392 00000100:00100000:1.0:1651529917.251968:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835712 00000100:00100000:1.0:1651529917.251971:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 769 00000100:00100000:1.0:1651529917.251972:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946835392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.251984:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946835456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (95us total) trans 38654706411 rc 0/0 00000100:00100000:0.0:1651529917.251987:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 768 00002000:00080000:1.0:1651529917.251990:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179819 count 1 00000100:00100000:0.0:1651529917.251992:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 770 00000100:00100000:0.0:1651529917.251994:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946835712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.251996:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251998:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 3/0,1 mode: --/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.251999:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179821 count 1 00010000:00010000:1.0:1651529917.252001:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252002:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252003:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 3/0,1 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252007:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 3/0,1 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252009:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 3/0,1 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252012:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 2/0,0 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.252025:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252027:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 3/0,1 mode: --/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252031:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252032:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252033:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 3/0,1 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252036:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 3/0,1 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252048:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 3/0,1 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252060:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 2/0,0 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252062:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946835392:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 89us (157us total) trans 38654706412 rc 0/0 00000100:00100000:1.0:1651529917.252065:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 769 00010000:00010000:1.0:1651529917.252080:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 2/0,0 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252084:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252085:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 2/0,0 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252097:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 3/0,0 mode: PW/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252100:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946835712:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 105us (185us total) trans 38654706413 rc 0/0 00010000:00010000:1.0:1651529917.252102:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 1/0,0 mode: --/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252103:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 770 00010000:00010000:1.0:1651529917.252105:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c304b lrc: 0/0,0 mode: --/PW res: [0x2be6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252109:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 2/0,0 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252111:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 2/0,0 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252112:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252113:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 2/0,0 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252114:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016217824 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.252115:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 2/0,0 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252116:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 3/0,0 mode: PW/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252118:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 3/0,0 mode: PW/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252119:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 1/0,0 mode: --/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252121:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3052 lrc: 0/0,0 mode: --/PW res: [0x2be6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252123:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 1/0,0 mode: --/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252126:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3059 lrc: 0/0,0 mode: --/PW res: [0x2be6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.252306:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.252319:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835840 00000100:00100000:1.0:1651529917.252334:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835968 00000100:00100000:0.0:1651529917.252337:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 771 00000100:00100000:0.0:1651529917.252339:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+253:39030:x1731745946835840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.252341:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 772 00000100:00100000:1.0:1651529917.252343:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+253:39030:x1731745946835968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.252345:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179823 count 1 00002000:00080000:1.0:1651529917.252348:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179825 count 1 00002000:00010000:1.0:1651529917.252353:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252355:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 3/0,1 mode: --/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.252358:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252359:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252359:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252359:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 3/0,1 mode: --/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252360:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 3/0,1 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252363:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252364:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 3/0,1 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252364:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252364:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 3/0,1 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252367:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 3/0,1 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252368:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 3/0,1 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252369:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 2/0,0 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252371:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 3/0,1 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252373:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 2/0,0 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252410:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946835968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (104us total) trans 38654706414 rc 0/0 00000100:00100000:1.0:1651529917.252413:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 772 00010000:00010000:1.0:1651529917.252420:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 2/0,0 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252425:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946835840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (139us total) trans 38654706415 rc 0/0 00000100:00100000:0.0:1651529917.252428:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 771 00010000:00010000:1.0:1651529917.252432:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252433:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 2/0,0 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252436:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 2/0,0 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252437:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 3/0,0 mode: PW/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252440:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252441:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 1/0,0 mode: --/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252441:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 2/0,0 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252444:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3060 lrc: 0/0,0 mode: --/PW res: [0x2be71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252444:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 3/0,0 mode: PW/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252449:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 1/0,0 mode: --/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252452:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3067 lrc: 0/0,0 mode: --/PW res: [0x2be6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252480:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835776 00000100:00100000:1.0:1651529917.252491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252507:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835904 00000100:00100000:0.0:1651529917.252511:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 773 00000100:00100000:0.0:1651529917.252513:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946835776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.252518:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179822 count 1 00002000:00010000:0.0:1651529917.252523:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252524:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 3/0,1 mode: --/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252528:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252529:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252530:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 3/0,1 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252533:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 3/0,1 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252536:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 3/0,1 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252538:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 2/0,0 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252544:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836032 00000100:00100000:1.0:1651529917.252550:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836288 00000100:00100000:1.0:1651529917.252552:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836736 00000100:00100000:1.0:1651529917.252561:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 774 00000100:00100000:1.0:1651529917.252562:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946835904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.252567:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179824 count 1 00002000:00010000:1.0:1651529917.252573:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252574:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 3/0,1 mode: --/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252586:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252587:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252587:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 3/0,1 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252591:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 3/0,1 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252598:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946835776:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (132us total) trans 38654706416 rc 0/0 00010000:00010000:1.0:1651529917.252600:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 3/0,1 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252601:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 773 00010000:00010000:1.0:1651529917.252603:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 2/0,0 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252606:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 775 00000100:00100000:0.0:1651529917.252608:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946836032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.252613:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179826 count 1 00002000:00010000:0.0:1651529917.252618:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252620:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 3/0,1 mode: --/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252623:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252624:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252625:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 3/0,1 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252628:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 3/0,1 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252631:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 3/0,1 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252634:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 2/0,0 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252641:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946835904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 78us (150us total) trans 38654706417 rc 0/0 00000100:00100000:1.0:1651529917.252644:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 774 00000100:00100000:1.0:1651529917.252649:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 776 00000100:00100000:1.0:1651529917.252651:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946836288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.252656:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179827 count 1 00002000:00010000:1.0:1651529917.252661:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252662:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 3/0,1 mode: --/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252666:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252666:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252667:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 3/0,1 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252670:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946836032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 60us (143us total) trans 38654706418 rc 0/0 00000100:00100000:0.0:1651529917.252674:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 775 00000100:00100000:0.0:1651529917.252679:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 777 00010000:00010000:1.0:1651529917.252680:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 3/0,1 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252681:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946836736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.252683:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 3/0,1 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252686:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 2/0,0 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.252712:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179829 count 1 00002000:00010000:0.0:1651529917.252718:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252719:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 3/0,1 mode: --/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252723:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252724:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252724:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 3/0,1 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252728:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 3/0,1 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252729:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946836288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 77us (196us total) trans 38654706419 rc 0/0 00010000:00010000:0.0:1651529917.252731:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 3/0,1 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252732:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 776 00010000:00010000:0.0:1651529917.252734:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 2/0,0 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252739:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 2/0,0 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252742:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000047b5824 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252743:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 2/0,0 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252746:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 3/0,0 mode: PW/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252751:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 1/0,0 mode: --/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252754:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047b5824/0xa29a79078f3c306e lrc: 0/0,0 mode: --/PW res: [0x2be6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252767:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 2/0,0 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252768:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946836736:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (230us total) trans 38654706420 rc 0/0 00010000:00010000:1.0:1651529917.252770:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009456242c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252771:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 2/0,0 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252771:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 777 00010000:00010000:1.0:1651529917.252773:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 3/0,0 mode: PW/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252777:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 1/0,0 mode: --/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252779:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009456242c/0xa29a79078f3c3075 lrc: 0/0,0 mode: --/PW res: [0x2be70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252779:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 2/0,0 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252783:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 2/0,0 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252784:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdd840ca already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.252785:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003d1e2872 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.252785:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 2/0,0 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252786:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 2/0,0 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252788:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 3/0,0 mode: PW/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252788:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 3/0,0 mode: PW/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252793:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 1/0,0 mode: --/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252796:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd840ca/0xa29a79078f3c307c lrc: 0/0,0 mode: --/PW res: [0x2be72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252799:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 1/0,0 mode: --/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252800:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 2/0,0 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252802:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1e2872/0xa29a79078f3c3083 lrc: 0/0,0 mode: --/PW res: [0x2be73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252823:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000682ba7bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.252824:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 2/0,0 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252827:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 3/0,0 mode: PW/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252831:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 1/0,0 mode: --/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252836:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682ba7bc/0xa29a79078f3c308a lrc: 0/0,0 mode: --/PW res: [0x2be75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252849:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836672 00000100:00100000:0.0:1651529917.252860:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 778 00000100:00100000:0.0:1651529917.252861:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946836672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.252865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.252866:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179828 count 1 00002000:00010000:0.0:1651529917.252871:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252873:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 3/0,1 mode: --/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252876:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252877:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252878:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 3/0,1 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252881:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 3/0,1 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252884:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 3/0,1 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252886:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 2/0,0 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252929:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946836672:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (94us total) trans 38654706421 rc 0/0 00000100:00100000:0.0:1651529917.252934:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 778 00010000:00010000:1.0:1651529917.252935:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 2/0,0 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252939:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071429b39 already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529917.252939:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836800 00010000:00010000:1.0:1651529917.252940:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 2/0,0 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252943:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 3/0,0 mode: PW/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252943:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836864 00000100:00100000:0.0:1651529917.252945:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 779 00000100:00100000:0.0:1651529917.252947:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+261:39029:x1731745946836800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.252948:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 1/0,0 mode: --/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252950:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071429b39/0xa29a79078f3c3091 lrc: 0/0,0 mode: --/PW res: [0x2be74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.252951:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179830 count 1 00002000:00010000:0.0:1651529917.252956:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252957:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 3/0,1 mode: --/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252976:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252977:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252978:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 3/0,1 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252982:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 3/0,1 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252984:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 780 00010000:00010000:0.0:1651529917.252985:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 3/0,1 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252986:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+261:39030:x1731745946836864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.252988:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 2/0,0 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.252999:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179831 count 1 00002000:00010000:1.0:1651529917.253004:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253006:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 3/0,1 mode: --/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253010:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253010:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253011:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 3/0,1 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253015:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 3/0,1 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253018:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 3/0,1 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253020:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 2/0,0 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253031:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946836800:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (173us total) trans 38654706422 rc 0/0 00000100:00100000:0.0:1651529917.253034:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 779 00010000:00010000:0.0:1651529917.253049:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 2/0,0 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253053:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea01ff05 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.253054:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 2/0,0 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253057:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 3/0,0 mode: PW/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253062:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 1/0,0 mode: --/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253065:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea01ff05/0xa29a79078f3c3098 lrc: 0/0,0 mode: --/PW res: [0x2be76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253069:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 2/0,0 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253072:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+262:39030:x1731745946836864:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 85us (196us total) trans 38654706423 rc 0/0 00010000:00010000:0.0:1651529917.253072:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e16f8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.253073:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 2/0,0 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253075:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 780 00010000:00010000:0.0:1651529917.253075:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 3/0,0 mode: PW/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253078:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 1/0,0 mode: --/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253083:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65e16f8/0xa29a79078f3c309f lrc: 0/0,0 mode: --/PW res: [0x2be77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.253151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253161:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837248 00000100:00100000:1.0:1651529917.253163:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837376 00000100:00100000:0.0:1651529917.253172:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 781 00000100:00100000:1.0:1651529917.253179:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 782 00000100:00100000:1.0:1651529917.253181:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946837376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.253187:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179835 count 1 00000100:00100000:0.0:1651529917.253196:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+263:39030:x1731745946837248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.253201:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1651529917.253201:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179833 count 1 00010000:00010000:1.0:1651529917.253203:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 3/0,1 mode: --/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253206:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253207:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529917.253207:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253208:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 3/0,1 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253208:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 3/0,1 mode: --/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253212:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 3/0,1 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253212:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253212:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253213:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 3/0,1 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253215:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 3/0,1 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253217:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 2/0,0 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253217:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 3/0,1 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253220:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 3/0,1 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253222:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 2/0,0 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253258:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946837376:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 76us (107us total) trans 38654706424 rc 0/0 00000100:00100000:1.0:1651529917.253261:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 782 00000100:00100000:0.0:1651529917.253262:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946837248:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (118us total) trans 38654706425 rc 0/0 00000100:00100000:0.0:1651529917.253267:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 781 00010000:00010000:1.0:1651529917.253268:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 2/0,0 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253271:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000053cb223d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253272:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 2/0,0 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253275:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 3/0,0 mode: PW/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253275:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 2/0,0 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253278:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa7cb3f3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.253279:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 2/0,0 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253282:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 3/0,0 mode: PW/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253287:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 1/0,0 mode: --/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253289:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 1/0,0 mode: --/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253289:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7cb3f3/0xa29a79078f3c30ad lrc: 0/0,0 mode: --/PW res: [0x2be79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253292:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cb223d/0xa29a79078f3c30a6 lrc: 0/0,0 mode: --/PW res: [0x2be7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253334:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837184 00000100:00100000:0.0:1651529917.253341:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 783 00000100:00100000:0.0:1651529917.253343:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+264:39030:x1731745946837184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.253348:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179832 count 1 00002000:00010000:0.0:1651529917.253352:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253354:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 3/0,1 mode: --/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.253358:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253358:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253359:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 3/0,1 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253363:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 3/0,1 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253366:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 3/0,1 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253369:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 2/0,0 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.253396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.253401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253405:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946837184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 61us (88us total) trans 38654706426 rc 0/0 00000100:00100000:1.0:1651529917.253407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253408:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 783 00000100:00100000:0.0:1651529917.253413:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837312 00000100:00100000:0.0:1651529917.253417:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837440 00000100:00100000:0.0:1651529917.253419:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837504 00000100:00100000:0.0:1651529917.253421:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837632 00000100:00100000:0.0:1651529917.253423:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837568 00000100:00100000:0.0:1651529917.253425:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 784 00000100:00100000:0.0:1651529917.253426:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+269:39030:x1731745946837312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.253431:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179834 count 1 00002000:00010000:0.0:1651529917.253435:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253436:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 3/0,1 mode: --/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253437:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 785 00000100:00100000:1.0:1651529917.253439:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+269:39030:x1731745946837440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.253440:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253440:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253441:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 3/0,1 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.253445:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179836 count 1 00010000:00010000:0.0:1651529917.253445:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 3/0,1 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253448:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 3/0,1 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.253450:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253450:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 2/0,0 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253452:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 3/0,1 mode: --/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253456:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253456:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253457:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 3/0,1 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253461:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 3/0,1 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253474:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 3/0,1 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253477:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 2/0,0 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253508:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+271:39030:x1731745946837312:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (159us total) trans 38654706427 rc 0/0 00000100:00100000:0.0:1651529917.253512:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 784 00000100:00100000:0.0:1651529917.253517:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 786 00000100:00100000:0.0:1651529917.253519:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+270:39030:x1731745946837504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.253522:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd121dee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+270:39030:x1731745946837440:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (132us total) trans 38654706428 rc 0/0 00002000:00080000:0.0:1651529917.253523:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179837 count 1 00000100:00100000:1.0:1651529917.253525:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 785 00002000:00010000:0.0:1651529917.253529:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253530:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 3/0,1 mode: --/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253534:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253534:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253535:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 3/0,1 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253539:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 3/0,1 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253542:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 787 00010000:00010000:0.0:1651529917.253542:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 3/0,1 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253543:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+269:39030:x1731745946837632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.253545:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 2/0,0 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.253547:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179839 count 1 00002000:00010000:1.0:1651529917.253552:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253554:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 3/0,1 mode: --/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253557:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253558:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253559:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 3/0,1 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253562:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 3/0,1 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253565:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 3/0,1 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253570:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 2/0,0 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253606:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+271:39030:x1731745946837504:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (209us total) trans 38654706429 rc 0/0 00000100:00100000:0.0:1651529917.253609:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 786 00000100:00100000:0.0:1651529917.253614:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 788 00000100:00100000:1.0:1651529917.253615:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+270:39030:x1731745946837632:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 71us (213us total) trans 38654706430 rc 0/0 00000100:00100000:0.0:1651529917.253616:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+270:39029:x1731745946837568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.253618:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 787 00002000:00080000:0.0:1651529917.253620:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179838 count 1 00002000:00010000:0.0:1651529917.253624:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253626:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 2/0,0 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253626:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 3/0,1 mode: --/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253629:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820f2298 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.253629:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253630:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 2/0,0 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253630:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253631:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 3/0,1 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253633:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 3/0,0 mode: PW/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253635:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 3/0,1 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253638:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 1/0,0 mode: --/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253638:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 3/0,1 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253641:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820f2298/0xa29a79078f3c30b4 lrc: 0/0,0 mode: --/PW res: [0x2be78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253643:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 2/0,0 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253645:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 2/0,0 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253648:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e8ecd1e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253649:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 2/0,0 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253651:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 3/0,0 mode: PW/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253654:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 1/0,0 mode: --/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253657:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8ecd1e/0xa29a79078f3c30bb lrc: 0/0,0 mode: --/PW res: [0x2be7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253660:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 2/0,0 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253663:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c686380d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253664:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 2/0,0 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253666:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 3/0,0 mode: PW/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253669:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 1/0,0 mode: --/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253672:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c686380d/0xa29a79078f3c30c2 lrc: 0/0,0 mode: --/PW res: [0x2be7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253687:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 2/0,0 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253689:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3b8469c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253690:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 2/0,0 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253691:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+270:39029:x1731745946837568:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (283us total) trans 38654706431 rc 0/0 00010000:00010000:1.0:1651529917.253693:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 3/0,0 mode: PW/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253694:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 788 00010000:00010000:1.0:1651529917.253696:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 1/0,0 mode: --/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253699:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b8469c/0xa29a79078f3c30c9 lrc: 0/0,0 mode: --/PW res: [0x2be7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253702:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 2/0,0 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253702:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 2/0,0 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253705:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f4abd4e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253705:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 2/0,0 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253705:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093eda540 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.253706:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 2/0,0 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253708:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 3/0,0 mode: PW/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253709:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 3/0,0 mode: PW/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253714:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 1/0,0 mode: --/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253717:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093eda540/0xa29a79078f3c30d0 lrc: 0/0,0 mode: --/PW res: [0x2be7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253718:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 1/0,0 mode: --/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253721:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4abd4e/0xa29a79078f3c30d7 lrc: 0/0,0 mode: --/PW res: [0x2be7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253764:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838080 00000100:00100000:1.0:1651529917.253770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253771:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 789 00000100:00100000:0.0:1651529917.253773:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+270:39029:x1731745946838080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.253778:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179841 count 1 00000100:00100000:1.0:1651529917.253781:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.253783:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253784:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 3/0,1 mode: --/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253788:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253788:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253789:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 3/0,1 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253793:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 3/0,1 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253795:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 3/0,1 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253798:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 2/0,0 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253845:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838016 00000100:00100000:1.0:1651529917.253851:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838144 00000100:00100000:0.0:1651529917.253858:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+273:39029:x1731745946838080:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (104us total) trans 38654706432 rc 0/0 00000100:00100000:1.0:1651529917.253859:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 790 00000100:00100000:1.0:1651529917.253861:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+273:39029:x1731745946838016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.253861:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 789 00002000:00080000:1.0:1651529917.253866:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179840 count 1 00000100:00100000:0.0:1651529917.253867:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 791 00000100:00100000:0.0:1651529917.253868:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946838144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.253871:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253873:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 3/0,1 mode: --/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.253873:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179842 count 1 00010000:00010000:1.0:1651529917.253877:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253877:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253878:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 3/0,1 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.253878:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253882:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 3/0,1 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253885:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 3/0,1 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253894:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 3/0,1 mode: --/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253896:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 2/0,0 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253901:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253901:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253902:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 3/0,1 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253913:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 3/0,1 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253916:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 3/0,1 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253918:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 2/0,0 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253945:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+274:39029:x1731745946838016:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (174us total) trans 38654706433 rc 0/0 00000100:00100000:1.0:1651529917.253948:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 790 00010000:00010000:1.0:1651529917.253955:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 2/0,0 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253959:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000005aa332 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253960:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 2/0,0 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253960:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+273:39030:x1731745946838144:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 91us (178us total) trans 38654706434 rc 0/0 00010000:00010000:1.0:1651529917.253963:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 3/0,0 mode: PW/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253963:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 791 00010000:00010000:1.0:1651529917.253968:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 1/0,0 mode: --/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253971:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005aa332/0xa29a79078f3c30de lrc: 0/0,0 mode: --/PW res: [0x2be81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253975:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 2/0,0 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253978:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb9b2147 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253987:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 2/0,0 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253990:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 3/0,0 mode: PW/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253992:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 2/0,0 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253993:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 1/0,0 mode: --/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253995:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006d9a23ca already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.253996:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb9b2147/0xa29a79078f3c30e5 lrc: 0/0,0 mode: --/PW res: [0x2be80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253996:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 2/0,0 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254000:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 3/0,0 mode: PW/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254020:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 1/0,0 mode: --/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254023:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d9a23ca/0xa29a79078f3c30ec lrc: 0/0,0 mode: --/PW res: [0x2be82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254074:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838400 00000100:00100000:1.0:1651529917.254079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254083:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838464 00000100:00100000:0.0:1651529917.254086:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 792 00000100:00100000:1.0:1651529917.254087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254088:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+274:39030:x1731745946838400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.254092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.254093:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179843 count 1 00000100:00100000:1.0:1651529917.254098:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838528 00000100:00100000:1.0:1651529917.254104:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838592 00000100:00100000:1.0:1651529917.254107:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 793 00000100:00100000:1.0:1651529917.254108:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946838464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:0.0:1651529917.254111:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254113:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 3/0,1 mode: --/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.254114:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179844 count 1 00010000:00010000:0.0:1651529917.254117:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.254119:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254120:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 3/0,1 mode: --/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254124:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254124:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254125:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 3/0,1 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254130:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254131:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 3/0,1 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254135:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 3/0,1 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254139:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 3/0,1 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254139:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 3/0,1 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254141:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 2/0,0 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254142:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 3/0,1 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254145:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 2/0,0 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254192:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+278:39030:x1731745946838400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 103us (131us total) trans 38654706435 rc 0/0 00000100:00100000:0.0:1651529917.254196:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 792 00000100:00100000:1.0:1651529917.254198:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+278:39029:x1731745946838464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (118us total) trans 38654706436 rc 0/0 00000100:00100000:1.0:1651529917.254201:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 793 00000100:00100000:0.0:1651529917.254203:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 794 00000100:00100000:0.0:1651529917.254204:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946838528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.254206:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 795 00000100:00100000:1.0:1651529917.254208:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946838592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.254209:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179845 count 1 00002000:00080000:1.0:1651529917.254213:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179846 count 1 00002000:00010000:0.0:1651529917.254214:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254216:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 3/0,1 mode: --/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.254217:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254219:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 3/0,1 mode: --/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254219:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254220:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254221:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 3/0,1 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254222:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254223:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254224:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 3/0,1 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254224:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 3/0,1 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254227:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 3/0,1 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254228:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 3/0,1 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254230:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 2/0,0 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254233:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 3/0,1 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254235:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 2/0,0 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254282:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+278:39029:x1731745946838592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (189us total) trans 38654706437 rc 0/0 00000100:00100000:1.0:1651529917.254285:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 795 00010000:00010000:1.0:1651529917.254292:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 2/0,0 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254296:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb7f365b already unused, calling callback (00000000109466a4) 00000100:00100000:0.0:1651529917.254296:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946838528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 90us (209us total) trans 38654706438 rc 0/0 00010000:00010000:1.0:1651529917.254297:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 2/0,0 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254300:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 3/0,0 mode: PW/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254300:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 794 00010000:00010000:1.0:1651529917.254305:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 1/0,0 mode: --/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254308:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7f365b/0xa29a79078f3c30f3 lrc: 0/0,0 mode: --/PW res: [0x2be83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254308:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 2/0,0 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254312:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 2/0,0 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254312:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064963318 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254313:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 2/0,0 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254316:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 3/0,0 mode: PW/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254320:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 1/0,0 mode: --/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254324:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000090d6fec already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.254325:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 2/0,0 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254327:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 3/0,0 mode: PW/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254331:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 1/0,0 mode: --/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254334:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090d6fec/0xa29a79078f3c3108 lrc: 0/0,0 mode: --/PW res: [0x2be86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254337:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 2/0,0 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254337:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064963318/0xa29a79078f3c30fa lrc: 0/0,0 mode: --/PW res: [0x2be84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254340:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5f37e43 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.254341:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 2/0,0 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254343:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 3/0,0 mode: PW/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254346:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 1/0,0 mode: --/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254356:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f37e43/0xa29a79078f3c3101 lrc: 0/0,0 mode: --/PW res: [0x2be85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254381:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838784 00000100:00100000:1.0:1651529917.254387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254388:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 796 00000100:00100000:0.0:1651529917.254390:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946838784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.254395:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179847 count 1 00000100:00100000:1.0:1651529917.254396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.254400:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254402:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 3/0,1 mode: --/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254405:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254406:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254407:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 3/0,1 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254410:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 3/0,1 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254413:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 3/0,1 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254416:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 2/0,0 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.254451:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839040 00000100:00100000:0.0:1651529917.254458:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+279:39030:x1731745946838784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 67us (87us total) trans 38654706439 rc 0/0 00000100:00100000:0.0:1651529917.254461:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 796 00000100:00100000:1.0:1651529917.254462:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839168 00000100:00100000:1.0:1651529917.254465:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839104 00000100:00100000:0.0:1651529917.254467:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 797 00000100:00100000:0.0:1651529917.254468:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946839040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.254469:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 798 00000100:00100000:1.0:1651529917.254471:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946839168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.254473:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179848 count 1 00002000:00080000:1.0:1651529917.254476:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179850 count 1 00002000:00010000:0.0:1651529917.254477:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254479:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 3/0,1 mode: --/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.254481:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254483:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 3/0,1 mode: --/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254486:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254487:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254488:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 3/0,1 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254491:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 3/0,1 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254494:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 3/0,1 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254497:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254498:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254499:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 3/0,1 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254503:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 3/0,1 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254506:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 3/0,1 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254508:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 2/0,0 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254509:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 2/0,0 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254556:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+282:39030:x1731745946839168:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (159us total) trans 38654706440 rc 0/0 00000100:00100000:0.0:1651529917.254558:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+282:39030:x1731745946839040:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (170us total) trans 38654706441 rc 0/0 00000100:00100000:1.0:1651529917.254559:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 798 00000100:00100000:0.0:1651529917.254561:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 797 00000100:00100000:1.0:1651529917.254564:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 799 00000100:00100000:1.0:1651529917.254566:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946839104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.254569:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 2/0,0 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.254570:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179849 count 1 00010000:00010000:0.0:1651529917.254573:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254574:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 2/0,0 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.254575:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254577:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 3/0,1 mode: --/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254577:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 3/0,0 mode: PW/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254580:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254581:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254582:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 3/0,1 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254582:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 1/0,0 mode: --/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254584:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c310f lrc: 0/0,0 mode: --/PW res: [0x2be87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254585:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 3/0,1 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254588:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 3/0,1 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254589:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 2/0,0 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254591:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 2/0,0 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254618:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f7fcb52 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254620:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 2/0,0 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254623:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 3/0,0 mode: PW/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254627:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 1/0,0 mode: --/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254630:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f7fcb52/0xa29a79078f3c311d lrc: 0/0,0 mode: --/PW res: [0x2be8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254634:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 2/0,0 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254637:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254638:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 2/0,0 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254641:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 3/0,0 mode: PW/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254643:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+281:39030:x1731745946839104:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (218us total) trans 38654706442 rc 0/0 00010000:00010000:0.0:1651529917.254644:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 1/0,0 mode: --/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254646:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 799 00010000:00010000:1.0:1651529917.254653:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 2/0,0 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254657:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d543ebfe already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.254658:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 2/0,0 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254660:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 3/0,0 mode: PW/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254661:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3116 lrc: 0/0,0 mode: --/PW res: [0x2be88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254665:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 1/0,0 mode: --/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254668:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d543ebfe/0xa29a79078f3c3124 lrc: 0/0,0 mode: --/PW res: [0x2be89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254702:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254713:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839552 00000100:00100000:1.0:1651529917.254719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254731:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839616 00000100:00100000:0.0:1651529917.254735:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 800 00000100:00100000:0.0:1651529917.254736:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+282:39030:x1731745946839552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.254739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.254741:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179851 count 1 00002000:00010000:0.0:1651529917.254746:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254748:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 3/0,1 mode: --/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254751:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254752:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254753:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 3/0,1 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254756:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 3/0,1 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254759:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 3/0,1 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254762:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 2/0,0 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.254792:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839680 00000100:00100000:1.0:1651529917.254798:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839744 00000100:00100000:1.0:1651529917.254801:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 801 00000100:00100000:1.0:1651529917.254825:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946839616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.254826:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946839552:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (123us total) trans 38654706443 rc 0/0 00002000:00080000:1.0:1651529917.254838:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179852 count 1 00002000:00010000:1.0:1651529917.254843:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254844:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 3/0,1 mode: --/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254848:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.254848:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 800 00010000:00010000:1.0:1651529917.254849:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254849:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 3/0,1 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254853:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 3/0,1 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254854:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 802 00000100:00100000:0.0:1651529917.254855:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+284:39030:x1731745946839680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.254856:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 3/0,1 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254858:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 2/0,0 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.254860:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179853 count 1 00002000:00010000:0.0:1651529917.254873:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254875:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 3/0,1 mode: --/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254879:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254879:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254880:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 3/0,1 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254884:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 3/0,1 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254887:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 3/0,1 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254890:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 2/0,0 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254906:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946839616:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 102us (186us total) trans 38654706444 rc 0/0 00000100:00100000:1.0:1651529917.254909:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 801 00000100:00100000:1.0:1651529917.254914:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 803 00000100:00100000:1.0:1651529917.254916:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946839744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.254920:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179854 count 1 00002000:00010000:1.0:1651529917.254925:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254927:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 3/0,1 mode: --/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254939:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254939:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.254939:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946839680:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (199us total) trans 38654706445 rc 0/0 00010000:00010000:1.0:1651529917.254940:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 3/0,1 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254942:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 802 00010000:00010000:1.0:1651529917.254944:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 3/0,1 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254947:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 3/0,1 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254950:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 2/0,0 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254953:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 2/0,0 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254966:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254967:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 2/0,0 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254970:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 3/0,0 mode: PW/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254974:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 1/0,0 mode: --/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254977:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c312b lrc: 0/0,0 mode: --/PW res: [0x2be8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254981:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 2/0,0 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254983:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946839744:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 66us (218us total) trans 38654706446 rc 0/0 00010000:00010000:0.0:1651529917.254984:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008215e54b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.254985:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 2/0,0 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254986:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 803 00010000:00010000:0.0:1651529917.254988:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 3/0,0 mode: PW/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254991:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 1/0,0 mode: --/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254994:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 2/0,0 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254996:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008215e54b/0xa29a79078f3c3132 lrc: 0/0,0 mode: --/PW res: [0x2be8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254997:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.254998:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 2/0,0 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254999:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 2/0,0 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255001:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 3/0,0 mode: PW/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255002:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d712eb2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255003:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 2/0,0 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255005:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 3/0,0 mode: PW/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255008:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 1/0,0 mode: --/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255009:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 1/0,0 mode: --/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255011:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d712eb2/0xa29a79078f3c3140 lrc: 0/0,0 mode: --/PW res: [0x2be8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255012:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3139 lrc: 0/0,0 mode: --/PW res: [0x2be8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255080:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840064 00000100:00100000:0.0:1651529917.255092:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 804 00000100:00100000:0.0:1651529917.255094:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946840064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.255099:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179856 count 1 00002000:00010000:0.0:1651529917.255104:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.255106:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.255106:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 3/0,1 mode: --/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.255122:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.255129:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840000 00010000:00010000:0.0:1651529917.255133:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.255134:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840128 00010000:00010000:0.0:1651529917.255134:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255135:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 3/0,1 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255136:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840192 00000100:00100000:1.0:1651529917.255139:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 805 00010000:00010000:0.0:1651529917.255139:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 3/0,1 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255140:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946840000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.255142:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 3/0,1 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.255145:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179855 count 1 00010000:00010000:0.0:1651529917.255145:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 2/0,0 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.255151:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255152:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 3/0,1 mode: --/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255156:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255157:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255158:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 3/0,1 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255161:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 3/0,1 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255166:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 3/0,1 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255169:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 2/0,0 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.255190:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+289:39030:x1731745946840064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 95us (120us total) trans 38654706447 rc 0/0 00000100:00100000:0.0:1651529917.255193:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 804 00000100:00100000:0.0:1651529917.255198:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 806 00000100:00100000:0.0:1651529917.255200:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946840128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.255204:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179857 count 1 00002000:00010000:0.0:1651529917.255209:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255211:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 3/0,1 mode: --/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255214:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.255215:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+289:39030:x1731745946840000:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (108us total) trans 38654706448 rc 0/0 00010000:00010000:0.0:1651529917.255215:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255216:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 3/0,1 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255218:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 805 00010000:00010000:0.0:1651529917.255220:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 3/0,1 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255223:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 807 00010000:00010000:0.0:1651529917.255223:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 3/0,1 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255225:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946840192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1651529917.255225:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 2/0,0 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.255229:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179858 count 1 00002000:00010000:1.0:1651529917.255234:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255235:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 3/0,1 mode: --/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255239:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255239:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255240:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 3/0,1 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255244:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 3/0,1 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255247:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 3/0,1 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255252:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 2/0,0 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.255302:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946840128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 101us (184us total) trans 38654706449 rc 0/0 00000100:00100000:0.0:1651529917.255305:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 806 00000100:00100000:1.0:1651529917.255310:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+289:39030:x1731745946840192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 84us (187us total) trans 38654706450 rc 0/0 00000100:00100000:1.0:1651529917.255313:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 807 00010000:00010000:0.0:1651529917.255313:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 2/0,0 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255316:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255317:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 2/0,0 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255320:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 2/0,0 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255320:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 3/0,0 mode: PW/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255324:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000859862c6 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.255325:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 2/0,0 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255325:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 1/0,0 mode: --/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255328:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 3/0,0 mode: PW/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255328:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3147 lrc: 0/0,0 mode: --/PW res: [0x2be90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255332:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 1/0,0 mode: --/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255333:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 2/0,0 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255335:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000859862c6/0xa29a79078f3c314e lrc: 0/0,0 mode: --/PW res: [0x2be8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255335:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255336:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 2/0,0 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255339:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 2/0,0 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255339:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 3/0,0 mode: PW/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255342:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255342:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 1/0,0 mode: --/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255343:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 2/0,0 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255345:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3155 lrc: 0/0,0 mode: --/PW res: [0x2be91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255346:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 3/0,0 mode: PW/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255349:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 1/0,0 mode: --/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255352:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c315c lrc: 0/0,0 mode: --/PW res: [0x2be92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255376:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840448 00000100:00100000:1.0:1651529917.255382:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255394:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840512 00000100:00100000:0.0:1651529917.255398:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 808 00000100:00100000:0.0:1651529917.255400:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+290:39030:x1731745946840448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.255402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.255405:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179859 count 1 00002000:00010000:0.0:1651529917.255410:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255411:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 3/0,1 mode: --/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255415:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255416:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255417:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 3/0,1 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255420:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 3/0,1 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255423:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 3/0,1 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255425:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 2/0,0 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.255457:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840576 00000100:00100000:1.0:1651529917.255462:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840640 00000100:00100000:0.0:1651529917.255469:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+293:39030:x1731745946840448:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (103us total) trans 38654706451 rc 0/0 00000100:00100000:1.0:1651529917.255471:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 809 00000100:00100000:1.0:1651529917.255473:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946840512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.255473:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 808 00002000:00080000:1.0:1651529917.255478:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179860 count 1 00000100:00100000:0.0:1651529917.255478:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 810 00000100:00100000:0.0:1651529917.255480:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+292:39030:x1731745946840576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.255483:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255484:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 3/0,1 mode: --/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.255484:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179861 count 1 00010000:00010000:1.0:1651529917.255488:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255489:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255489:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 3/0,1 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255504:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 3/0,1 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.255504:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255505:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 3/0,1 mode: --/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255507:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 3/0,1 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255509:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255510:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 2/0,0 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255510:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255511:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 3/0,1 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255514:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 3/0,1 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255525:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 3/0,1 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255528:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 2/0,0 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255557:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+294:39029:x1731745946840512:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 83us (174us total) trans 38654706452 rc 0/0 00000100:00100000:1.0:1651529917.255560:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 809 00000100:00100000:1.0:1651529917.255565:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 811 00000100:00100000:1.0:1651529917.255567:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946840640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.255567:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+293:39030:x1731745946840576:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (165us total) trans 38654706453 rc 0/0 00000100:00100000:0.0:1651529917.255570:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 810 00002000:00080000:1.0:1651529917.255571:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179862 count 1 00002000:00010000:1.0:1651529917.255576:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255577:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 3/0,1 mode: --/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255578:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 2/0,0 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255581:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255581:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255582:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 3/0,1 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255586:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 3/0,1 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255600:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255601:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 2/0,0 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255603:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 3/0,1 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255606:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 2/0,0 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255612:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 3/0,0 mode: PW/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255617:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 1/0,0 mode: --/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255620:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c3163 lrc: 0/0,0 mode: --/PW res: [0x2be93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255624:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 2/0,0 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255627:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255628:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 2/0,0 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255630:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 3/0,0 mode: PW/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255634:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 1/0,0 mode: --/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255636:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c316a lrc: 0/0,0 mode: --/PW res: [0x2be94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255639:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 2/0,0 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255640:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946840640:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 72us (209us total) trans 38654706454 rc 0/0 00000100:00100000:1.0:1651529917.255642:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 811 00010000:00010000:0.0:1651529917.255642:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255643:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 2/0,0 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255645:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 3/0,0 mode: PW/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255648:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 1/0,0 mode: --/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255650:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 2/0,0 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255653:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3171 lrc: 0/0,0 mode: --/PW res: [0x2be95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255654:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.255655:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 2/0,0 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255658:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 3/0,0 mode: PW/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255663:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 1/0,0 mode: --/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255666:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3178 lrc: 0/0,0 mode: --/PW res: [0x2be96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255717:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840704 00000100:00100000:1.0:1651529917.255724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255728:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 812 00000100:00100000:0.0:1651529917.255730:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+293:39030:x1731745946840704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.255740:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179863 count 1 00000100:00100000:1.0:1651529917.255743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.255745:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255747:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 3/0,1 mode: --/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255750:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255751:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255752:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 3/0,1 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255755:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 3/0,1 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255758:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 3/0,1 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255760:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 2/0,0 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.255798:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840768 00000100:00100000:0.0:1651529917.255817:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946840704:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 86us (116us total) trans 38654706455 rc 0/0 00000100:00100000:1.0:1651529917.255822:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840832 00000100:00100000:0.0:1651529917.255822:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 812 00000100:00100000:1.0:1651529917.255825:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840896 00000100:00100000:1.0:1651529917.255828:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 813 00000100:00100000:1.0:1651529917.255830:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+296:39029:x1731745946840768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.255835:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179864 count 1 00002000:00010000:1.0:1651529917.255840:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255841:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 3/0,1 mode: --/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.255841:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 814 00000100:00100000:0.0:1651529917.255843:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+296:39030:x1731745946840832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1651529917.255845:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255845:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255846:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 3/0,1 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.255848:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179865 count 1 00010000:00010000:1.0:1651529917.255850:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 3/0,1 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255853:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 3/0,1 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.255853:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255855:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 3/0,1 mode: --/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255856:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 2/0,0 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255859:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255859:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255860:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 3/0,1 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255871:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 3/0,1 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255875:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 3/0,1 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255877:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 2/0,0 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255904:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+298:39029:x1731745946840768:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 73us (180us total) trans 38654706456 rc 0/0 00000100:00100000:1.0:1651529917.255917:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 813 00000100:00100000:0.0:1651529917.255919:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006014d15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946840832:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 75us (175us total) trans 38654706457 rc 0/0 00000100:00100000:0.0:1651529917.255922:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 814 00000100:00100000:1.0:1651529917.255923:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 815 00000100:00100000:1.0:1651529917.255925:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+296:39029:x1731745946840896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.255929:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179866 count 1 00002000:00010000:1.0:1651529917.255934:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255936:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 3/0,1 mode: --/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255940:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255940:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255941:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 3/0,1 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255945:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 3/0,1 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255954:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 3/0,1 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255957:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 2/0,0 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255969:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 2/0,0 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255975:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.255976:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 2/0,0 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255979:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 3/0,0 mode: PW/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255983:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 1/0,0 mode: --/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255986:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c317f lrc: 0/0,0 mode: --/PW res: [0x2be97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255991:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+297:39029:x1731745946840896:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 65us (220us total) trans 38654706458 rc 0/0 00010000:00010000:0.0:1651529917.255991:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 2/0,0 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255993:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00000100:00100000:1.0:1651529917.255994:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 815 00010000:00010000:0.0:1651529917.255994:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 2/0,0 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255997:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 3/0,0 mode: PW/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256000:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 1/0,0 mode: --/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256004:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 2/0,0 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256005:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3186 lrc: 0/0,0 mode: --/PW res: [0x2be98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256009:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 2/0,0 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256010:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.256011:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 2/0,0 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256011:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256012:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 2/0,0 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256013:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 3/0,0 mode: PW/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256015:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 3/0,0 mode: PW/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256018:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 1/0,0 mode: --/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256018:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 1/0,0 mode: --/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256020:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c3194 lrc: 0/0,0 mode: --/PW res: [0x2be9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256021:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c318d lrc: 0/0,0 mode: --/PW res: [0x2be99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.256072:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840960 00000100:00100000:1.0:1651529917.256078:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.256090:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841024 00000100:00100000:0.0:1651529917.256094:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 816 00000100:00100000:0.0:1651529917.256096:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946840960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651529917.256098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.256101:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179867 count 1 00002000:00010000:0.0:1651529917.256106:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.256107:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 3/0,1 mode: --/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256111:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256111:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256112:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 3/0,1 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256116:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 3/0,1 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256118:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 3/0,1 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256121:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 2/0,0 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.256150:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841088 00000100:00100000:1.0:1651529917.256156:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841152 00000100:00100000:1.0:1651529917.256159:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 817 00000100:00100000:1.0:1651529917.256160:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39029:x1731745946841024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.256165:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946840960:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 68us (104us total) trans 38654706459 rc 0/0 00000100:00100000:0.0:1651529917.256168:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 816 00002000:00080000:1.0:1651529917.256171:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179868 count 1 00000100:00100000:0.0:1651529917.256174:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 818 00000100:00100000:0.0:1651529917.256175:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+300:39030:x1731745946841088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00010000:1.0:1651529917.256176:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.256178:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 3/0,1 mode: --/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.256180:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179869 count 1 00010000:00010000:1.0:1651529917.256184:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.256185:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529917.256185:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.256186:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 3/0,1 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256189:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 3/0,1 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256192:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 3/0,1 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256195:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 2/0,0 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256207:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 3/0,1 mode: --/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256211:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256212:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256213:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 3/0,1 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256217:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 3/0,1 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256220:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 3/0,1 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256222:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 2/0,0 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256242:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39029:x1731745946841024:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 80us (164us total) trans 38654706460 rc 0/0 00000100:00100000:1.0:1651529917.256245:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 817 00000100:00100000:1.0:1651529917.256251:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 819 00000100:00100000:1.0:1651529917.256252:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39029:x1731745946841152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.256257:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179870 count 1 00002000:00010000:1.0:1651529917.256262:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.256263:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 3/0,1 mode: --/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.256263:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946841088:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 87us (165us total) trans 38654706461 rc 0/0 00010000:00010000:1.0:1651529917.256267:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.256267:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.256267:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 818 00010000:00010000:1.0:1651529917.256268:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 3/0,1 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256274:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 2/0,0 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256278:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256279:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 2/0,0 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256281:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 3/0,1 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256282:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 3/0,0 mode: PW/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256284:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 3/0,1 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256287:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 2/0,0 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256287:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 1/0,0 mode: --/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256309:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c319b lrc: 0/0,0 mode: --/PW res: [0x2be9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256321:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 2/0,0 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256325:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256325:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 2/0,0 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256328:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39029:x1731745946841152:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (202us total) trans 38654706462 rc 0/0 00010000:00010000:0.0:1651529917.256328:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 3/0,0 mode: PW/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256331:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 819 00010000:00010000:0.0:1651529917.256332:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 1/0,0 mode: --/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256334:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c31a2 lrc: 0/0,0 mode: --/PW res: [0x2be9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256338:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 2/0,0 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256338:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 2/0,0 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256341:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256341:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256341:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 2/0,0 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256342:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 2/0,0 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256344:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 3/0,0 mode: PW/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256345:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 3/0,0 mode: PW/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256350:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 1/0,0 mode: --/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256350:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 1/0,0 mode: --/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256352:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c31b0 lrc: 0/0,0 mode: --/PW res: [0x2be9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256353:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c31a9 lrc: 0/0,0 mode: --/PW res: [0x2be9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.256404:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841216 00000100:00100000:1.0:1651529917.256410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.256414:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 820 00000100:00100000:0.0:1651529917.256416:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946841216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529917.256426:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179871 count 1 00000100:00100000:1.0:1651529917.256429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.256431:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2be9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.256432:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 3/0,1 mode: --/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256436:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256436:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256437:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 3/0,1 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256441:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 3/0,1 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256444:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 3/0,1 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256446:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 2/0,0 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.256479:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841280 00000100:00100000:1.0:1651529917.256485:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841344 00000100:00100000:0.0:1651529917.256491:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+304:39030:x1731745946841216:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 74us (97us total) trans 38654706463 rc 0/0 00000100:00100000:1.0:1651529917.256494:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841408 00000100:00100000:0.0:1651529917.256494:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 820 00000100:00100000:1.0:1651529917.256498:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 821 00000100:00100000:1.0:1651529917.256499:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+304:39029:x1731745946841280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.256500:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 822 00000100:00100000:0.0:1651529917.256502:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+304:39030:x1731745946841344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529917.256505:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179872 count 1 00002000:00080000:0.0:1651529917.256506:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179873 count 1 00002000:00010000:1.0:1651529917.256510:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.256512:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 3/0,1 mode: --/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.256512:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.256514:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 3/0,1 mode: --/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256515:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.256516:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.256517:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 3/0,1 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256520:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 3/0,1 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256523:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 3/0,1 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256526:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 2/0,0 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256531:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256532:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256533:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 3/0,1 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256537:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 3/0,1 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256540:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 3/0,1 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256543:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 2/0,0 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256583:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+306:39029:x1731745946841280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 82us (173us total) trans 38654706464 rc 0/0 00000100:00100000:1.0:1651529917.256587:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 821 00000100:00100000:0.0:1651529917.256591:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946841344:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 88us (162us total) trans 38654706465 rc 0/0 00000100:00100000:1.0:1651529917.256592:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 823 00000100:00100000:1.0:1651529917.256593:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946841408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529917.256596:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 822 00002000:00080000:1.0:1651529917.256598:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179874 count 1 00002000:00010000:1.0:1651529917.256602:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.256603:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 2/0,0 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256604:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 3/0,1 mode: --/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256607:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256607:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529917.256608:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.256608:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 2/0,0 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256609:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 3/0,1 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256611:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 3/0,0 mode: PW/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256612:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 3/0,1 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256615:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 3/0,1 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256615:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 1/0,0 mode: --/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.256617:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 2/0,0 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256618:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c31b7 lrc: 0/0,0 mode: --/PW res: [0x2be9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256622:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 2/0,0 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256625:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256626:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 2/0,0 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256629:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 3/0,0 mode: PW/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256635:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 1/0,0 mode: --/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256637:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c31be lrc: 0/0,0 mode: --/PW res: [0x2bea0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256641:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 2/0,0 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256643:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000386c4efa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256644:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 2/0,0 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256647:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 3/0,0 mode: PW/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256650:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 1/0,0 mode: --/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256651:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946841408:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 56us (196us total) trans 38654706466 rc 0/0 00010000:00010000:0.0:1651529917.256652:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c31c5 lrc: 0/0,0 mode: --/PW res: [0x2bea1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256655:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 2/0,0 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256658:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529917.256659:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 2/0,0 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256661:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 3/0,0 mode: PW/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.256664:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 823 00010000:00010000:0.0:1651529917.256664:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 1/0,0 mode: --/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.256667:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c31cc lrc: 0/0,0 mode: --/PW res: [0x2bea2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529918.039298:0:194942:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529918.039301:0:194942:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 140: Check reasonable stack depth (shouldn't LBUG) ============================================================== 22:18:36 (1651529916) 00000001:00080000:1.0:1651529919.402077:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706466 is committed 00000100:00100000:1.0:1651529919.712179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529919.712199:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841472 00000100:00100000:1.0:1651529919.712229:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529919.712232:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946841472:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529919.712266:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946841472:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529919.712270:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000400:00000080:1.0:1651529921.413635:0:195160:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529921.413638:0:195160:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150a: truncate/append tests =============== 22:18:41 (1651529921) 00000100:00100000:1.0:1651529921.444166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.444184:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353147968 00000100:00100000:1.0:1651529921.444206:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 824 00000100:00100000:1.0:1651529921.444209:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:438145:x1731754353147968:12345-10.240.43.64@tcp:8:cp.0 00010000:00080000:1.0:1651529921.444240:0:194455:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13521 last 0 00000020:00000080:1.0:1651529921.444271:0:194455:0:(genops.c:1359:class_connect()) connect: client ec96cd77-f6e5-48c2-876b-61a646cc1c34, cookie 0xa29a79078f3c31d3 00002000:00100000:1.0:1651529921.444294:0:194455:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli ec96cd77-f6e5-48c2-876b-61a646cc1c34/000000002462372a ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529921.444303:0:194455:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529921.444339:0:194455:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651529921.444350:0:194455:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529921.444383:0:194455:0:(import.c:85:import_set_state_nolock()) 000000006b1932d0 TL¥Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529921.444424:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438145:x1731754353147968:12345-10.240.43.64@tcp:8:cp.0 Request processed in 214us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.444428:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 824 00000100:00100000:1.0:1651529921.444725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.444733:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148032 00000100:00100000:1.0:1651529921.444748:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 825 00000100:00100000:1.0:1651529921.444750:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:0:x1731754353148032:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651529921.444761:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529921.444771:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f770a expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529921.444782:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529921.444789:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.444790:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.444794:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.444815:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.444821:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea47ebc4, rc 0) 00000100:00100000:1.0:1651529921.444833:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:0:x1731754353148032:12345-10.240.43.64@tcp:101:cp.0 Request processed in 83us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.444836:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 825 00000100:00100000:1.0:1651529921.445373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.445381:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148096 00000100:00100000:1.0:1651529921.445394:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 826 00000100:00100000:1.0:1651529921.445396:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:451115:x1731754353148096:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651529921.445399:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529921.445403:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 2/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7711 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529921.445419:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 2/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.445423:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.445424:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.445425:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 4/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529921.445436:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.445441:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529921.445452:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000634ba2f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529921.445478:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4472595 going to sleep for 11 seconds 00000100:00100000:1.0:1651529921.445892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.445911:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000634ba2f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529921.445918:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 3/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529921.445918:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148160 00010000:00010000:1.0:1651529921.445923:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033a35c44, rc 0) 00010000:00010000:0.0:1651529921.445930:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529921.445933:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+9:451115:x1731754353148096:12345-10.240.43.64@tcp:101:cp.0 Request processed in 537us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.445936:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 826 00000100:00100000:1.0:1651529921.445953:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529921.445955:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438149:x1731754353148160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529921.445959:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529921.445964:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529921.445969:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529921.445976:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31da lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f770a expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529921.445979:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.445980:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.445982:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529921.445985:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529921.445994:0:176856:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529921.445998:0:176856:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730240:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651529921.446007:0:176856:0:(client.c:2492:ptlrpc_set_wait()) set 000000003bbd61f4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529921.446281:0:176856:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf518e04 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730240:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651529921.446286:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529921.446295:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:438149:x1731754353148160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 340us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.446298:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529921.451431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.451467:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148416 00002000:00100000:0.0:1651529921.451483:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->6095) req@00000000cf518e04 x1731754353148416/t0(0) o4->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:652/0 lens 6584/0 e 0 to 0 dl 1651529932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651529921.451493:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf518e04 with x1731754353148416 ext(0->6095) 00002000:00010000:0.0:1651529921.451495:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cf518e04 00000100:00100000:0.0:1651529921.451503:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529921.451506:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:438146:x1731754353148416:12345-10.240.43.64@tcp:4:cp.0 00000001:00100000:1.0:1651529921.493174:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000100:00100000:0.0:1651529921.493381:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf518e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438146:x1731754353148416:12345-10.240.43.64@tcp:4:cp.0 Request processed in 41874us (41950us total) trans 38654706467 rc 0/0 00000100:00100000:0.0:1651529921.493387:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00002000:00100000:0.0:1651529921.493390:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->6095) req@00000000cf518e04 x1731754353148416/t38654706467(0) o4->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:652/0 lens 6584/448 e 0 to 0 dl 1651529932 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651529921.493394:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf518e04 with x1731754353148416 ext(0->6095) 00002000:00010000:0.0:1651529921.493396:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cf518e04 00000100:00100000:1.0:1651529921.493844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.493852:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148480 00000100:00100000:1.0:1651529921.493868:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529921.493870:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:439093:x1731754353148480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529921.493873:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651529921.493877:0:176856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:1.0:1651529921.493878:0:176856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb mtime from disk: 0 -> 1651529921 00002000:00010000:1.0:1651529921.493879:0:176856:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb ctime from disk: 0 -> 1651529921 00002000:00010000:1.0:1651529921.493880:0:176856:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:1.0:1651529921.493885:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e1 lrc: 0/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7711 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529921.493891:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529921.493902:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:439093:x1731754353148480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.493905:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529921.630289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.630298:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148800 00000100:00100000:1.0:1651529921.630313:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 827 00000100:00100000:1.0:1651529921.630315:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:438149:x1731754353148800:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651529921.630319:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529921.630332:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e8 lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7726 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529921.630338:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 6096, mtime: 0x627058c1, atime: 0x0, ctime: 0x627058c1, blocks: 0x10 00010000:00010000:1.0:1651529921.630343:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.630344:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529921.630346:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e8 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7726 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.630351:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e8 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7726 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.630355:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033a35c44, rc 0) 00000100:00100000:1.0:1651529921.630366:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438149:x1731754353148800:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 50us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.630369:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 827 00000100:00100000:1.0:1651529921.664275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.664302:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148992 00002000:00100000:0.0:1651529921.664320:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@00000000870c23d5 x1731754353148992/t0(0) o3->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:647/0 lens 488/0 e 0 to 0 dl 1651529927 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651529921.664325:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000870c23d5 with x1731754353148992 ext(0->4194303) 00002000:00010000:0.0:1651529921.664328:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000870c23d5 00000100:00100000:0.0:1651529921.664336:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:0.0:1651529921.664339:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438149:x1731754353148992:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651529921.665635:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000870c23d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438149:x1731754353148992:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 1295us (1360us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529921.665640:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00002000:00100000:0.0:1651529921.665643:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@00000000870c23d5 x1731754353148992/t0(0) o3->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:647/0 lens 488/440 e 0 to 0 dl 1651529927 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651529921.665647:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000870c23d5 with x1731754353148992 ext(0->4194303) 00002000:00010000:0.0:1651529921.665649:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000870c23d5 00000100:00100000:0.0:1651529921.760153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529921.760170:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841664 00000100:00100000:0.0:1651529921.760201:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 52 00000100:00100000:0.0:1651529921.760203:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946841664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529921.760218:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 17130432 pending 32768 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529921.760247:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946841664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529921.760251:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 52 00000100:00100000:0.0:1651529921.900480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.900509:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353149760 00000100:00100000:1.0:1651529921.900536:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 828 00000100:00100000:1.0:1651529921.900539:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:451137:x1731754353149760:12345-10.240.43.64@tcp:9:umount.0 00000020:00000080:1.0:1651529921.900556:0:194455:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c31d3 00000020:00010000:1.0:1651529921.900568:0:194455:0:(genops.c:1857:obd_stale_export_put()) Put export 000000002462372a: total 1 00000100:00080000:1.0:1651529921.900570:0:194455:0:(import.c:85:import_set_state_nolock()) 000000006b1932d0 Ææ»Žÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529921.900593:0:194455:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654706467 00000100:00100000:1.0:1651529921.900658:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:451137:x1731754353149760:12345-10.240.43.64@tcp:9:umount.0 Request processed in 118us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.900662:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 828 00000020:00010000:1.0:1651529921.900679:0:176858:0:(genops.c:1843:obd_stale_export_get()) Get export 000000002462372a: total 1 00010000:00010000:1.0:1651529921.900687:0:176858:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export 000000002462372a, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1651529921.900721:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31e8 lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7726 expref: 5 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529921.900731:0:176858:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export 000000002462372a, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1651529921.987418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529921.987446:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353154304 00000100:00100000:1.0:1651529921.987467:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 829 00000100:00100000:1.0:1651529921.987469:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:438145:x1731754353154304:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:1.0:1651529921.987484:0:194455:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp t0 exp 0000000002beaa81 cur 13521 last 0 00000020:00000080:1.0:1651529921.987498:0:194455:0:(genops.c:1359:class_connect()) connect: client cccc371e-feb6-4a45-b229-8d88a861b48a, cookie 0xa29a79078f3c31ef 00002000:00100000:1.0:1651529921.987503:0:194455:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli cccc371e-feb6-4a45-b229-8d88a861b48a/000000006487e25e ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529921.987507:0:194455:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529921.987535:0:194455:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651529921.987538:0:194455:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651529921.987550:0:194455:0:(import.c:85:import_set_state_nolock()) 000000008046fc10 Ææ»Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529921.987575:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438145:x1731754353154304:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529921.987579:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 829 00000100:00100000:0.0:1651529922.021139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.021150:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353154624 00000100:00100000:0.0:1651529922.021163:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:0.0:1651529922.021165:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451194:x1731754353154624:12345-10.240.43.64@tcp:13:df.0 00002000:00000024:0.0:1651529922.021173:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8725440 pending 32768 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529922.021201:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451194:x1731754353154624:12345-10.240.43.64@tcp:13:df.0 Request processed in 35us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529922.021204:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:0.0:1651529922.084972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.084995:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353154944 00000100:00100000:1.0:1651529922.085012:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 830 00000100:00100000:1.0:1651529922.085014:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353154944:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651529922.085019:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.085029:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f77b9 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529922.085053:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 6096, mtime: 0x627058c1, atime: 0x0, ctime: 0x627058c1, blocks: 0x10 00010000:00010000:1.0:1651529922.085061:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.085061:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.085066:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.085073:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.085079:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033a35c44, rc 0) 00000100:00100000:1.0:1651529922.085092:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353154944:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 77us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.085095:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 830 00000100:00100000:0.0:1651529922.086963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.086973:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155072 00002000:00100000:0.0:1651529922.086984:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@000000007aa9f6c5 x1731754353155072/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:653/0 lens 488/0 e 0 to 0 dl 1651529933 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651529922.086990:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007aa9f6c5 with x1731754353155072 ext(0->4194303) 00002000:00010000:0.0:1651529922.086992:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007aa9f6c5 00000100:00100000:0.0:1651529922.086999:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651529922.087001:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353155072:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651529922.087541:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007aa9f6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353155072:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 538us (577us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529922.087546:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00002000:00100000:0.0:1651529922.087549:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@000000007aa9f6c5 x1731754353155072/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:653/0 lens 488/440 e 0 to 0 dl 1651529933 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651529922.087553:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007aa9f6c5 with x1731754353155072 ext(0->4194303) 00002000:00010000:0.0:1651529922.087555:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007aa9f6c5 00000100:00100000:1.0:1651529922.093550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.093559:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155456 00000100:00100000:1.0:1651529922.093573:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 831 00000100:00100000:1.0:1651529922.093576:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451197:x1731754353155456:12345-10.240.43.64@tcp:101:truncate.0 00010000:00010000:1.0:1651529922.093580:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.093585:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 2/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f77c7 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.093594:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 2/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.093598:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.093599:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.093600:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 4/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.093613:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.093618:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.093624:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529922.093647:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 11 seconds 00000100:00100000:1.0:1651529922.093884:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529922.093892:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 3/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.093898:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea47ebc4, rc 0) 00000100:00100000:1.0:1651529922.093912:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451197:x1731754353155456:12345-10.240.43.64@tcp:101:truncate.0 Request processed in 336us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.093916:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 831 00000100:00100000:1.0:1651529922.094991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.095001:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155520 00010000:00010000:1.0:1651529922.095007:0:176856:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.095022:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529922.095024:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353155520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529922.095028:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529922.095033:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.095038:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.095053:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c31f6 lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77b9 expref: 8 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.095057:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.095058:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.095059:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.095062:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.095072:0:176856:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529922.095076:0:176856:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730368:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651529922.095093:0:176856:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 6 seconds 00000100:00100000:1.0:1651529922.095299:0:176856:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d610303 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730368:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651529922.095304:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.095316:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353155520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 291us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.095319:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651529922.095352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.095361:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155584 00002000:00010000:0.0:1651529922.095368:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179875/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651529922.095369:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731754353155584 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651529922.095373:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd. 00000100:00100000:0.0:1651529922.095378:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:0.0:1651529922.095380:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353155584:12345-10.240.43.64@tcp:10:truncate.0 00000001:00080000:1.0:1651529922.125887:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706468 is committed 00000001:00100000:1.0:1651529922.125891:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cccc371e-feb6-4a45-b229-8d88a861b48a 00000001:00100000:1.0:1651529922.125892:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000001:00080000:1.0:1651529922.125894:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706467 is committed 00000020:00000080:1.0:1651529922.125896:0:176850:0:(genops.c:985:class_export_put()) final put 000000002462372a/ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:0.0:1651529922.125925:0:188427:0:(genops.c:944:class_export_destroy()) destroying export 000000002462372a/ec96cd77-f6e5-48c2-876b-61a646cc1c34 for lustre-OST0000 00000020:00000080:0.0:1651529922.125942:0:188427:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000006b1932d0 for lustre-OST0000 00002000:00010000:0.0:1651529922.126021:0:176870:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb size from disk: 6096 -> 6000 00002000:00010000:0.0:1651529922.126022:0:176870:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb mtime from disk: 1651529921 -> 1651529922 00002000:00010000:0.0:1651529922.126024:0:176870:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529922.126024:0:176870:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb ctime from disk: 1651529921 -> 1651529922 00002000:00010000:0.0:1651529922.126025:0:176870:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:0.0:1651529922.126049:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000528e2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353155584:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 30659us (30688us total) trans 38654706468 rc 0/0 00000100:00100000:0.0:1651529922.126054:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00002000:00010000:0.0:1651529922.126055:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179875/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651529922.126056:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000528e2dbd with x1731754353155584 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651529922.126058:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000528e2dbd. 00000100:00100000:1.0:1651529922.129946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.129955:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155648 00000100:00100000:1.0:1651529922.129971:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529922.129973:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451154:x1731754353155648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529922.129976:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529922.129984:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c31fd lrc: 0/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77c7 expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.129990:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.130002:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:451154:x1731754353155648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.130005:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529922.136993:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.137001:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353155968 00000100:00100000:1.0:1651529922.137013:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 832 00000100:00100000:1.0:1651529922.137015:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438148:x1731754353155968:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651529922.137019:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.137023:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f77dc expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529922.137046:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 6000, mtime: 0x627058c2, atime: 0x0, ctime: 0x627058c2, blocks: 0x10 00010000:00010000:1.0:1651529922.137051:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.137052:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.137054:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 6 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.137059:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 6 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.137063:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea47ebc4, rc 0) 00000100:00100000:1.0:1651529922.137078:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353155968:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 62us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.137081:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 832 00000100:00100000:1.0:1651529922.138957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.138980:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156096 00002000:00100000:0.0:1651529922.138989:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@00000000949e31c0 x1731754353156096/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651529922.138993:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000949e31c0 with x1731754353156096 ext(0->4194303) 00002000:00010000:0.0:1651529922.138995:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000949e31c0 00000100:00100000:0.0:1651529922.139001:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529922.139003:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353156096:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651529922.140001:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000949e31c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353156096:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 996us (1043us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529922.140004:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00002000:00100000:0.0:1651529922.140007:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@00000000949e31c0 x1731754353156096/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/440 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651529922.140011:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000949e31c0 with x1731754353156096 ext(0->4194303) 00002000:00010000:0.0:1651529922.140013:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000949e31c0 00000100:00100000:1.0:1651529922.142552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.142561:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156480 00000100:00100000:1.0:1651529922.142573:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 833 00000100:00100000:1.0:1651529922.142575:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:450964:x1731754353156480:12345-10.240.43.64@tcp:101:bash.0 00010000:00010000:1.0:1651529922.142579:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.142584:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 2/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f77ea expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.142591:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 2/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.142594:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.142603:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.142604:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 4/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.142614:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.142618:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.142623:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529922.142642:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 6 seconds 00000100:00100000:1.0:1651529922.142857:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040519434 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529922.142863:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 3/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.142869:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033a35c44, rc 0) 00000100:00100000:1.0:1651529922.142881:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:450964:x1731754353156480:12345-10.240.43.64@tcp:101:bash.0 Request processed in 305us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.142884:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 833 00000100:00100000:1.0:1651529922.143919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.143927:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156544 00010000:00010000:1.0:1651529922.143932:0:176856:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.143946:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529922.143948:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353156544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529922.143958:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529922.143963:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.143967:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.143974:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3204 lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77dc expref: 7 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.143978:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.143978:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.143980:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.143983:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.143992:0:176856:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529922.143996:0:176856:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac62fc72 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730496:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651529922.144012:0:176856:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 6 seconds 00000100:00100000:1.0:1651529922.144207:0:176856:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac62fc72 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730496:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651529922.144211:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.144223:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353156544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 275us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.144233:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529922.144351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.144367:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156672 00002000:00100000:0.0:1651529922.144375:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->8191) req@00000000ac62fc72 x1731754353156672/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651529922.144379:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ac62fc72 with x1731754353156672 ext(4096->8191) 00002000:00010000:0.0:1651529922.144381:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ac62fc72 00000100:00100000:0.0:1651529922.144387:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:0.0:1651529922.144389:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353156672:12345-10.240.43.64@tcp:3:bash.0 00000100:00100000:0.0:1651529922.144415:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac62fc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353156672:12345-10.240.43.64@tcp:3:bash.0 Request processed in 26us (64us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1651529922.144420:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00002000:00100000:0.0:1651529922.144422:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->8191) req@00000000ac62fc72 x1731754353156672/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/4536 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 4096/4096 job:'bash.0' 00002000:00100000:0.0:1651529922.144426:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ac62fc72 with x1731754353156672 ext(4096->8191) 00002000:00010000:0.0:1651529922.144427:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ac62fc72 00000100:00100000:1.0:1651529922.147976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.148003:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156736 00002000:00100000:0.0:1651529922.148015:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->6005) req@00000000d462b184 x1731754353156736/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 2400/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651529922.148019:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d462b184 with x1731754353156736 ext(4096->6005) 00002000:00010000:0.0:1651529922.148020:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d462b184 00000100:00100000:0.0:1651529922.148027:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:0.0:1651529922.148028:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353156736:12345-10.240.43.64@tcp:4:bash.0 00000100:00100000:0.0:1651529922.148606:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d462b184 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353156736:12345-10.240.43.64@tcp:4:bash.0 Request processed in 576us (630us total) trans 38654706469 rc 0/0 00000100:00100000:0.0:1651529922.148610:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00002000:00100000:0.0:1651529922.148613:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->6005) req@00000000d462b184 x1731754353156736/t38654706469(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 2400/448 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 0/0 job:'bash.0' 00002000:00100000:0.0:1651529922.148617:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d462b184 with x1731754353156736 ext(4096->6005) 00002000:00010000:0.0:1651529922.148618:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d462b184 00000100:00100000:1.0:1651529922.148863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.148872:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353156800 00000100:00100000:1.0:1651529922.148887:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529922.148889:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754353156800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529922.148893:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651529922.148896:0:176856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb size from disk: 6000 -> 6006 00010000:00010000:1.0:1651529922.148901:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c320b lrc: 0/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f77ea expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.148906:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.148918:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754353156800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.148921:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529922.156492:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.156500:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157312 00000100:00100000:1.0:1651529922.156512:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 834 00000100:00100000:1.0:1651529922.156514:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353157312:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651529922.156518:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.156521:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7806 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529922.156526:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 6006, mtime: 0x627058c2, atime: 0x0, ctime: 0x627058c2, blocks: 0x10 00010000:00010000:1.0:1651529922.156530:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.156539:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.156540:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.156546:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 8 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.156550:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033a35c44, rc 0) 00000100:00100000:1.0:1651529922.156564:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353157312:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 50us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.156567:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 834 00000100:00100000:1.0:1651529922.158371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.158394:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157440 00002000:00100000:0.0:1651529922.158403:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@000000006d610303 x1731754353157440/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651529922.158407:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d610303 with x1731754353157440 ext(0->4194303) 00002000:00010000:0.0:1651529922.158408:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d610303 00000100:00100000:0.0:1651529922.158415:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:0.0:1651529922.158416:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353157440:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651529922.158851:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d610303 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353157440:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 434us (480us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529922.158855:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00002000:00100000:0.0:1651529922.158858:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@000000006d610303 x1731754353157440/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/440 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651529922.158861:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d610303 with x1731754353157440 ext(0->4194303) 00002000:00010000:0.0:1651529922.158862:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d610303 00000100:00100000:1.0:1651529922.161087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.161095:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157696 00000100:00100000:1.0:1651529922.161107:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 835 00000100:00100000:1.0:1651529922.161109:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:450964:x1731754353157696:12345-10.240.43.64@tcp:101:bash.0 00010000:00010000:1.0:1651529922.161113:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.161117:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 2/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7814 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.161125:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 2/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.161128:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.161129:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.161130:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 4/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 9 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.161150:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.161155:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.161159:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4b187e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529922.161178:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 6 seconds 00000100:00100000:1.0:1651529922.161358:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4b187e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529922.161364:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 3/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 9 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.161369:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea47ebc4, rc 0) 00000100:00100000:1.0:1651529922.161385:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:450964:x1731754353157696:12345-10.240.43.64@tcp:101:bash.0 Request processed in 275us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.161388:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 835 00000100:00100000:1.0:1651529922.162450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.162459:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157760 00010000:00010000:1.0:1651529922.162464:0:176856:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00000100:00100000:1.0:1651529922.162478:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529922.162479:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754353157760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529922.162482:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529922.162493:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.162498:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.162504:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3212 lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7806 expref: 9 pid: 194455 timeout: 13671 lvb_type: 1 00010000:00010000:1.0:1651529922.162508:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.162509:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.162510:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.162513:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.162522:0:176856:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529922.162526:0:176856:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9ee32db pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730624:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651529922.162543:0:176856:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bc7f3875 going to sleep for 6 seconds 00000100:00100000:1.0:1651529922.162745:0:176856:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9ee32db pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:176856:1731745966730624:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651529922.162749:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.162761:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353157760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 281us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.162764:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529922.162872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.162883:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157888 00002000:00100000:0.0:1651529922.162891:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->8191) req@00000000a9ee32db x1731754353157888/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651529922.162895:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9ee32db with x1731754353157888 ext(4096->8191) 00002000:00010000:0.0:1651529922.162896:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9ee32db 00000100:00100000:0.0:1651529922.162902:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651529922.162903:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353157888:12345-10.240.43.64@tcp:3:bash.0 00000100:00100000:0.0:1651529922.162928:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ee32db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353157888:12345-10.240.43.64@tcp:3:bash.0 Request processed in 24us (57us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1651529922.162931:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00002000:00100000:0.0:1651529922.162933:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->8191) req@00000000a9ee32db x1731754353157888/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/4536 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 4096/4096 job:'bash.0' 00002000:00100000:0.0:1651529922.162937:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9ee32db with x1731754353157888 ext(4096->8191) 00002000:00010000:0.0:1651529922.162938:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9ee32db 00000100:00100000:1.0:1651529922.166436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.166460:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353157952 00002000:00100000:0.0:1651529922.166468:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->6011) req@00000000634ba2f4 x1731754353157952/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 2408/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651529922.166472:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000634ba2f4 with x1731754353157952 ext(4096->6011) 00002000:00010000:0.0:1651529922.166473:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000634ba2f4 00000100:00100000:0.0:1651529922.166479:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651529922.166481:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353157952:12345-10.240.43.64@tcp:4:bash.0 00000100:00100000:0.0:1651529922.166753:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000634ba2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353157952:12345-10.240.43.64@tcp:4:bash.0 Request processed in 271us (317us total) trans 38654706470 rc 0/0 00000100:00100000:0.0:1651529922.166757:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00002000:00100000:0.0:1651529922.166760:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (4096->6011) req@00000000634ba2f4 x1731754353157952/t38654706470(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 2408/448 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 0/0 job:'bash.0' 00002000:00100000:0.0:1651529922.166763:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000634ba2f4 with x1731754353157952 ext(4096->6011) 00002000:00010000:0.0:1651529922.166765:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000634ba2f4 00000100:00100000:1.0:1651529922.166967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.166975:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353158016 00000100:00100000:1.0:1651529922.166988:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529922.166990:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451154:x1731754353158016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529922.166990:0:176855:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 40 00010000:00010000:1.0:1651529922.166993:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529922.166994:0:176855:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00002000:00010000:1.0:1651529922.166997:0:176856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea3:0x0] updating lvb size from disk: 6006 -> 6012 00010000:00010000:1.0:1651529922.167002:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3219 lrc: 0/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7814 expref: 10 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529922.167007:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529922.167019:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451154:x1731754353158016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.167022:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529922.175361:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529922.175369:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353158336 00000100:00100000:1.0:1651529922.175381:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 836 00000100:00100000:1.0:1651529922.175383:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353158336:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651529922.175387:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529922.175391:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 2/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7822 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529922.175396:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea3:0x0] initial LVB size: 6012, mtime: 0x627058c2, atime: 0x0, ctime: 0x627058c2, blocks: 0x10 00010000:00010000:1.0:1651529922.175400:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.175401:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529922.175402:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.175415:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529922.175420:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea47ebc4, rc 0) 00000100:00100000:1.0:1651529922.175434:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353158336:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 50us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529922.175437:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 836 00000100:00100000:1.0:1651529922.177318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.177342:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353158464 00002000:00100000:0.0:1651529922.177352:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@0000000037c77544 x1731754353158464/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/0 e 0 to 0 dl 1651529928 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651529922.177356:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037c77544 with x1731754353158464 ext(0->4194303) 00002000:00010000:0.0:1651529922.177357:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037c77544 00000100:00100000:0.0:1651529922.177364:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:0.0:1651529922.177365:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353158464:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651529922.177760:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037c77544 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353158464:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 393us (441us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529922.177765:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00002000:00100000:0.0:1651529922.177768:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea3:0x0] (0->4194303) req@0000000037c77544 x1731754353158464/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:648/0 lens 488/440 e 0 to 0 dl 1651529928 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651529922.177771:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037c77544 with x1731754353158464 ext(0->4194303) 00002000:00010000:0.0:1651529922.177773:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037c77544 00000100:00100000:0.0:1651529923.741930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529923.741967:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842048 00000100:00100000:1.0:1651529923.741995:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 837 00000100:00100000:1.0:1651529923.741998:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529923.742014:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179875 count 1 00010000:00010000:1.0:1651529923.742028:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529923.742038:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 2/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 9 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529923.742056:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529923.742057:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529923.742058:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 4/0,1 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529923.742074:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 9 pid: 194455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529923.742092:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 9 pid: 194455 timeout: 13673 lvb_type: 1 00000100:00100000:1.0:1651529923.742099:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000439507df pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529923.742129:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd7fa1ac going to sleep for 6 seconds 00000100:00100000:0.0:1651529923.742464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529923.742481:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000439507df pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529923.742481:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353158784 00010000:00010000:1.0:1651529923.742488:0:194455:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742492:0:195164:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 13673 lvb_type: 1 00000100:00100000:0.0:1651529923.742504:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:0.0:1651529923.742506:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353158784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529923.742511:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529923.742513:0:195164:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 4/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 13673 lvb_type: 1 00010000:00010000:0.0:1651529923.742518:0:195164:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 3/0,0 mode: PR/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 13673 lvb_type: 1 00010000:00010000:0.0:1651529923.742528:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3220 lrc: 0/0,0 mode: --/PR res: [0x2bea3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7822 expref: 10 pid: 194455 timeout: 13673 lvb_type: 1 00010000:00010000:0.0:1651529923.742533:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529923.742534:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529923.742535:0:195164:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742540:0:195164:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 4/0,1 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742552:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529923.742563:0:194455:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529923.742566:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353158784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529923.742570:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00010000:00010000:1.0:1651529923.742571:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529923.742575:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,1 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529923.742578:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742832:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742837:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529923.742839:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 2/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742842:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 3/0,0 mode: PW/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742848:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 1/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529923.742851:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3227 lrc: 0/0,0 mode: --/PW res: [0x2bea3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529923.743129:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946842048:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1129us (1202us total) trans 38654706471 rc 0/0 00000100:00100000:1.0:1651529923.743133:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 837 00000100:00100000:0.0:1651529926.880188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529926.880204:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842240 00000100:00100000:0.0:1651529926.880223:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 54 00000100:00100000:0.0:1651529926.880226:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946842240:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529926.880242:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 25568192 pending 57344 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529926.880264:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946842240:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529926.880268:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 54 00000001:00080000:1.0:1651529928.435374:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706471 is committed 00000001:00080000:1.0:1651529928.435379:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706470 is committed 00000100:00100000:0.0:1651529930.976197:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529930.976228:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842304 00000100:00100000:1.0:1651529930.976254:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529930.976257:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842304:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529930.976291:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842304:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529930.976295:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529931.452871:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088e71ac2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966730752:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529931.452874:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d3bbd7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966730816:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529931.453524:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088e71ac2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966730752:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529931.453526:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d3bbd7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966730816:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529932.000164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529932.000186:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842432 00000100:00100000:0.0:1651529932.000202:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 55 00000100:00100000:0.0:1651529932.000204:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529932.000219:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 25510848 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529932.000235:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529932.000239:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 55 00000400:00000080:0.0:1651529932.911303:0:195379:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529932.911307:0:195379:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 22:18:52 (1651529932) 00000100:00100000:1.0:1651529937.120175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529937.120207:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842624 00000100:00100000:0.0:1651529937.120232:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 56 00000100:00100000:0.0:1651529937.120234:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529937.120253:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 25510848 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529937.120279:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529937.120283:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 56 00000100:00100000:1.0:1651529942.240161:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529942.240186:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842752 00000100:00100000:0.0:1651529942.240209:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 57 00000100:00100000:0.0:1651529942.240211:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842752:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529942.240228:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 25510848 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529942.240254:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946842752:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529942.240257:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 57 00000400:00000080:1.0:1651529944.547200:0:195651:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529944.547202:0:195651:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 22:19:04 (1651529944) 00000100:00100000:1.0:1651529944.798958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529944.798976:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353164672 00000100:00100000:1.0:1651529944.799002:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 838 00000100:00100000:1.0:1651529944.799004:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754353164672:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651529944.799110:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353164672:12345-10.240.43.64@tcp:2:touch.0 Request processed in 105us (155us total) trans 38654706472 rc 0/0 00000100:00100000:1.0:1651529944.799114:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 838 00000100:00100000:1.0:1651529944.805700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529944.805708:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165184 00000100:00100000:1.0:1651529944.805722:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 839 00000100:00100000:1.0:1651529944.805724:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:453244:x1731754353165184:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529944.805729:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529944.805739:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 2/0,0 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f786f expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529944.805747:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea4:0x0] initial LVB size: 0, mtime: 0x627058d8, atime: 0x627058d8, ctime: 0x627058d8, blocks: 0x0 00010000:00010000:1.0:1651529944.805755:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529944.805756:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529944.805760:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 3/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529944.805767:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 3/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529944.805772:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a2fed4bc, rc 0) 00000100:00100000:1.0:1651529944.805787:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:453244:x1731754353165184:12345-10.240.43.64@tcp:101:dd.0 Request processed in 63us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529944.805791:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 839 00000100:00100000:1.0:1651529944.806004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.806018:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165248 00002000:00010000:0.0:1651529944.806030:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529944.806031:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d9c52bb with x1731754353165248 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529944.806036:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d9c52bb. 00000100:00100000:0.0:1651529944.806045:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651529944.806047:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353165248:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529944.806095:0:176870:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529944.806097:0:176870:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb mtime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529944.806098:0:176870:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb atime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529944.806099:0:176870:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb ctime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529944.806100:0:176870:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529944.806115:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9c52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353165248:12345-10.240.43.64@tcp:10:dd.0 Request processed in 67us (111us total) trans 38654706473 rc 0/0 00000100:00100000:0.0:1651529944.806118:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00002000:00010000:0.0:1651529944.806119:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529944.806120:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d9c52bb with x1731754353165248 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529944.806122:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006d9c52bb. 00000100:00100000:1.0:1651529944.845396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.845415:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165376 00002000:00100000:0.0:1651529944.845429:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->4194303) req@000000002cb30376 x1731754353165376/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/0 e 0 to 0 dl 1651529950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529944.845434:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002cb30376 with x1731754353165376 ext(0->4194303) 00002000:00010000:0.0:1651529944.845436:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002cb30376 00000100:00100000:0.0:1651529944.845444:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:0.0:1651529944.845446:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353165376:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529944.876622:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cb30376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353165376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 31172us (31223us total) trans 38654706474 rc 0/0 00000100:00100000:0.0:1651529944.876629:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00002000:00100000:0.0:1651529944.876636:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->4194303) req@000000002cb30376 x1731754353165376/t38654706474(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/448 e 0 to 0 dl 1651529950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529944.876642:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002cb30376 with x1731754353165376 ext(0->4194303) 00002000:00010000:0.0:1651529944.876645:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002cb30376 00000100:00100000:0.0:1651529944.884486:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.884497:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165504 00002000:00100000:0.0:1651529944.884512:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (4194304->8388607) req@0000000088e71ac2 x1731754353165504/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/0 e 0 to 0 dl 1651529950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529944.884516:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731754353165504 ext(4194304->8388607) 00002000:00010000:0.0:1651529944.884518:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:0.0:1651529944.884532:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651529944.884534:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353165504:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529944.889649:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088e71ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353165504:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5111us (5160us total) trans 38654706475 rc 0/0 00000100:00100000:0.0:1651529944.889656:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00002000:00100000:0.0:1651529944.889663:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (4194304->8388607) req@0000000088e71ac2 x1731754353165504/t38654706475(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/448 e 0 to 0 dl 1651529950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529944.889668:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088e71ac2 with x1731754353165504 ext(4194304->8388607) 00002000:00010000:0.0:1651529944.889671:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000088e71ac2 00000100:00100000:0.0:1651529944.916419:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.916431:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165632 00002000:00100000:0.0:1651529944.916446:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (8388608->12582911) req@00000000bd6e46f6 x1731754353165632/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/0 e 0 to 0 dl 1651529950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529944.916451:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731754353165632 ext(8388608->12582911) 00002000:00010000:0.0:1651529944.916452:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:0.0:1651529944.916466:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:0.0:1651529944.916468:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438147:x1731754353165632:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529944.924675:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6e46f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438147:x1731754353165632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8202us (8253us total) trans 38654706476 rc 0/0 00000100:00100000:0.0:1651529944.924682:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00002000:00100000:0.0:1651529944.924688:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (8388608->12582911) req@00000000bd6e46f6 x1731754353165632/t38654706476(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/448 e 0 to 0 dl 1651529950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529944.924693:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bd6e46f6 with x1731754353165632 ext(8388608->12582911) 00002000:00010000:0.0:1651529944.924696:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bd6e46f6 00000100:00100000:0.0:1651529944.957391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.957404:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165760 00002000:00100000:0.0:1651529944.957419:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (12582912->16777215) req@000000001d3bbd7f x1731754353165760/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/0 e 0 to 0 dl 1651529950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529944.957423:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731754353165760 ext(12582912->16777215) 00002000:00010000:0.0:1651529944.957425:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00000100:00100000:0.0:1651529944.957439:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651529944.957441:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438147:x1731754353165760:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529944.968060:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3bbd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+16:438147:x1731754353165760:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10608us (10660us total) trans 38654706477 rc 0/0 00000100:00100000:0.0:1651529944.968068:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00002000:00100000:0.0:1651529944.968074:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (12582912->16777215) req@000000001d3bbd7f x1731754353165760/t38654706477(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/448 e 0 to 0 dl 1651529950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529944.968079:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d3bbd7f with x1731754353165760 ext(12582912->16777215) 00002000:00010000:0.0:1651529944.968082:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d3bbd7f 00000100:00100000:0.0:1651529944.998255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529944.998267:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353165888 00002000:00100000:0.0:1651529944.998282:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (16777216->20971519) req@00000000d4277c50 x1731754353165888/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/0 e 0 to 0 dl 1651529950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529944.998287:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4277c50 with x1731754353165888 ext(16777216->20971519) 00002000:00010000:0.0:1651529944.998288:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4277c50 00000100:00100000:0.0:1651529944.998304:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651529944.998306:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+16:438147:x1731754353165888:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529945.006990:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438147:x1731754353165888:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8680us (8733us total) trans 38654706478 rc 0/0 00000100:00100000:0.0:1651529945.006997:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00002000:00100000:0.0:1651529945.007003:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (16777216->20971519) req@00000000d4277c50 x1731754353165888/t38654706478(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:670/0 lens 488/448 e 0 to 0 dl 1651529950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529945.007008:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4277c50 with x1731754353165888 ext(16777216->20971519) 00002000:00010000:0.0:1651529945.007012:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4277c50 00000100:00100000:0.0:1651529945.007678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529945.007689:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166080 00002000:00010000:0.0:1651529945.007700:0:176869:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529945.007701:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095fdfa67 with x1731754353166080 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529945.007707:0:176869:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095fdfa67. 00000100:00100000:0.0:1651529945.007720:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:0.0:1651529945.007722:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438148:x1731754353166080:12345-10.240.43.64@tcp:10:bash.0 00002000:00010000:0.0:1651529945.009530:0:176869:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529945.009532:0:176869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb mtime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529945.009533:0:176869:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb atime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529945.009534:0:176869:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb ctime from disk: 1651529944 -> 1651529944 00002000:00010000:0.0:1651529945.009535:0:176869:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529945.009554:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095fdfa67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438148:x1731754353166080:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1831us (1876us total) trans 38654706479 rc 0/0 00000100:00100000:0.0:1651529945.009558:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00002000:00010000:0.0:1651529945.009559:0:176869:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529945.009560:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095fdfa67 with x1731754353166080 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529945.009562:0:176869:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095fdfa67. 00000100:00100000:0.0:1651529945.038968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529945.038994:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166144 00000100:00100000:1.0:1651529945.039014:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 840 00000100:00100000:1.0:1651529945.039017:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438147:x1731754353166144:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529945.039118:0:194455:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:1.0:1651529945.039119:0:194455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb mtime from disk: 1651529944 -> 1651529944 00002000:00010000:1.0:1651529945.039120:0:194455:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb atime from disk: 1651529944 -> 1651529944 00002000:00010000:1.0:1651529945.039121:0:194455:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb ctime from disk: 1651529944 -> 1651529944 00002000:00010000:1.0:1651529945.039123:0:194455:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb blocks from disk: 0 -> 40960 00000100:00100000:1.0:1651529945.039138:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+20:438147:x1731754353166144:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 121us (171us total) trans 38654706480 rc 0/0 00000100:00100000:1.0:1651529945.039142:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 840 00000100:00100000:0.0:1651529945.089617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529945.089638:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166272 00000100:00100000:1.0:1651529945.089651:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 841 00000100:00100000:1.0:1651529945.089653:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+20:438146:x1731754353166272:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529945.488043:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706480 is committed 00000100:00100000:1.0:1651529945.488088:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353166272:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 398434us (398472us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529945.488093:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 841 00000100:00100000:0.0:1651529945.494701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529945.494712:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166784 00002000:00100000:0.0:1651529945.494725:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->32767) req@000000000ed299f6 x1731754353166784/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:0.0:1651529945.494730:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ed299f6 with x1731754353166784 ext(0->32767) 00002000:00010000:0.0:1651529945.494732:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000ed299f6 00000100:00100000:0.0:1651529945.494744:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:0.0:1651529945.494746:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353166784:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529945.495088:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ed299f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353166784:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 340us (387us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1651529945.495092:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00002000:00100000:0.0:1651529945.495095:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->32767) req@000000000ed299f6 x1731754353166784/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0' 00002000:00100000:0.0:1651529945.495099:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ed299f6 with x1731754353166784 ext(0->32767) 00002000:00010000:0.0:1651529945.495101:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000ed299f6 00000100:00100000:0.0:1651529945.502602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529945.502610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529945.502623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529945.502629:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529945.502634:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166976 00000100:00100000:0.0:1651529945.502635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:1.0:1651529945.502644:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (4227072->8421375) req@0000000091a9a810 x1731754353166976/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529945.502649:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091a9a810 with x1731754353166976 ext(4227072->8421375) 00002000:00010000:1.0:1651529945.502651:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000091a9a810 00000100:00100000:0.0:1651529945.502651:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167104 00000100:00100000:1.0:1651529945.502655:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353166912 00002000:00100000:0.0:1651529945.502658:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (12615680->16809983) req@000000002ee0cee8 x1731754353167104/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529945.502659:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (32768->4227071) req@000000000ac90bbd x1731754353166912/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529945.502663:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ac90bbd with x1731754353166912 ext(32768->4227071) 00002000:00100000:0.0:1651529945.502663:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ee0cee8 with x1731754353167104 ext(12615680->16809983) 00002000:00010000:1.0:1651529945.502664:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000ac90bbd 00002000:00010000:0.0:1651529945.502664:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ee0cee8 00000100:00100000:1.0:1651529945.502666:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167040 00002000:00100000:1.0:1651529945.502669:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (8421376->12615679) req@00000000b4f01c8d x1731754353167040/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529945.502672:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b4f01c8d with x1731754353167040 ext(8421376->12615679) 00002000:00010000:1.0:1651529945.502673:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b4f01c8d 00000100:00100000:0.0:1651529945.502674:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167168 00000100:00100000:1.0:1651529945.502676:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:1.0:1651529945.502678:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353166976:12345-10.240.43.64@tcp:3:md5sum.0 00002000:00100000:0.0:1651529945.502678:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (16809984->20971519) req@0000000023757f5b x1731754353167168/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/0 e 0 to 0 dl 1651529951 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:0.0:1651529945.502681:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023757f5b with x1731754353167168 ext(16809984->20971519) 00002000:00010000:0.0:1651529945.502683:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000023757f5b 00000100:00100000:1.0:1651529945.509549:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a9a810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353166976:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 6868us (6946us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651529945.509554:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00002000:00100000:1.0:1651529945.509559:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (4227072->8421375) req@0000000091a9a810 x1731754353166976/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:1.0:1651529945.509564:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091a9a810 with x1731754353166976 ext(4227072->8421375) 00002000:00010000:1.0:1651529945.509566:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000091a9a810 00000100:00100000:1.0:1651529945.509585:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:1.0:1651529945.509588:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353166912:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:1.0:1651529945.514413:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ac90bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353166912:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 4823us (11788us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651529945.514418:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 20 00002000:00100000:1.0:1651529945.514423:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (32768->4227071) req@000000000ac90bbd x1731754353166912/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:1.0:1651529945.514428:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ac90bbd with x1731754353166912 ext(32768->4227071) 00002000:00010000:1.0:1651529945.514430:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000ac90bbd 00000100:00100000:1.0:1651529945.514438:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:1.0:1651529945.514440:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353167104:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:1.0:1651529945.525766:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee0cee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353167104:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 11323us (23152us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651529945.525774:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 21 00002000:00100000:1.0:1651529945.525779:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (12615680->16809983) req@000000002ee0cee8 x1731754353167104/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:1.0:1651529945.525784:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ee0cee8 with x1731754353167104 ext(12615680->16809983) 00002000:00010000:1.0:1651529945.525787:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ee0cee8 00000100:00100000:1.0:1651529945.525816:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 22 00000100:00100000:1.0:1651529945.525818:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353167040:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:1.0:1651529945.529513:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353167040:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 3692us (26881us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651529945.529519:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 22 00002000:00100000:1.0:1651529945.529524:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (8421376->12615679) req@00000000b4f01c8d x1731754353167040/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:1.0:1651529945.529528:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b4f01c8d with x1731754353167040 ext(8421376->12615679) 00002000:00010000:1.0:1651529945.529530:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b4f01c8d 00000100:00100000:1.0:1651529945.529540:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 23 00000100:00100000:1.0:1651529945.529542:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353167168:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:1.0:1651529945.537415:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023757f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353167168:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 7869us (34777us total) trans 0 rc 4161536/4161536 00000100:00100000:1.0:1651529945.537422:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 23 00002000:00100000:1.0:1651529945.537427:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (16809984->20971519) req@0000000023757f5b x1731754353167168/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:671/0 lens 488/440 e 0 to 0 dl 1651529951 ref 1 fl Complete:/0/0 rc 4161536/4161536 job:'md5sum.0' 00002000:00100000:1.0:1651529945.537432:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023757f5b with x1731754353167168 ext(16809984->20971519) 00002000:00010000:1.0:1651529945.537435:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000023757f5b 00000100:00100000:0.0:1651529946.014640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529946.014667:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167616 00002000:00010000:1.0:1651529946.014686:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529946.014688:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006bb38036 with x1731754353167616 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529946.014695:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006bb38036. 00000100:00100000:1.0:1651529946.014712:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 24 00000100:00100000:1.0:1651529946.014715:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353167616:12345-10.240.43.64@tcp:10:bash.0 00002000:00010000:1.0:1651529946.016584:0:176870:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb size from disk: 20971520 -> 0 00002000:00010000:1.0:1651529946.016586:0:176870:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb mtime from disk: 1651529944 -> 1651529946 00002000:00010000:1.0:1651529946.016587:0:176870:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb atime from disk: 1651529944 -> 1651529944 00002000:00010000:1.0:1651529946.016588:0:176870:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb ctime from disk: 1651529944 -> 1651529946 00002000:00010000:1.0:1651529946.016589:0:176870:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb blocks from disk: 40960 -> 0 00000100:00100000:1.0:1651529946.016620:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb38036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353167616:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1904us (1982us total) trans 38654706481 rc 0/0 00000100:00100000:1.0:1651529946.016624:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 24 00002000:00010000:1.0:1651529946.016625:0:176870:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179876/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529946.016626:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006bb38036 with x1731754353167616 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529946.016628:0:176870:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006bb38036. 00000100:00100000:0.0:1651529946.023325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529946.023350:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167680 00000100:00100000:1.0:1651529946.023365:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 842 00000100:00100000:1.0:1651529946.023367:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353167680:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529946.040728:0:194455:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:1.0:1651529946.040732:0:194455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb mtime from disk: 1651529946 -> 1651529946 00002000:00010000:1.0:1651529946.040733:0:194455:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb atime from disk: 1651529944 -> 1651529944 00002000:00010000:1.0:1651529946.040734:0:194455:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb ctime from disk: 1651529946 -> 1651529946 00002000:00010000:1.0:1651529946.040736:0:194455:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea4:0x0] updating lvb blocks from disk: 0 -> 40960 00000100:00100000:1.0:1651529946.040777:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353167680:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 17408us (17452us total) trans 38654706482 rc 0/0 00000100:00100000:1.0:1651529946.040785:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 842 00000100:00100000:0.0:1651529946.041640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529946.041672:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353167808 00000100:00100000:1.0:1651529946.041693:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 843 00000100:00100000:1.0:1651529946.041696:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353167808:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529946.392836:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706482 is committed 00000100:00100000:1.0:1651529946.392867:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353167808:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 351170us (351228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529946.392871:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 843 00000100:00100000:0.0:1651529946.398091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529946.398113:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168192 00002000:00100000:1.0:1651529946.398127:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->32767) req@000000007ad292bc x1731754353168192/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529946.398133:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ad292bc with x1731754353168192 ext(0->32767) 00002000:00010000:1.0:1651529946.398136:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007ad292bc 00000100:00100000:1.0:1651529946.398149:0:176870:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 25 00000100:00100000:1.0:1651529946.398151:0:176870:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353168192:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:1.0:1651529946.398581:0:176870:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad292bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353168192:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 428us (491us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1651529946.398585:0:176870:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 25 00002000:00100000:1.0:1651529946.398588:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (0->32767) req@000000007ad292bc x1731754353168192/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0' 00002000:00100000:1.0:1651529946.398593:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ad292bc with x1731754353168192 ext(0->32767) 00002000:00010000:1.0:1651529946.398595:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007ad292bc 00000100:00100000:0.0:1651529946.406504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529946.406520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529946.406527:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168384 00000100:00100000:0.0:1651529946.406528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529946.406534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:1.0:1651529946.406536:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (4227072->8421375) req@00000000b9e74008 x1731754353168384/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529946.406540:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b9e74008 with x1731754353168384 ext(4227072->8421375) 00000100:00100000:0.0:1651529946.406540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:1.0:1651529946.406541:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b9e74008 00000100:00100000:1.0:1651529946.406545:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168512 00000100:00100000:0.0:1651529946.406548:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168320 00002000:00100000:1.0:1651529946.406549:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (12615680->16809983) req@000000002a14ba1b x1731754353168512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529946.406552:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a14ba1b with x1731754353168512 ext(12615680->16809983) 00002000:00010000:1.0:1651529946.406553:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002a14ba1b 00000100:00100000:1.0:1651529946.406555:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168448 00002000:00100000:1.0:1651529946.406558:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (8421376->12615679) req@0000000047a18988 x1731754353168448/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:0.0:1651529946.406560:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (32768->4227071) req@000000003478f7c9 x1731754353168320/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1651529946.406561:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047a18988 with x1731754353168448 ext(8421376->12615679) 00002000:00010000:1.0:1651529946.406562:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047a18988 00000100:00100000:1.0:1651529946.406564:0:176870:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168576 00002000:00100000:0.0:1651529946.406565:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003478f7c9 with x1731754353168320 ext(32768->4227071) 00002000:00100000:1.0:1651529946.406567:0:176870:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x2bea4:0x0] (16809984->20971519) req@00000000fdb83b12 x1731754353168576/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/0 e 0 to 0 dl 1651529952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00010000:0.0:1651529946.406567:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003478f7c9 00002000:00100000:1.0:1651529946.406570:0:176870:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fdb83b12 with x1731754353168576 ext(16809984->20971519) 00002000:00010000:1.0:1651529946.406571:0:176870:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fdb83b12 00000100:00100000:0.0:1651529946.406573:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 26 00000100:00100000:0.0:1651529946.406575:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353168384:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529946.410932:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e74008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353168384:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 4352us (4425us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651529946.410939:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 26 00002000:00100000:0.0:1651529946.410946:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (4227072->8421375) req@00000000b9e74008 x1731754353168384/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:0.0:1651529946.410951:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b9e74008 with x1731754353168384 ext(4227072->8421375) 00002000:00010000:0.0:1651529946.410954:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b9e74008 00000100:00100000:0.0:1651529946.410966:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 27 00000100:00100000:0.0:1651529946.410969:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353168512:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529946.414204:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a14ba1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353168512:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 3231us (7680us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651529946.414211:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 27 00002000:00100000:0.0:1651529946.414216:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (12615680->16809983) req@000000002a14ba1b x1731754353168512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:0.0:1651529946.414221:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a14ba1b with x1731754353168512 ext(12615680->16809983) 00002000:00010000:0.0:1651529946.414224:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002a14ba1b 00000100:00100000:0.0:1651529946.414234:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 28 00000100:00100000:0.0:1651529946.414237:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353168448:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529946.417564:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047a18988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353168448:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 3323us (11025us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651529946.417570:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 28 00002000:00100000:0.0:1651529946.417576:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (8421376->12615679) req@0000000047a18988 x1731754353168448/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:0.0:1651529946.417581:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047a18988 with x1731754353168448 ext(8421376->12615679) 00002000:00010000:0.0:1651529946.417584:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047a18988 00000100:00100000:0.0:1651529946.417594:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 29 00000100:00100000:0.0:1651529946.417596:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353168320:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529946.420800:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003478f7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353168320:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 3200us (14269us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651529946.420818:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 29 00002000:00100000:0.0:1651529946.420824:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (32768->4227071) req@000000003478f7c9 x1731754353168320/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'md5sum.0' 00002000:00100000:0.0:1651529946.420833:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003478f7c9 with x1731754353168320 ext(32768->4227071) 00002000:00010000:0.0:1651529946.420836:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003478f7c9 00000100:00100000:0.0:1651529946.420846:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 30 00000100:00100000:0.0:1651529946.420849:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353168576:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529946.429268:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb83b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353168576:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 8415us (22724us total) trans 0 rc 4161536/4161536 00000100:00100000:0.0:1651529946.429276:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 30 00002000:00100000:0.0:1651529946.429282:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bea4:0x0] (16809984->20971519) req@00000000fdb83b12 x1731754353168576/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:672/0 lens 488/440 e 0 to 0 dl 1651529952 ref 1 fl Complete:/0/0 rc 4161536/4161536 job:'md5sum.0' 00002000:00100000:0.0:1651529946.429288:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fdb83b12 with x1731754353168576 ext(16809984->20971519) 00002000:00010000:0.0:1651529946.429291:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fdb83b12 00000100:00100000:0.0:1651529947.366599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529947.366746:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843200 00000100:00100000:0.0:1651529947.366768:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 58 00000100:00100000:0.0:1651529947.366771:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529947.366787:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81188007936 avail 77017296896 00000100:00100000:0.0:1651529947.366846:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843200:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529947.366850:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 58 00000100:00100000:0.0:1651529948.087764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529948.087819:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843264 00000100:00100000:1.0:1651529948.087848:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 844 00000100:00100000:1.0:1651529948.087850:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529948.087867:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179876 count 1 00010000:00010000:1.0:1651529948.087891:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529948.087902:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 2/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 5 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529948.087906:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529948.087907:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529948.087908:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 4/0,1 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529948.087923:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 3/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 5 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529948.087928:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 4/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 5 pid: 194455 timeout: 13697 lvb_type: 0 00000100:00100000:1.0:1651529948.087935:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d84766e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529948.087965:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 000000000445bf11 going to sleep for 6 seconds 00000100:00100000:1.0:1651529948.088298:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d84766e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966730880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529948.088305:0:194455:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529948.088413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529948.088445:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353169088 00010000:00010000:0.0:1651529948.088457:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 4/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 6 pid: 194455 timeout: 13697 lvb_type: 0 00000100:00100000:0.0:1651529948.088474:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:0.0:1651529948.088476:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353169088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529948.088481:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529948.088483:0:176855:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 4/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 6 pid: 194455 timeout: 13697 lvb_type: 0 00010000:00010000:0.0:1651529948.088488:0:176855:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 3/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 6 pid: 194455 timeout: 13697 lvb_type: 0 00010000:00010000:0.0:1651529948.088498:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c322e lrc: 0/0,0 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f786f expref: 6 pid: 194455 timeout: 13697 lvb_type: 0 00010000:00010000:0.0:1651529948.088503:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529948.088503:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529948.088505:0:176855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088509:0:176855:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 4/0,1 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088521:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529948.088534:0:194455:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529948.088535:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438146:x1731754353169088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529948.088538:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529948.088538:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00010000:00010000:1.0:1651529948.088549:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,1 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529948.088553:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 2/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088576:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 2/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088584:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529948.088585:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 2/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088589:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 3/0,0 mode: PW/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088594:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 1/0,0 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529948.088597:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3235 lrc: 0/0,0 mode: --/PW res: [0x2bea4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529948.090490:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946843264:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 2638us (2730us total) trans 38654706483 rc 0/0 00000100:00100000:1.0:1651529948.090494:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 844 00000100:00100000:0.0:1651529950.432198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529950.432243:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843392 00000100:00100000:1.0:1651529950.432271:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529950.432274:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946843392:12345-10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529950.432306:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946843392:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529950.432309:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529952.480187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529952.480202:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843520 00000100:00100000:0.0:1651529952.480221:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 59 00000100:00100000:0.0:1651529952.480224:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946843520:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529952.480257:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529952.480288:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d029b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946843520:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529952.480292:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 59 00000001:00080000:1.0:1651529954.518442:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706483 is committed 00000100:00100000:1.0:1651529956.540884:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000006ea721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731008:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529956.540884:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6791f5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966730944:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529956.541285:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000006ea721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731008:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529956.541285:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6791f5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966730944:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529957.600207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529957.600222:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843648 00000100:00100000:0.0:1651529957.600241:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 60 00000100:00100000:0.0:1651529957.600243:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946843648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529957.600259:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529957.600284:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077498c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946843648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529957.600288:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 60 00000400:00000080:1.0:1651529960.026536:0:196085:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529960.026538:0:196085:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150c: Verify fallocate Size and Blocks ==== 22:19:19 (1651529959) 00000100:00100000:0.0:1651529960.286080:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.286112:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353169984 00000100:00100000:1.0:1651529960.286147:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 845 00000100:00100000:1.0:1651529960.286150:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:454473:x1731754353169984:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.286166:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.286191:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 2/0,0 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78ae expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.286202:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.286211:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.286212:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.286217:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 3/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.286225:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 3/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.286231:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bb68e27f, rc 0) 00000100:00100000:1.0:1651529960.286256:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454473:x1731754353169984:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 105us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.286259:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 845 00000100:00100000:0.0:1651529960.286988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.287006:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353170112 00000100:00100000:1.0:1651529960.287020:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 846 00000100:00100000:1.0:1651529960.287022:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353170112:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529960.287181:0:194455:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea5:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1651529960.287183:0:194455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287184:0:194455:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287185:0:194455:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287186:0:194455:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea5:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1651529960.287199:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353170112:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 177us (212us total) trans 38654706484 rc 0/0 00000100:00100000:1.0:1651529960.287210:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 846 00000100:00100000:0.0:1651529960.318074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.318097:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353170304 00000100:00100000:1.0:1651529960.318110:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 847 00000100:00100000:1.0:1651529960.318112:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353170304:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529960.351096:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706484 is committed 00000100:00100000:1.0:1651529960.351120:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353170304:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 33007us (33045us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.351123:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 847 00000100:00100000:0.0:1651529960.367662:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.367686:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171712 00000100:00100000:1.0:1651529960.367701:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 848 00000100:00100000:1.0:1651529960.367703:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454477:x1731754353171712:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.367707:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.367713:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 2/0,0 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78ed expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.367719:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.367724:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.367725:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.367728:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 3/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.367733:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 3/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 7 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.367737:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651529960.367749:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454477:x1731754353171712:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 45us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.367761:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 848 00000100:00100000:0.0:1651529960.368524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.368547:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171904 00000100:00100000:1.0:1651529960.368561:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 849 00000100:00100000:1.0:1651529960.368562:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454477:x1731754353171904:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.368566:0:194455:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.368571:0:194455:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 2/0,0 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7902 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.368576:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.368580:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368581:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368583:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 3/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368588:0:194455:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 3/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 8 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368592:0:194455:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a2fed4bc, rc 0) 00000100:00100000:1.0:1651529960.368603:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ec01255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454477:x1731754353171904:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 40us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.368606:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 849 00000100:00100000:0.0:1651529960.368923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.368935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.368943:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172224 00000100:00100000:1.0:1651529960.368946:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172032 00000100:00100000:1.0:1651529960.368966:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 850 00000100:00100000:1.0:1651529960.368968:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353172224:12345-10.240.43.64@tcp:22:fallocate.0 00000100:00100000:0.0:1651529960.368969:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 851 00000100:00100000:0.0:1651529960.368971:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353172032:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651529960.369045:0:176863:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea7:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1651529960.369047:0:176863:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1651529960.369048:0:176863:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529960.369049:0:176863:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1651529960.369050:0:176863:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea7:0x0] updating lvb blocks from disk: 0 -> 14336 00002000:00010000:1.0:1651529960.369056:0:194455:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bea8:0x0] updating lvb size from disk: 0 -> 268435456 00002000:00010000:1.0:1651529960.369068:0:194455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bea8:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:0.0:1651529960.369075:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353172032:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 103us (140us total) trans 38654706485 rc 0/0 00000100:00100000:0.0:1651529960.369079:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 851 00002000:00010000:1.0:1651529960.369080:0:194455:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bea8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369081:0:194455:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bea8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369082:0:194455:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bea8:0x0] updating lvb blocks from disk: 0 -> 507904 00000100:00100000:1.0:1651529960.369093:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353172224:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 124us (170us total) trans 38654706486 rc 0/0 00000100:00100000:1.0:1651529960.369097:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 850 00000100:00100000:0.0:1651529960.392042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529960.392072:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843840 00000100:00100000:1.0:1651529960.392088:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 852 00000100:00100000:1.0:1651529960.392090:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651529960.392097:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179877 count 1 00010000:00010000:1.0:1651529960.392103:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392109:0:194455:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 2/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 9 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392113:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529960.392113:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529960.392114:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 4/0,1 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392126:0:194455:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 3/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 9 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392131:0:194455:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 4/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 9 pid: 194455 timeout: 13710 lvb_type: 0 00000100:00100000:1.0:1651529960.392137:0:194455:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ffeb17b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966731072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529960.392166:0:194455:0:(client.c:2492:ptlrpc_set_wait()) set 0000000086786859 going to sleep for 6 seconds 00000100:00100000:0.0:1651529960.392264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.392298:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172608 00000100:00100000:0.0:1651529960.392317:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 853 00000100:00100000:0.0:1651529960.392319:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353172608:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:1.0:1651529960.392327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.392343:0:176864:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 4 min 3 max 80 00000100:00100000:0.0:1651529960.392346:0:176864:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1651529960.392399:0:176863:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 4 min 3 max 80 00000100:00100000:1.0:1651529960.392404:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172416 00000100:00100000:0.0:1651529960.392492:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 854 00000100:00100000:0.0:1651529960.392494:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353172416:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:1.0:1651529960.392824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.392853:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172736 00010000:00010000:0.0:1651529960.392862:0:195164:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 5/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 12 pid: 194455 timeout: 13710 lvb_type: 0 00000100:00100000:0.0:1651529960.392887:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:0.0:1651529960.392889:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438146:x1731754353172736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529960.392891:0:194455:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ffeb17b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:194455:1731745966731072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529960.392893:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529960.392895:0:195164:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 4/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 12 pid: 194455 timeout: 13710 lvb_type: 0 00010000:00010000:1.0:1651529960.392898:0:194455:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392900:0:195164:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 3/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 12 pid: 194455 timeout: 13710 lvb_type: 0 00010000:00010000:0.0:1651529960.392909:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c323c lrc: 0/0,0 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ae expref: 12 pid: 194455 timeout: 13710 lvb_type: 0 00010000:00010000:0.0:1651529960.392913:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529960.392919:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529960.392920:0:195164:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392924:0:195164:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 4/0,1 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392938:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529960.392948:0:194455:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529960.392950:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754353172736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529960.392952:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529960.392953:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00010000:00010000:1.0:1651529960.392956:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,1 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392959:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 2/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392990:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 2/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392995:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529960.392996:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 2/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.393000:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 3/0,0 mode: PW/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.393005:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 1/0,0 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.393008:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3251 lrc: 0/0,0 mode: --/PW res: [0x2bea5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529960.393104:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000546aedd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946843840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1012us (1061us total) trans 38654706487 rc 0/0 00000100:00100000:1.0:1651529960.393108:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 852 00000001:00080000:1.0:1651529960.417040:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706486 is committed 00000100:00100000:0.0:1651529960.417092:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b7574 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353172608:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 24771us (24827us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529960.417105:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 853 00000100:00100000:0.0:1651529960.417148:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353172416:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 24653us (24821us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529960.417151:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 854 00000100:00100000:0.0:1651529961.812982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529961.812994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529961.813013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529961.813030:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843968 00000100:00100000:1.0:1651529961.813038:0:194455:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844032 00000100:00100000:0.0:1651529961.813049:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844096 00000100:00100000:1.0:1651529961.813054:0:194455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 855 00000100:00100000:1.0:1651529961.813057:0:194455:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946843968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1651529961.813057:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 856 00000100:00100000:0.0:1651529961.813068:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946844032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529961.813084:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179879 count 1 00002000:00080000:1.0:1651529961.813085:0:194455:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179878 count 1 00002000:00010000:1.0:1651529961.813106:0:194455:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529961.813108:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.813109:0:194455:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 3/0,1 mode: --/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.813116:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529961.813116:0:194455:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529961.813119:0:194455:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 3/0,1 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813119:0:176865:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 2/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813123:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.813123:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.813124:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 4/0,1 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.813126:0:194455:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 3/0,1 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.813130:0:194455:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 3/0,1 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.813133:0:194455:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 2/0,0 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813138:0:176865:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 3/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813151:0:176865:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 4/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 6 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:0.0:1651529961.813163:0:176865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dd33cf3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966731136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529961.813194:0:176865:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f29684f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529961.813203:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 857 00000100:00100000:0.0:1651529961.813205:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946844096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529961.813217:0:176864:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179880 count 1 00010000:00010000:0.0:1651529961.813226:0:176864:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813231:0:176864:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 2/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813234:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.813235:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.813236:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 4/0,1 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.813245:0:194455:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b879addf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946843968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 187us (266us total) trans 38654706488 rc 0/0 00000100:00100000:1.0:1651529961.813249:0:194455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 855 00010000:00010000:0.0:1651529961.813251:0:176864:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 3/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 6 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813255:0:176864:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 4/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 6 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:0.0:1651529961.813259:0:176864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a38e86d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:176864:1731745966731200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529961.813268:0:176864:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce42a80d going to sleep for 6 seconds 00010000:00010000:0.0:1651529961.813275:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 2/0,0 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813286:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529961.813288:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 2/0,0 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813291:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 3/0,0 mode: PW/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813299:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 1/0,0 mode: --/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.813302:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c3258 lrc: 0/0,0 mode: --/PW res: [0x2bea6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 194455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.813940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529961.813949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529961.813961:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353173120 00010000:00010000:0.0:1651529961.813968:0:195164:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 5/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 7 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:1.0:1651529961.813969:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353173184 00010000:00010000:1.0:1651529961.813977:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 5/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 8 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:0.0:1651529961.813993:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651529961.814001:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353173120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529961.814005:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529961.814007:0:195164:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 5/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 8 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:1.0:1651529961.814010:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00010000:00010000:0.0:1651529961.814011:0:195164:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 4/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 8 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:1.0:1651529961.814012:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353173184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529961.814017:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529961.814019:0:176855:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 5/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 8 pid: 194455 timeout: 13711 lvb_type: 0 00010000:00010000:1.0:1651529961.814023:0:176855:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 4/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 8 pid: 194455 timeout: 13711 lvb_type: 0 00010000:00010000:0.0:1651529961.814025:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.814026:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.814027:0:195164:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814030:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.814030:0:195164:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 4/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814031:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529961.814032:0:176855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814035:0:176855:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 4/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814036:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529961.814040:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529961.814048:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353173120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529961.814051:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651529961.814056:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a4697fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353173184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529961.814070:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00010000:00010000:0.0:1651529961.814076:0:176864:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c324a lrc: 0/0,0 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7902 expref: 6 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:0.0:1651529961.814080:0:176864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a38e86d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:176864:1731745966731200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529961.814086:0:176864:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814089:0:176864:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814092:0:176864:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814095:0:176864:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,1 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814105:0:176864:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 2/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814145:0:176865:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3243 lrc: 0/0,0 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78ed expref: 5 pid: 194455 timeout: 13711 lvb_type: 0 00000100:00100000:1.0:1651529961.814150:0:176865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dd33cf3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966731136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529961.814155:0:176865:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814158:0:176865:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814161:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814165:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,1 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.814167:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 2/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.814204:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946844096:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 998us (1191us total) trans 38654706489 rc 0/0 00000100:00100000:0.0:1651529961.814208:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 857 00010000:00010000:0.0:1651529961.814215:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 2/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814219:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003416f7b2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529961.814220:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 2/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814223:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 3/0,0 mode: PW/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814228:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 1/0,0 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.814231:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd46a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946844032:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1162us (1236us total) trans 38654706490 rc 0/0 00010000:00010000:0.0:1651529961.814231:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c3266 lrc: 0/0,0 mode: --/PW res: [0x2bea8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.814235:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 856 00010000:00010000:0.0:1651529961.814235:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 2/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814238:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000386c4efa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651529961.814248:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 2/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814251:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 3/0,0 mode: PW/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814255:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 1/0,0 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.814258:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c325f lrc: 0/0,0 mode: --/PW res: [0x2bea7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529962.720189:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529962.720219:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844352 00000100:00100000:0.0:1651529962.720238:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 61 00000100:00100000:0.0:1651529962.720240:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946844352:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529962.720255:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529962.720275:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d84766e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946844352:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529962.720279:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 61 00000001:00080000:0.0:1651529966.291918:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706490 is committed 00000100:00100000:1.0:1651529967.840219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529967.840248:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844544 00000100:00100000:0.0:1651529967.840271:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 62 00000100:00100000:0.0:1651529967.840274:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946844544:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529967.840290:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81208979456 avail 77038268416 00000100:00100000:0.0:1651529967.840315:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000006ea721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946844544:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529967.840318:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 62 00000400:00000080:0.0:1651529969.756600:0:196358:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529969.756603:0:196358:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 22:19:29 (1651529969) 00000100:00100000:1.0:1651529970.020462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.020480:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174400 00000100:00100000:1.0:1651529970.020522:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 858 00000100:00100000:1.0:1651529970.020525:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:455478:x1731754353174400:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529970.020535:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529970.020555:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c326d lrc: 2/0,0 mode: --/PW res: [0x2beaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f793a expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529970.020567:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529970.020584:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529970.020585:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529970.020591:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c326d lrc: 3/0,0 mode: PW/PW res: [0x2beaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f793a expref: 6 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529970.020611:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c326d lrc: 3/0,0 mode: PW/PW res: [0x2beaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f793a expref: 6 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529970.020617:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651529970.020651:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ffeb17b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:455478:x1731754353174400:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 126us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529970.020655:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 858 00000100:00100000:1.0:1651529970.020978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.020987:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174528 00000100:00100000:1.0:1651529970.020998:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 859 00000100:00100000:1.0:1651529970.021000:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353174528:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529970.021197:0:176865:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beaa:0x0] updating lvb size from disk: 0 -> 537919488 00002000:00010000:1.0:1651529970.021199:0:176865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beaa:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021200:0:176865:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2beaa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021200:0:176865:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beaa:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021201:0:176865:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beaa:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1651529970.021219:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006533094b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353174528:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 218us (241us total) trans 38654706491 rc 0/0 00000100:00100000:1.0:1651529970.021222:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 859 00000100:00100000:1.0:1651529970.045941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.045950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.045961:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174656 00000100:00100000:1.0:1651529970.045968:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174784 00000100:00100000:1.0:1651529970.045981:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 860 00000100:00100000:1.0:1651529970.045982:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353174656:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:0.0:1651529970.045991:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 861 00000100:00100000:0.0:1651529970.045995:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353174784:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:1.0:1651529970.046011:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a73567 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353174656:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 28us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529970.046014:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 860 00000001:00080000:0.0:1651529970.077910:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706491 is committed 00000100:00100000:0.0:1651529970.077941:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdad0fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353174784:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 31945us (31990us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529970.077945:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 861 00000100:00100000:1.0:1651529970.081851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529970.081869:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353175040 00000100:00100000:0.0:1651529970.081884:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 862 00000100:00100000:0.0:1651529970.081886:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353175040:12345-10.240.43.64@tcp:101:stat.0 00010000:00010000:0.0:1651529970.081890:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529970.081912:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c3274 lrc: 2/0,0 mode: --/PR res: [0x2bea9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7948 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529970.081919:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bea9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529970.081924:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529970.081925:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529970.081928:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c3274 lrc: 3/0,0 mode: PR/PR res: [0x2bea9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7948 expref: 7 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529970.081933:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c3274 lrc: 3/0,0 mode: PR/PR res: [0x2bea9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7948 expref: 7 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529970.081937:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000386c4efa, rc 0) 00000100:00100000:0.0:1651529970.081954:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000428dda1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353175040:12345-10.240.43.64@tcp:101:stat.0 Request processed in 68us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529970.081963:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 862 00000400:00000080:0.0:1651529972.806193:0:196630:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529972.806196:0:196630:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150e: Verify 60% of available OST space consumed by fallocate ========================================================== 22:19:32 (1651529972) 00000100:00100000:1.0:1651529972.960171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529972.960513:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844800 00000100:00100000:0.0:1651529972.960535:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 63 00000100:00100000:0.0:1651529972.960538:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946844800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529972.960555:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529972.960584:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6791f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946844800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529972.960588:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 63 00000100:00100000:1.0:1651529973.052356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529973.052383:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353175360 00000100:00100000:0.0:1651529973.052402:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 64 00000100:00100000:0.0:1651529973.052405:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456200:x1731754353175360:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529973.052418:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529973.052446:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456200:x1731754353175360:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 40us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529973.052449:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 64 00000100:00100000:1.0:1651529973.078203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529973.078223:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176256 00000100:00100000:0.0:1651529973.078240:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 863 00000100:00100000:0.0:1651529973.078242:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456209:x1731754353176256:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:0.0:1651529973.078247:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529973.078267:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 2/0,0 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7979 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529973.078286:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529973.078295:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529973.078295:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529973.078301:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 3/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529973.078308:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 3/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529973.078314:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003416f7b2, rc 0) 00000100:00100000:0.0:1651529973.078328:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:456209:x1731754353176256:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 85us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529973.078331:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 863 00000100:00100000:1.0:1651529973.078975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529973.078992:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176384 00000100:00100000:0.0:1651529973.079006:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 864 00000100:00100000:0.0:1651529973.079007:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353176384:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651529973.079130:0:196143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beab:0x0] updating lvb size from disk: 0 -> 104857600 00002000:00010000:0.0:1651529973.079132:0:196143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beab:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1651529973.079133:0:196143:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2beab:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529973.079134:0:196143:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beab:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1651529973.079134:0:196143:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beab:0x0] updating lvb blocks from disk: 0 -> 204800 00000100:00100000:0.0:1651529973.079148:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353176384:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 139us (173us total) trans 38654706492 rc 0/0 00000100:00100000:0.0:1651529973.079151:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 864 00000100:00100000:1.0:1651529973.148379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529973.148402:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176576 00000100:00100000:0.0:1651529973.148423:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 865 00000100:00100000:0.0:1651529973.148425:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353176576:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651529973.181606:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706492 is committed 00000100:00100000:0.0:1651529973.181628:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353176576:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 33201us (33249us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529973.181631:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 865 00000100:00100000:1.0:1651529975.194911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529975.194935:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176960 00000100:00100000:0.0:1651529975.194948:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 65 00000100:00100000:0.0:1651529975.194950:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+8:456213:x1731754353176960:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529975.194960:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81103073280 avail 76932362240 00000100:00100000:0.0:1651529975.194977:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+8:456213:x1731754353176960:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 26us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529975.194980:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 65 00000100:00100000:1.0:1651529975.714479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529975.714507:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844992 00000100:00100000:0.0:1651529975.714529:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 866 00000100:00100000:0.0:1651529975.714531:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946844992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529975.714544:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179883 count 1 00010000:00010000:0.0:1651529975.714555:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.714565:0:196143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 2/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.714569:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529975.714570:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529975.714571:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 4/0,1 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.714597:0:196143:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 3/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.714603:0:196143:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 4/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 7 pid: 196143 timeout: 13725 lvb_type: 0 00000100:00100000:0.0:1651529975.714609:0:196143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a38e86d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529975.714635:0:196143:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd854747 going to sleep for 6 seconds 00000100:00100000:0.0:1651529975.714931:0:196143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a38e86d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529975.714938:0:196143:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529975.715010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529975.715034:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177216 00010000:00010000:1.0:1651529975.715045:0:176856:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 4/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 13725 lvb_type: 0 00000100:00100000:1.0:1651529975.715076:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651529975.715079:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353177216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529975.715084:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529975.715086:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 4/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 13725 lvb_type: 0 00010000:00010000:1.0:1651529975.715091:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 3/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 13725 lvb_type: 0 00010000:00010000:1.0:1651529975.715101:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003416f7b2/0xa29a79078f3c327b lrc: 0/0,0 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7979 expref: 8 pid: 196143 timeout: 13725 lvb_type: 0 00010000:00010000:1.0:1651529975.715115:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529975.715116:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529975.715118:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715122:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 4/0,1 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715129:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529975.715136:0:196143:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715141:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529975.715143:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353177216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529975.715144:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,1 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529975.715146:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00010000:00010000:0.0:1651529975.715148:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 2/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715195:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 2/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715200:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000566545e3 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529975.715202:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 2/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715206:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 3/0,0 mode: PW/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715211:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 1/0,0 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715213:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566545e3/0xa29a79078f3c3282 lrc: 0/0,0 mode: --/PW res: [0x2beab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529975.715294:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946844992:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 761us (817us total) trans 38654706493 rc 0/0 00000100:00100000:0.0:1651529975.715298:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 866 00000100:00100000:1.0:1651529978.080179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529978.080207:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845184 00000100:00100000:0.0:1651529978.080226:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 66 00000100:00100000:0.0:1651529978.080229:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845184:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529978.080244:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529978.080266:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845184:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529978.080269:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 66 00000001:00080000:0.0:1651529981.144183:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706493 is committed 00000100:00100000:1.0:1651529981.628917:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731392:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529981.628917:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000bbc6606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731328:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529981.629413:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000bbc6606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731328:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529981.629423:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082408984 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731392:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529983.200163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529983.200193:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845248 00000100:00100000:0.0:1651529983.200214:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 67 00000100:00100000:0.0:1651529983.200216:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946845248:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529983.200233:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529983.200255:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946845248:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529983.200258:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 67 00000100:00100000:1.0:1651529984.558152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529984.558176:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177408 00000100:00100000:0.0:1651529984.558192:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 68 00000100:00100000:0.0:1651529984.558195:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f610d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456622:x1731754353177408:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529984.558218:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 46605248 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529984.558241:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f610d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456622:x1731754353177408:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529984.558245:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 68 00000400:00000080:0.0:1651529987.297293:0:196902:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529987.297296:0:196902:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150f: Verify fallocate punch functionality ========================================================== 22:19:47 (1651529987) 00000100:00100000:1.0:1651529987.549902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.549929:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177792 00000100:00100000:0.0:1651529987.549956:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 867 00000100:00100000:0.0:1651529987.549959:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:457349:x1731754353177792:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529987.549970:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529987.549981:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 2/0,0 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f79a3 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529987.549992:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529987.550002:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529987.550003:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529987.550008:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 3/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529987.550016:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 3/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529987.550021:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000040c1504b, rc 0) 00000100:00100000:0.0:1651529987.550045:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:457349:x1731754353177792:12345-10.240.43.64@tcp:101:dd.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529987.550048:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 867 00000100:00100000:1.0:1651529987.554646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.554674:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353178112 00002000:00100000:0.0:1651529987.554687:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->20479) req@0000000056934c87 x1731754353178112/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 488/0 e 0 to 0 dl 1651529993 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529987.554692:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000056934c87 with x1731754353178112 ext(0->20479) 00002000:00010000:0.0:1651529987.554694:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000056934c87 00000100:00100000:0.0:1651529987.554706:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 31 00000100:00100000:0.0:1651529987.554708:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353178112:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529987.555309:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056934c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353178112:12345-10.240.43.64@tcp:4:dd.0 Request processed in 599us (663us total) trans 38654706494 rc 0/0 00000100:00100000:0.0:1651529987.555313:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 31 00002000:00100000:0.0:1651529987.555316:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->20479) req@0000000056934c87 x1731754353178112/t38654706494(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 488/448 e 0 to 0 dl 1651529993 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529987.555320:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000056934c87 with x1731754353178112 ext(0->20479) 00002000:00010000:0.0:1651529987.555322:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000056934c87 00000100:00100000:0.0:1651529987.555521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.555529:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353178176 00000100:00100000:0.0:1651529987.555543:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 868 00000100:00100000:0.0:1651529987.555545:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353178176:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651529987.555612:0:196143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb size from disk: 0 -> 20480 00002000:00010000:0.0:1651529987.555614:0:196143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb mtime from disk: 0 -> 1651529987 00002000:00010000:0.0:1651529987.555615:0:196143:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529987.555615:0:196143:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb ctime from disk: 0 -> 1651529987 00002000:00010000:0.0:1651529987.555616:0:196143:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb blocks from disk: 0 -> 24 00000100:00100000:0.0:1651529987.555633:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353178176:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 87us (112us total) trans 38654706495 rc 0/0 00000100:00100000:0.0:1651529987.555644:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 868 00000100:00100000:0.0:1651529987.581562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.581570:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353178304 00000100:00100000:0.0:1651529987.581583:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 869 00000100:00100000:0.0:1651529987.581585:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353178304:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651529987.614107:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706495 is committed 00000100:00100000:0.0:1651529987.614134:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353178304:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 32548us (32573us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529987.614138:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 869 00000100:00100000:0.0:1651529987.624542:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.624550:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353178752 00000100:00100000:0.0:1651529987.624564:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 870 00000100:00100000:0.0:1651529987.624566:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353178752:12345-10.240.43.64@tcp:23:lseek_test.0 00000100:00100000:0.0:1651529987.624606:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353178752:12345-10.240.43.64@tcp:23:lseek_test.0 Request processed in 39us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529987.624609:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 870 00000100:00100000:0.0:1651529987.627920:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.627929:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353178880 00002000:00100000:0.0:1651529987.627936:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (4096->32767) req@0000000075572930 x1731754353178880/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 504/0 e 0 to 0 dl 1651529993 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:0.0:1651529987.627941:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000075572930 with x1731754353178880 ext(4096->32767) 00002000:00010000:0.0:1651529987.627942:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000075572930 00000100:00100000:0.0:1651529987.627953:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 32 00000100:00100000:0.0:1651529987.627955:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353178880:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529987.628181:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075572930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353178880:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 225us (262us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529987.628185:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 32 00002000:00100000:0.0:1651529987.628188:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (4096->32767) req@0000000075572930 x1731754353178880/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 504/440 e 0 to 0 dl 1651529993 ref 1 fl Complete:/0/0 rc 8192/8192 job:'md5sum.0' 00002000:00100000:0.0:1651529987.628192:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000075572930 with x1731754353178880 ext(4096->32767) 00002000:00010000:0.0:1651529987.628193:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000075572930 00000100:00100000:0.0:1651529987.633463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.633470:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353179328 00002000:00010000:0.0:1651529987.633476:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179884/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529987.633477:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000004593d58 with x1731754353179328 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529987.633480:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000004593d58. 00000100:00100000:0.0:1651529987.633491:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 33 00000100:00100000:0.0:1651529987.633492:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353179328:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529987.633543:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb size from disk: 20480 -> 0 00002000:00010000:0.0:1651529987.633545:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb mtime from disk: 1651529987 -> 1651529987 00002000:00010000:0.0:1651529987.633546:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529987.633547:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb ctime from disk: 1651529987 -> 1651529987 00002000:00010000:0.0:1651529987.633548:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb blocks from disk: 24 -> 0 00000100:00100000:0.0:1651529987.633564:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004593d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438147:x1731754353179328:12345-10.240.43.64@tcp:10:dd.0 Request processed in 71us (101us total) trans 38654706496 rc 0/0 00000100:00100000:0.0:1651529987.633567:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 33 00002000:00010000:0.0:1651529987.633568:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179884/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529987.633569:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000004593d58 with x1731754353179328 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529987.633571:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000004593d58. 00000100:00100000:0.0:1651529987.637232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.637240:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353179392 00002000:00100000:0.0:1651529987.637248:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->20479) req@000000001f30a901 x1731754353179392/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 488/0 e 0 to 0 dl 1651529993 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529987.637252:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f30a901 with x1731754353179392 ext(0->20479) 00002000:00010000:0.0:1651529987.637253:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f30a901 00000100:00100000:0.0:1651529987.637265:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 34 00000100:00100000:0.0:1651529987.637267:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353179392:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529987.637605:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f30a901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353179392:12345-10.240.43.64@tcp:4:dd.0 Request processed in 337us (372us total) trans 38654706497 rc 0/0 00000100:00100000:0.0:1651529987.637609:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 34 00002000:00100000:0.0:1651529987.637612:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->20479) req@000000001f30a901 x1731754353179392/t38654706497(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 488/448 e 0 to 0 dl 1651529993 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529987.637616:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f30a901 with x1731754353179392 ext(0->20479) 00002000:00010000:0.0:1651529987.637617:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f30a901 00000100:00100000:0.0:1651529987.637795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.637814:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353179456 00000100:00100000:0.0:1651529987.637827:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 871 00000100:00100000:0.0:1651529987.637829:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353179456:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651529987.637894:0:196143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb size from disk: 0 -> 20480 00002000:00010000:0.0:1651529987.637895:0:196143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb mtime from disk: 1651529987 -> 1651529987 00002000:00010000:0.0:1651529987.637896:0:196143:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb atime from disk: 0 -> 1651529987 00002000:00010000:0.0:1651529987.637897:0:196143:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb ctime from disk: 1651529987 -> 1651529987 00002000:00010000:0.0:1651529987.637898:0:196143:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beac:0x0] updating lvb blocks from disk: 0 -> 40 00000100:00100000:0.0:1651529987.637912:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353179456:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 83us (118us total) trans 38654706498 rc 0/0 00000100:00100000:0.0:1651529987.637922:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 871 00000100:00100000:0.0:1651529987.638360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.638367:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353179584 00000100:00100000:0.0:1651529987.638382:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 872 00000100:00100000:0.0:1651529987.638383:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438148:x1731754353179584:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651529987.662311:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706498 is committed 00000100:00100000:0.0:1651529987.662338:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353179584:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 23953us (23978us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529987.662342:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 872 00000100:00100000:0.0:1651529987.672671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529987.672680:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353179968 00002000:00100000:0.0:1651529987.672688:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->32767) req@0000000080d2b44b x1731754353179968/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 504/0 e 0 to 0 dl 1651529993 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:0.0:1651529987.672692:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080d2b44b with x1731754353179968 ext(0->32767) 00002000:00010000:0.0:1651529987.672694:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080d2b44b 00000100:00100000:0.0:1651529987.672706:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 35 00000100:00100000:0.0:1651529987.672708:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353179968:12345-10.240.43.64@tcp:3:md5sum.0 00000100:00100000:0.0:1651529987.672903:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080d2b44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353179968:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 193us (231us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651529987.672906:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 35 00002000:00100000:0.0:1651529987.672909:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beac:0x0] (0->32767) req@0000000080d2b44b x1731754353179968/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:713/0 lens 504/440 e 0 to 0 dl 1651529993 ref 1 fl Complete:/0/0 rc 8192/8192 job:'md5sum.0' 00002000:00100000:0.0:1651529987.672913:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080d2b44b with x1731754353179968 ext(0->32767) 00002000:00010000:0.0:1651529987.672914:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080d2b44b 00000100:00100000:0.0:1651529988.320221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529988.320239:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845696 00000100:00100000:0.0:1651529988.320259:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 69 00000100:00100000:0.0:1651529988.320261:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946845696:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529988.320275:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 63390656 pending 0 free 81207930880 avail 77037129728 00000100:00100000:0.0:1651529988.320304:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082408984 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946845696:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529988.320308:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 69 00000100:00100000:0.0:1651529989.201716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529989.201731:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845760 00000100:00100000:0.0:1651529989.201757:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 873 00000100:00100000:0.0:1651529989.201760:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946845760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651529989.201777:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179884 count 1 00010000:00010000:0.0:1651529989.201790:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529989.201800:0:196143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 2/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529989.201816:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529989.201817:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529989.201818:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 4/0,1 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529989.201833:0:196143:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 3/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529989.201838:0:196143:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 4/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 7 pid: 196143 timeout: 13738 lvb_type: 0 00000100:00100000:0.0:1651529989.201856:0:196143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a432c3d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529989.201888:0:196143:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec047fbe going to sleep for 6 seconds 00000100:00100000:0.0:1651529989.202255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529989.202276:0:196143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a432c3d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529989.202281:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353180288 00010000:00010000:0.0:1651529989.202283:0:196143:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202293:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 4/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 13738 lvb_type: 0 00000100:00100000:1.0:1651529989.202307:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651529989.202309:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353180288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529989.202314:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529989.202316:0:176855:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 4/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 13738 lvb_type: 0 00010000:00010000:1.0:1651529989.202321:0:176855:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 3/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 13738 lvb_type: 0 00010000:00010000:1.0:1651529989.202331:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c1504b/0xa29a79078f3c3289 lrc: 0/0,0 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79a3 expref: 8 pid: 196143 timeout: 13738 lvb_type: 0 00010000:00010000:1.0:1651529989.202335:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529989.202336:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529989.202338:0:176855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202342:0:176855:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 4/0,1 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202355:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529989.202365:0:196143:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529989.202369:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529989.202370:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353180288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529989.202372:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,1 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529989.202373:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00010000:00010000:0.0:1651529989.202376:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 2/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202418:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 2/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202423:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000806805c0 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651529989.202425:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 2/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202428:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 3/0,0 mode: PW/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202433:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 1/0,0 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529989.202436:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806805c0/0xa29a79078f3c3290 lrc: 0/0,0 mode: --/PW res: [0x2beac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529989.202512:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 751us (800us total) trans 38654706499 rc 0/0 00000100:00100000:0.0:1651529989.202516:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 873 00000100:00100000:1.0:1651529993.440175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529993.440201:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845888 00000100:00100000:0.0:1651529993.440223:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 70 00000100:00100000:0.0:1651529993.440226:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529993.440254:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 63390656 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529993.440280:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a26869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529993.440283:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 70 00000001:00080000:0.0:1651529995.652369:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706499 is committed 00000100:00100000:1.0:1651529998.560191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529998.560216:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846016 00000100:00100000:0.0:1651529998.560238:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 71 00000100:00100000:0.0:1651529998.560240:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846016:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651529998.560257:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 63390656 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651529998.560282:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052921917 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846016:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529998.560285:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 71 00000400:00000080:0.0:1651530000.817529:0:197174:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530000.817531:0:197174:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150g: Verify fallocate punch on large range ========================================================== 22:20:00 (1651530000) 00000100:00100000:1.0:1651530001.084878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.084904:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181248 00000100:00100000:0.0:1651530001.084931:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 874 00000100:00100000:0.0:1651530001.084934:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:458480:x1731754353181248:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:0.0:1651530001.084943:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530001.084954:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 2/0,0 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f79f0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530001.084965:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bead:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530001.084975:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530001.084976:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530001.084981:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 3/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530001.085001:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 3/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530001.085006:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000590e4cfe, rc 0) 00000100:00100000:0.0:1651530001.085030:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:458480:x1731754353181248:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.085034:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 874 00000100:00100000:1.0:1651530001.085823:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.085839:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181376 00000100:00100000:1.0:1651530001.085849:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 875 00000100:00100000:1.0:1651530001.085852:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353181376:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651530001.085967:0:196143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb size from disk: 0 -> 104857600 00002000:00010000:1.0:1651530001.085969:0:196143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651530001.085970:0:196143:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530001.085970:0:196143:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651530001.085971:0:196143:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb blocks from disk: 0 -> 204800 00000100:00100000:1.0:1651530001.085991:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353181376:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 138us (168us total) trans 38654706500 rc 0/0 00000100:00100000:1.0:1651530001.085995:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 875 00000100:00100000:1.0:1651530001.112896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.112904:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181568 00000100:00100000:1.0:1651530001.112912:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 876 00000100:00100000:1.0:1651530001.112914:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353181568:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651530001.146148:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706500 is committed 00000100:00100000:1.0:1651530001.146198:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353181568:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 33282us (33302us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530001.146203:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 876 00000100:00100000:1.0:1651530001.150572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.150597:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182144 00002000:00010000:0.0:1651530001.150606:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530001.150607:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5f5c711 with x1731754353182144 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530001.150611:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5f5c711. 00000100:00100000:0.0:1651530001.150623:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 36 00000100:00100000:0.0:1651530001.150625:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353182144:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.150684:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb size from disk: 104857600 -> 0 00002000:00010000:0.0:1651530001.150686:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb mtime from disk: 0 -> 1651530001 00002000:00010000:0.0:1651530001.150687:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.150688:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb ctime from disk: 0 -> 1651530001 00002000:00010000:0.0:1651530001.150689:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb blocks from disk: 204800 -> 0 00000100:00100000:0.0:1651530001.150702:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f5c711 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353182144:12345-10.240.43.64@tcp:10:dd.0 Request processed in 77us (132us total) trans 38654706501 rc 0/0 00000100:00100000:0.0:1651530001.150706:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 36 00002000:00010000:0.0:1651530001.150707:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530001.150708:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5f5c711 with x1731754353182144 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530001.150720:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c5f5c711. 00000100:00100000:1.0:1651530001.183430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.183454:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182400 00002000:00010000:0.0:1651530001.183461:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (104857600->18446744073709551615) 00002000:00100000:0.0:1651530001.183463:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd23a90b with x1731754353182400 ext(104857600->18446744073709551615) 00002000:00010000:0.0:1651530001.183466:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd23a90b. 00000100:00100000:0.0:1651530001.183476:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 37 00000100:00100000:0.0:1651530001.183478:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438147:x1731754353182400:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.183508:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb size from disk: 0 -> 104857600 00002000:00010000:0.0:1651530001.183509:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.183510:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.183511:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.183512:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530001.183525:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd23a90b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438147:x1731754353182400:12345-10.240.43.64@tcp:10:dd.0 Request processed in 46us (96us total) trans 38654706502 rc 0/0 00000100:00100000:0.0:1651530001.183528:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 37 00002000:00010000:0.0:1651530001.183529:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (104857600->18446744073709551615) 00002000:00100000:0.0:1651530001.183530:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd23a90b with x1731754353182400 ext(104857600->18446744073709551615) 00002000:00010000:0.0:1651530001.183532:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd23a90b. 00000100:00100000:1.0:1651530001.214366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.214389:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182656 00002000:00010000:0.0:1651530001.214397:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (52428800->18446744073709551615) 00002000:00100000:0.0:1651530001.214398:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ca831975 with x1731754353182656 ext(52428800->18446744073709551615) 00002000:00010000:0.0:1651530001.214401:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ca831975. 00000100:00100000:0.0:1651530001.214411:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 38 00000100:00100000:0.0:1651530001.214413:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca831975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353182656:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.214444:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb size from disk: 104857600 -> 52428800 00002000:00010000:0.0:1651530001.214454:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.214455:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.214456:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.214457:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530001.214472:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca831975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353182656:12345-10.240.43.64@tcp:10:dd.0 Request processed in 59us (108us total) trans 38654706503 rc 0/0 00000100:00100000:0.0:1651530001.214476:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 38 00002000:00010000:0.0:1651530001.214477:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179885/0 (52428800->18446744073709551615) 00002000:00100000:0.0:1651530001.214478:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ca831975 with x1731754353182656 ext(52428800->18446744073709551615) 00002000:00010000:0.0:1651530001.214480:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ca831975. 00000100:00100000:1.0:1651530001.334615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.334645:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183232 00002000:00100000:0.0:1651530001.334667:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bead:0x0] (0->54525951) req@00000000051dd470 x1731754353183232/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:727/0 lens 504/0 e 0 to 0 dl 1651530007 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530001.334674:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000051dd470 with x1731754353183232 ext(0->54525951) 00002000:00010000:0.0:1651530001.334677:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000051dd470 00000100:00100000:0.0:1651530001.334691:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 39 00000100:00100000:0.0:1651530001.334693:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000051dd470 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754353183232:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530001.341318:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000051dd470 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438147:x1731754353183232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6622us (6703us total) trans 38654706504 rc 0/0 00000100:00100000:0.0:1651530001.341325:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 39 00002000:00100000:0.0:1651530001.341330:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bead:0x0] (0->54525951) req@00000000051dd470 x1731754353183232/t38654706504(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:727/0 lens 504/448 e 0 to 0 dl 1651530007 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530001.341335:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000051dd470 with x1731754353183232 ext(0->54525951) 00002000:00010000:0.0:1651530001.341338:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000051dd470 00000100:00100000:1.0:1651530001.343038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.343052:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183296 00000100:00100000:1.0:1651530001.343076:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 877 00000100:00100000:1.0:1651530001.343088:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353183296:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651530001.343425:0:176864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb size from disk: 52428800 -> 54525952 00002000:00010000:1.0:1651530001.343427:0:176864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:1.0:1651530001.343428:0:176864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530001.343429:0:176864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:1.0:1651530001.343430:0:176864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bead:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1651530001.343450:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438149:x1731754353183296:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 362us (413us total) trans 38654706505 rc 0/0 00000100:00100000:1.0:1651530001.343454:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 877 00000100:00100000:1.0:1651530001.348931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.348940:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183552 00000100:00100000:1.0:1651530001.348949:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 878 00000100:00100000:1.0:1651530001.348950:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438148:x1731754353183552:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651530001.527980:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706505 is committed 00000100:00100000:1.0:1651530001.528042:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353183552:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 179089us (179109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530001.528046:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 878 00000100:00100000:1.0:1651530001.539682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.539693:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184064 00000100:00100000:1.0:1651530001.539702:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 879 00000100:00100000:1.0:1651530001.539704:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353184064:12345-10.240.43.64@tcp:23:lseek_test.0 00000100:00100000:1.0:1651530001.539741:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353184064:12345-10.240.43.64@tcp:23:lseek_test.0 Request processed in 35us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530001.539744:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 879 00000100:00100000:1.0:1651530001.542195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530001.542213:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184192 00000100:00100000:1.0:1651530001.542220:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 880 00000100:00100000:1.0:1651530001.542222:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353184192:12345-10.240.43.64@tcp:23:lseek_test.0 00000100:00100000:1.0:1651530001.542246:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353184192:12345-10.240.43.64@tcp:23:lseek_test.0 Request processed in 23us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530001.542250:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 880 00000100:00100000:1.0:1651530002.939850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530002.939868:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846528 00000100:00100000:1.0:1651530002.939888:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 881 00000100:00100000:1.0:1651530002.939891:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530002.939907:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179885 count 1 00010000:00010000:1.0:1651530002.939920:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.939931:0:196143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 2/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.939935:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530002.939936:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530002.939937:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 4/0,1 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.939951:0:196143:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 3/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.939957:0:196143:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 4/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 7 pid: 196143 timeout: 13752 lvb_type: 0 00000100:00100000:1.0:1651530002.939977:0:196143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530002.940011:0:196143:0:(client.c:2492:ptlrpc_set_wait()) set 000000007846e07a going to sleep for 6 seconds 00000100:00100000:1.0:1651530002.940389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530002.940399:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184576 00010000:00010000:1.0:1651530002.940406:0:176856:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 5/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 8 pid: 196143 timeout: 13752 lvb_type: 0 00000100:00100000:1.0:1651530002.940416:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530002.940418:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353184576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530002.940422:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530002.940424:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 5/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 8 pid: 196143 timeout: 13752 lvb_type: 0 00010000:00010000:1.0:1651530002.940429:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 4/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 8 pid: 196143 timeout: 13752 lvb_type: 0 00010000:00010000:1.0:1651530002.940439:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530002.940440:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530002.940441:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940445:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 4/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940451:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530002.940470:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353184576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530002.940481:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00010000:00010000:1.0:1651530002.940507:0:196143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590e4cfe/0xa29a79078f3c3297 lrc: 0/0,0 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f0 expref: 7 pid: 196143 timeout: 13752 lvb_type: 0 00000100:00100000:1.0:1651530002.940512:0:196143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d000b113 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530002.940518:0:196143:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940522:0:196143:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940525:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940529:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,1 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940532:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 2/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940559:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 2/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940566:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530002.940568:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 2/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940573:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 3/0,0 mode: PW/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940580:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 1/0,0 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940583:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c329e lrc: 0/0,0 mode: --/PW res: [0x2bead:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530002.940657:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946846528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 765us (810us total) trans 38654706506 rc 0/0 00000100:00100000:1.0:1651530002.940660:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 881 00000100:00100000:0.0:1651530003.680177:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530003.680191:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846656 00000100:00100000:0.0:1651530003.680207:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 72 00000100:00100000:0.0:1651530003.680209:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946846656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530003.680223:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 68633536 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530003.680247:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081f2c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946846656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 37us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530003.680251:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 72 00000100:00100000:0.0:1651530006.716868:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731584:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530006.716874:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731648:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530006.718316:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000622c21ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731648:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530006.718323:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f685b181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731584:10.240.43.61@tcp:400:kworker/u4:2.0 00000001:00080000:0.0:1651530008.274088:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706506 is committed 00000100:00100000:0.0:1651530008.800204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530008.800219:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846784 00000100:00100000:0.0:1651530008.800238:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 73 00000100:00100000:0.0:1651530008.800240:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846784:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530008.800255:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 68633536 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530008.800281:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f685b181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846784:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530008.800285:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 73 00000400:00000080:0.0:1651530010.885524:0:197446:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530010.885526:0:197446:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 151: test cache on oss and controls ========================================================================================= 22:20:10 (1651530010) 00000100:00100000:0.0:1651530011.927324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530011.927353:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353185664 00000100:00100000:1.0:1651530011.927376:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 882 00000100:00100000:1.0:1651530011.927379:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:459680:x1731754353185664:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651530011.927389:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530011.927411:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32a5 lrc: 2/0,0 mode: --/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7a44 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530011.927422:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530011.927432:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530011.927433:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530011.927438:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32a5 lrc: 3/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a44 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530011.927446:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32a5 lrc: 3/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a44 expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530011.927452:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a718d34a, rc 0) 00000100:00100000:1.0:1651530011.927476:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:459680:x1731754353185664:12345-10.240.43.64@tcp:101:dd.0 Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530011.927480:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 882 00000100:00100000:1.0:1651530012.157835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.157865:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353185856 00002000:00100000:1.0:1651530012.157887:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beae:0x0] (0->16383) req@00000000d000b113 x1731754353185856/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 16872/0 e 0 to 0 dl 1651530018 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651530012.157893:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d000b113 with x1731754353185856 ext(0->16383) 00002000:00010000:1.0:1651530012.157896:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d000b113 00000100:00100000:1.0:1651530012.157906:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 40 00000100:00100000:1.0:1651530012.157919:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353185856:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651530012.158305:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d000b113 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353185856:12345-10.240.43.64@tcp:4:dd.0 Request processed in 385us (472us total) trans 38654706507 rc 0/0 00000100:00100000:1.0:1651530012.158310:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 40 00002000:00100000:1.0:1651530012.158313:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beae:0x0] (0->16383) req@00000000d000b113 x1731754353185856/t38654706507(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 16872/448 e 0 to 0 dl 1651530018 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651530012.158318:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d000b113 with x1731754353185856 ext(0->16383) 00002000:00010000:1.0:1651530012.158319:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d000b113 00000100:00100000:1.0:1651530012.158706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.158716:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353185920 00000100:00100000:1.0:1651530012.158727:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651530012.158729:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451154:x1731754353185920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530012.158734:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:1.0:1651530012.158739:0:176855:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beae:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:1.0:1651530012.158741:0:176855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beae:0x0] updating lvb mtime from disk: 0 -> 1651530011 00002000:00010000:1.0:1651530012.158742:0:176855:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beae:0x0] updating lvb ctime from disk: 0 -> 1651530011 00002000:00010000:1.0:1651530012.158743:0:176855:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beae:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:1.0:1651530012.158753:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32a5 lrc: 0/0,0 mode: --/PW res: [0x2beae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a44 expref: 10 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530012.158764:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386c4efa/0xa29a79078f3c3274 lrc: 0/0,0 mode: --/PR res: [0x2bea9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7948 expref: 9 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530012.158771:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c326d lrc: 0/0,0 mode: --/PW res: [0x2beaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f793a expref: 8 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530012.158789:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530012.158820:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754353185920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 90us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530012.158823:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651530012.167110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.167120:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353186304 00000100:00100000:1.0:1651530012.167129:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 883 00000100:00100000:1.0:1651530012.167131:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353186304:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530012.167136:0:176864:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530012.167141:0:176864:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ac lrc: 2/0,0 mode: --/PR res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7a59 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530012.167147:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beae:0x0] initial LVB size: 16384, mtime: 0x6270591b, atime: 0x0, ctime: 0x6270591b, blocks: 0x20 00010000:00010000:1.0:1651530012.167153:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530012.167154:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530012.167157:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ac lrc: 3/0,0 mode: PR/PR res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a59 expref: 8 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530012.167163:0:176864:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ac lrc: 3/0,0 mode: PR/PR res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a59 expref: 8 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530012.167168:0:176864:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530012.167185:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754353186304:12345-10.240.43.64@tcp:101:cat.0 Request processed in 53us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530012.167189:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 883 00000100:00100000:1.0:1651530012.169198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.169206:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353186432 00002000:00100000:1.0:1651530012.169213:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beae:0x0] (0->4194303) req@00000000dd130bac x1731754353186432/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651530018 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530012.169217:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd130bac with x1731754353186432 ext(0->4194303) 00002000:00010000:1.0:1651530012.169219:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd130bac 00000100:00100000:1.0:1651530012.169224:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 41 00000100:00100000:1.0:1651530012.169226:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353186432:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530012.170202:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd130bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353186432:12345-10.240.43.64@tcp:3:cat.0 Request processed in 974us (1003us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1651530012.170205:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 41 00002000:00100000:1.0:1651530012.170208:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beae:0x0] (0->4194303) req@00000000dd130bac x1731754353186432/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651530018 ref 1 fl Complete:/0/0 rc 16384/16384 job:'cat.0' 00002000:00100000:1.0:1651530012.170212:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd130bac with x1731754353186432 ext(0->4194303) 00002000:00010000:1.0:1651530012.170213:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000dd130bac 00000100:00100000:1.0:1651530012.645149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.645166:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353187456 00000100:00100000:1.0:1651530012.645190:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:1.0:1651530012.645193:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754353187456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530012.645201:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530012.645222:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ac lrc: 0/0,0 mode: --/PR res: [0x2beae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a59 expref: 8 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530012.645232:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530012.645260:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754353187456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530012.645272:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:1.0:1651530013.112356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.112374:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353188992 00000100:00100000:1.0:1651530013.112393:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 884 00000100:00100000:1.0:1651530013.112396:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:459883:x1731754353188992:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651530013.112405:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530013.112416:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32b3 lrc: 2/0,0 mode: --/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7a9f expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530013.112428:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530013.112438:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.112439:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.112444:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32b3 lrc: 3/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a9f expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.112451:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32b3 lrc: 3/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a9f expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.112457:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530013.112482:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:459883:x1731754353188992:12345-10.240.43.64@tcp:101:dd.0 Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530013.112485:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 884 00000100:00100000:1.0:1651530013.384333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.384351:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189184 00002000:00100000:1.0:1651530013.384372:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->12287) req@00000000065a6ca6 x1731754353189184/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:739/0 lens 12776/0 e 0 to 0 dl 1651530019 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651530013.384392:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000065a6ca6 with x1731754353189184 ext(0->12287) 00002000:00010000:1.0:1651530013.384395:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000065a6ca6 00000100:00100000:1.0:1651530013.384406:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 42 00000100:00100000:1.0:1651530013.384409:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353189184:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651530013.384758:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000065a6ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438147:x1731754353189184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 347us (427us total) trans 38654706508 rc 0/0 00000100:00100000:1.0:1651530013.384762:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 42 00002000:00100000:1.0:1651530013.384765:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->12287) req@00000000065a6ca6 x1731754353189184/t38654706508(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:739/0 lens 12776/448 e 0 to 0 dl 1651530019 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651530013.384769:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000065a6ca6 with x1731754353189184 ext(0->12287) 00002000:00010000:1.0:1651530013.384771:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000065a6ca6 00000100:00100000:1.0:1651530013.385161:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.385172:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189248 00000100:00100000:1.0:1651530013.385184:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:1.0:1651530013.385186:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451155:x1731754353189248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530013.385191:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530013.385196:0:176855:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beaf:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:1.0:1651530013.385197:0:176855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beaf:0x0] updating lvb mtime from disk: 0 -> 1651530013 00002000:00010000:1.0:1651530013.385198:0:176855:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beaf:0x0] updating lvb ctime from disk: 0 -> 1651530013 00002000:00010000:1.0:1651530013.385199:0:176855:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beaf:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:1.0:1651530013.385210:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32b3 lrc: 0/0,0 mode: --/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a9f expref: 10 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.385219:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530013.385239:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754353189248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530013.385242:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:1.0:1651530013.393051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.393061:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189632 00000100:00100000:1.0:1651530013.393071:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 885 00000100:00100000:1.0:1651530013.393073:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754353189632:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530013.393078:0:176864:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530013.393095:0:176864:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ba lrc: 2/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7ab4 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530013.393102:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaf:0x0] initial LVB size: 12288, mtime: 0x6270591d, atime: 0x0, ctime: 0x6270591d, blocks: 0x18 00010000:00010000:1.0:1651530013.393109:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.393110:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.393113:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ba lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ab4 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530013.393120:0:176864:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ba lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ab4 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530013.393125:0:176864:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530013.393137:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c620888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438146:x1731754353189632:12345-10.240.43.64@tcp:101:cat.0 Request processed in 63us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530013.393140:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 885 00000100:00100000:1.0:1651530013.395071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.395079:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189760 00002000:00100000:1.0:1651530013.395096:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@000000009da7ffff x1731754353189760/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:739/0 lens 488/0 e 0 to 0 dl 1651530019 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530013.395103:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009da7ffff with x1731754353189760 ext(0->4194303) 00002000:00010000:1.0:1651530013.395105:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009da7ffff 00000100:00100000:1.0:1651530013.395111:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 43 00000100:00100000:1.0:1651530013.395113:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438147:x1731754353189760:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530013.396002:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da7ffff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438147:x1731754353189760:12345-10.240.43.64@tcp:3:cat.0 Request processed in 888us (931us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1651530013.396006:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 43 00002000:00100000:1.0:1651530013.396009:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@000000009da7ffff x1731754353189760/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:739/0 lens 488/440 e 0 to 0 dl 1651530019 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:1.0:1651530013.396013:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009da7ffff with x1731754353189760 ext(0->4194303) 00002000:00010000:1.0:1651530013.396014:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009da7ffff 00000100:00100000:1.0:1651530013.886889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530013.886908:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189952 00000100:00100000:1.0:1651530013.886932:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651530013.886935:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451155:x1731754353189952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530013.886943:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530013.886963:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32ba lrc: 0/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ab4 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530013.886973:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530013.886992:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002293d0c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754353189952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530013.886996:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651530013.920286:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530013.920314:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846912 00000100:00100000:0.0:1651530013.920329:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 74 00000100:00100000:0.0:1651530013.920331:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530013.920342:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 85509056 pending 77824 free 81207914496 avail 77037203456 00000100:00100000:0.0:1651530013.920366:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095b887a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 34us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530013.920369:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 74 00000100:00100000:1.0:1651530013.944075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530013.944430:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846976 00000100:00100000:1.0:1651530013.944445:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 886 00000100:00100000:1.0:1651530013.944447:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530013.944459:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179886 count 1 00002000:00010000:1.0:1651530013.944471:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beae:0x0] initial LVB size: 16384, mtime: 0x6270591b, atime: 0x0, ctime: 0x6270591b, blocks: 0x20 00010000:00010000:1.0:1651530013.944475:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 3/0,1 mode: --/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.944482:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.944483:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.944485:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 3/0,1 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.944492:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 3/0,1 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.944496:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 3/0,1 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.944499:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 2/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530013.945000:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946846976:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 551us (926us total) trans 38654706509 rc 0/0 00000100:00100000:1.0:1651530013.945003:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 886 00010000:00010000:1.0:1651530013.945014:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 2/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.945030:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530013.945032:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 2/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.945035:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 3/0,0 mode: PW/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.945043:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 1/0,0 mode: --/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.945045:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c1 lrc: 0/0,0 mode: --/PW res: [0x2beae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530018.018959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530018.018974:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353190144 00000100:00100000:1.0:1651530018.018993:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 887 00000100:00100000:1.0:1651530018.018996:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353190144:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530018.019005:0:176864:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530018.019015:0:176864:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c8 lrc: 2/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7ac2 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530018.019027:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaf:0x0] initial LVB size: 12288, mtime: 0x6270591d, atime: 0x0, ctime: 0x6270591d, blocks: 0x18 00010000:00010000:1.0:1651530018.019036:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530018.019037:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530018.019042:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c8 lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ac2 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530018.019064:0:176864:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c8 lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ac2 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530018.019069:0:176864:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530018.019104:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190144:12345-10.240.43.64@tcp:101:cat.0 Request processed in 108us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530018.019108:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 887 00000100:00100000:1.0:1651530018.021105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530018.021115:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353190336 00002000:00100000:1.0:1651530018.021127:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@00000000763950ed x1731754353190336/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:744/0 lens 488/0 e 0 to 0 dl 1651530024 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530018.021132:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000763950ed with x1731754353190336 ext(0->4194303) 00002000:00010000:1.0:1651530018.021134:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000763950ed 00000100:00100000:1.0:1651530018.021140:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44 00000100:00100000:1.0:1651530018.021142:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190336:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530018.021801:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000763950ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190336:12345-10.240.43.64@tcp:3:cat.0 Request processed in 658us (696us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1651530018.021823:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44 00002000:00100000:1.0:1651530018.021826:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@00000000763950ed x1731754353190336/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:744/0 lens 488/440 e 0 to 0 dl 1651530024 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:1.0:1651530018.021831:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000763950ed with x1731754353190336 ext(0->4194303) 00002000:00010000:1.0:1651530018.021832:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000763950ed 00000100:00100000:1.0:1651530018.353670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530018.353698:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353190528 00000100:00100000:1.0:1651530018.353722:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530018.353724:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451155:x1731754353190528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530018.353732:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530018.353754:0:176855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32c8 lrc: 0/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ac2 expref: 10 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530018.353764:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530018.353784:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754353190528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530018.353787:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530018.361266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530018.361276:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353190720 00000100:00100000:1.0:1651530018.361286:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 888 00000100:00100000:1.0:1651530018.361287:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353190720:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530018.361295:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530018.361300:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32cf lrc: 2/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7ad0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530018.361307:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaf:0x0] initial LVB size: 12288, mtime: 0x6270591d, atime: 0x0, ctime: 0x6270591d, blocks: 0x18 00010000:00010000:1.0:1651530018.361313:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530018.361314:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530018.361317:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32cf lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ad0 expref: 10 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530018.361323:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32cf lrc: 3/0,0 mode: PR/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ad0 expref: 10 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530018.361340:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530018.361353:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190720:12345-10.240.43.64@tcp:101:cat.0 Request processed in 64us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530018.361356:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 888 00000100:00100000:1.0:1651530018.363317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530018.363327:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353190912 00002000:00100000:1.0:1651530018.363338:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@00000000439507df x1731754353190912/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:744/0 lens 488/0 e 0 to 0 dl 1651530024 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530018.363343:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000439507df with x1731754353190912 ext(0->4194303) 00002000:00010000:1.0:1651530018.363345:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000439507df 00000100:00100000:1.0:1651530018.363352:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 45 00000100:00100000:1.0:1651530018.363353:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190912:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530018.363961:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000439507df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353190912:12345-10.240.43.64@tcp:3:cat.0 Request processed in 606us (644us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1651530018.363965:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 45 00002000:00100000:1.0:1651530018.363968:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beaf:0x0] (0->4194303) req@00000000439507df x1731754353190912/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:744/0 lens 488/440 e 0 to 0 dl 1651530024 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:1.0:1651530018.363972:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000439507df with x1731754353190912 ext(0->4194303) 00002000:00010000:1.0:1651530018.363973:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000439507df 00000001:00080000:0.0:1651530018.525988:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706509 is committed 00000001:00080000:0.0:1651530018.525993:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706508 is committed 00000100:00100000:1.0:1651530019.040268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530019.040293:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847168 00000100:00100000:1.0:1651530019.040316:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 75 00000100:00100000:1.0:1651530019.040318:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946847168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530019.040349:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 85431232 pending 0 free 81207918592 avail 77037207552 00000100:00100000:1.0:1651530019.040374:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ef56f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946847168:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530019.040378:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 75 00000400:00000080:1.0:1651530021.338533:0:198582:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530021.338536:0:198582:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 152: test read/write with enomem ====================================================================================== 22:20:19 (1651530019) 00000100:00100000:1.0:1651530021.415670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530021.415689:0:176856:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192128 00000100:00100000:1.0:1651530021.415752:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:1.0:1651530021.415755:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451155:x1731754353192128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530021.415767:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530021.415831:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32cf lrc: 0/0,0 mode: --/PR res: [0x2beaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7ad0 expref: 6 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.415850:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530021.415894:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:451155:x1731754353192128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 138us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530021.415898:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00000400:00000080:1.0:1651530022.691042:0:198800:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530022.691045:0:198800:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 153: test if fdatasync does not crash ================================================================================= 22:20:22 (1651530022) 00000100:00100000:1.0:1651530022.717150:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530022.717169:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192704 00000100:00100000:1.0:1651530022.717199:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 889 00000100:00100000:1.0:1651530022.717202:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:461491:x1731754353192704:12345-10.240.43.64@tcp:101:multiop.0 00010000:00010000:1.0:1651530022.717211:0:176864:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530022.717228:0:176864:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 2/0,0 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7b1d expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530022.717247:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530022.717260:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530022.717261:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530022.717266:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 3/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 6 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.717274:0:176864:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 3/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 6 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.717280:0:176864:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530022.717301:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:461491:x1731754353192704:12345-10.240.43.64@tcp:101:multiop.0 Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530022.717305:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 889 00000100:00100000:1.0:1651530022.717749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530022.717773:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192768 00002000:00100000:1.0:1651530022.717792:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beb0:0x0] (0->4095) req@00000000f3bcca9b x1731754353192768/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:748/0 lens 4584/0 e 0 to 0 dl 1651530028 ref 1 fl New:/0/ffffffff rc 0/-1 job:'multiop.0' 00002000:00100000:1.0:1651530022.717798:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f3bcca9b with x1731754353192768 ext(0->4095) 00002000:00010000:1.0:1651530022.717800:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f3bcca9b 00000100:00100000:1.0:1651530022.717824:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 46 00000100:00100000:1.0:1651530022.717826:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353192768:12345-10.240.43.64@tcp:4:multiop.0 00000100:00100000:1.0:1651530022.718421:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcca9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353192768:12345-10.240.43.64@tcp:4:multiop.0 Request processed in 593us (672us total) trans 38654706510 rc 0/0 00000100:00100000:1.0:1651530022.718425:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 46 00002000:00100000:1.0:1651530022.718435:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beb0:0x0] (0->4095) req@00000000f3bcca9b x1731754353192768/t38654706510(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:748/0 lens 4584/448 e 0 to 0 dl 1651530028 ref 1 fl Complete:/0/0 rc 0/0 job:'multiop.0' 00002000:00100000:1.0:1651530022.718439:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f3bcca9b with x1731754353192768 ext(0->4095) 00002000:00010000:1.0:1651530022.718441:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f3bcca9b 00000100:00100000:1.0:1651530022.748640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530022.748650:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847296 00000100:00100000:1.0:1651530022.748665:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 890 00000100:00100000:1.0:1651530022.748667:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946847296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530022.748674:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179887 count 1 00002000:00010000:1.0:1651530022.748690:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beaf:0x0] initial LVB size: 12288, mtime: 0x6270591d, atime: 0x0, ctime: 0x6270591d, blocks: 0x18 00010000:00010000:1.0:1651530022.748693:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 3/0,1 mode: --/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.748698:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530022.748698:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530022.748699:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 3/0,1 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.748704:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 3/0,1 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.748708:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 3/0,1 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530022.748711:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 2/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530022.748740:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 2/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530022.748754:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530022.748761:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 2/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530022.748766:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 3/0,0 mode: PW/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530022.748775:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 1/0,0 mode: --/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530022.748778:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c32dd lrc: 0/0,0 mode: --/PW res: [0x2beaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530022.748841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530022.748897:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192896 00000100:00100000:1.0:1651530022.748913:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 891 00000100:00100000:1.0:1651530022.748915:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353192896:12345-10.240.43.64@tcp:16:multiop.0 00000100:00100000:1.0:1651530022.749229:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0d742 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946847296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 560us (588us total) trans 38654706511 rc 0/0 00000100:00100000:1.0:1651530022.749232:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 890 00000001:00080000:0.0:1651530022.773693:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706511 is committed 00000001:00080000:0.0:1651530022.773696:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706510 is committed 00000100:00100000:1.0:1651530022.773731:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4a4558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353192896:12345-10.240.43.64@tcp:16:multiop.0 Request processed in 24815us (24890us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530022.773735:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 891 00000400:00000080:1.0:1651530024.034431:0:199018:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530024.034433:0:199018:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154A: lfs path2fid and fid2path basic checks ========================================================== 22:20:23 (1651530023) 00000100:00100000:1.0:1651530024.160216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530024.160236:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847424 00000100:00100000:1.0:1651530024.160266:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 76 00000100:00100000:1.0:1651530024.160269:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946847424:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530024.160281:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207918592 avail 77037178880 00000100:00100000:1.0:1651530024.160306:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f689d7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946847424:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 36us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530024.160309:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 76 00000400:00000080:1.0:1651530025.332906:0:199236:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530025.332908:0:199236:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154B: verify the ll_decode_linkea tool ==== 22:20:25 (1651530025) 00000100:00100000:1.0:1651530025.361992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530025.362009:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353194304 00000100:00100000:1.0:1651530025.362029:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 892 00000100:00100000:1.0:1651530025.362032:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353194304:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530025.362505:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000907f6ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353194304:12345-10.240.43.64@tcp:2:touch.0 Request processed in 471us (515us total) trans 38654706512 rc 0/0 00000100:00100000:1.0:1651530025.362509:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 892 00000400:00000080:0.0:1651530026.642795:0:199454:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530026.642797:0:199454:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154a: Open-by-FID ========================= 22:20:26 (1651530026) 00000100:00100000:1.0:1651530026.790730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.790749:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353200128 00000100:00100000:1.0:1651530026.790771:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 893 00000100:00100000:1.0:1651530026.790774:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353200128:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530026.790916:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f21b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353200128:12345-10.240.43.64@tcp:2:touch.0 Request processed in 141us (190us total) trans 38654706513 rc 0/0 00000100:00100000:1.0:1651530026.790921:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 893 00000100:00100000:1.0:1651530026.795321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.795330:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353200448 00000100:00100000:1.0:1651530026.795343:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 894 00000100:00100000:1.0:1651530026.795345:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353200448:12345-10.240.43.64@tcp:101:mv.0 00010000:00010000:1.0:1651530026.795351:0:176864:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530026.795366:0:176864:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 2/0,0 mode: --/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7c27 expref: -99 pid: 176864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530026.795375:0:176864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb2:0x0] initial LVB size: 0, mtime: 0x6270592a, atime: 0x6270592a, ctime: 0x6270592a, blocks: 0x0 00010000:00010000:1.0:1651530026.795387:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.795388:0:176864:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.795392:0:176864:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 3/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 9 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.795399:0:176864:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 3/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 9 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.795413:0:176864:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e53a570, rc 0) 00000100:00100000:1.0:1651530026.795425:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a0ac54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353200448:12345-10.240.43.64@tcp:101:mv.0 Request processed in 79us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530026.795428:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 894 00000100:00100000:1.0:1651530026.870061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.870070:0:176864:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353205824 00000100:00100000:1.0:1651530026.870084:0:176864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 895 00000100:00100000:1.0:1651530026.870086:0:176864:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353205824:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530026.870145:0:176864:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ce3bc2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353205824:12345-10.240.43.64@tcp:2:touch.0 Request processed in 58us (84us total) trans 38654706514 rc 0/0 00000100:00100000:1.0:1651530026.870149:0:176864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 895 00000100:00100000:1.0:1651530026.938863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530026.938874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530026.938891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530026.938899:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848064 00000100:00100000:1.0:1651530026.938901:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848192 00000100:00100000:1.0:1651530026.938910:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848128 00000100:00100000:0.0:1651530026.938918:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 896 00000100:00100000:0.0:1651530026.938920:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946848192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1651530026.938922:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 897 00000100:00100000:1.0:1651530026.938923:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946848064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651530026.938930:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179890 count 1 00002000:00080000:1.0:1651530026.938931:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179888 count 1 00010000:00010000:1.0:1651530026.938938:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.938939:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: --/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.938946:0:176863:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 2/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 9 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.938946:0:196143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 2/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 9 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530026.938950:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530026.938951:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530026.938960:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 4/0,1 mode: --/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.938961:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530026.938961:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530026.938962:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 4/0,1 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.938979:0:196143:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 3/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 9 pid: 176864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.938980:0:176863:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 3/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 9 pid: 176864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.938985:0:196143:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 4/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 9 pid: 176864 timeout: 13776 lvb_type: 1 00010000:00010000:1.0:1651530026.938986:0:176863:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 4/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 9 pid: 176864 timeout: 13776 lvb_type: 0 00000100:00100000:1.0:1651530026.938991:0:176863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966731776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530026.938992:0:196143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530026.939011:0:176863:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cf70d77b going to sleep for 6 seconds 00000100:00100000:0.0:1651530026.939013:0:196143:0:(client.c:2492:ptlrpc_set_wait()) set 000000002e117113 going to sleep for 6 seconds 00000100:00100000:1.0:1651530026.939019:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 898 00000100:00100000:1.0:1651530026.939021:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946848128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530026.939026:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179889 count 1 00002000:00010000:1.0:1651530026.939033:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb1:0x0] initial LVB size: 0, mtime: 0x62705929, atime: 0x62705929, ctime: 0x62705929, blocks: 0x0 00010000:00010000:1.0:1651530026.939035:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 3/0,1 mode: --/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939038:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.939039:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.939040:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 3/0,1 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939045:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 3/0,1 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939066:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 3/0,1 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939069:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 2/0,0 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939148:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 2/0,0 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939152:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530026.939153:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 2/0,0 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939157:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 3/0,0 mode: PW/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939164:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 1/0,0 mode: --/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.939167:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c32f9 lrc: 0/0,0 mode: --/PW res: [0x2beb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530026.939378:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946848128:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 356us (486us total) trans 38654706515 rc 0/0 00000100:00100000:1.0:1651530026.939382:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 898 00000100:00100000:0.0:1651530026.939908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.939919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.939921:0:176863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966731776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530026.939928:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353208576 00010000:00010000:1.0:1651530026.939935:0:176863:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.939935:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 4/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 10 pid: 176864 timeout: 13776 lvb_type: 0 00000100:00100000:0.0:1651530026.939945:0:176855:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353208640 00010000:00010000:0.0:1651530026.939948:0:176855:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 5/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 11 pid: 176864 timeout: 13776 lvb_type: 1 00000100:00100000:1.0:1651530026.939951:0:176856:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:1.0:1651530026.939954:0:176856:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353208576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651530026.939956:0:176855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00010000:00010000:1.0:1651530026.939958:0:176856:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651530026.939958:0:176855:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353208640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530026.939960:0:176856:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 4/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 11 pid: 176864 timeout: 13776 lvb_type: 0 00010000:00010000:0.0:1651530026.939961:0:176855:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530026.939963:0:176855:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 5/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 11 pid: 176864 timeout: 13776 lvb_type: 1 00010000:00010000:1.0:1651530026.939965:0:176856:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 3/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 11 pid: 176864 timeout: 13776 lvb_type: 0 00010000:00010000:1.0:1651530026.939971:0:176856:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c32d6 lrc: 0/0,0 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b1d expref: 11 pid: 176864 timeout: 13776 lvb_type: 0 00010000:00010000:1.0:1651530026.939975:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.939976:0:176856:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.939977:0:176856:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.939978:0:176855:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 4/0,0 mode: PR/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 10 pid: 176864 timeout: 13776 lvb_type: 1 00010000:00010000:1.0:1651530026.939980:0:176856:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 4/0,1 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.939986:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530026.939986:0:176855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.939987:0:176856:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651530026.939987:0:176855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.939990:0:176855:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 4/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530026.939996:0:176856:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353208576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (90us total) trans 0 rc 0/0 00010000:00010000:0.0:1651530026.939996:0:176855:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530026.939999:0:176856:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651530026.940004:0:176855:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353208640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530026.940007:0:176855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00010000:00010000:1.0:1651530026.940015:0:176863:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940019:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.940021:0:196143:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c32e4 lrc: 0/0,0 mode: --/PR res: [0x2beb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7c27 expref: 8 pid: 176864 timeout: 13776 lvb_type: 1 00010000:00010000:1.0:1651530026.940022:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,1 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940025:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 2/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530026.940026:0:196143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000336087c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966731712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530026.940030:0:196143:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.940033:0:196143:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.940036:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.940047:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,1 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.940050:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 2/0,0 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940079:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 2/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940084:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530026.940085:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 2/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940088:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 3/0,0 mode: PW/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940101:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 1/0,0 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940104:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c32eb lrc: 0/0,0 mode: --/PW res: [0x2beb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940109:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 2/0,0 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940119:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aa865cce already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530026.940120:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 2/0,0 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940123:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 3/0,0 mode: PW/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940126:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 1/0,0 mode: --/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.940129:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa865cce/0xa29a79078f3c32f2 lrc: 0/0,0 mode: --/PW res: [0x2beb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530026.940316:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946848064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1391us (1453us total) trans 38654706516 rc 0/0 00000100:00100000:0.0:1651530026.940316:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946848192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1395us (1441us total) trans 38654706517 rc 0/0 00000100:00100000:0.0:1651530026.940320:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 896 00000100:00100000:1.0:1651530026.940322:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 897 00000001:00080000:1.0:1651530028.246653:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706517 is committed 00000001:00080000:1.0:1651530028.246660:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706514 is committed 00000400:00000080:1.0:1651530028.265437:0:199672:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530028.265439:0:199672:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154b: Open-by-FID for remote directory ==== 22:20:27 (1651530027) 00000400:00000080:0.0:1651530028.566817:0:199726:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530028.566820:0:199726:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_154b needs >= 2 MDTs 00000400:00000080:1.0:1651530028.901187:0:199780:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530028.901190:0:199780:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154c: lfs path2fid and fid2path multiple arguments ========================================================== 22:20:28 (1651530028) 00000100:00100000:0.0:1651530028.927511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530028.927543:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353214592 00000100:00100000:1.0:1651530028.927568:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 899 00000100:00100000:1.0:1651530028.927571:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438148:x1731754353214592:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530028.927691:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353214592:12345-10.240.43.64@tcp:2:touch.0 Request processed in 119us (182us total) trans 38654706518 rc 0/0 00000100:00100000:1.0:1651530028.927695:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 899 00000100:00100000:0.0:1651530028.931059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530028.931082:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353215488 00000100:00100000:1.0:1651530028.931100:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 900 00000100:00100000:1.0:1651530028.931102:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353215488:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530028.931141:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353215488:12345-10.240.43.64@tcp:2:touch.0 Request processed in 38us (82us total) trans 38654706519 rc 0/0 00000100:00100000:1.0:1651530028.931144:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 900 00000100:00100000:0.0:1651530029.281108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530029.281126:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848704 00000100:00100000:0.0:1651530029.281161:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 77 00000100:00100000:0.0:1651530029.281164:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000bf9a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946848704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530029.281181:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530029.281207:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000bf9a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946848704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530029.281211:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 77 00000400:00000080:1.0:1651530030.217108:0:199998:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530030.217111:0:199998:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154d: Verify open file fid ================ 22:20:29 (1651530029) 00000100:00100000:0.0:1651530031.804872:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731840:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530031.804880:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731904:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530031.805276:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045555879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966731840:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530031.805289:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966731904:10.240.43.61@tcp:400:kworker/u4:2.0 00000400:00000080:1.0:1651530032.967176:0:200216:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530032.967179:0:200216:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154e: .lustre is not returned by readdir == 22:20:32 (1651530032) 00000400:00000080:1.0:1651530034.333127:0:200434:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530034.333130:0:200434:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154f: get parent fids by reading link ea == 22:20:34 (1651530034) 00000100:00100000:0.0:1651530034.373282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530034.373317:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353218240 00000100:00100000:1.0:1651530034.373353:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 901 00000100:00100000:1.0:1651530034.373356:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353218240:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530034.373367:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530034.373388:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 2/0,0 mode: --/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7eab expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530034.373405:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530034.373418:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530034.373419:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530034.373423:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 3/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 8 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530034.373432:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 3/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 8 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530034.373438:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b8f49831, rc 0) 00000100:00100000:1.0:1651530034.373466:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353218240:12345-10.240.43.64@tcp:101:cp.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530034.373470:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 901 00000100:00100000:0.0:1651530034.374301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530034.374319:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353218368 00000100:00100000:1.0:1651530034.374332:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 902 00000100:00100000:1.0:1651530034.374334:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:466084:x1731754353218368:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530034.374338:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530034.374342:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 2/0,0 mode: --/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7eb9 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530034.374350:0:176863:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 2/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530034.374353:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530034.374354:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530034.374355:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 4/0,0 mode: --/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 9 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530034.374367:0:176863:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 3/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530034.374380:0:176863:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 4/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 13784 lvb_type: 1 00000100:00100000:1.0:1651530034.374386:0:176863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966731968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530034.374410:0:176863:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a65f0ac5 going to sleep for 6 seconds 00000100:00100000:0.0:1651530034.374764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530034.374773:0:176863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966731968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530034.374774:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353218432 00010000:00010000:1.0:1651530034.374780:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 3/0,0 mode: --/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 10 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530034.374786:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00010000:00010000:0.0:1651530034.374792:0:195164:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 4/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 10 pid: 176863 timeout: 13784 lvb_type: 1 00000100:00100000:1.0:1651530034.374800:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:466084:x1731754353218368:12345-10.240.43.64@tcp:101:cp.0 Request processed in 465us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530034.374814:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 902 00000100:00100000:0.0:1651530034.374822:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651530034.374825:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353218432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530034.374830:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530034.374836:0:195164:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 4/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 13784 lvb_type: 1 00010000:00010000:0.0:1651530034.374841:0:195164:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 3/0,0 mode: PR/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 13784 lvb_type: 1 00010000:00010000:0.0:1651530034.374850:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c3300 lrc: 0/0,0 mode: --/PR res: [0x2beb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eab expref: 9 pid: 176863 timeout: 13784 lvb_type: 1 00010000:00010000:0.0:1651530034.374854:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530034.374855:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530034.374857:0:195164:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 2/0,0 mode: PW/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530034.374861:0:195164:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 3/0,0 mode: PW/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530034.374871:0:195164:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 3/0,0 mode: PW/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530034.374886:0:195164:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:195164:1731745966732032:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530034.374899:0:195164:0:(client.c:2492:ptlrpc_set_wait()) set 000000002e117113 going to sleep for 6 seconds 00000100:00100000:0.0:1651530034.375126:0:195164:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c89c54 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:195164:1731745966732032:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530034.375131:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530034.375141:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353218432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 315us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530034.375144:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000001:00080000:1.0:1651530034.396291:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706519 is committed 00000100:00100000:0.0:1651530034.400107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530034.400117:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848960 00000100:00100000:0.0:1651530034.400132:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 78 00000100:00100000:0.0:1651530034.400134:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946848960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530034.400145:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530034.400158:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039c89c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946848960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530034.400161:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 78 00000400:00000080:0.0:1651530035.780481:0:200652:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530035.780483:0:200652:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154g: various llapi FID tests ============= 22:20:35 (1651530035) 00000100:00100000:0.0:1651530039.520191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530039.520211:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849152 00000100:00100000:0.0:1651530039.520238:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 79 00000100:00100000:0.0:1651530039.520241:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946849152:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530039.520261:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530039.520288:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a38e86d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946849152:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530039.520305:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 79 00000100:00100000:0.0:1651530039.534642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530039.534666:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849280 00000100:00100000:1.0:1651530039.534686:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 903 00000100:00100000:1.0:1651530039.534689:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946849280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530039.534699:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179895 count 1 00002000:00010000:1.0:1651530039.534730:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530039.534734:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 3/0,1 mode: --/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534741:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530039.534742:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530039.534745:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 3/0,1 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534757:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 3/0,1 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534761:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 3/0,1 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534764:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 2/0,0 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534836:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 2/0,0 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534842:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530039.534844:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 2/0,0 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534848:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 3/0,0 mode: PW/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534857:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 1/0,0 mode: --/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534860:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c330e lrc: 0/0,0 mode: --/PW res: [0x2beb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530039.535197:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946849280:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 507us (555us total) trans 38654706520 rc 0/0 00000100:00100000:1.0:1651530039.535201:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 903 00000100:00100000:0.0:1651530042.048963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530042.048992:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353618880 00000100:00100000:1.0:1651530042.049020:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651530042.049023:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353618880:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530042.049063:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353618880:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 40us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530042.049067:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:0.0:1651530044.584152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530044.584182:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849472 00000100:00100000:1.0:1651530044.584209:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 904 00000100:00100000:1.0:1651530044.584212:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946849472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530044.584229:0:176863:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179896 count 1 00002000:00010000:1.0:1651530044.584256:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530044.584260:0:176863:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 3/0,1 mode: --/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530044.584273:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530044.584274:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530044.584276:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 3/0,1 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530044.584283:0:176863:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 3/0,1 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530044.584288:0:176863:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 3/0,1 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530044.584291:0:176863:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 2/0,0 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530044.584317:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 2/0,0 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530044.584324:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530044.584325:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 2/0,0 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530044.584340:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 3/0,0 mode: PW/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530044.584350:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 1/0,0 mode: --/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530044.584353:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c3315 lrc: 0/0,0 mode: --/PW res: [0x2beb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530044.584699:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946849472:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 486us (550us total) trans 38654706521 rc 0/0 00000100:00100000:1.0:1651530044.584703:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 904 00000001:00080000:1.0:1651530044.609155:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706521 is committed 00000100:00100000:0.0:1651530044.640112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530044.640124:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849536 00000100:00100000:0.0:1651530044.640142:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 80 00000100:00100000:0.0:1651530044.640144:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849536:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530044.640155:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530044.640170:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c5625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849536:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 26us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530044.640174:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 80 00000100:00100000:0.0:1651530049.760181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530049.760200:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849856 00000100:00100000:0.0:1651530049.760227:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 81 00000100:00100000:0.0:1651530049.760230:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946849856:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530049.760249:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530049.760275:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001831d34a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946849856:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530049.760279:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 81 00000100:00100000:0.0:1651530054.880138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530054.880157:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849984 00000100:00100000:0.0:1651530054.880185:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 82 00000100:00100000:0.0:1651530054.880188:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849984:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530054.880208:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530054.880235:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003052a6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849984:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530054.880239:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 82 00000100:00100000:0.0:1651530056.892895:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732096:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530056.892953:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651530056.892957:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966732160:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530056.893294:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966732160:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530056.893298:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000492a58a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732096:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530060.000204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530060.000223:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850112 00000100:00100000:0.0:1651530060.000250:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 83 00000100:00100000:0.0:1651530060.000252:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946850112:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530060.000271:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530060.000297:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd33cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946850112:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530060.000301:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 83 00000100:00100000:0.0:1651530065.121193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530065.121211:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850240 00000100:00100000:0.0:1651530065.121238:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 84 00000100:00100000:0.0:1651530065.121254:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850240:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530065.121274:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 93840320 pending 0 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530065.121304:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a432c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850240:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530065.121308:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 84 00000100:00100000:0.0:1651530067.649014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530067.649044:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754355599488 00000100:00100000:1.0:1651530067.649073:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530067.649076:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754355599488:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530067.649131:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754355599488:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530067.649134:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651530069.185064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530069.185105:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754355973632 00002000:00100000:1.0:1651530069.185140:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beb6:0x0] (0->157) req@00000000d37dbb13 x1731754355973632/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:40/0 lens 648/0 e 0 to 0 dl 1651530075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530069.185158:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d37dbb13 with x1731754355973632 ext(0->157) 00002000:00010000:1.0:1651530069.185161:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d37dbb13 00000100:00100000:1.0:1651530069.185174:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 47 00000100:00100000:1.0:1651530069.185176:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754355973632:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530069.185535:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d37dbb13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754355973632:12345-10.240.43.64@tcp:4:cp.0 Request processed in 358us (474us total) trans 38654706522 rc 0/0 00000100:00100000:1.0:1651530069.185539:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 47 00002000:00100000:1.0:1651530069.185543:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2beb6:0x0] (0->157) req@00000000d37dbb13 x1731754355973632/t38654706522(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:40/0 lens 648/448 e 0 to 0 dl 1651530075 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530069.185547:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d37dbb13 with x1731754355973632 ext(0->157) 00002000:00010000:1.0:1651530069.185549:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d37dbb13 00000100:00100000:0.0:1651530069.659443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530069.659476:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356077376 00000100:00100000:1.0:1651530069.659500:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 905 00000100:00100000:1.0:1651530069.659503:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356077376:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:1.0:1651530069.659511:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530069.659532:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c331c lrc: 2/0,0 mode: --/PR res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30b097 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530069.659543:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530069.659552:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530069.659553:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530069.659557:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c331c lrc: 3/0,0 mode: PR/PR res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b097 expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530069.659566:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c331c lrc: 3/0,0 mode: PR/PR res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b097 expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530069.659578:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a7b944c, rc 0) 00000100:00100000:1.0:1651530069.659601:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356077376:12345-10.240.43.64@tcp:101:rm.0 Request processed in 98us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530069.659605:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 905 00000100:00100000:0.0:1651530070.240168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530070.240186:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850368 00000100:00100000:0.0:1651530070.240212:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 85 00000100:00100000:0.0:1651530070.240215:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b8ab07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530070.240229:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 102278080 pending 28672 free 81207930880 avail 77037219840 00000100:00100000:0.0:1651530070.240254:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b8ab07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850368:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530070.240258:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 85 00000400:00000080:0.0:1651530071.553327:0:200871:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530071.553330:0:200871:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 22:21:11 (1651530071) 00000100:00100000:0.0:1651530072.250830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530072.251046:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356237632 00000100:00100000:1.0:1651530072.251072:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530072.251075:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451154:x1731754356237632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530072.251082:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1651530072.251103:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c331c lrc: 0/0,0 mode: --/PR res: [0x2beb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b097 expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1651530072.251125:0:195164:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2beb6:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1651530072.251126:0:195164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2beb6:0x0] updating lvb mtime from disk: 0 -> 1651530034 00002000:00010000:1.0:1651530072.251127:0:195164:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2beb6:0x0] updating lvb ctime from disk: 0 -> 1651530034 00002000:00010000:1.0:1651530072.251128:0:195164:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2beb6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1651530072.251131:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3307 lrc: 0/0,0 mode: --/PW res: [0x2beb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7eb9 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.251136:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530072.251164:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754356237632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530072.251168:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00000400:00000080:0.0:1651530074.218864:0:201309:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530074.218867:0:201309:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 22:21:13 (1651530073) 00000100:00100000:0.0:1651530074.816985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530074.817034:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356240896 00000100:00100000:0.0:1651530074.817074:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651530074.817077:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356240896:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530074.817143:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356240896:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530074.817147:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651530075.183816:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530075.183834:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241344 00000100:00100000:0.0:1651530075.183854:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 906 00000100:00100000:0.0:1651530075.183856:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356241344:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530075.183866:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530075.183891:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 2/0,0 mode: --/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c59e expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530075.183922:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530075.183931:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.183932:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.183936:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.183945:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.183950:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a79ef65, rc 0) 00000100:00100000:0.0:1651530075.183972:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356241344:12345-10.240.43.64@tcp:101:cp.0 Request processed in 115us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530075.183976:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 906 00000100:00100000:0.0:1651530075.184321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530075.184329:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241408 00000100:00100000:0.0:1651530075.184347:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 907 00000100:00100000:0.0:1651530075.184349:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:472318:x1731754356241408:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530075.184353:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530075.184358:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 2/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c5a5 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.184367:0:176863:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 2/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.184371:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.184371:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.184372:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 4/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 9 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.184384:0:176863:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.184389:0:176863:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 13824 lvb_type: 1 00000100:00100000:0.0:1651530075.184395:0:176863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966732224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530075.184414:0:176863:0:(client.c:2492:ptlrpc_set_wait()) set 000000002e117113 going to sleep for 6 seconds 00000100:00100000:0.0:1651530075.184684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530075.184705:0:176863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000aa474e4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966732224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530075.184707:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241472 00010000:00010000:0.0:1651530075.184713:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 3/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 10 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.184719:0:176854:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 10 pid: 196143 timeout: 13824 lvb_type: 1 00010000:00010000:0.0:1651530075.184728:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000015f46ac3, rc 0) 00000100:00100000:0.0:1651530075.184740:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:472318:x1731754356241408:12345-10.240.43.64@tcp:101:cp.0 Request processed in 390us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530075.184743:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 907 00000100:00100000:1.0:1651530075.184756:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:1.0:1651530075.184758:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de11e0ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356241472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530075.184764:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530075.184771:0:176854:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.184790:0:176854:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.184800:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a79ef65/0xa29a79078f3c3323 lrc: 0/0,0 mode: --/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c59e expref: 9 pid: 196143 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.184820:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.184821:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.184824:0:176854:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 2/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.184828:0:176854:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 3/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.184839:0:176854:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 3/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530075.184844:0:176854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009601edf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732288:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530075.184870:0:176854:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a65f0ac5 going to sleep for 6 seconds 00000100:00100000:1.0:1651530075.185122:0:176854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009601edf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732288:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530075.185128:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530075.185147:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de11e0ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356241472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 388us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530075.185151:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651530075.189536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.189566:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241728 00002000:00100000:1.0:1651530075.189592:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->6095) req@000000000aa474e4 x1731754356241728/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 6584/0 e 0 to 0 dl 1651530081 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530075.189601:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000aa474e4 with x1731754356241728 ext(0->6095) 00002000:00010000:1.0:1651530075.189603:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000aa474e4 00000100:00100000:1.0:1651530075.189616:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 48 00000100:00100000:1.0:1651530075.189618:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aa474e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356241728:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530075.190038:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aa474e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754356241728:12345-10.240.43.64@tcp:4:cp.0 Request processed in 418us (502us total) trans 38654706523 rc 0/0 00000100:00100000:1.0:1651530075.190042:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 48 00002000:00100000:1.0:1651530075.190044:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->6095) req@000000000aa474e4 x1731754356241728/t38654706523(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 6584/448 e 0 to 0 dl 1651530081 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530075.190048:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000aa474e4 with x1731754356241728 ext(0->6095) 00002000:00010000:1.0:1651530075.190050:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000aa474e4 00000100:00100000:0.0:1651530075.190311:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.190336:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241792 00000100:00100000:1.0:1651530075.190349:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651530075.190351:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451155:x1731754356241792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530075.190355:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530075.190358:0:176854:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:1.0:1651530075.190359:0:176854:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb mtime from disk: 0 -> 1651530075 00002000:00010000:1.0:1651530075.190368:0:176854:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb ctime from disk: 0 -> 1651530075 00002000:00010000:1.0:1651530075.190369:0:176854:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:1.0:1651530075.190375:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f46ac3/0xa29a79078f3c332a lrc: 0/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5a5 expref: 10 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.190381:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530075.190392:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754356241792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530075.190395:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651530075.197566:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530075.197574:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356241984 00000100:00100000:0.0:1651530075.197583:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 908 00000100:00100000:0.0:1651530075.197584:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356241984:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:0.0:1651530075.197588:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530075.197593:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 2/0,0 mode: --/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c5ba expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530075.197599:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebb:0x0] initial LVB size: 6096, mtime: 0x6270595b, atime: 0x0, ctime: 0x6270595b, blocks: 0x10 00010000:00010000:0.0:1651530075.197604:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.197604:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.197606:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 10 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.197612:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 10 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.197616:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a4f97720, rc 0) 00000100:00100000:0.0:1651530075.197632:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754356241984:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 47us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530075.197643:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 908 00000100:00100000:0.0:1651530075.199561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.199585:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356242112 00002000:00100000:1.0:1651530075.199594:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->4194303) req@000000006faf06e4 x1731754356242112/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 488/0 e 0 to 0 dl 1651530081 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530075.199598:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006faf06e4 with x1731754356242112 ext(0->4194303) 00002000:00010000:1.0:1651530075.199599:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006faf06e4 00000100:00100000:1.0:1651530075.199610:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 49 00000100:00100000:1.0:1651530075.199611:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754356242112:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530075.235220:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006faf06e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754356242112:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 35607us (35658us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1651530075.235224:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 49 00002000:00100000:1.0:1651530075.235227:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->4194303) req@000000006faf06e4 x1731754356242112/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 488/440 e 0 to 0 dl 1651530081 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:1.0:1651530075.235231:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006faf06e4 with x1731754356242112 ext(0->4194303) 00002000:00010000:1.0:1651530075.235233:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006faf06e4 00000100:00100000:1.0:1651530075.241004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530075.241028:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356242304 00000100:00100000:0.0:1651530075.241042:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 909 00000100:00100000:0.0:1651530075.241044:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+10:472324:x1731754356242304:12345-10.240.43.64@tcp:101:truncate.0 00010000:00010000:0.0:1651530075.241049:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530075.241055:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 2/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c5c1 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.241064:0:196143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 2/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.241068:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.241069:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.241070:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 4/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 11 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.241079:0:196143:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530075.241083:0:196143:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 13824 lvb_type: 1 00000100:00100000:0.0:1651530075.241088:0:196143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095a5ff9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966732352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530075.241106:0:196143:0:(client.c:2492:ptlrpc_set_wait()) set 000000002e117113 going to sleep for 6 seconds 00000100:00100000:0.0:1651530075.241339:0:196143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095a5ff9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:196143:1731745966732352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530075.241354:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 3/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 11 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.241360:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000059b4498e, rc 0) 00000100:00100000:0.0:1651530075.241373:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+11:472324:x1731754356242304:12345-10.240.43.64@tcp:101:truncate.0 Request processed in 329us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530075.241376:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 909 00000100:00100000:1.0:1651530075.242463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.242471:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356242368 00010000:00010000:1.0:1651530075.242486:0:176854:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 13824 lvb_type: 1 00000100:00100000:1.0:1651530075.242501:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530075.242503:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754356242368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530075.242507:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530075.242513:0:176854:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 4/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.242518:0:176854:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 3/0,0 mode: PR/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.242525:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f97720/0xa29a79078f3c3331 lrc: 0/0,0 mode: --/PR res: [0x2bebb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5ba expref: 11 pid: 176863 timeout: 13824 lvb_type: 1 00010000:00010000:1.0:1651530075.242529:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.242530:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.242531:0:176854:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 2/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 10 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.242535:0:176854:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 3/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 10 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.242544:0:176854:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 3/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 10 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530075.242548:0:176854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732416:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530075.242572:0:176854:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a65f0ac5 going to sleep for 6 seconds 00000100:00100000:1.0:1651530075.242781:0:176854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014c7e474 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732416:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530075.242786:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530075.242799:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438146:x1731754356242368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 295us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530075.242816:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530075.242884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.242893:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356242432 00002000:00010000:1.0:1651530075.242899:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179899/0 (6000->18446744073709551615) 00002000:00100000:1.0:1651530075.242900:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014c7e474 with x1731754356242432 ext(6000->18446744073709551615) 00002000:00010000:1.0:1651530075.242904:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000014c7e474. 00000100:00100000:1.0:1651530075.242914:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 50 00000100:00100000:1.0:1651530075.242916:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754356242432:12345-10.240.43.64@tcp:10:truncate.0 00002000:00010000:1.0:1651530075.243379:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb size from disk: 6096 -> 6000 00002000:00010000:1.0:1651530075.243381:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb mtime from disk: 1651530075 -> 1651530075 00002000:00010000:1.0:1651530075.243382:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530075.243383:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb ctime from disk: 1651530075 -> 1651530075 00002000:00010000:1.0:1651530075.243384:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebb:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:1.0:1651530075.243401:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014c7e474 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754356242432:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 484us (516us total) trans 38654706524 rc 0/0 00000100:00100000:1.0:1651530075.243404:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 50 00002000:00010000:1.0:1651530075.243405:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179899/0 (6000->18446744073709551615) 00002000:00100000:1.0:1651530075.243406:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014c7e474 with x1731754356242432 ext(6000->18446744073709551615) 00002000:00010000:1.0:1651530075.243408:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000014c7e474. 00000100:00100000:1.0:1651530075.248376:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530075.248394:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356242944 00002000:00100000:1.0:1651530075.248401:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->4194303) req@0000000046898db9 x1731754356242944/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 488/0 e 0 to 0 dl 1651530081 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530075.248406:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046898db9 with x1731754356242944 ext(0->4194303) 00002000:00010000:1.0:1651530075.248407:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046898db9 00000100:00100000:1.0:1651530075.248418:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:1.0:1651530075.248420:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754356242944:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530075.249258:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046898db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754356242944:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 837us (882us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1651530075.249262:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 51 00002000:00100000:1.0:1651530075.249265:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebb:0x0] (0->4194303) req@0000000046898db9 x1731754356242944/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:46/0 lens 488/440 e 0 to 0 dl 1651530081 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:1.0:1651530075.249269:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046898db9 with x1731754356242944 ext(0->4194303) 00002000:00010000:1.0:1651530075.249270:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046898db9 00000100:00100000:1.0:1651530075.260378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000001:00080000:0.0:1651530075.260396:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706523 is committed 00000100:00100000:0.0:1651530075.260407:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851072 00000100:00100000:0.0:1651530075.260418:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 910 00000100:00100000:0.0:1651530075.260420:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946851072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651530075.260435:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179897 count 1 00002000:00010000:0.0:1651530075.260452:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530075.260454:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 3/0,1 mode: --/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260459:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.260460:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.260461:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 3/0,1 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260466:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 3/0,1 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260470:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 3/0,1 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260473:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 2/0,0 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260505:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 2/0,0 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260510:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f25ba4b already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530075.260512:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 2/0,0 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260516:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 3/0,0 mode: PW/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260522:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 1/0,0 mode: --/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260533:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f25ba4b/0xa29a79078f3c333f lrc: 0/0,0 mode: --/PW res: [0x2beb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530075.260759:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946851072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 337us (380us total) trans 38654706525 rc 0/0 00000100:00100000:0.0:1651530075.260763:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 910 00000100:00100000:1.0:1651530075.360819:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530075.360922:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851392 00000100:00100000:0.0:1651530075.360948:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 86 00000100:00100000:0.0:1651530075.360951:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946851392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530075.360979:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 110654400 pending 0 free 81207926784 avail 77037154304 00000100:00100000:0.0:1651530075.361007:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021498c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946851392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530075.361011:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 86 00000400:00000080:1.0:1651530076.896691:0:201747:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530076.896693:0:201747:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 22:21:16 (1651530076) 00000100:00100000:1.0:1651530077.580936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530077.580953:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244160 00000100:00100000:1.0:1651530077.580984:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530077.580986:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356244160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530077.580994:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530077.581016:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4498e/0xa29a79078f3c3338 lrc: 0/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c5c1 expref: 7 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530077.581026:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530077.581050:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454981:x1731754356244160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530077.581054:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00000400:00000080:1.0:1651530079.544713:0:202185:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530079.544715:0:202185:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 22:21:19 (1651530079) 00000100:00100000:1.0:1651530080.480305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530080.480322:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851712 00000100:00100000:1.0:1651530080.480347:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:1.0:1651530080.480349:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946851712:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530080.480375:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 110654400 pending 0 free 81207918592 avail 77037207552 00000100:00100000:1.0:1651530080.480409:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000622c21ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946851712:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.480413:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:1.0:1651530080.500238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.500264:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356247744 00000100:00100000:0.0:1651530080.500284:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 911 00000100:00100000:0.0:1651530080.500287:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356247744:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530080.500295:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530080.500321:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 2/0,0 mode: --/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c67e expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530080.500336:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530080.500345:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.500346:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.500350:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 7 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.500358:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 7 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.500372:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095cff58f, rc 0) 00000100:00100000:0.0:1651530080.500392:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356247744:12345-10.240.43.64@tcp:101:cp.0 Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530080.500396:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 911 00000100:00100000:1.0:1651530080.500761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.500780:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356247808 00000100:00100000:0.0:1651530080.500789:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 912 00000100:00100000:0.0:1651530080.500791:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:473868:x1731754356247808:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530080.500795:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530080.500799:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 2/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c685 expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.500827:0:176863:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 2/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.500831:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.500832:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.500833:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 4/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.500845:0:176863:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.500850:0:176863:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 13830 lvb_type: 1 00000100:00100000:0.0:1651530080.500856:0:176863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095a5ff9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966732480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530080.500884:0:176863:0:(client.c:2492:ptlrpc_set_wait()) set 000000005bc13e98 going to sleep for 6 seconds 00000100:00100000:1.0:1651530080.501170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.501170:0:176863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095a5ff9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:176863:1731745966732480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530080.501178:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 3/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 8 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530080.501181:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356247872 00010000:00010000:0.0:1651530080.501184:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f782055, rc 0) 00010000:00010000:1.0:1651530080.501191:0:176854:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 9 pid: 196143 timeout: 13830 lvb_type: 1 00000100:00100000:0.0:1651530080.501195:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:473868:x1731754356247808:12345-10.240.43.64@tcp:101:cp.0 Request processed in 403us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530080.501198:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 912 00000100:00100000:1.0:1651530080.501206:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:1.0:1651530080.501208:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356247872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530080.501213:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530080.501218:0:176854:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.501223:0:176854:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.501232:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c3346 lrc: 0/0,0 mode: --/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c67e expref: 8 pid: 196143 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.501244:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.501245:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.501248:0:176854:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 2/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 7 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.501262:0:176854:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 3/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 7 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.501272:0:176854:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 3/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 7 pid: 176863 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530080.501276:0:176854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073ff402b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732544:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530080.501291:0:176854:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a65f0ac5 going to sleep for 6 seconds 00000100:00100000:1.0:1651530080.501492:0:176854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073ff402b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732544:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530080.501497:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530080.501507:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356247872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 298us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.501511:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:0.0:1651530080.505829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530080.505843:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248128 00002000:00100000:1.0:1651530080.505855:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->6095) req@0000000095a5ff9b x1731754356248128/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 6584/0 e 0 to 0 dl 1651530086 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530080.505860:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095a5ff9b with x1731754356248128 ext(0->6095) 00002000:00010000:1.0:1651530080.505862:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095a5ff9b 00000100:00100000:1.0:1651530080.505873:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 52 00000100:00100000:1.0:1651530080.505875:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356248128:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530080.506163:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095a5ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356248128:12345-10.240.43.64@tcp:4:cp.0 Request processed in 286us (334us total) trans 38654706526 rc 0/0 00000100:00100000:1.0:1651530080.506166:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 52 00002000:00100000:1.0:1651530080.506178:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->6095) req@0000000095a5ff9b x1731754356248128/t38654706526(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 6584/448 e 0 to 0 dl 1651530086 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530080.506182:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095a5ff9b with x1731754356248128 ext(0->6095) 00002000:00010000:1.0:1651530080.506183:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095a5ff9b 00000100:00100000:0.0:1651530080.506456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530080.506478:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248192 00000100:00100000:1.0:1651530080.506490:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:1.0:1651530080.506492:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754356248192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530080.506496:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530080.506499:0:176854:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:1.0:1651530080.506500:0:176854:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb mtime from disk: 0 -> 1651530080 00002000:00010000:1.0:1651530080.506501:0:176854:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb ctime from disk: 0 -> 1651530080 00002000:00010000:1.0:1651530080.506502:0:176854:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:1.0:1651530080.506508:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c334d lrc: 0/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c685 expref: 9 pid: 176863 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.506513:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530080.506524:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451155:x1731754356248192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.506527:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651530080.513086:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.513095:0:176863:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248384 00000100:00100000:0.0:1651530080.513103:0:176863:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 913 00000100:00100000:0.0:1651530080.513105:0:176863:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356248384:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:0.0:1651530080.513109:0:176863:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530080.513113:0:176863:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 2/0,0 mode: --/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c69a expref: -99 pid: 176863 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530080.513129:0:176863:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebc:0x0] initial LVB size: 6096, mtime: 0x62705960, atime: 0x0, ctime: 0x62705960, blocks: 0x10 00010000:00010000:0.0:1651530080.513134:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.513135:0:176863:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.513136:0:176863:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.513141:0:176863:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 9 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530080.513156:0:176863:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f782055, rc 0) 00000100:00100000:0.0:1651530080.513173:0:176863:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438147:x1731754356248384:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 67us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530080.513176:0:176863:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 913 00000100:00100000:0.0:1651530080.515175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530080.515197:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248512 00002000:00100000:1.0:1651530080.515205:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->4194303) req@000000000028453d x1731754356248512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 488/0 e 0 to 0 dl 1651530086 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530080.515209:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731754356248512 ext(0->4194303) 00002000:00010000:1.0:1651530080.515210:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:1.0:1651530080.515220:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:1.0:1651530080.515222:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754356248512:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530080.519844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530080.519858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530080.519867:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851840 00000100:00100000:0.0:1651530080.519880:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851968 00000100:00100000:0.0:1651530080.519886:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 914 00000100:00100000:0.0:1651530080.519888:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946851840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651530080.519895:0:196143:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179898 count 1 00002000:00010000:0.0:1651530080.519902:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530080.519904:0:196143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 3/0,1 mode: --/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519908:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.519909:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530080.519910:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 3/0,1 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519915:0:196143:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 3/0,1 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519919:0:196143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 3/0,1 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519922:0:196143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 2/0,0 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530080.519930:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 915 00000100:00100000:1.0:1651530080.519933:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946851968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530080.519945:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179899 count 1 00002000:00010000:1.0:1651530080.519953:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebb:0x0] initial LVB size: 6000, mtime: 0x6270595b, atime: 0x0, ctime: 0x6270595b, blocks: 0x10 00010000:00010000:1.0:1651530080.519955:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 3/0,1 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519960:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.519961:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.519962:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 3/0,1 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519966:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 3/0,1 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519969:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 3/0,1 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519972:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 2/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519995:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 2/0,0 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.520000:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095cff58f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530080.520001:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 2/0,0 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.520005:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 3/0,0 mode: PW/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520008:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 2/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.520010:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 1/0,0 mode: --/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520012:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530080.520013:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c335b lrc: 0/0,0 mode: --/PW res: [0x2beba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520030:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 2/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520033:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 3/0,0 mode: PW/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520039:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 1/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.520042:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3362 lrc: 0/0,0 mode: --/PW res: [0x2bebb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530080.520372:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946851840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 482us (528us total) trans 38654706528 rc 0/0 00000100:00100000:0.0:1651530080.520376:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 914 00000100:00100000:0.0:1651530080.520468:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000028453d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754356248512:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 5245us (5293us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530080.520472:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 53 00002000:00100000:0.0:1651530080.520475:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->4194303) req@000000000028453d x1731754356248512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 488/440 e 0 to 0 dl 1651530086 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530080.520479:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000028453d with x1731754356248512 ext(0->4194303) 00002000:00010000:0.0:1651530080.520490:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000028453d 00000100:00100000:1.0:1651530080.520681:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946851968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 747us (822us total) trans 38654706527 rc 0/0 00000100:00100000:1.0:1651530080.520685:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 915 00000100:00100000:1.0:1651530080.526137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530080.526148:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248704 00000100:00100000:1.0:1651530080.526164:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 916 00000100:00100000:1.0:1651530080.526166:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:473874:x1731754356248704:12345-10.240.43.64@tcp:101:truncate.0 00010000:00010000:1.0:1651530080.526172:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530080.526177:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 2/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c6a1 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.526187:0:176865:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 2/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530080.526191:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.526199:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.526200:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 4/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 10 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.526210:0:176865:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530080.526215:0:176865:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 13830 lvb_type: 1 00000100:00100000:1.0:1651530080.526219:0:176865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fb9e9d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966732608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530080.526241:0:176865:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b19a51b6 going to sleep for 6 seconds 00000100:00100000:1.0:1651530080.526448:0:176865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fb9e9d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966732608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530080.526455:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 3/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 10 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.526460:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530080.526476:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:473874:x1731754356248704:12345-10.240.43.64@tcp:101:truncate.0 Request processed in 309us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.526479:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 916 00000100:00100000:1.0:1651530080.527543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530080.527552:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248768 00010000:00010000:1.0:1651530080.527557:0:176854:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 13830 lvb_type: 1 00000100:00100000:1.0:1651530080.527571:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:1.0:1651530080.527573:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438146:x1731754356248768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530080.527583:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530080.527589:0:176854:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 4/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.527593:0:176854:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 3/0,0 mode: PR/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.527600:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f782055/0xa29a79078f3c3354 lrc: 0/0,0 mode: --/PR res: [0x2bebc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c69a expref: 10 pid: 176863 timeout: 13830 lvb_type: 1 00010000:00010000:1.0:1651530080.527603:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.527604:0:176854:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.527605:0:176854:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 2/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 9 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.527609:0:176854:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 3/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 9 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.527618:0:176854:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 3/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 9 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530080.527622:0:176854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b723b39 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732672:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530080.527644:0:176854:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b19a51b6 going to sleep for 6 seconds 00000100:00100000:1.0:1651530080.527883:0:176854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b723b39 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:176854:1731745966732672:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530080.527888:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530080.527900:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754356248768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 326us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.527910:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:1.0:1651530080.527956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.527971:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356248832 00002000:00010000:0.0:1651530080.527980:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179900/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651530080.527981:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731754356248832 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651530080.527984:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39. 00000100:00100000:0.0:1651530080.527991:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 54 00000100:00100000:0.0:1651530080.527993:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356248832:12345-10.240.43.64@tcp:10:truncate.0 00002000:00010000:0.0:1651530080.531796:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb size from disk: 6096 -> 6000 00002000:00010000:0.0:1651530080.531798:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb mtime from disk: 1651530080 -> 1651530080 00002000:00010000:0.0:1651530080.531799:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530080.531800:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb ctime from disk: 1651530080 -> 1651530080 00002000:00010000:0.0:1651530080.531801:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebc:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:0.0:1651530080.531824:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b723b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754356248832:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 3830us (3868us total) trans 38654706529 rc 0/0 00000100:00100000:0.0:1651530080.531828:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 54 00002000:00010000:0.0:1651530080.531829:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179900/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651530080.531830:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b723b39 with x1731754356248832 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651530080.531832:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b723b39. 00000001:00080000:0.0:1651530080.532136:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706526 is committed 00000001:00080000:0.0:1651530080.532140:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706525 is committed 00000100:00100000:1.0:1651530080.537052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.537076:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356249344 00002000:00100000:0.0:1651530080.537086:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->4194303) req@00000000ffc345cf x1731754356249344/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 488/0 e 0 to 0 dl 1651530086 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530080.537090:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731754356249344 ext(0->4194303) 00002000:00010000:0.0:1651530080.537091:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00000100:00100000:0.0:1651530080.537098:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 55 00000100:00100000:0.0:1651530080.537108:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356249344:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530080.537584:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc345cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356249344:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 475us (531us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530080.537588:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 55 00002000:00100000:0.0:1651530080.537591:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebc:0x0] (0->4194303) req@00000000ffc345cf x1731754356249344/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:51/0 lens 488/440 e 0 to 0 dl 1651530086 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530080.537595:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffc345cf with x1731754356249344 ext(0->4194303) 00002000:00010000:0.0:1651530080.537596:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ffc345cf 00000100:00100000:1.0:1651530081.980908:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d66fdca2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966732800:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530081.980909:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abd26db6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732736:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530081.981349:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d66fdca2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966732800:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530081.981354:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abd26db6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732736:10.240.43.61@tcp:400:kworker/u4:2.0 00000400:00000080:0.0:1651530082.186725:0:202623:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530082.186728:0:202623:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155e: Verify big file correctness: read cache:on write_cache:on ========================================================== 22:21:21 (1651530081) 00000100:00100000:0.0:1651530082.867758:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530082.868692:0:176854:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356250560 00000100:00100000:1.0:1651530082.868721:0:176854:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530082.868724:0:176854:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3edcbf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356250560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530082.868732:0:176854:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530082.868752:0:176854:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3369 lrc: 0/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6a1 expref: 7 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530082.868761:0:176854:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530082.868784:0:176854:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3edcbf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454981:x1731754356250560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530082.868787:0:176854:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:0.0:1651530083.776664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530083.776694:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852288 00000100:00100000:1.0:1651530083.776722:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 917 00000100:00100000:1.0:1651530083.776725:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946852288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530083.776741:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179900 count 1 00002000:00010000:1.0:1651530083.776758:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebc:0x0] initial LVB size: 6000, mtime: 0x62705960, atime: 0x0, ctime: 0x62705960, blocks: 0x10 00010000:00010000:1.0:1651530083.776762:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 3/0,1 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776786:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530083.776787:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530083.776789:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 3/0,1 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776796:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 3/0,1 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776800:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 3/0,1 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776816:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 2/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776897:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 2/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776902:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530083.776903:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 2/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776907:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 3/0,0 mode: PW/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776915:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 1/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530083.776928:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3370 lrc: 0/0,0 mode: --/PW res: [0x2bebc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530083.777175:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946852288:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 449us (514us total) trans 38654706530 rc 0/0 00000100:00100000:1.0:1651530083.777179:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 917 00000100:00100000:0.0:1651530085.600181:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530085.600197:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852416 00000100:00100000:0.0:1651530085.600220:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 88 00000100:00100000:0.0:1651530085.600222:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946852416:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530085.600238:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530085.600264:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000307b836d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946852416:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530085.600267:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 88 00000001:00080000:0.0:1651530086.200731:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706530 is committed 00000001:00080000:0.0:1651530086.200739:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706529 is committed 00000100:00100000:0.0:1651530090.176956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530090.176985:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356250816 00000100:00100000:1.0:1651530090.177012:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530090.177014:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356250816:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530090.177048:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356250816:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530090.177051:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:0.0:1651530090.720150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530090.720160:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852480 00000100:00100000:0.0:1651530090.720178:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 89 00000100:00100000:0.0:1651530090.720180:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530090.720193:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530090.720212:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aae53944 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 31us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530090.720216:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 89 00000100:00100000:0.0:1651530092.646832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530092.646845:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356250880 00000100:00100000:0.0:1651530092.646865:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 90 00000100:00100000:0.0:1651530092.646867:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:475074:x1731754356250880:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530092.646882:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530092.646913:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbd270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:475074:x1731754356250880:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530092.646917:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 90 00000400:00000080:0.0:1651530094.879121:0:203061:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530094.879133:0:203061:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155f: Verify big file correctness: read cache:on write_cache:off ========================================================== 22:21:34 (1651530094) 00000100:00100000:0.0:1651530095.840238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530095.840256:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852800 00000100:00100000:0.0:1651530095.840281:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 91 00000100:00100000:0.0:1651530095.840284:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530095.840302:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530095.840330:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001dfd8468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852800:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530095.840343:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 91 00000100:00100000:0.0:1651530100.960217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530100.960233:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853056 00000100:00100000:0.0:1651530100.960258:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 92 00000100:00100000:0.0:1651530100.960261:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530100.960279:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530100.960306:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044516f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530100.960310:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 92 00000100:00100000:0.0:1651530102.697926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530102.697939:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356254080 00000100:00100000:0.0:1651530102.697961:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 93 00000100:00100000:0.0:1651530102.697964:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:476209:x1731754356254080:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530102.697979:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530102.698007:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cbc277d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:476209:x1731754356254080:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 43us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530102.698011:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 93 00000400:00000080:1.0:1651530104.755347:0:203499:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530104.755349:0:203499:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155g: Verify big file correctness: read cache:off write_cache:on ========================================================== 22:21:44 (1651530104) 00000100:00100000:0.0:1651530106.080217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530106.080235:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853312 00000100:00100000:0.0:1651530106.080261:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 94 00000100:00100000:0.0:1651530106.080264:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946853312:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530106.080281:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530106.080310:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091613880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946853312:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530106.080326:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 94 00000100:00100000:0.0:1651530107.068905:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5078479 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732864:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530107.068912:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b840a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966732928:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530107.069247:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b840a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966732928:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530107.069248:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5078479 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732864:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530111.201643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530111.201660:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853568 00000100:00100000:0.0:1651530111.201685:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 95 00000100:00100000:0.0:1651530111.201688:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530111.201706:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530111.201733:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5078479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530111.201737:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 95 00000100:00100000:0.0:1651530112.570156:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.570170:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356257600 00000100:00100000:0.0:1651530112.570191:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 96 00000100:00100000:0.0:1651530112.570194:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:477305:x1731754356257600:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530112.570209:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530112.570238:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000830ccf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:477305:x1731754356257600:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 43us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530112.570241:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 96 00000400:00000080:1.0:1651530114.630085:0:203937:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530114.630088:0:203937:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155h: Verify big file correctness: read cache:off write_cache:off ========================================================== 22:21:54 (1651530114) 00000100:00100000:0.0:1651530116.321325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530116.321344:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853888 00000100:00100000:0.0:1651530116.321369:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 97 00000100:00100000:0.0:1651530116.321372:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530116.321406:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530116.321435:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db30feb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530116.321439:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 97 00000100:00100000:0.0:1651530121.440192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530121.440208:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854144 00000100:00100000:0.0:1651530121.440233:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 98 00000100:00100000:0.0:1651530121.440236:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854144:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1651530121.440253:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530121.440280:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b840a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854144:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530121.440283:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 98 00000100:00100000:0.0:1651530123.708129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530123.708153:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260928 00000100:00100000:0.0:1651530123.708174:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 99 00000100:00100000:0.0:1651530123.708177:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:478479:x1731754356260928:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530123.708192:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 119030720 pending 0 free 81207926784 avail 77037215744 00000100:00100000:0.0:1651530123.708220:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a74cd038 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:478479:x1731754356260928:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530123.708224:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 99 00000400:00000080:0.0:1651530125.774708:0:204375:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530125.774710:0:204375:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 156: Verification of tunables ============= 22:22:05 (1651530125) 00000100:00100000:0.0:1651530126.283749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530126.283781:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265088 00000100:00100000:1.0:1651530126.283820:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 918 00000100:00100000:1.0:1651530126.283823:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:479189:x1731754356265088:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651530126.283833:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530126.283859:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3377 lrc: 2/0,0 mode: --/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c822 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530126.283871:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530126.283881:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.283882:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.283887:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3377 lrc: 3/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c822 expref: 6 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.283895:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3377 lrc: 3/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c822 expref: 6 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.283901:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac0794d8, rc 0) 00000100:00100000:1.0:1651530126.283925:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e27626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:479189:x1731754356265088:12345-10.240.43.64@tcp:101:dd.0 Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.283928:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 918 00000100:00100000:1.0:1651530126.515987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530126.516015:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265280 00002000:00100000:0.0:1651530126.516039:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebd:0x0] (0->16383) req@00000000d66fdca2 x1731754356265280/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 16872/0 e 0 to 0 dl 1651530132 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530126.516059:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d66fdca2 with x1731754356265280 ext(0->16383) 00002000:00010000:0.0:1651530126.516062:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d66fdca2 00000100:00100000:0.0:1651530126.516074:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 56 00000100:00100000:0.0:1651530126.516077:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356265280:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530126.516477:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fdca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356265280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 399us (492us total) trans 38654706531 rc 0/0 00000100:00100000:0.0:1651530126.516481:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 56 00002000:00100000:0.0:1651530126.516485:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebd:0x0] (0->16383) req@00000000d66fdca2 x1731754356265280/t38654706531(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 16872/448 e 0 to 0 dl 1651530132 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530126.516489:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d66fdca2 with x1731754356265280 ext(0->16383) 00002000:00010000:0.0:1651530126.516491:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d66fdca2 00000100:00100000:1.0:1651530126.516777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530126.516791:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265344 00000100:00100000:0.0:1651530126.516822:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651530126.516824:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754356265344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530126.516830:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530126.516835:0:195164:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebd:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:0.0:1651530126.516837:0:195164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebd:0x0] updating lvb mtime from disk: 0 -> 1651530126 00002000:00010000:0.0:1651530126.516838:0:195164:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebd:0x0] updating lvb ctime from disk: 0 -> 1651530126 00002000:00010000:0.0:1651530126.516839:0:195164:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebd:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1651530126.516850:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c3377 lrc: 0/0,0 mode: --/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c822 expref: 8 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530126.516859:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530126.516870:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bec6a46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356265344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530126.516882:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530126.525316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530126.525327:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265728 00000100:00100000:1.0:1651530126.525345:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 919 00000100:00100000:1.0:1651530126.525348:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356265728:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530126.525353:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530126.525360:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c337e lrc: 2/0,0 mode: --/PR res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c837 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530126.525368:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebd:0x0] initial LVB size: 16384, mtime: 0x6270598e, atime: 0x0, ctime: 0x6270598e, blocks: 0x20 00010000:00010000:1.0:1651530126.525375:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.525384:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.525387:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c337e lrc: 3/0,0 mode: PR/PR res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c837 expref: 8 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530126.525395:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c337e lrc: 3/0,0 mode: PR/PR res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c837 expref: 8 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530126.525400:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a7b944c, rc 0) 00000100:00100000:1.0:1651530126.525417:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fba5cf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356265728:12345-10.240.43.64@tcp:101:cat.0 Request processed in 68us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.525420:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 919 00000100:00100000:1.0:1651530126.527340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530126.527364:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265856 00002000:00100000:0.0:1651530126.527374:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebd:0x0] (0->4194303) req@00000000abd26db6 x1731754356265856/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 488/0 e 0 to 0 dl 1651530132 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530126.527378:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abd26db6 with x1731754356265856 ext(0->4194303) 00002000:00010000:0.0:1651530126.527380:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abd26db6 00000100:00100000:0.0:1651530126.527386:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 57 00000100:00100000:0.0:1651530126.527388:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356265856:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530126.527841:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abd26db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356265856:12345-10.240.43.64@tcp:3:cat.0 Request processed in 451us (501us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1651530126.527845:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 57 00002000:00100000:0.0:1651530126.527848:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebd:0x0] (0->4194303) req@00000000abd26db6 x1731754356265856/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 488/440 e 0 to 0 dl 1651530132 ref 1 fl Complete:/0/0 rc 16384/16384 job:'cat.0' 00002000:00100000:0.0:1651530126.527852:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abd26db6 with x1731754356265856 ext(0->4194303) 00002000:00010000:0.0:1651530126.527854:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abd26db6 00000100:00100000:1.0:1651530126.560174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530126.560187:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854528 00000100:00100000:1.0:1651530126.560201:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 100 00000100:00100000:1.0:1651530126.560204:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530126.560214:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 127439808 pending 40960 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530126.560237:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000492a58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.560241:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 100 00000100:00100000:1.0:1651530126.995094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530126.995255:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356266880 00000100:00100000:0.0:1651530126.995285:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651530126.995288:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754356266880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530126.995296:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530126.995317:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c337e lrc: 0/0,0 mode: --/PR res: [0x2bebd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c837 expref: 8 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530126.995326:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530126.995348:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8217908 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356266880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530126.995364:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000400:00000080:1.0:1651530127.536353:0:204703:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530127.536355:0:204703:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn on read and write cache 00000400:00000080:0.0:1651530128.379693:0:204865:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530128.379695:0:204865:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back. 00000400:00000080:1.0:1651530128.832656:0:204919:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530128.832659:0:204919:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read should be satisfied from the cache. 00000400:00000080:0.0:1651530129.689563:0:205081:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530129.689565:0:205081:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits: before: 8237, after: 8240 00000400:00000080:0.0:1651530129.998218:0:205135:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530129.998221:0:205135:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000100:00100000:1.0:1651530131.680858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530131.680877:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854656 00000100:00100000:1.0:1651530131.680897:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 101 00000100:00100000:1.0:1651530131.680911:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530131.680930:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 127439808 pending 40960 free 81207910400 avail 77037199360 00000100:00100000:1.0:1651530131.680960:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090cf2668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530131.680964:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 101 00000100:00100000:1.0:1651530131.707850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530131.707866:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854784 00000100:00100000:1.0:1651530131.707885:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 920 00000100:00100000:1.0:1651530131.707887:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530131.707899:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179901 count 1 00002000:00010000:1.0:1651530131.707914:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebd:0x0] initial LVB size: 16384, mtime: 0x6270598e, atime: 0x0, ctime: 0x6270598e, blocks: 0x20 00010000:00010000:1.0:1651530131.707918:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 3/0,1 mode: --/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.707925:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530131.707926:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530131.707928:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 3/0,1 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.707936:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 3/0,1 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.707939:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 3/0,1 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.707943:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 2/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.708030:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 2/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.708034:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530131.708035:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 2/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.708039:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 3/0,0 mode: PW/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.708046:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 1/0,0 mode: --/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530131.708049:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c3385 lrc: 0/0,0 mode: --/PW res: [0x2bebd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530131.709153:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000227fbd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946854784:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1263us (1303us total) trans 38654706532 rc 0/0 00000100:00100000:0.0:1651530131.709158:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 920 00000001:00080000:0.0:1651530131.731039:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706532 is committed 00000001:00080000:0.0:1651530131.731043:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706531 is committed 00000400:00000080:1.0:1651530131.791410:0:205243:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530131.791412:0:205243:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8240, after: 8243 00000400:00000080:1.0:1651530132.093227:0:205297:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530132.093230:0:205297:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn off the read cache and turn on the write cache 00000100:00100000:0.0:1651530132.156875:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2e27626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732992:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530132.156878:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000546aedd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966733056:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530132.157338:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2e27626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966732992:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530132.157346:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000546aedd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966733056:10.240.43.61@tcp:400:kworker/u4:2.0 00000400:00000080:0.0:1651530132.948458:0:205459:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530132.948460:0:205459:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000400:00000080:0.0:1651530133.801275:0:205622:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530133.801278:0:205622:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8243, after: 8246 00000400:00000080:0.0:1651530134.108565:0:205676:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530134.108568:0:205676:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back. 00000100:00100000:1.0:1651530134.209061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.209095:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356270592 00000100:00100000:0.0:1651530134.209121:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651530134.209124:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438148:x1731754356270592:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530134.209170:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f5991ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438148:x1731754356270592:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530134.209174:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00000400:00000080:1.0:1651530134.409756:0:205730:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530134.409758:0:205730:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read should be satisfied from the cache. 00000400:00000080:0.0:1651530135.283429:0:205892:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530135.283432:0:205892:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8246, after: 8249 00000400:00000080:0.0:1651530135.590485:0:205946:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530135.590487:0:205946:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn off read and write cache 00000400:00000080:0.0:1651530136.441907:0:206109:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530136.441910:0:206109:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back 00000400:00000080:0.0:1651530136.747920:0:206163:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530136.747923:0:206163:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: It should not be satisfied from the cache. 00000100:00100000:1.0:1651530136.769776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530136.769818:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356272448 00000100:00100000:1.0:1651530136.769841:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 921 00000100:00100000:1.0:1651530136.769843:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+5:482377:x1731754356272448:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651530136.769854:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530136.769865:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c338c lrc: 2/0,0 mode: --/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8ed expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530136.769876:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530136.769886:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530136.769887:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530136.769893:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c338c lrc: 3/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ed expref: 6 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.769901:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c338c lrc: 3/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ed expref: 6 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.769906:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009fbbe5ae, rc 0) 00000100:00100000:1.0:1651530136.769933:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+6:482377:x1731754356272448:12345-10.240.43.64@tcp:101:dd.0 Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530136.769937:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 921 00000100:00100000:1.0:1651530136.774692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530136.774704:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356272640 00002000:00100000:1.0:1651530136.774715:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebe:0x0] (0->12287) req@00000000e605748f x1731754356272640/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:107/0 lens 12776/0 e 0 to 0 dl 1651530142 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651530136.774720:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e605748f with x1731754356272640 ext(0->12287) 00002000:00010000:1.0:1651530136.774722:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e605748f 00000100:00100000:1.0:1651530136.774735:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 58 00000100:00100000:1.0:1651530136.774745:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356272640:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651530136.775084:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e605748f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356272640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 338us (392us total) trans 38654706533 rc 0/0 00000100:00100000:1.0:1651530136.775088:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 58 00002000:00100000:1.0:1651530136.775091:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebe:0x0] (0->12287) req@00000000e605748f x1731754356272640/t38654706533(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:107/0 lens 12776/448 e 0 to 0 dl 1651530142 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651530136.775095:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e605748f with x1731754356272640 ext(0->12287) 00002000:00010000:1.0:1651530136.775096:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e605748f 00000100:00100000:1.0:1651530136.775330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530136.775350:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356272704 00000100:00100000:0.0:1651530136.775370:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:0.0:1651530136.775372:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754356272704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651530136.775377:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530136.775382:0:195164:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bebe:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1651530136.775384:0:195164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bebe:0x0] updating lvb mtime from disk: 0 -> 1651530136 00002000:00010000:0.0:1651530136.775385:0:195164:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bebe:0x0] updating lvb ctime from disk: 0 -> 1651530136 00002000:00010000:0.0:1651530136.775386:0:195164:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bebe:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1651530136.775394:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c338c lrc: 0/0,0 mode: --/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ed expref: 8 pid: 196143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530136.775402:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530136.775415:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccddbd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754356272704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530136.775419:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530136.800244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530136.800254:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855104 00000100:00100000:1.0:1651530136.800264:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 102 00000100:00100000:1.0:1651530136.800266:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855104:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530136.800273:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135836608 pending 36864 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530136.800292:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dc282c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855104:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530136.800295:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 102 00000100:00100000:1.0:1651530137.045521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530137.045539:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273088 00000100:00100000:1.0:1651530137.045565:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 922 00000100:00100000:1.0:1651530137.045568:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356273088:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530137.045578:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530137.045588:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3393 lrc: 2/0,0 mode: --/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c902 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530137.045613:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebe:0x0] initial LVB size: 12288, mtime: 0x62705998, atime: 0x0, ctime: 0x62705998, blocks: 0x18 00010000:00010000:1.0:1651530137.045622:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530137.045623:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530137.045627:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3393 lrc: 3/0,0 mode: PR/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c902 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530137.045634:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3393 lrc: 3/0,0 mode: PR/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c902 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530137.045640:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016217824, rc 0) 00000100:00100000:1.0:1651530137.045666:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9f0a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356273088:12345-10.240.43.64@tcp:101:cat.0 Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530137.045670:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 922 00000100:00100000:1.0:1651530137.047631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530137.047640:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273216 00002000:00100000:1.0:1651530137.047652:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebe:0x0] (0->4194303) req@0000000090d075b5 x1731754356273216/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:108/0 lens 488/0 e 0 to 0 dl 1651530143 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530137.047658:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090d075b5 with x1731754356273216 ext(0->4194303) 00002000:00010000:1.0:1651530137.047660:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090d075b5 00000100:00100000:1.0:1651530137.047673:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 59 00000100:00100000:1.0:1651530137.047675:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754356273216:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530137.048345:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d075b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754356273216:12345-10.240.43.64@tcp:3:cat.0 Request processed in 668us (714us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1651530137.048349:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 59 00002000:00100000:1.0:1651530137.048361:0:176868:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x2bebe:0x0] (0->4194303) req@0000000090d075b5 x1731754356273216/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:108/0 lens 488/440 e 0 to 0 dl 1651530143 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:1.0:1651530137.048366:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090d075b5 with x1731754356273216 ext(0->4194303) 00002000:00010000:1.0:1651530137.048367:0:176868:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090d075b5 00000400:00000080:0.0:1651530137.605124:0:206325:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530137.605127:0:206325:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8249 00000400:00000080:0.0:1651530137.909455:0:206379:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530137.909458:0:206379:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn on the read cache and turn off the write cache 00000100:00100000:1.0:1651530138.195862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530138.197168:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273408 00000100:00100000:0.0:1651530138.197193:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:0.0:1651530138.197196:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754356273408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651530138.197214:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530138.197236:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c3393 lrc: 0/0,0 mode: --/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c902 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530138.197246:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530138.197272:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd3081b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754356273408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 76us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530138.197276:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00000400:00000080:1.0:1651530138.757043:0:206541:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530138.757045:0:206541:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back 00000400:00000080:1.0:1651530139.065670:0:206595:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530139.065672:0:206595:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: It should not be satisfied from the cache. 00000100:00100000:1.0:1651530139.080543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530139.080574:0:196143:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273472 00000100:00100000:0.0:1651530139.080601:0:196143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 923 00000100:00100000:0.0:1651530139.080604:0:196143:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356273472:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651530139.080615:0:196143:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530139.080627:0:196143:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c339a lrc: 2/0,0 mode: --/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c909 expref: -99 pid: 196143 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530139.080639:0:196143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebe:0x0] initial LVB size: 12288, mtime: 0x62705998, atime: 0x0, ctime: 0x62705998, blocks: 0x18 00010000:00010000:0.0:1651530139.080647:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530139.080648:0:196143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530139.080653:0:196143:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c339a lrc: 3/0,0 mode: PR/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c909 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530139.080661:0:196143:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c339a lrc: 3/0,0 mode: PR/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c909 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530139.080667:0:196143:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095cff58f, rc 0) 00000100:00100000:0.0:1651530139.080698:0:196143:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080249b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356273472:12345-10.240.43.64@tcp:101:rm.0 Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530139.080718:0:196143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 923 00000100:00100000:1.0:1651530140.562765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530140.562792:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273984 00000100:00100000:0.0:1651530140.562834:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:0.0:1651530140.562836:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451155:x1731754356273984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530140.562844:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530140.562866:0:195164:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c339a lrc: 0/0,0 mode: --/PR res: [0x2bebe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c909 expref: 8 pid: 196143 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530140.562876:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530140.562902:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628382ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451155:x1731754356273984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530140.562906:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00000400:00000080:1.0:1651530141.132283:0:206757:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530141.132285:0:206757:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8249 00000400:00000080:0.0:1651530141.435539:0:206811:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530141.435542:0:206811:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000100:00100000:1.0:1651530141.920234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530141.920251:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855232 00000100:00100000:1.0:1651530141.920270:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 103 00000100:00100000:1.0:1651530141.920273:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855232:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530141.920290:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135836608 pending 36864 free 81207914496 avail 77037203456 00000100:00100000:1.0:1651530141.920313:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073ff402b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855232:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530141.920317:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 103 00000100:00100000:1.0:1651530141.951725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530141.951773:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855296 00000100:00100000:0.0:1651530141.951788:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 924 00000100:00100000:0.0:1651530141.951790:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946855296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1651530141.951801:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179902 count 1 00002000:00010000:0.0:1651530141.951830:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bebe:0x0] initial LVB size: 12288, mtime: 0x62705998, atime: 0x0, ctime: 0x62705998, blocks: 0x18 00010000:00010000:0.0:1651530141.951834:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 3/0,1 mode: --/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951842:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.951843:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.951845:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 3/0,1 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951869:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 3/0,1 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951873:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 3/0,1 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951876:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 2/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951953:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 2/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951957:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095cff58f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530141.951959:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 2/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951963:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 3/0,0 mode: PW/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951970:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 1/0,0 mode: --/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951973:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cff58f/0xa29a79078f3c33a1 lrc: 0/0,0 mode: --/PW res: [0x2bebe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530141.952651:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062ba7e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946855296:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 860us (927us total) trans 38654706534 rc 0/0 00000100:00100000:1.0:1651530141.952656:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 924 00000001:00080000:0.0:1651530141.975989:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706534 is committed 00000001:00080000:0.0:1651530141.976001:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706533 is committed 00000400:00000080:0.0:1651530142.288213:0:206973:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530142.288215:0:206973:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8252 00000400:00000080:0.0:1651530143.946640:0:207245:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530143.946643:0:207245:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160a: changelog sanity ==================== 22:22:23 (1651530143) 00000100:00100000:1.0:1651530144.780415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530144.780434:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356277056 00000100:00100000:1.0:1651530144.780460:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 925 00000100:00100000:1.0:1651530144.780473:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356277056:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530144.780584:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000978de632 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356277056:12345-10.240.43.64@tcp:2:touch.0 Request processed in 111us (173us total) trans 38654706535 rc 0/0 00000100:00100000:1.0:1651530144.780588:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 925 00000100:00100000:1.0:1651530146.518876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530146.518889:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356279360 00000100:00100000:1.0:1651530146.518911:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 926 00000100:00100000:1.0:1651530146.518914:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:484374:x1731754356279360:12345-10.240.43.64@tcp:101:bash.0 00010000:00010000:1.0:1651530146.518922:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530146.518942:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c33a8 lrc: 2/0,0 mode: --/PW res: [0x2bec0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c9fe expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530146.518954:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530146.518963:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530146.518964:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530146.518969:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c33a8 lrc: 3/0,0 mode: PW/PW res: [0x2bec0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9fe expref: 7 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530146.518977:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016217824/0xa29a79078f3c33a8 lrc: 3/0,0 mode: PW/PW res: [0x2bec0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9fe expref: 7 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530146.518982:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016217824, rc 0) 00000100:00100000:1.0:1651530146.519002:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae427147 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:484374:x1731754356279360:12345-10.240.43.64@tcp:101:bash.0 Request processed in 88us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530146.519005:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 926 00000100:00100000:1.0:1651530147.036949:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530147.036973:0:176868:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356280192 00002000:00010000:0.0:1651530147.036990:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179904/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530147.036992:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009fb9e9d6 with x1731754356280192 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530147.036998:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009fb9e9d6. 00000100:00100000:0.0:1651530147.037008:0:176868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 60 00000100:00100000:0.0:1651530147.037011:0:176868:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356280192:12345-10.240.43.64@tcp:10:bash.0 00002000:00010000:0.0:1651530147.037076:0:176868:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x2bec0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530147.037078:0:176868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x2bec0:0x0] updating lvb mtime from disk: 0 -> 1651530147 00002000:00010000:0.0:1651530147.037079:0:176868:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x2bec0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530147.037080:0:176868:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x2bec0:0x0] updating lvb ctime from disk: 0 -> 1651530147 00002000:00010000:0.0:1651530147.037081:0:176868:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x2bec0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530147.037107:0:176868:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fb9e9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356280192:12345-10.240.43.64@tcp:10:bash.0 Request processed in 96us (159us total) trans 38654706536 rc 0/0 00000100:00100000:0.0:1651530147.037111:0:176868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 60 00002000:00010000:0.0:1651530147.037113:0:176868:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 179904/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530147.037114:0:176868:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009fb9e9d6 with x1731754356280192 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530147.037115:0:176868:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009fb9e9d6. 00000100:00100000:1.0:1651530147.041233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530147.041249:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855680 00000100:00100000:1.0:1651530147.041260:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 104 00000100:00100000:1.0:1651530147.041262:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530147.041272:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135799744 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530147.041285:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce3f0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (53us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530147.041289:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 104 00000100:00100000:1.0:1651530148.687836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530148.687851:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946856192 00000100:00100000:1.0:1651530148.687873:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 927 00000100:00100000:1.0:1651530148.687876:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:243454:x1731745946856192:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651530148.687902:0:176865:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c1ae9 00000100:00080000:1.0:1651530148.687906:0:176865:0:(import.c:85:import_set_state_nolock()) 00000000b9cbdc7e Âæ»Žÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651530148.687949:0:176865:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654706536 00000100:00100000:1.0:1651530148.688222:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4112a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:243454:x1731745946856192:12345-10.240.43.61@tcp:9:umount.0 Request processed in 345us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530148.688227:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 927 00000001:00100000:0.0:1651530150.112574:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651530150.112577:0:176850:0:(genops.c:985:class_export_put()) final put 0000000025c57667/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1651530150.112588:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706536 is committed 00000020:00000080:1.0:1651530150.112600:0:188427:0:(genops.c:944:class_export_destroy()) destroying export 0000000025c57667/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1651530150.112629:0:188427:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000b9cbdc7e for lustre-OST0000 00000100:00100000:1.0:1651530151.616999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530151.617009:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356283776 00000100:00100000:1.0:1651530151.617026:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530151.617028:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356283776:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530151.617046:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b22dac73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356283776:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 17us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530151.617049:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530157.244891:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db2b0975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966733184:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530157.244891:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966733120:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530157.651501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530157.651514:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946857024 00000100:00100000:1.0:1651530157.651543:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 928 00000100:00100000:1.0:1651530157.651545:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:39028:x1731745946857024:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651530157.651557:0:176865:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000002beaa81 cur 13757 last 0 00000020:00000080:1.0:1651530157.651575:0:176865:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa29a79078f3c33af 00002000:00100000:1.0:1651530157.651581:0:176865:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/0000000091b218ea ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1651530157.651582:0:176865:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1651530157.651584:0:176865:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651530157.651622:0:176865:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651530157.651630:0:176865:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651530157.651645:0:176865:0:(import.c:85:import_set_state_nolock()) 00000000ad086c0e Âæ»Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651530157.651664:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a5b6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946857024:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 118us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530157.651667:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 928 00000100:00100000:1.0:1651530157.652120:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530157.652130:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946857088 00000100:00100000:1.0:1651530157.652139:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 105 00000100:00100000:1.0:1651530157.652141:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055faf4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946857088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530157.652150:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135799744 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530157.652186:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055faf4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946857088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 44us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530157.652189:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 105 00000100:00100000:1.0:1651530158.878229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530158.878257:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946858944 00000100:00100000:1.0:1651530158.878283:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 929 00000100:00100000:1.0:1651530158.878285:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:244000:x1731745946858944:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651530158.878315:0:176865:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179969 -> diff = -65 00002000:02000040:1.0:1651530158.878320:0:176865:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:179905 to 0x0:179969 00002000:00010000:1.0:1651530158.879955:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.879960:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 3/0,1 mode: --/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.879968:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.879969:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.879971:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 3/0,1 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.879977:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 3/0,1 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.879981:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 3/0,1 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.879984:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 2/0,0 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880011:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 2/0,0 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880019:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.880020:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 2/0,0 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880025:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 3/0,0 mode: PW/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880034:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 1/0,0 mode: --/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880037:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c33b6 lrc: 0/0,0 mode: --/PW res: [0x2bf01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880966:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880969:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 3/0,1 mode: --/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880973:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880974:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880979:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 3/0,1 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880983:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 3/0,1 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880987:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 3/0,1 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880990:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 2/0,0 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881029:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 2/0,0 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881033:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.881034:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 2/0,0 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881037:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 3/0,0 mode: PW/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881042:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 1/0,0 mode: --/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881045:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c33bd lrc: 0/0,0 mode: --/PW res: [0x2bf00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881145:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881164:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 3/0,1 mode: --/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881168:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881169:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881170:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 3/0,1 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881173:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 3/0,1 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881176:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 3/0,1 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881179:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 2/0,0 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881201:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 2/0,0 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881206:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.881207:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 2/0,0 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881210:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 3/0,0 mode: PW/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881216:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 1/0,0 mode: --/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881229:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c33c4 lrc: 0/0,0 mode: --/PW res: [0x2beff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881333:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2befe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881336:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 3/0,1 mode: --/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881339:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881340:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881340:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 3/0,1 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881344:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 3/0,1 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881347:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 3/0,1 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881358:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 2/0,0 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881376:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 2/0,0 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881380:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.881381:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 2/0,0 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881384:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 3/0,0 mode: PW/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881388:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 1/0,0 mode: --/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881391:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c33cb lrc: 0/0,0 mode: --/PW res: [0x2befe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881453:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2befd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881455:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 3/0,1 mode: --/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881459:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881459:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881460:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 3/0,1 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881464:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 3/0,1 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881467:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 3/0,1 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881470:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 2/0,0 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881506:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 2/0,0 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881510:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.881511:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 2/0,0 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881523:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 3/0,0 mode: PW/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881529:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 1/0,0 mode: --/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881531:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c33d2 lrc: 0/0,0 mode: --/PW res: [0x2befd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881566:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2befc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881568:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 3/0,1 mode: --/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881571:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881572:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881573:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 3/0,1 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881576:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 3/0,1 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881579:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 3/0,1 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881582:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 2/0,0 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881609:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 2/0,0 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881613:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.881614:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 2/0,0 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881626:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 3/0,0 mode: PW/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881631:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 1/0,0 mode: --/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881633:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c33d9 lrc: 0/0,0 mode: --/PW res: [0x2befc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881694:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2befb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881696:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 3/0,1 mode: --/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881700:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881701:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881701:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 3/0,1 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881705:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 3/0,1 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881708:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 3/0,1 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881710:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 2/0,0 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881728:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 2/0,0 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881732:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.881733:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 2/0,0 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881736:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 3/0,0 mode: PW/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881740:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 1/0,0 mode: --/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881742:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c33e0 lrc: 0/0,0 mode: --/PW res: [0x2befb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881819:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2befa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881821:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 3/0,1 mode: --/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881825:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881826:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881827:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 3/0,1 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881830:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 3/0,1 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881841:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 3/0,1 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881843:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 2/0,0 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881882:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 2/0,0 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881885:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.881886:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 2/0,0 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881889:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 3/0,0 mode: PW/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881894:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 1/0,0 mode: --/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881896:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c33e7 lrc: 0/0,0 mode: --/PW res: [0x2befa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881936:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881938:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 3/0,1 mode: --/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881942:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881950:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881951:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 3/0,1 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881955:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 3/0,1 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881958:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 3/0,1 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881960:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 2/0,0 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881978:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 2/0,0 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881989:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.881990:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 2/0,0 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881992:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.881993:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 3/0,0 mode: PW/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881994:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 3/0,1 mode: --/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881997:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530158.881997:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 1/0,0 mode: --/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881998:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881999:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 3/0,1 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882000:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c33ee lrc: 0/0,0 mode: --/PW res: [0x2bef9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882002:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 3/0,1 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882005:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 3/0,1 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882007:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 2/0,0 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882027:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 2/0,0 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882030:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.882031:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 2/0,0 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882033:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 3/0,0 mode: PW/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882037:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 1/0,0 mode: --/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882047:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c33f5 lrc: 0/0,0 mode: --/PW res: [0x2bef8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882110:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882112:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 3/0,1 mode: --/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882116:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882116:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882117:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 3/0,1 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882121:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 3/0,1 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882124:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 3/0,1 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882126:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 2/0,0 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882170:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 2/0,0 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882175:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.882176:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 2/0,0 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882179:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 3/0,0 mode: PW/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882193:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 1/0,0 mode: --/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882195:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c33fc lrc: 0/0,0 mode: --/PW res: [0x2bef7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882243:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882245:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 3/0,1 mode: --/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882249:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882250:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882250:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 3/0,1 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882254:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 3/0,1 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882257:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 3/0,1 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882259:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 2/0,0 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882277:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 2/0,0 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882280:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.882281:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 2/0,0 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882284:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 3/0,0 mode: PW/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882288:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 1/0,0 mode: --/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882291:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3403 lrc: 0/0,0 mode: --/PW res: [0x2bef6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882409:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882411:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 3/0,1 mode: --/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882426:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882426:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882427:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 3/0,1 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882431:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 3/0,1 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882434:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 3/0,1 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882437:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 2/0,0 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882453:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 2/0,0 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882457:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.882458:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 2/0,0 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882474:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 3/0,0 mode: PW/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882478:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 1/0,0 mode: --/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882481:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c340a lrc: 0/0,0 mode: --/PW res: [0x2bef5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882605:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882607:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 3/0,1 mode: --/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882611:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882611:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882612:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 3/0,1 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882615:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 3/0,1 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882618:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 3/0,1 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882628:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 2/0,0 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882663:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 2/0,0 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882666:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081ada84a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.882667:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 2/0,0 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882670:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 3/0,0 mode: PW/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882675:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 1/0,0 mode: --/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882678:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ada84a/0xa29a79078f3c3411 lrc: 0/0,0 mode: --/PW res: [0x2bef4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882782:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882784:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 3/0,1 mode: --/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882788:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882789:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882790:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 3/0,1 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882802:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 3/0,1 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882817:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 3/0,1 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882820:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 2/0,0 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882836:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 2/0,0 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882840:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e0d18c5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.882841:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 2/0,0 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882844:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 3/0,0 mode: PW/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882848:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 1/0,0 mode: --/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.882851:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0d18c5/0xa29a79078f3c3418 lrc: 0/0,0 mode: --/PW res: [0x2bef3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.882975:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.882977:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 3/0,1 mode: --/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882981:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882981:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.882982:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 3/0,1 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882986:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 3/0,1 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882989:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 3/0,1 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.882991:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 2/0,0 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883016:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 2/0,0 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883026:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000015b2637 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.883027:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 2/0,0 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883030:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 3/0,0 mode: PW/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883034:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 1/0,0 mode: --/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883037:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015b2637/0xa29a79078f3c341f lrc: 0/0,0 mode: --/PW res: [0x2bef2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883114:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883116:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 3/0,1 mode: --/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883120:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883120:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883121:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 3/0,1 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883125:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 3/0,1 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883128:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 3/0,1 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883130:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 2/0,0 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883174:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 2/0,0 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883178:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021275de8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.883179:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 2/0,0 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883182:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 3/0,0 mode: PW/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883196:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 1/0,0 mode: --/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883199:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021275de8/0xa29a79078f3c3426 lrc: 0/0,0 mode: --/PW res: [0x2bef1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883242:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bef0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883243:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 3/0,1 mode: --/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883247:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883248:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883248:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 3/0,1 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883252:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 3/0,1 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883255:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 3/0,1 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883258:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 2/0,0 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883275:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 2/0,0 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883279:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f4be2ac0 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.883280:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 2/0,0 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883282:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 3/0,0 mode: PW/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883286:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 1/0,0 mode: --/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883297:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4be2ac0/0xa29a79078f3c342d lrc: 0/0,0 mode: --/PW res: [0x2bef0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883369:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883371:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 3/0,1 mode: --/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883382:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883383:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883384:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 3/0,1 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883387:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 3/0,1 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883390:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 3/0,1 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883393:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 2/0,0 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883409:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 2/0,0 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883413:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a90bfd37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.883414:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 2/0,0 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883417:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 3/0,0 mode: PW/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883421:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 1/0,0 mode: --/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883423:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90bfd37/0xa29a79078f3c3434 lrc: 0/0,0 mode: --/PW res: [0x2beef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883488:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883490:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 3/0,1 mode: --/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883493:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883494:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883495:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 3/0,1 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883498:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 3/0,1 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883501:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 3/0,1 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883514:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 2/0,0 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883549:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 2/0,0 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883553:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0accd18 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.883554:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 2/0,0 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883557:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 3/0,0 mode: PW/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883561:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 1/0,0 mode: --/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883564:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0accd18/0xa29a79078f3c343b lrc: 0/0,0 mode: --/PW res: [0x2beee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883671:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883673:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 3/0,1 mode: --/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883677:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883678:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883678:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 3/0,1 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883689:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 3/0,1 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883692:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 3/0,1 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883695:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 2/0,0 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883712:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 2/0,0 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883715:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba5b8d96 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.883716:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 2/0,0 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883727:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 3/0,0 mode: PW/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883731:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 1/0,0 mode: --/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883734:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5b8d96/0xa29a79078f3c3442 lrc: 0/0,0 mode: --/PW res: [0x2beed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.883857:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.883859:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 3/0,1 mode: --/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883863:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883863:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.883864:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 3/0,1 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883868:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 3/0,1 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883871:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 3/0,1 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.883874:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 2/0,0 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883898:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 2/0,0 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883902:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e5d5897 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.883903:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 2/0,0 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883906:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 3/0,0 mode: PW/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883910:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 1/0,0 mode: --/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.883913:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5d5897/0xa29a79078f3c3449 lrc: 0/0,0 mode: --/PW res: [0x2beec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884042:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884044:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 3/0,1 mode: --/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884048:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884048:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884049:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 3/0,1 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884052:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 3/0,1 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884055:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 3/0,1 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884058:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 2/0,0 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884104:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 2/0,0 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884108:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d1f099d already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.884109:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 2/0,0 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884112:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 3/0,0 mode: PW/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884125:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 1/0,0 mode: --/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884128:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1f099d/0xa29a79078f3c3450 lrc: 0/0,0 mode: --/PW res: [0x2beeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884242:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884245:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 3/0,1 mode: --/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884248:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884249:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884250:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 3/0,1 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884253:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 3/0,1 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884256:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 3/0,1 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884259:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 2/0,0 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884276:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 2/0,0 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884286:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009966b94f already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.884287:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 2/0,0 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884290:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 3/0,0 mode: PW/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884294:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 1/0,0 mode: --/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884297:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009966b94f/0xa29a79078f3c3457 lrc: 0/0,0 mode: --/PW res: [0x2beea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884416:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884418:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 3/0,1 mode: --/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884432:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884433:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884434:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 3/0,1 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884438:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 3/0,1 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884441:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 3/0,1 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884444:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 2/0,0 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884461:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 2/0,0 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884464:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088561f21 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.884465:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 2/0,0 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884468:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 3/0,0 mode: PW/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884472:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 1/0,0 mode: --/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884483:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088561f21/0xa29a79078f3c345e lrc: 0/0,0 mode: --/PW res: [0x2bee9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884602:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884604:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 3/0,1 mode: --/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884608:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884608:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884609:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 3/0,1 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884613:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 3/0,1 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884616:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 3/0,1 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884625:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 2/0,0 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884660:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 2/0,0 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884664:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000062e9b49 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.884665:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 2/0,0 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884668:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 3/0,0 mode: PW/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884673:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 1/0,0 mode: --/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884675:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e9b49/0xa29a79078f3c3465 lrc: 0/0,0 mode: --/PW res: [0x2bee8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884788:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884790:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 3/0,1 mode: --/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884794:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884794:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.884795:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 3/0,1 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884827:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 3/0,1 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884830:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 3/0,1 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.884833:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 2/0,0 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884850:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 2/0,0 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884854:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000268d25e1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.884855:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 2/0,0 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884857:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 3/0,0 mode: PW/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884862:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 1/0,0 mode: --/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.884864:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268d25e1/0xa29a79078f3c346c lrc: 0/0,0 mode: --/PW res: [0x2bee7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.884996:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.884998:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 3/0,1 mode: --/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885002:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885002:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885003:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 3/0,1 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885007:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 3/0,1 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885010:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 3/0,1 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885013:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 2/0,0 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885036:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 2/0,0 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885040:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a772ca06 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.885041:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 2/0,0 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885052:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 3/0,0 mode: PW/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885057:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 1/0,0 mode: --/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885060:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a772ca06/0xa29a79078f3c3473 lrc: 0/0,0 mode: --/PW res: [0x2bee6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.885193:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.885196:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 3/0,1 mode: --/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885199:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885200:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885201:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 3/0,1 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885204:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 3/0,1 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885208:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 3/0,1 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885210:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 2/0,0 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885245:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 2/0,0 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885248:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000101e4964 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.885249:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 2/0,0 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885252:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 3/0,0 mode: PW/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885266:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 1/0,0 mode: --/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885269:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101e4964/0xa29a79078f3c347a lrc: 0/0,0 mode: --/PW res: [0x2bee5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.885378:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.885380:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 3/0,1 mode: --/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885384:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885385:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885385:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 3/0,1 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885389:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 3/0,1 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885392:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 3/0,1 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885395:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 2/0,0 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885413:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 2/0,0 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885416:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7d0c66c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.885417:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 2/0,0 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885420:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 3/0,0 mode: PW/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885424:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 1/0,0 mode: --/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885426:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d0c66c/0xa29a79078f3c3481 lrc: 0/0,0 mode: --/PW res: [0x2bee4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.885557:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.885559:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 3/0,1 mode: --/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885569:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885569:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885570:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 3/0,1 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885574:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 3/0,1 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885577:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 3/0,1 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885580:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 2/0,0 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885596:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 2/0,0 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885605:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000897c5bf already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.885606:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 2/0,0 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885609:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 3/0,0 mode: PW/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885613:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 1/0,0 mode: --/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885616:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000897c5bf/0xa29a79078f3c3488 lrc: 0/0,0 mode: --/PW res: [0x2bee3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.885733:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.885735:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 3/0,1 mode: --/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885739:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885740:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885740:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 3/0,1 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885744:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 3/0,1 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885747:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 3/0,1 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885761:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 2/0,0 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885797:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 2/0,0 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885800:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030acc86a already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.885801:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 2/0,0 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885818:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 3/0,0 mode: PW/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885823:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 1/0,0 mode: --/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885836:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030acc86a/0xa29a79078f3c348f lrc: 0/0,0 mode: --/PW res: [0x2bee2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.885923:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.885925:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 3/0,1 mode: --/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885929:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885929:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.885930:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 3/0,1 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885944:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 3/0,1 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885947:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 3/0,1 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.885950:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 2/0,0 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885968:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 2/0,0 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885971:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acfd0ef2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.885972:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 2/0,0 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885975:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 3/0,0 mode: PW/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885980:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 1/0,0 mode: --/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.885992:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfd0ef2/0xa29a79078f3c3496 lrc: 0/0,0 mode: --/PW res: [0x2bee1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886055:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bee0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886057:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 3/0,1 mode: --/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886060:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886061:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886062:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 3/0,1 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886065:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 3/0,1 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886068:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 3/0,1 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886071:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 2/0,0 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886100:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 2/0,0 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886103:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9386f1e already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886104:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 2/0,0 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886107:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 3/0,0 mode: PW/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886111:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 1/0,0 mode: --/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886114:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9386f1e/0xa29a79078f3c349d lrc: 0/0,0 mode: --/PW res: [0x2bee0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886184:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bedf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886186:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 3/0,1 mode: --/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886189:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886190:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886191:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 3/0,1 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886194:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 3/0,1 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886197:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 3/0,1 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886200:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 2/0,0 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886222:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bede:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886224:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 3/0,1 mode: --/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886227:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886228:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886228:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 3/0,1 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886231:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 3/0,1 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886242:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 3/0,1 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886245:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 2/0,0 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886262:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 2/0,0 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886266:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000406c58a2 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886267:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 2/0,0 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886278:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 3/0,0 mode: PW/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886282:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 1/0,0 mode: --/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886285:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000406c58a2/0xa29a79078f3c34a4 lrc: 0/0,0 mode: --/PW res: [0x2bedf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886289:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 2/0,0 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886292:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff73fa02 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886293:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 2/0,0 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886295:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 3/0,0 mode: PW/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886298:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 1/0,0 mode: --/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886301:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff73fa02/0xa29a79078f3c34ab lrc: 0/0,0 mode: --/PW res: [0x2bede:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886354:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bedd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886356:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 3/0,1 mode: --/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886359:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886360:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886361:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 3/0,1 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886364:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 3/0,1 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886367:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 3/0,1 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886370:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 2/0,0 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886380:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 2/0,0 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886388:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2e406ba already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886389:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 2/0,0 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886392:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 3/0,0 mode: PW/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886395:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 1/0,0 mode: --/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886397:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bedc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.886398:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e406ba/0xa29a79078f3c34b2 lrc: 0/0,0 mode: --/PW res: [0x2bedd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886399:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 3/0,1 mode: --/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886411:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886412:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886413:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 3/0,1 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886416:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 3/0,1 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886419:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 3/0,1 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886422:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 2/0,0 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886457:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 2/0,0 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886460:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a8ba774 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.886461:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 2/0,0 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886464:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 3/0,0 mode: PW/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886469:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 1/0,0 mode: --/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886484:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8ba774/0xa29a79078f3c34b9 lrc: 0/0,0 mode: --/PW res: [0x2bedc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886526:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bedb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886528:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 3/0,1 mode: --/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886531:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886532:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886533:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 3/0,1 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886537:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 3/0,1 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886539:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 3/0,1 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886542:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 2/0,0 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886552:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 2/0,0 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886555:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6595fad already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886556:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 2/0,0 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886559:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 3/0,0 mode: PW/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886562:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 1/0,0 mode: --/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886572:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6595fad/0xa29a79078f3c34c0 lrc: 0/0,0 mode: --/PW res: [0x2bedb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886651:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886653:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 3/0,1 mode: --/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886657:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886657:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886662:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 3/0,1 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886666:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 3/0,1 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886669:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 3/0,1 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886672:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 2/0,0 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886681:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 2/0,0 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886684:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e7cb770 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886685:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 2/0,0 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886688:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 3/0,0 mode: PW/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886692:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 1/0,0 mode: --/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886695:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7cb770/0xa29a79078f3c34c7 lrc: 0/0,0 mode: --/PW res: [0x2beda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886776:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886778:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 3/0,1 mode: --/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886782:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886782:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886783:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 3/0,1 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886787:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 3/0,1 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886790:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 3/0,1 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886793:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 2/0,0 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886852:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 2/0,0 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886856:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e53a570 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.886857:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 2/0,0 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886860:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 3/0,0 mode: PW/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886865:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 1/0,0 mode: --/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886868:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e53a570/0xa29a79078f3c34ce lrc: 0/0,0 mode: --/PW res: [0x2bed9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886907:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886908:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 3/0,1 mode: --/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886912:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886913:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886913:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 3/0,1 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886917:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 3/0,1 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886931:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 3/0,1 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886934:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 2/0,0 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886944:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 2/0,0 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886947:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea47ebc4 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886947:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 2/0,0 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886958:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 3/0,0 mode: PW/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886962:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 1/0,0 mode: --/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886965:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea47ebc4/0xa29a79078f3c34d5 lrc: 0/0,0 mode: --/PW res: [0x2bed8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.886967:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.886968:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 3/0,1 mode: --/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886972:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886973:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.886973:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 3/0,1 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886977:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 3/0,1 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886979:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 3/0,1 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.886982:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 2/0,0 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886991:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 2/0,0 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886994:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a718d34a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.886995:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 2/0,0 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.886998:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 3/0,0 mode: PW/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887003:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 1/0,0 mode: --/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887007:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a718d34a/0xa29a79078f3c34dc lrc: 0/0,0 mode: --/PW res: [0x2bed7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887093:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887095:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 3/0,1 mode: --/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887105:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887106:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887107:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 3/0,1 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887110:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 3/0,1 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887113:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 3/0,1 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887116:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 2/0,0 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887151:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 2/0,0 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887162:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b8f49831 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.887163:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 2/0,0 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887166:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 3/0,0 mode: PW/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887170:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 1/0,0 mode: --/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887182:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8f49831/0xa29a79078f3c34e3 lrc: 0/0,0 mode: --/PW res: [0x2bed6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887233:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887234:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 3/0,1 mode: --/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887238:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887239:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887240:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 3/0,1 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887243:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 3/0,1 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887246:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 3/0,1 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887249:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 2/0,0 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887267:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 2/0,0 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887278:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9b45e69 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887279:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 2/0,0 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887282:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 3/0,0 mode: PW/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887286:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 1/0,0 mode: --/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887289:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b45e69/0xa29a79078f3c34ea lrc: 0/0,0 mode: --/PW res: [0x2bed5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887350:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887352:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 3/0,1 mode: --/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887356:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887356:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887361:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 3/0,1 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887365:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 3/0,1 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887368:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 3/0,1 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887371:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 2/0,0 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887388:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 2/0,0 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887391:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac0794d8 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887393:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 2/0,0 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887395:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 3/0,0 mode: PW/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887399:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 1/0,0 mode: --/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887410:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac0794d8/0xa29a79078f3c34f1 lrc: 0/0,0 mode: --/PW res: [0x2bed4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887464:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887466:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 3/0,1 mode: --/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887470:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887470:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887471:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 3/0,1 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887475:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 3/0,1 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887477:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 3/0,1 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887480:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 2/0,0 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887526:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887528:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 3/0,1 mode: --/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887532:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887532:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887533:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 3/0,1 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887536:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 3/0,1 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887539:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 3/0,1 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887542:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 2/0,0 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887558:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 2/0,0 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887562:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bf5ab83 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887563:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 2/0,0 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887565:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 3/0,0 mode: PW/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887570:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 1/0,0 mode: --/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887572:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5ab83/0xa29a79078f3c34f8 lrc: 0/0,0 mode: --/PW res: [0x2bed3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887576:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 2/0,0 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887579:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fbbe5ae already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887579:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 2/0,0 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887590:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 3/0,0 mode: PW/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887594:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 1/0,0 mode: --/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887597:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbbe5ae/0xa29a79078f3c34ff lrc: 0/0,0 mode: --/PW res: [0x2bed2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887653:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887655:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 3/0,1 mode: --/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887659:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887659:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887660:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 3/0,1 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887663:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 3/0,1 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887671:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 3/0,1 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887673:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 2/0,0 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887690:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 2/0,0 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887694:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006a7b944c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887694:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 2/0,0 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887697:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 3/0,0 mode: PW/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887701:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 1/0,0 mode: --/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887704:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7b944c/0xa29a79078f3c3506 lrc: 0/0,0 mode: --/PW res: [0x2bed1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887767:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bed0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887768:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 3/0,1 mode: --/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887772:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887772:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887773:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 3/0,1 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887777:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 3/0,1 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887780:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 3/0,1 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887782:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 2/0,0 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887832:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 2/0,0 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887845:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bb68e27f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.887846:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 2/0,0 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887849:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 3/0,0 mode: PW/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887854:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 1/0,0 mode: --/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887857:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb68e27f/0xa29a79078f3c350d lrc: 0/0,0 mode: --/PW res: [0x2bed0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.887906:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2becf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.887908:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 3/0,1 mode: --/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887911:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887912:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.887913:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 3/0,1 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887916:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 3/0,1 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887919:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 3/0,1 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.887929:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 2/0,0 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887946:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 2/0,0 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887956:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033a35c44 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.887957:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 2/0,0 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887960:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 3/0,0 mode: PW/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887964:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 1/0,0 mode: --/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.887967:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a35c44/0xa29a79078f3c3514 lrc: 0/0,0 mode: --/PW res: [0x2becf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888038:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bece:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888040:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 3/0,1 mode: --/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888043:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888044:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888045:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 3/0,1 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888048:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 3/0,1 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888051:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 3/0,1 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888054:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 2/0,0 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888063:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 2/0,0 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888067:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fed4bc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.888068:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 2/0,0 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888070:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 3/0,0 mode: PW/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888074:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 1/0,0 mode: --/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888085:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fed4bc/0xa29a79078f3c351b lrc: 0/0,0 mode: --/PW res: [0x2bece:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888087:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2becd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888089:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 3/0,1 mode: --/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888092:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888093:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888098:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 3/0,1 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888102:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 3/0,1 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888105:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 3/0,1 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888107:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 2/0,0 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888142:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 2/0,0 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888146:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000619d42da already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.888147:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 2/0,0 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888150:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 3/0,0 mode: PW/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888163:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 1/0,0 mode: --/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888165:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619d42da/0xa29a79078f3c3522 lrc: 0/0,0 mode: --/PW res: [0x2becd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888224:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2becc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888230:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 3/0,1 mode: --/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888234:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888234:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888235:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 3/0,1 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888239:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 3/0,1 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888242:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 3/0,1 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888244:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 2/0,0 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888254:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 2/0,0 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888258:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.888259:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 2/0,0 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888262:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 3/0,0 mode: PW/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888265:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 1/0,0 mode: --/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888268:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c3529 lrc: 0/0,0 mode: --/PW res: [0x2becc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888348:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2becb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888350:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 3/0,1 mode: --/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888354:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888354:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888355:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 3/0,1 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888359:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 3/0,1 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888362:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 3/0,1 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888370:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 2/0,0 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888379:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 2/0,0 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888383:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.888384:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 2/0,0 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888394:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 3/0,0 mode: PW/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888398:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 1/0,0 mode: --/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888401:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c3530 lrc: 0/0,0 mode: --/PW res: [0x2becb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888471:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2beca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888473:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 3/0,1 mode: --/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888477:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888478:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888478:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 3/0,1 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888482:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 3/0,1 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888485:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 3/0,1 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888488:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 2/0,0 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888527:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 2/0,0 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888531:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000014ba77e already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.888532:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 2/0,0 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888542:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 3/0,0 mode: PW/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888547:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 1/0,0 mode: --/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888550:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014ba77e/0xa29a79078f3c3537 lrc: 0/0,0 mode: --/PW res: [0x2beca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888597:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888599:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 3/0,1 mode: --/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888603:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888604:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888605:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 3/0,1 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888608:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 3/0,1 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888611:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 3/0,1 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888614:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 2/0,0 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888638:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 2/0,0 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888642:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.888643:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 2/0,0 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888646:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 3/0,0 mode: PW/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888650:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 1/0,0 mode: --/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888652:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c353e lrc: 0/0,0 mode: --/PW res: [0x2bec9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888727:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888729:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 3/0,1 mode: --/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888732:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888733:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888734:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 3/0,1 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888737:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 3/0,1 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888740:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 3/0,1 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888743:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 2/0,0 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888760:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 2/0,0 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888769:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.888770:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 2/0,0 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888772:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 3/0,0 mode: PW/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888777:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 1/0,0 mode: --/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.888779:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c3545 lrc: 0/0,0 mode: --/PW res: [0x2bec8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888858:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888860:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 3/0,1 mode: --/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888864:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888864:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888865:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 3/0,1 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888869:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 3/0,1 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888876:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 3/0,1 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888879:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 2/0,0 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888915:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 2/0,0 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888919:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.888920:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 2/0,0 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888922:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 3/0,0 mode: PW/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888927:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 1/0,0 mode: --/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888930:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c354c lrc: 0/0,0 mode: --/PW res: [0x2bec7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.888977:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.888979:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 3/0,1 mode: --/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888982:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888987:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.888988:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 3/0,1 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888992:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 3/0,1 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888995:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 3/0,1 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.888998:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 2/0,0 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889015:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 2/0,0 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889019:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.889020:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 2/0,0 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889022:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 3/0,0 mode: PW/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.889026:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.889027:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 1/0,0 mode: --/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889028:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 3/0,1 mode: --/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889031:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889032:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889033:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 3/0,1 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889036:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 3/0,1 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889038:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c3553 lrc: 0/0,0 mode: --/PW res: [0x2bec6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889039:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 3/0,1 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889041:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 2/0,0 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889059:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 2/0,0 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889062:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.889063:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 2/0,0 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889066:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 3/0,0 mode: PW/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889070:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 1/0,0 mode: --/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889072:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c355a lrc: 0/0,0 mode: --/PW res: [0x2bec5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.889148:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.889150:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 3/0,1 mode: --/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889163:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889164:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889165:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 3/0,1 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889168:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 3/0,1 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889171:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 3/0,1 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889174:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 2/0,0 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.889214:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.889216:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 3/0,1 mode: --/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889219:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889219:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889220:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 3/0,1 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889223:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 3/0,1 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889231:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 3/0,1 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889234:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 2/0,0 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889251:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 2/0,0 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889254:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.889255:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 2/0,0 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889267:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 3/0,0 mode: PW/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889271:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 1/0,0 mode: --/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889274:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c3561 lrc: 0/0,0 mode: --/PW res: [0x2bec4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889278:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 2/0,0 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889280:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db5120f7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.889281:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 2/0,0 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889284:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 3/0,0 mode: PW/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889287:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 1/0,0 mode: --/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889289:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c3568 lrc: 0/0,0 mode: --/PW res: [0x2bec3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.889334:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.889336:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 3/0,1 mode: --/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889340:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889340:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889341:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 3/0,1 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889344:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 3/0,1 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889347:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 3/0,1 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889350:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 2/0,0 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889360:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 2/0,0 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889369:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530158.889370:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 2/0,0 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889373:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 3/0,0 mode: PW/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889376:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 1/0,0 mode: --/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.889379:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c356f lrc: 0/0,0 mode: --/PW res: [0x2bec2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.889442:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bec1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.889444:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 3/0,1 mode: --/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889458:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889458:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.889459:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 3/0,1 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889463:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 3/0,1 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889466:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 3/0,1 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889468:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 2/0,0 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651530158.889494:0:176865:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:179904 00000100:00100000:1.0:1651530158.889518:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9da362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:244000:x1731745946858944:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 11231us (11292us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530158.889521:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 929 00010000:00010000:1.0:1651530158.889531:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 2/0,0 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889534:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004044efa8 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530158.889535:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 2/0,0 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889538:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 3/0,0 mode: PW/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889553:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 1/0,0 mode: --/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.889556:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c3576 lrc: 0/0,0 mode: --/PW res: [0x2bec1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530158.891881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530158.891890:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859136 00000100:00100000:1.0:1651530158.891903:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 930 00000100:00100000:1.0:1651530158.891905:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:244000:x1731745946859136:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651530158.891916:0:176865:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 179970 00000100:00100000:1.0:1651530158.894343:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005da4e6e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:244000:x1731745946859136:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 2437us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530158.894347:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 930 00000400:00000080:0.0:1651530162.270075:0:207463:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530162.270078:0:207463:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160b: Verify that very long rename doesn't crash in changelog ========================================================== 22:22:41 (1651530161) 00000100:00100000:1.0:1651530162.914492:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530162.914510:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859392 00000100:00100000:1.0:1651530162.914529:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 106 00000100:00100000:1.0:1651530162.914532:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946859392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530162.914549:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135798848 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530162.914572:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009165de55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946859392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530162.914575:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 106 00000100:00100000:1.0:1651530163.126795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530163.126815:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356286016 00000100:00100000:1.0:1651530163.126830:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 931 00000100:00100000:1.0:1651530163.126841:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356286016:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530163.126923:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081170421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356286016:12345-10.240.43.64@tcp:2:touch.0 Request processed in 80us (128us total) trans 38654706537 rc 0/0 00000100:00100000:1.0:1651530163.126927:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 931 00000100:00100000:1.0:1651530163.180171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530163.180182:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356291200 00000100:00100000:1.0:1651530163.180199:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 932 00000100:00100000:1.0:1651530163.180201:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356291200:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:1.0:1651530163.180207:0:176865:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530163.180226:0:176865:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 2/0,0 mode: --/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30cb7f expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530163.180235:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf02:0x0] initial LVB size: 0, mtime: 0x627059b3, atime: 0x627059b3, ctime: 0x627059b3, blocks: 0x0 00010000:00010000:1.0:1651530163.180243:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530163.180244:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530163.180248:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 3/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 8 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530163.180255:0:176865:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 3/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 8 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530163.180261:0:176865:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004044efa8, rc 0) 00000100:00100000:1.0:1651530163.180275:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ed139f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356291200:12345-10.240.43.64@tcp:101:rm.0 Request processed in 74us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530163.180279:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 932 00000001:00080000:0.0:1651530163.191966:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706537 is committed 00000001:00100000:0.0:1651530163.191985:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00000400:0.0:1651530164.412842:0:39028:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530157/real 1651530157] req@000000003d9e753e x1731745966733120/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530164 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00000400:1.0:1651530164.412874:0:39027:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530157/real 1651530157] req@00000000db2b0975 x1731745966733184/t0(0) o400->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 224/224 e 0 to 1 dl 1651530164 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00100000:1.0:1651530164.412897:0:39027:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@00000000db2b0975 x1731745966733184/t0(0) o400->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 224/224 e 0 to 1 dl 1651530164 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00080000:1.0:1651530164.412902:0:39027:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1651530164.412903:0:39027:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1651530164.421620:0:39027:0:(import.c:433:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1651530164.421631:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db2b0975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966733184:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00080000:1.0:1651530164.421645:0:188427:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530164.421647:0:188427:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1651530164.421653:0:188427:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530164.421656:0:188427:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 13258 00000100:00080000:1.0:1651530164.421663:0:188427:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000010ca3c65 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651530164.421683:0:188427:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db2b0975 x1731745966733248/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651530164.421701:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db2b0975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966733248:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00100000:0.0:1651530164.423443:0:39028:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@000000003d9e753e x1731745966733120/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530164 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 00000100:00080000:0.0:1651530164.423448:0:39028:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1651530164.423449:0:39028:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1651530164.426017:0:39028:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1651530164.426018:0:39028:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1651530164.426027:0:39028:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000003d9e753e x1731745966733120/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530164 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:1.0' 10000000:01000000:0.0:1651530164.426052:0:39028:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1651530164.426053:0:39028:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1651530164.426054:0:39028:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1651530164.426055:0:39028:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1651530164.426089:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30052a09-f4a3-492a-add7-6d156733f5e5:39028:1731745966733120:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00080000:0.0:1651530164.426101:0:188427:0:(pinger.c:250:ptlrpc_pinger_process_import()) 30052a09-f4a3-492a-add7-6d156733f5e5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1651530164.426103:0:188427:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:0.0:1651530164.426103:0:188427:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651530164.426105:0:188427:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 13258 00000100:00080000:0.0:1651530164.426114:0:188427:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000003127423f using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:0.0:1651530164.426121:0:188427:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b2e27626 x1731745966733312/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651530164.426143:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 9 00000100:00080000:1.0:1651530164.428899:0:39026:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@00000000db2b0975 x1731745966733248/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651530170 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530164.428903:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1651530164.428906:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1651530164.428907:0:39026:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530164.431905:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db2b0975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966733248:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00100000:1.0:1651530164.431914:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2e27626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966733312:10.240.43.61@tcp:250:kworker/u4:0.0 00000100:00080000:1.0:1651530164.432203:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:1.0:1651530164.432214:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1651530164.432215:0:39026:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b158553dd624b to 0x7e7b158553e600a9 00000100:00080000:1.0:1651530164.434517:0:39026:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1651530164.434519:0:39026:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:1.0:1651530164.434660:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2e27626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966733312:10.240.43.61@tcp:250:kworker/u4:0.0 00000100:00080000:1.0:1651530164.434668:0:207468:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:1.0:1651530164.434670:0:207468:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651530164.434670:0:207468:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1651530164.434687:0:207468:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530164.434703:0:207468:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530164.434710:0:207468:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1651530164.434728:0:207468:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530164.434731:0:207468:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000a1af0c60/0xa29a79078f3c1ab1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd6259 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530164.434740:0:207468:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530164.434743:0:207468:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530164.434745:0:207468:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530164.434746:0:207468:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530164.434747:0:207468:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000b415eb38/0xa29a79078f3c1aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd6252 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530164.434757:0:207468:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530164.434759:0:207468:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530164.434761:0:207468:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530164.434762:0:207468:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530164.434763:0:207468:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000008e74d38/0xa29a79078f3c1ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd6260 expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530164.434765:0:207468:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530164.434768:0:207468:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530164.434770:0:207468:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530164.434771:0:207468:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530164.434771:0:207468:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000f821ef24/0xa29a79078f3c1ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd626e expref: -99 pid: 176848 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530164.434782:0:207468:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530164.434785:0:207468:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530164.434787:0:207468:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651530164.434788:0:207468:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530164.434789:0:207468:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000203d678c/0xa29a79078f3c1bd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd6324 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651530164.434797:0:207468:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1651530164.434798:0:207468:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1651530164.434799:0:207468:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651530164.434800:0:207468:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1651530164.434801:0:207468:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530165.500175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530165.500193:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859456 00000100:00100000:1.0:1651530165.500219:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 933 00000100:00100000:1.0:1651530165.500222:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1651530165.500238:0:176865:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:179970 count 1 00010000:00010000:1.0:1651530165.500252:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: --/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500262:0:176865:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 2/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 6 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530165.500267:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530165.500268:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530165.500269:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 4/0,1 mode: --/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500283:0:176865:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 3/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 6 pid: 176865 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530165.500288:0:176865:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 4/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 6 pid: 176865 timeout: 13915 lvb_type: 1 00000100:00100000:1.0:1651530165.500309:0:176865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006bb41bf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966733376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530165.500336:0:176865:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cc4df6df going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.500706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530165.500715:0:195164:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356291392 00010000:00010000:1.0:1651530165.500723:0:195164:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 5/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 7 pid: 176865 timeout: 13915 lvb_type: 1 00000100:00100000:1.0:1651530165.500733:0:195164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:1.0:1651530165.500734:0:195164:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356291392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530165.500739:0:195164:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530165.500741:0:195164:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 5/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 7 pid: 176865 timeout: 13915 lvb_type: 1 00010000:00010000:1.0:1651530165.500745:0:195164:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 4/0,0 mode: PR/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 7 pid: 176865 timeout: 13915 lvb_type: 1 00010000:00010000:1.0:1651530165.500756:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530165.500757:0:195164:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530165.500758:0:195164:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500762:0:195164:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 4/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500768:0:195164:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530165.500789:0:195164:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c6345d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356291392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530165.500793:0:195164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 20 10000000:01000000:1.0:1651530165.500852:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1651530165.500861:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8e16c2c2a000 from 205 10000000:01000000:1.0:1651530165.500863:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1651530165.500878:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500882:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500886:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.500892:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733440:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.500905:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00010000:00010000:1.0:1651530165.500947:0:176865:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004044efa8/0xa29a79078f3c357d lrc: 0/0,0 mode: --/PR res: [0x2bf02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30cb7f expref: 6 pid: 176865 timeout: 13915 lvb_type: 1 00000100:00100000:1.0:1651530165.500952:0:176865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006bb41bf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:176865:1731745966733376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530165.500957:0:176865:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500961:0:176865:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500964:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500979:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,1 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.500983:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 2/0,0 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530165.501007:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 2/0,0 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530165.501014:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c40b80ac already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530165.501016:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 2/0,0 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530165.501020:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 3/0,0 mode: PW/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530165.501028:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 1/0,0 mode: --/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530165.501030:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40b80ac/0xa29a79078f3c3584 lrc: 0/0,0 mode: --/PW res: [0x2bf02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.501081:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db2b0975 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946859456:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 858us (909us total) trans 38654706538 rc 0/0 00000100:00100000:1.0:1651530165.501085:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 933 00000100:00100000:1.0:1651530165.501210:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733440:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530165.501225:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.501229:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.501268:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733504:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.501279:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.501679:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733504:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.501706:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733568:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.501722:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.501943:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733568:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530165.502306:0:207632:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:1.0:1651530165.502480:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:1.0:1651530165.502495:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1651530165.502497:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.502501:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530165.502505:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1651530165.502506:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1651530165.502507:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1651530165.502513:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.502516:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.502519:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.502525:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733632:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.502538:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.502750:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733632:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530165.502755:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.502758:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.502773:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733696:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.502783:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.502997:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733696:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.503006:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733760:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.503018:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.503447:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733760:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530165.503727:0:207633:0:(llog.c:768:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 8 00000020:01000000:1.0:1651530165.503764:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-7 (rc=0) 10000000:01000000:1.0:1651530165.503771:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1651530165.503773:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.503777:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530165.503780:0:176861:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1651530165.503781:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16c2c2a000 from 19 10000000:01000000:1.0:1651530165.503782:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1651530165.503788:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.503791:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.503794:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.503800:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733824:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.503826:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.504043:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733824:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530165.504047:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.504060:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.504074:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733888:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.504085:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.504275:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733888:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.504284:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733952:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.504296:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.505884:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966733952:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530165.506169:0:207634:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19 00000020:01000000:1.0:1651530165.506204:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1651530165.506211:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1651530165.506213:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.506217:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530165.506220:0:176861:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:1.0:1651530165.506221:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff8e16844ada28 from 1 10000000:01000000:1.0:1651530165.506222:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1651530165.506228:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.506231:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.506234:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.506250:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734016:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.506263:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 0000000058cd6399 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.506513:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734016:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530165.506517:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.506520:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.506607:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734080:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.506625:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000001004a992 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.515055:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734080:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:1.0:1651530165.516304:0:176861:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0000: index object [0x200000003:0x16:0x0] (8/32) registered 10000000:01000000:1.0:1651530165.516375:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1651530165.516378:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.516382:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530165.516385:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1651530165.516386:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8e16844ada28 from 1 10000000:01000000:1.0:1651530165.516387:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1651530165.516392:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.516395:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.516405:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.516411:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734144:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.516424:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000001004a992 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.516730:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734144:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530165.516735:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.516738:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530165.516752:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734208:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530165.516762:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 000000001004a992 going to sleep for 6 seconds 00000100:00100000:1.0:1651530165.517308:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9e753e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734208:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1651530165.517316:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1651530165.517317:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530165.517321:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651530166.209147:0:207685:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530166.209149:0:207685:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160c: verify that changelog log catch the truncate event ========================================================== 22:22:45 (1651530165) 00000100:00100000:1.0:1651530168.032243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530168.032261:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859520 00000100:00100000:1.0:1651530168.032280:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 107 00000100:00100000:1.0:1651530168.032283:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946859520:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530168.032312:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135798848 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530168.032336:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9e753e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946859520:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530168.032340:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 107 00000400:00000080:1.0:1651530169.231457:0:207903:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530169.231460:0:207903:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160d: verify that changelog log catch the migrate event ========================================================== 22:22:48 (1651530168) 00000100:00100000:1.0:1651530169.533882:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651530169.533895:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006bb41bf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966734272:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530169.534477:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006bb41bf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966734272:10.240.43.61@tcp:400:kworker/u4:0.0 00000400:00000080:1.0:1651530169.572631:0:207957:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530169.572633:0:207957:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_160d needs >= 2 MDTs 00000400:00000080:0.0:1651530169.904236:0:208011:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530169.904239:0:208011:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160e: changelog negative testing (should return errors) ========================================================== 22:22:49 (1651530169) 00000100:00100000:1.0:1651530170.048985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530170.049002:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356293632 00000100:00100000:1.0:1651530170.049028:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:1.0:1651530170.049031:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356293632:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530170.049063:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bb41bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356293632:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 32us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530170.049067:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00000001:00080000:1.0:1651530171.095620:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706538 is committed 00000400:00000080:0.0:1651530172.714995:0:208229:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530172.714997:0:208229:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160f: changelog garbage collect (timestamped users) ========================================================== 22:22:52 (1651530172) 00000100:00100000:1.0:1651530173.152236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530173.152253:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859648 00000100:00100000:1.0:1651530173.152273:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 108 00000100:00100000:1.0:1651530173.152276:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946859648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530173.152294:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135798848 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530173.152331:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000336087c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946859648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530173.152334:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 108 00000400:00000080:1.0:1651530174.235117:0:208283:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530174.235120:0:208283:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: 1651530173: creating first files 00000100:00100000:1.0:1651530178.272268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530178.272288:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859840 00000100:00100000:1.0:1651530178.272318:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 109 00000100:00100000:1.0:1651530178.272320:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530178.272354:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135798848 pending 0 free 81207926784 avail 77037215744 00000100:00100000:1.0:1651530178.272378:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018e07a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859840:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530178.272382:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 109 00000100:00100000:1.0:1651530180.801025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530180.801054:0:176869:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356295488 00002000:00100000:0.0:1651530180.801072:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bec0:0x0] (0->6) req@0000000045555879 x1731754356295488/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:151/0 lens 496/0 e 0 to 0 dl 1651530186 ref 1 fl New:/0/ffffffff rc 0/-1 job:'bash.0' 00002000:00100000:0.0:1651530180.801078:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000045555879 with x1731754356295488 ext(0->6) 00002000:00010000:0.0:1651530180.801081:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000045555879 00000100:00100000:0.0:1651530180.801101:0:176869:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 61 00000100:00100000:0.0:1651530180.801103:0:176869:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356295488:12345-10.240.43.64@tcp:4:bash.0 00000100:00100000:0.0:1651530180.801444:0:176869:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045555879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356295488:12345-10.240.43.64@tcp:4:bash.0 Request processed in 339us (420us total) trans 38654706539 rc 0/0 00000100:00100000:0.0:1651530180.801449:0:176869:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 61 00002000:00100000:0.0:1651530180.801451:0:176869:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x2bec0:0x0] (0->6) req@0000000045555879 x1731754356295488/t38654706539(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:151/0 lens 496/448 e 0 to 0 dl 1651530186 ref 1 fl Complete:/0/0 rc 0/0 job:'bash.0' 00002000:00100000:0.0:1651530180.801456:0:176869:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000045555879 with x1731754356295488 ext(0->6) 00002000:00010000:0.0:1651530180.801457:0:176869:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000045555879 00000100:00100000:1.0:1651530183.392185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530183.392202:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860032 00000100:00100000:1.0:1651530183.392221:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 110 00000100:00100000:1.0:1651530183.392223:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860032:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530183.392240:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144207936 pending 28672 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530183.392263:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242d477 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860032:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530183.392266:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 110 00000100:00100000:1.0:1651530186.433029:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530186.433045:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356296320 00000100:00100000:1.0:1651530186.433068:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530186.433071:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356296320:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530186.433106:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356296320:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 35us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530186.433110:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000001:00080000:0.0:1651530186.458376:0:176850:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 38654706539 is committed 00000100:00100000:1.0:1651530188.512229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530188.512248:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860224 00000100:00100000:1.0:1651530188.512268:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 111 00000100:00100000:1.0:1651530188.512271:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860224:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530188.512289:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530188.512313:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbc6606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860224:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530188.512317:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 111 00000400:00000080:0.0:1651530189.845357:0:208501:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530189.845359:0:208501:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160g: changelog garbage collect on idle records ========================================================== 22:23:09 (1651530189) 00000100:00100000:1.0:1651530191.036893:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0d3a056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966734336:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530191.036895:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d9b8735 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966734400:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530191.037409:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0d3a056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966734336:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530191.037409:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d9b8735 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966734400:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530192.576952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530192.576967:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356298624 00000100:00100000:1.0:1651530192.576994:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530192.576997:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356298624:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530192.577026:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b187e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356298624:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530192.577030:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530193.632207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530193.632221:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860352 00000100:00100000:1.0:1651530193.632234:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 112 00000100:00100000:1.0:1651530193.632236:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860352:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530193.632260:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530193.632277:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040519434 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860352:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530193.632281:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 112 00000100:00100000:1.0:1651530198.754369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530198.754387:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860480 00000100:00100000:1.0:1651530198.754408:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 113 00000100:00100000:1.0:1651530198.754411:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530198.754429:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530198.754452:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009601edf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530198.754456:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 113 00000400:00000080:0.0:1651530199.260526:0:208719:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530199.260528:0:208719:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160h: changelog gc thread stop upon umount, orphan records delete ========================================================== 22:23:18 (1651530198) 00000100:00100000:1.0:1651530203.872153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530203.872183:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860736 00000100:00100000:1.0:1651530203.872205:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 114 00000100:00100000:1.0:1651530203.872207:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530203.872226:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530203.872249:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d9b8735 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860736:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530203.872253:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 114 00000100:00100000:1.0:1651530208.992117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530208.992128:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860864 00000100:00100000:1.0:1651530208.992140:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 115 00000100:00100000:1.0:1651530208.992143:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860864:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530208.992153:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530208.992193:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d3a056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860864:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 49us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530208.992197:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 115 00000100:00100000:1.0:1651530214.113035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530214.113052:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860928 00000100:00100000:1.0:1651530214.113072:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 116 00000100:00100000:1.0:1651530214.113074:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860928:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530214.113092:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530214.113115:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860928:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530214.113118:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 116 00000100:00100000:1.0:1651530214.638296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530214.638308:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946861440 00000100:00100000:1.0:1651530214.638326:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 934 00000100:00100000:1.0:1651530214.638328:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:251973:x1731745946861440:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651530214.638341:0:176865:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xa29a79078f3c33af 00000100:00080000:1.0:1651530214.638345:0:176865:0:(import.c:85:import_set_state_nolock()) 00000000ad086c0e Âæ»Žÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651530214.638363:0:176865:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654706539 00000100:00100000:1.0:1651530214.638417:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd55cbfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:251973:x1731745946861440:12345-10.240.43.61@tcp:9:umount.0 Request processed in 87us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530214.638420:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 934 00000100:00100000:1.0:1651530216.124869:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb128d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966734464:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530216.124874:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccee1bd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966734528:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:0.0:1651530216.125209:0:39028:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1651530216.125211:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1651530216.125214:0:39028:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1651530216.128293:0:39028:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651530216.128295:0:39028:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 13764 00000100:00080000:0.0:1651530216.128299:0:39028:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000010ca3c65 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651530216.128310:0:39028:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f2b7574 x1731745966734592/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651530216.128323:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccee1bd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966734528:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530216.128339:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f2b7574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966734592:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1651530216.131932:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651530216.131936:0:39026:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:1.0:1651530216.131948:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f2b7574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966734592:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1651530218.177021:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530218.177031:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356301888 00000100:00100000:1.0:1651530218.177051:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:1.0:1651530218.177054:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356301888:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530218.177075:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c302487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356301888:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 21us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530218.177079:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000001:00100000:0.0:1651530220.246342:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651530220.246345:0:176850:0:(genops.c:985:class_export_put()) final put 0000000091b218ea/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651530220.246369:0:188427:0:(genops.c:944:class_export_destroy()) destroying export 0000000091b218ea/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1651530220.246390:0:188427:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000ad086c0e for lustre-OST0000 00000100:00000400:1.0:1651530223.292845:0:39027:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530216/real 1651530216] req@00000000cb128d57 x1731745966734464/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530223 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00100000:1.0:1651530223.298433:0:39027:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@00000000cb128d57 x1731745966734464/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530223 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530223.298438:0:39027:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1651530223.298440:0:39027:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1651530223.301006:0:39027:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1651530223.301007:0:39027:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651530223.301009:0:39027:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000cb128d57 x1731745966734464/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530223 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 10000000:01000000:1.0:1651530223.301017:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1651530223.301018:0:188427:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530223.301019:0:39027:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1651530223.301019:0:39027:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1651530223.301020:0:39027:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:0.0:1651530223.301022:0:188427:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1651530223.301023:0:188427:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1651530223.301029:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb128d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30052a09-f4a3-492a-add7-6d156733f5e5:39027:1731745966734464:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:0.0:1651530223.301042:0:188427:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 13815 00000100:00080000:0.0:1651530223.301043:0:188427:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1651530223.301046:0:188427:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000010ca3c65 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651530223.301060:0:188427:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b879addf x1731745966734656/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651530223.301074:0:188427:0:(pinger.c:250:ptlrpc_pinger_process_import()) 30052a09-f4a3-492a-add7-6d156733f5e5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1651530223.301075:0:188427:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:0.0:1651530223.301076:0:188427:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651530223.301077:0:188427:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 13764 00000100:00080000:0.0:1651530223.301079:0:188427:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000003127423f using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:0.0:1651530223.301083:0:188427:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dbdd46a6 x1731745966734720/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651530223.301100:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b879addf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966734656:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00100000:0.0:1651530223.301131:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbdd46a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966734720:10.240.43.61@tcp:250:kworker/u4:0.0 00000100:00100000:1.0:1651530224.005067:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530224.005091:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946862272 00000100:00100000:1.0:1651530224.005110:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 935 00000100:00100000:1.0:1651530224.005112:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:39028:x1731745946862272:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651530224.005123:0:176865:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000002beaa81 cur 13823 last 0 00000020:00000080:1.0:1651530224.005135:0:176865:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa29a79078f3c35ae 00002000:00100000:1.0:1651530224.005140:0:176865:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/0000000091cb4538 ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1651530224.005141:0:176865:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1651530224.005143:0:176865:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651530224.005167:0:176865:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000e0a7f320 00002000:00080000:1.0:1651530224.005189:0:176865:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1651530224.005199:0:176865:0:(import.c:85:import_set_state_nolock()) 00000000ad086c0e Âæ»Žÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651530224.005222:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb128d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946862272:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 110us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530224.005226:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 935 00000100:00100000:1.0:1651530224.005521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530224.005531:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946862336 00000100:00100000:1.0:1651530224.005540:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 117 00000100:00100000:1.0:1651530224.005542:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946862336:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530224.005551:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144179264 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530224.005566:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee1bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946862336:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (45us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530224.005569:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 117 00000100:00100000:1.0:1651530225.425299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530225.425313:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864320 00000100:00100000:1.0:1651530225.425334:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 936 00000100:00100000:1.0:1651530225.425337:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:252762:x1731745946864320:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651530225.425360:0:176865:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 180001 -> diff = -31 00002000:02000040:1.0:1651530225.425361:0:176865:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0000: deleting orphan objects from 0x0:179971 to 0x0:180001 00002000:00010000:1.0:1651530225.427059:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427063:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 3/0,1 mode: --/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427071:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427072:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427074:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 3/0,1 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427081:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 3/0,1 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427085:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 3/0,1 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427088:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 2/0,0 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427187:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427189:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 3/0,1 mode: --/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427193:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427193:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427194:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 3/0,1 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427206:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 3/0,1 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427209:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 3/0,1 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427212:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 2/0,0 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427255:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427257:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 3/0,1 mode: --/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427261:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427261:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427262:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 3/0,1 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427265:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 3/0,1 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427269:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 3/0,1 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427271:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 2/0,0 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427313:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427315:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 3/0,1 mode: --/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427319:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427319:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427320:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 3/0,1 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427324:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 3/0,1 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427326:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 3/0,1 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427329:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 2/0,0 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427359:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427361:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 3/0,1 mode: --/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427364:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427365:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427365:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 3/0,1 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427369:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 3/0,1 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427377:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 3/0,1 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427380:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 2/0,0 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427409:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427411:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 3/0,1 mode: --/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427414:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427415:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427416:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 3/0,1 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427419:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 3/0,1 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427422:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 3/0,1 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427424:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 2/0,0 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427453:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427455:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 3/0,1 mode: --/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427465:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427466:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427467:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 3/0,1 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427470:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 3/0,1 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427473:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 3/0,1 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427476:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 2/0,0 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427505:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427507:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 3/0,1 mode: --/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427511:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427511:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427512:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 3/0,1 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427515:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 3/0,1 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427518:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 3/0,1 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427528:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 2/0,0 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427559:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427561:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 3/0,1 mode: --/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427564:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427565:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427566:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 3/0,1 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427569:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 3/0,1 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427571:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 3/0,1 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427574:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 2/0,0 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427604:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427606:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 3/0,1 mode: --/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427610:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427610:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427615:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 3/0,1 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427619:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 3/0,1 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427621:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 3/0,1 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427624:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 2/0,0 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427657:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427659:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 3/0,1 mode: --/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427663:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427663:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427664:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 3/0,1 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427667:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 3/0,1 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427670:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 3/0,1 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427673:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 2/0,0 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427713:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427714:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 3/0,1 mode: --/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427718:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427718:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427719:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 3/0,1 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427722:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 3/0,1 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427725:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 3/0,1 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427728:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 2/0,0 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427757:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427759:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 3/0,1 mode: --/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427762:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427762:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427763:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 3/0,1 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427766:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 3/0,1 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427778:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 3/0,1 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427780:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 2/0,0 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427837:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427839:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 3/0,1 mode: --/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427843:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427843:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427844:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 3/0,1 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427847:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 3/0,1 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427848:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 2/0,0 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427851:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 3/0,1 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427853:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 2/0,0 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427855:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e14a427 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427857:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 2/0,0 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427861:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 3/0,0 mode: PW/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427870:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 1/0,0 mode: --/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427882:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14a427/0xa29a79078f3c35b5 lrc: 0/0,0 mode: --/PW res: [0x2bf21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427886:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427888:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 3/0,1 mode: --/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427889:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 2/0,0 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427891:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db5120f7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427892:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 2/0,0 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427895:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 3/0,0 mode: PW/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427898:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.427898:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 1/0,0 mode: --/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427899:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427900:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 3/0,1 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427901:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5120f7/0xa29a79078f3c35bc lrc: 0/0,0 mode: --/PW res: [0x2bf20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427903:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 3/0,1 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427904:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 2/0,0 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427906:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 3/0,1 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427907:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000026bcd6b1 already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530225.427908:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 2/0,0 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427908:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 2/0,0 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427918:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 3/0,0 mode: PW/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427921:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 1/0,0 mode: --/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427924:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bcd6b1/0xa29a79078f3c35c3 lrc: 0/0,0 mode: --/PW res: [0x2bf1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427928:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 2/0,0 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427930:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030ff021a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427931:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 2/0,0 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427934:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 3/0,0 mode: PW/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427937:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 1/0,0 mode: --/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427939:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ff021a/0xa29a79078f3c35ca lrc: 0/0,0 mode: --/PW res: [0x2bf1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427943:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 2/0,0 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427944:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427946:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 3/0,1 mode: --/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427949:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427950:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427951:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 3/0,1 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427951:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c3b0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427952:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 2/0,0 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427954:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 3/0,1 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427954:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 3/0,0 mode: PW/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427957:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 3/0,1 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427958:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 1/0,0 mode: --/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427960:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c3b0b/0xa29a79078f3c35d1 lrc: 0/0,0 mode: --/PW res: [0x2bf1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427964:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 2/0,0 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427966:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 2/0,0 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427966:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c07fbd5b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427967:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 2/0,0 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427970:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 3/0,0 mode: PW/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427972:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 1/0,0 mode: --/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427982:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07fbd5b/0xa29a79078f3c35d8 lrc: 0/0,0 mode: --/PW res: [0x2bf1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427985:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 2/0,0 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427988:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8237f75 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.427989:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 2/0,0 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427991:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 3/0,0 mode: PW/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427994:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 1/0,0 mode: --/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427997:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8237f75/0xa29a79078f3c35df lrc: 0/0,0 mode: --/PW res: [0x2bf1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428000:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 2/0,0 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428001:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428003:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 3/0,1 mode: --/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428003:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007b3165c7 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428003:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 2/0,0 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428006:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428006:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428007:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 3/0,1 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428011:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 3/0,1 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428013:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 3/0,1 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428013:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 3/0,0 mode: PW/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428016:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 2/0,0 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428016:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 1/0,0 mode: --/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428019:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3165c7/0xa29a79078f3c35e6 lrc: 0/0,0 mode: --/PW res: [0x2bf1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428022:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 2/0,0 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428025:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003860835a already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428026:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 2/0,0 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428028:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 3/0,0 mode: PW/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428031:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 1/0,0 mode: --/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428034:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003860835a/0xa29a79078f3c35ed lrc: 0/0,0 mode: --/PW res: [0x2bf19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428037:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 2/0,0 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428045:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cefd9f91 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428046:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 2/0,0 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428049:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.428049:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 3/0,0 mode: PW/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428050:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 3/0,1 mode: --/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428052:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 1/0,0 mode: --/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428054:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428054:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.428055:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cefd9f91/0xa29a79078f3c35f4 lrc: 0/0,0 mode: --/PW res: [0x2bf18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428058:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 2/0,0 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428060:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 3/0,1 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428061:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f425678c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428062:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 2/0,0 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428063:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 3/0,1 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428064:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 3/0,0 mode: PW/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428066:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 3/0,1 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428067:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 1/0,0 mode: --/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428069:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 2/0,0 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428077:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f425678c/0xa29a79078f3c35fb lrc: 0/0,0 mode: --/PW res: [0x2bf17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428081:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 2/0,0 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428084:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b7551ddc already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428085:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 2/0,0 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428087:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 3/0,0 mode: PW/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428090:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 1/0,0 mode: --/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428093:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7551ddc/0xa29a79078f3c3602 lrc: 0/0,0 mode: --/PW res: [0x2bf16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428096:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 2/0,0 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428099:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c179deaa already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428100:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 2/0,0 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428102:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428104:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 3/0,1 mode: --/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428107:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428108:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428109:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 3/0,1 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428109:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 3/0,0 mode: PW/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428112:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 3/0,1 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428112:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 1/0,0 mode: --/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428115:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 3/0,1 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428115:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c179deaa/0xa29a79078f3c3609 lrc: 0/0,0 mode: --/PW res: [0x2bf15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428117:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 2/0,0 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428119:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 2/0,0 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428121:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a4ecf9ef already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428122:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 2/0,0 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428124:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 3/0,0 mode: PW/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428127:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 1/0,0 mode: --/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428130:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ecf9ef/0xa29a79078f3c3610 lrc: 0/0,0 mode: --/PW res: [0x2bf14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428134:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 2/0,0 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428141:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edb5d78c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428142:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 2/0,0 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428144:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 3/0,0 mode: PW/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428148:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 1/0,0 mode: --/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428150:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb5d78c/0xa29a79078f3c3617 lrc: 0/0,0 mode: --/PW res: [0x2bf13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428152:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428154:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 3/0,1 mode: --/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428154:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 2/0,0 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428156:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad6adb6f already unused, calling callback (00000000109466a4) 00010000:00010000:1.0:1651530225.428157:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.428157:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 2/0,0 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428158:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428159:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 3/0,1 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428159:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 3/0,0 mode: PW/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428162:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 3/0,1 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428162:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 1/0,0 mode: --/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428165:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 3/0,1 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428167:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 2/0,0 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428172:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6adb6f/0xa29a79078f3c361e lrc: 0/0,0 mode: --/PW res: [0x2bf12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428184:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 2/0,0 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428187:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a7e4551 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428188:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 2/0,0 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428190:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 3/0,0 mode: PW/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428194:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 1/0,0 mode: --/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428196:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7e4551/0xa29a79078f3c3625 lrc: 0/0,0 mode: --/PW res: [0x2bf11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428199:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 2/0,0 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428202:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f3b4cc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428203:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 2/0,0 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428207:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428208:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 3/0,1 mode: --/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428212:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428212:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428213:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 3/0,1 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428213:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 3/0,0 mode: PW/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428216:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 3/0,1 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428217:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 1/0,0 mode: --/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428219:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3b4cc3/0xa29a79078f3c362c lrc: 0/0,0 mode: --/PW res: [0x2bf10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428223:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 2/0,0 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428225:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 3/0,1 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428226:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000084cb5491 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428226:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 2/0,0 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428227:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 2/0,0 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428229:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 3/0,0 mode: PW/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428232:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 1/0,0 mode: --/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428235:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cb5491/0xa29a79078f3c3633 lrc: 0/0,0 mode: --/PW res: [0x2bf0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428238:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 2/0,0 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428245:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b1768d already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428246:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 2/0,0 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428249:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 3/0,0 mode: PW/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428252:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 1/0,0 mode: --/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428255:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b1768d/0xa29a79078f3c363a lrc: 0/0,0 mode: --/PW res: [0x2bf0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428256:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428257:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 3/0,1 mode: --/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428258:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 2/0,0 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428261:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428261:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.428261:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b45e480 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428261:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 2/0,0 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428262:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 3/0,1 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428264:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 3/0,0 mode: PW/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428265:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 3/0,1 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428267:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 1/0,0 mode: --/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428268:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 3/0,1 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428270:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 2/0,0 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428277:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b45e480/0xa29a79078f3c3641 lrc: 0/0,0 mode: --/PW res: [0x2bf0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428280:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 2/0,0 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428283:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051a46c40 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428284:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 2/0,0 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428286:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 3/0,0 mode: PW/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428289:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 1/0,0 mode: --/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428292:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a46c40/0xa29a79078f3c3648 lrc: 0/0,0 mode: --/PW res: [0x2bf0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428304:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428306:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 3/0,1 mode: --/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428315:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428316:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428317:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 3/0,1 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428320:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 3/0,1 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428323:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 3/0,1 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428325:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 2/0,0 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428365:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428366:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 3/0,1 mode: --/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428370:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428370:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428371:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 3/0,1 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428374:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 3/0,1 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428377:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 3/0,1 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428387:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 2/0,0 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428421:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428423:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 3/0,1 mode: --/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428426:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428427:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428428:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 3/0,1 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428431:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 3/0,1 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428434:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 3/0,1 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428436:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 2/0,0 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428459:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 2/0,0 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428463:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001001cb5 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428464:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 2/0,0 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428470:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428471:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 3/0,1 mode: --/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428475:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428476:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.428478:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 3/0,0 mode: PW/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428480:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 3/0,1 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428484:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 3/0,1 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428484:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 1/0,0 mode: --/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428486:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001001cb5/0xa29a79078f3c364f lrc: 0/0,0 mode: --/PW res: [0x2bf0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428487:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 3/0,1 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428490:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 2/0,0 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428491:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 2/0,0 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428493:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fe3ca94c already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428494:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 2/0,0 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428497:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 3/0,0 mode: PW/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428500:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 1/0,0 mode: --/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428503:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ca94c/0xa29a79078f3c3656 lrc: 0/0,0 mode: --/PW res: [0x2bf0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428506:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 2/0,0 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428514:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0f7309 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428515:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 2/0,0 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428518:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.428518:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 3/0,0 mode: PW/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428520:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 3/0,1 mode: --/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428521:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 1/0,0 mode: --/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428523:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.428523:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0f7309/0xa29a79078f3c365d lrc: 0/0,0 mode: --/PW res: [0x2bf09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428524:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428524:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 3/0,1 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428527:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 2/0,0 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428528:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 3/0,1 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428529:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094f73a37 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428530:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 2/0,0 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428531:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 3/0,1 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428533:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 2/0,0 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428533:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 3/0,0 mode: PW/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428536:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 1/0,0 mode: --/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428545:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f73a37/0xa29a79078f3c3664 lrc: 0/0,0 mode: --/PW res: [0x2bf08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428549:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 2/0,0 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428551:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eab8f50b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428552:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 2/0,0 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428555:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 3/0,0 mode: PW/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428558:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 1/0,0 mode: --/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428561:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8f50b/0xa29a79078f3c366b lrc: 0/0,0 mode: --/PW res: [0x2bf07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428576:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428578:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 3/0,1 mode: --/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428582:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428582:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428583:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 3/0,1 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428586:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 3/0,1 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428589:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 3/0,1 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428591:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 2/0,0 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428611:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 2/0,0 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428615:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e35abc3 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428616:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 2/0,0 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428627:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 3/0,0 mode: PW/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428632:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 1/0,0 mode: --/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428633:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.428634:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e35abc3/0xa29a79078f3c3672 lrc: 0/0,0 mode: --/PW res: [0x2bf06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428635:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 3/0,1 mode: --/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428639:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428639:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428640:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 3/0,1 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428643:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 3/0,1 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428650:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 3/0,1 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428653:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 2/0,0 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428670:0:176857:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 2/0,0 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428674:0:176857:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffaad856 already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428675:0:176857:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 2/0,0 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428678:0:176857:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 3/0,0 mode: PW/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428682:0:176857:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 1/0,0 mode: --/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428684:0:176857:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffaad856/0xa29a79078f3c3679 lrc: 0/0,0 mode: --/PW res: [0x2bf05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428692:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428694:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 3/0,1 mode: --/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428697:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428698:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428698:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 3/0,1 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428702:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 3/0,1 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428704:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 3/0,1 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428707:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 2/0,0 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428716:0:176858:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 2/0,0 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428726:0:176858:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2e7abbd already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428727:0:176858:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 2/0,0 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428729:0:176858:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 3/0,0 mode: PW/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428733:0:176858:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 1/0,0 mode: --/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428736:0:176858:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e7abbd/0xa29a79078f3c3680 lrc: 0/0,0 mode: --/PW res: [0x2bf04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428739:0:176865:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x2bf03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428740:0:176865:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 3/0,1 mode: --/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428750:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428751:0:176865:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428752:0:176865:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 3/0,1 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428755:0:176865:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 3/0,1 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428758:0:176865:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 3/0,1 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428760:0:176865:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 2/0,0 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428777:0:194892:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 2/0,0 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428780:0:194892:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006ba49a0b already unused, calling callback (00000000109466a4) 00010000:00010000:0.0:1651530225.428781:0:194892:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 2/0,0 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428784:0:194892:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 3/0,0 mode: PW/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651530225.428788:0:176865:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x0:179970 00010000:00010000:0.0:1651530225.428788:0:194892:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 1/0,0 mode: --/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428799:0:194892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba49a0b/0xa29a79078f3c3687 lrc: 0/0,0 mode: --/PW res: [0x2bf03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 176865 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.428823:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f07681a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:252762:x1731745946864320:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 3485us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530225.428827:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 936 00000100:00100000:1.0:1651530225.430467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530225.430475:0:176865:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864448 00000100:00100000:1.0:1651530225.430489:0:176865:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 937 00000100:00100000:1.0:1651530225.430491:0:176865:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:252762:x1731745946864448:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1651530225.430502:0:176865:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 180002 00000100:00100000:1.0:1651530225.432636:0:176865:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009afa4f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:252762:x1731745946864448:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 2143us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530225.432640:0:176865:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 937 00000100:00080000:1.0:1651530228.412827:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) 30052a09-f4a3-492a-add7-6d156733f5e5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530228.412832:0:205517:0:(pinger.c:264:ptlrpc_pinger_process_import()) 30052a09-f4a3-492a-add7-6d156733f5e5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1651530228.412833:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530228.412834:0:205517:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000080:0.0:1651530229.292493:0:208938:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530229.292495:0:208938:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160i: changelog user register/unregister race ========================================================== 22:23:49 (1651530229) 00000100:00100000:1.0:1651530229.436873:0:39026:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530223/real 1651530223] req@00000000dbdd46a6 x1731745966734720/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 1 dl 1651530229 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00100000:1.0:1651530229.436888:0:39026:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000dbdd46a6 x1731745966734720/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 1 dl 1651530229 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530229.436899:0:39026:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651530229.436906:0:39026:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of MGS on 10.240.43.61@tcp failed (-110) 00000100:00100000:1.0:1651530229.436908:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbdd46a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966734720:10.240.43.61@tcp:250:kworker/u4:0.0 00000100:00080000:1.0:1651530229.436922:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) 30052a09-f4a3-492a-add7-6d156733f5e5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530229.436925:0:205517:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651530229.436926:0:205517:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530229.436927:0:205517:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 13822 00000100:00080000:1.0:1651530229.436929:0:205517:0:(import.c:580:import_select_connection()) MGC10.240.43.61@tcp: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1651530229.436931:0:205517:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000003127423f using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651530229.436943:0:205517:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000deafcc4d x1731745966734784/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651530229.436950:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530229.436951:0:205517:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1651530229.436958:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000deafcc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966734784:10.240.43.61@tcp:250:kworker/u4:1.0 00000100:00080000:1.0:1651530229.437733:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:1.0:1651530229.437745:0:39026:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1651530229.437747:0:39026:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b158553e600a9 to 0x7e7b158553e60739 00000100:00080000:1.0:1651530229.440113:0:39026:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1651530229.440116:0:39026:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:1.0:1651530229.440183:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000deafcc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30052a09-f4a3-492a-add7-6d156733f5e5:39026:1731745966734784:10.240.43.61@tcp:250:kworker/u4:1.0 00000100:00080000:1.0:1651530229.440191:0:208942:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:1.0:1651530229.440192:0:208942:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651530229.440193:0:208942:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1651530229.440200:0:208942:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530229.440205:0:208942:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530229.440208:0:208942:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1651530229.440213:0:208942:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530229.440216:0:208942:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000004044efa8/0xa29a79078f3c35a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e600c5 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530229.440220:0:208942:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530229.440223:0:208942:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530229.440225:0:208942:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530229.440227:0:208942:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530229.440227:0:208942:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000014ba77e/0xa29a79078f3c358b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e600b0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530229.440230:0:208942:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530229.440241:0:208942:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530229.440243:0:208942:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530229.440244:0:208942:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530229.440245:0:208942:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000d27cca91/0xa29a79078f3c3592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e600b7 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530229.440248:0:208942:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530229.440250:0:208942:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530229.440252:0:208942:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530229.440253:0:208942:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530229.440253:0:208942:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000c40b80ac/0xa29a79078f3c35a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e600cc expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530229.440257:0:208942:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530229.440259:0:208942:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530229.440261:0:208942:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651530229.440262:0:208942:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530229.440262:0:208942:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000d2632ae4/0xa29a79078f3c3599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e600be expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651530229.440266:0:208942:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1651530229.440273:0:208942:0:(import.c:85:import_set_state_nolock()) 000000003127423f MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1651530229.440274:0:208942:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651530229.440275:0:208942:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1651530229.440276:0:208942:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530229.472216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530229.472229:0:176866:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864576 00000100:00100000:1.0:1651530229.472244:0:176866:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 118 00000100:00100000:1.0:1651530229.472247:0:176866:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946864576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530229.472261:0:176866:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144178368 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530229.472282:0:176866:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deafcc4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946864576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530229.472285:0:176866:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 118 00000001:00100000:0.0:1651530229.593419:0:176850:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1651530230.652829:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1651530230.652831:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8e16c2c2a000 from 205 10000000:01000000:0.0:1651530230.652833:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651530230.652852:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.652858:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.652863:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.652874:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734848:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.652907:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f29684f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.655209:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734848:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530230.655216:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6080b expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.655221:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e6080b expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.655247:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734912:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.655275:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f29684f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.657743:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734912:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.657754:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734976:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.657775:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f29684f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.658018:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966734976:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530230.658358:0:208943:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:0.0:1651530230.658395:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:0.0:1651530230.658402:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651530230.658404:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6080b expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.658408:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000095cff58f/0xa29a79078f3c368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6080b expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530230.658411:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1651530230.658412:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1651530230.658413:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1651530230.658419:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.658422:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.658425:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.658430:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735040:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.658446:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.658665:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735040:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530230.658670:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60812 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.658673:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60812 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.658688:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735104:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.658705:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.659102:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735104:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.659125:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735168:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.659142:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.659675:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735168:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530230.659988:0:208944:0:(llog.c:768:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 8 00000020:01000000:0.0:1651530230.660018:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-7 (rc=0) 10000000:01000000:0.0:1651530230.660023:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1651530230.660025:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60812 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.660028:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000059b4498e/0xa29a79078f3c3695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60812 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530230.660031:0:176861:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651530230.660032:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff8e16c2c2a000 from 19 10000000:01000000:0.0:1651530230.660033:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651530230.660039:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.660051:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.660055:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.660060:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735232:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.660075:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce42a80d going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.661712:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735232:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530230.661717:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60819 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.661720:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60819 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.661734:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735296:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.661751:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce42a80d going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.661936:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735296:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.661945:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735360:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.661963:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ce42a80d going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.662375:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735360:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530230.662672:0:208945:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19 00000020:01000000:0.0:1651530230.662699:0:176861:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1651530230.662703:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651530230.662705:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60819 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.662717:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004f25ba4b/0xa29a79078f3c369c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60819 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530230.662720:0:176861:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:0.0:1651530230.662720:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff8e16844ada28 from 1 10000000:01000000:0.0:1651530230.662721:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651530230.662727:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.662730:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.662733:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.662738:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735424:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.662753:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f29684f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.664575:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735424:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530230.664580:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60820 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.664583:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60820 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.664652:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735488:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.664672:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.665353:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735488:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:0.0:1651530230.665608:0:176861:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0000: index object [0x200000003:0x17:0x0] (8/32) registered 10000000:01000000:0.0:1651530230.665671:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651530230.665673:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60820 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.665677:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000a4f97720/0xa29a79078f3c36a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60820 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530230.665680:0:176861:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1651530230.665680:0:176861:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8e16844ada28 from 1 10000000:01000000:0.0:1651530230.665681:0:176861:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651530230.665687:0:176861:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.665690:0:176861:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.665693:0:176861:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.665698:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735552:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.665711:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.665910:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735552:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530230.665914:0:176861:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60827 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.665918:0:176861:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60827 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530230.665932:0:176861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735616:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530230.665953:0:176861:0:(client.c:2492:ptlrpc_set_wait()) set 00000000941a0ced going to sleep for 6 seconds 00000100:00100000:0.0:1651530230.666351:0:176861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5d51bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30052a09-f4a3-492a-add7-6d156733f5e5:176861:1731745966735616:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1651530230.666359:0:176861:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651530230.666361:0:176861:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60827 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530230.666364:0:176861:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000015f46ac3/0xa29a79078f3c36aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60827 expref: -99 pid: 176861 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651530234.556836:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530234.556841:0:205517:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1651530234.556853:0:39026:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530223/real 1651530223] req@00000000b879addf x1731745966734656/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 1 dl 1651530234 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00100000:1.0:1651530234.556868:0:39026:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000b879addf x1731745966734656/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 1 dl 1651530234 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530234.556879:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651530234.556882:0:39026:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-110) 00000100:00100000:1.0:1651530234.556884:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b879addf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966734656:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00080000:1.0:1651530234.556910:0:205517:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530234.556912:0:205517:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1651530234.556913:0:205517:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530234.556915:0:205517:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 10.240.43.61@tcp last attempt 13822 00000100:00080000:1.0:1651530234.556926:0:205517:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 11s 00000100:00080000:1.0:1651530234.556929:0:205517:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0000: import 0000000010ca3c65 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651530234.556943:0:205517:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008ffeb17b x1731745966735680/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651530234.556955:0:39026:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ffeb17b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966735680:10.240.43.61@tcp:38:kworker/u4:1.0 00000100:00080000:1.0:1651530234.559797:0:39026:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 10 00000100:00080000:1.0:1651530234.561592:0:39026:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@000000008ffeb17b x1731745966735680/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651530250 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'kworker/u4:1.0' 00000100:00080000:1.0:1651530234.561597:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1651530234.561599:0:39026:0:(import.c:85:import_set_state_nolock()) 0000000010ca3c65 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1651530234.561600:0:39026:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530234.563589:0:39026:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ffeb17b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:39026:1731745966735680:10.240.43.61@tcp:38:kworker/u4:1.0 00000100:00100000:0.0:1651530234.592164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530234.592200:0:176867:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864640 00000100:00100000:1.0:1651530234.592219:0:176867:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 119 00000100:00100000:1.0:1651530234.592221:0:176867:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946864640:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1651530234.592235:0:176867:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 144178368 pending 0 free 81207922688 avail 77037211648 00000100:00100000:1.0:1651530234.592252:0:176867:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d51bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946864640:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530234.592256:0:176867:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 119 00000400:00000080:0.0:1651530235.789523:0:209160:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530235.789526:0:209160:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160j: client can be umounted while its chanangelog is being used ========================================================== 22:23:55 (1651530235) 00000400:00000080:1.0:1651530236.184313:0:209214:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530236.184316:0:209214:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_160j: @@@@@@ FAIL: mount_client on /mnt/lustre2 failed Debug log: 138351 lines, 138351 kept, 0 dropped, 0 bad.